Problems Finishing

My husband and I have been sleeping together for nearly 5 years and I'd say it's safe to say that we very much enjoy our sex life. We recently got married and have decided that we are ready to start our family. But I have a concern.... throughout our sex life he has only finished 3 maybe 4 times because of me and by me I mean my vagina. He can cum but it's generally brought on by masturbating. For the longest I thought it was because it wasn't ready to risk any chances of me getting pregnant but now I know and he's confirmed that he just can get off unless he is doing it on his own. He gets so angry when it doesn't just happen on its own and he swears that this is an issue he's had his entire life. Any ideas or thoughts?