No boner??

My boyfriend and I have had sex several times, since October 2017, but the past 3 times he’s been unable to get hard, or it goes unhard very quickly? He said that it’s nothing and this happens sometimes but I’m feeling so self conscious about myself and my body because of it and all I really do after it all is just cry. Any advice ladies, anyone been through this?