something wrong with me ?

My boyfriend and I rarely have sex , at frat it’s great and he hard but like 5 minutes later he gets soft & i know he tries to keep me from seeing it but once I finds out he’s soft I get so upset and cry or get mad cause I feel like he’s not into me , I am 8 weeks pregnant and I’m not sure what else to do . Sometimes it gets where I just wanna leave him , what can I do ?