Our sex life and my boyfriend

OK so I just have to vent for a minute and as for everyone's opinion so I've known my boyfriend for four years now we finally started dating about six months ago we found out we were pregnant in April so we have our first baby girl on the way together and I love my boyfriend but I'm kind of struggling with our sex life because since this is his first baby he is scared to have sex or anything like that so that leaves me hanging and I love our sex life before and I felt that it kept us close but now it's not there and I feel like we are drifting apart he hardly comes over to my house anymore and I know he works he owns his own construction business but before he would always be with me always call me everything and now it's just kind of gone it's not there and I feel like sometimes he is hiding things from me like he said that he lost his phone the other day and really he had it the whole time I let him borrow my phone for three days because I couldn't get a hold of him but he was lying about his phone the whole time so I'm just kind of stuck in a spot where I don't really know what to do and now he won't even bring his phone around me like he used to so can someone please tell me what they think I'm 28 and he's 34