Am i in the wrong here?

So in the beginning of my relationship me and my bf would want to see each other non-stop. Mostly because my mother prohibited us to see each other, but id always go behind her back. He would buy me roses, write me love notes, buy me chocolates, etc. I broke the rules so many times just to be with him. Until one day he got me pregnant, and my mom finally agreed to let him live with us. Now its been 3 years and 7 months of being together and boy have things changed. There have been times that ive cried so much because of constant loneliness that i feel and much more. There are times when were home together and he tells me "i got to wash the car" and im like ok and he leaves and comes back 3 hours later and im always asking "where did you go?" And hes like "i went to wash the car, get a haircut, to the bank, etc" (im home 24/7 by the way, i go to college so those are the only days im out, and maybe on the weekends when he doesnt work) and i get so angry because he didnt take me and left me with the baby all day AGAIN. I had a car, but now he's using it because his car messed up and we dont have the money to fix it yet. On our anniversaries, i dont get no gift, no nothing, MAYBE we go out for a burger or something. On my birthday, nothing. Its been 2 years that we've been broke on my bday. Its not about the gifts, but the fact that he can go buy things we dont need but he cant give me a single card or SOMETHING made by him to show me some love. He also always goes on about how he's sorry that he didn't anything for me either of those days and i always tell him its okay. Then, lately, hes been doing things that literally piss me off. There are times that im downstairs and he goes upstairs, i go upstairs with him, then he tells me hes gonna go to the gas station to get a beer or something. So here i am looking for attention from him and he doesnt give it to me. OK. Plus, our sex life sucks now. Im not even trying to be mean, but jesus christ. Back then we could go hoursssss, and now we seriously go 2 seconds. We go 2 seconds until he's finished, then he goes to sleep. And im here all freaking sexually frustrated. There are times i just look at him sleep like ughhhhhh, because he doesnt please me. He works a lot i know, but there are times he himself tells me he doesnt. Maybe its because back then he was active and now he isnt? There are also times when i get mad at him because he plays too much sometimes, then he asks me what i want to eat and i tell him idk. And he gets so mad and tells me you didnt tell me anything so were not gonna eat fuck it. And he drives home. I know hes not cheating im positive about that. I try talking to him, but he always feels like he didnt do anything wrong or like im "trippin". Am i wrong or? I just dont know anymore. Sorry for it being so long i just need to rant. Opinions please?