My boyfriend doesn't have much sex with me

When my boyfriend and I first got together he couldn't keep his hands off of me and wanted sex every day. Sometimes twice a day but now that we are 6 months into our relationship that isn't the case anymore. I am lucky to get sex from him at least once a week or none at all during a Facebook whole week. Over time our sex life has been decreasing. It started before I found out that I was pregnant. I am around 11 weeks pregnant and feel like maybe I just am not attractive to him anymore or maybe he thinks our sex life is boring now. I don't know but it makes me feel low about myself. I even wear my booty underwear to bed cause he likes them but that does nothing. I even asked him if he finds me attractive still and he said of course I do. Then he said I don't want to have sex right now. Then last night I touched him down there a little and put his hand on my vagina but he just left his hand there for awhile and didn't do anything or even look at me. It really bothers me cause I don't know what's going on. He isn't distant or anything like that. He still holds my hand and rubs my leg and gives me kisses. So I am so confused and hurt. Has anyone else ever had this problem?