Husband says he needs space

Im trying not to be emotional about this whole situation but its hard especially when i just found out im pregnant again. My husband has been moody and distant latley hes pulling away from me. I told him im trying to give him a little space and he said that good he needs it. Should I be concerned for our relationship? I love him dearly and holding back the tears atleast infront of him i feel like being a sahm has made me so clingy... any suggestions i have no friends in the area and live in a small town there isnt much getting out.... i need encouragment and strength.