Confused

I have a question. I used to live in town on main street. I was a 5 bedroom house. I have two stepchildren and my four month old. It was a great house but not a lot yard to play in. We now are living in the country with a big yard to play in. But the thing is the house is sooooo small. It has 3 bedrooms. A very tiny kitchen. The house doesn't work well for me with having a baby. The thing is it's my husband's great grandparents house. They built it. I don't like it here and want to go back to main street. I'm a stay at home mom so I feel isolated. I'm so far away from my family. Can you guys give me your opinions on what I should do? Thanks.