Should siblings have to share a room?

So my husband and I are in a “disagreement” I suppose. We are trying to decide how many children to welcome into our family. We own a small 1100 square foot home with 3 bedrooms and 1 bathroom that we will be calling home for at least the next 15 years. For reference: my husband grew up sharing a room with his brother in a trailer. I grew up in a large home as an only child. My childhood bedroom was almost twice the size of my current master bedroom. My husband wants at least 4 children. Stating that 2-3 children can share a room. I however feel a child should have their own room so that they can have their own space to escape to when they need it. So I would like to stop at 2 children solely based on the bedroom/bathroom situation. I have always seen myself having a big family, but with the home we have I just can’t picture a family of 6 or more sharing 3 bedrooms and 1 bathroom. Right now we have a 6 year old boy we adopted and adore and we’re about to start the IVF process to hopefully have a little girl. Am I crazy for making giant life choices based on my home. Or should I go for the big family I’ve always dreamed of and accept the children sharing bedrooms?