Struggling

I feel like this community will understand and help me through this struggle. I am battling with the struggle of wanting a fourth child, I know this seems ridiculous as some are struggling with TTC. My issue is my heart is telling me, my husband and I are not done having children but mentally I’m not sure we can afford another one, and my family would shame me for having a fourth. I know what I want, but is it the right choice.... I don’t want to feel guilty for wanting another child.