Scared to tell husband I’m pregnant

So in May my husband said we could try for another baby in May on my birthday but before that he was like no more kids we are done and I was okay with that but he new I wanted a boy since we have 4 girls and so after he told me that I was like really all excited so a week later I stopped my birth control and now I’m pregnant and every time I wanna tell him he either stressed out after work or he saying something about not having anymore kids but he did say I could try again but seems like he went back on what he said I just want to tell him with out it being a disappointment but he shouldn’t have brought it up if he didn’t mean it right?