Would this be a dealbreaker for you or am I just being petty?

Would this be a deal breaker for anyone else when it comes to moving in together or am I just being petty? This happened last night but I’m still thinking about it and it’s really bothering me. I have an apartment and my bf has a house. I’m 4 months pregnant so we’ve been talking about moving in together and his house is bigger than my apartment so I would be giving up my apartment to do this. He smokes weed and I do not. It is NOT legal in our state so I told him if I move in with him I don’t want him smoking in the house when the baby comes and that if he’s going to continue smoking he needs to go outside to do it. He has a big fenced in back yard, stone patio right outside the door, and a covered front porch as well so no big deal right ? He basically threw a fit and told me no that he’s going to smoke in HIS house if he wants to and that he’ll just keep candles and in-scents burning and spray air fresheners. I told him why do all that when you can simply step outside onto one of the porches? It’s not like there’s nowhere outside to smoke. I told him I’m not buying a bunch of brand new baby stuff for it to all be tainted with weed smoke and wreak of marijuana. I don’t want the baby breathing smoke in, and I also don’t want my newborn baby constantly breathing in smoke on top of candles, air fresheners, in-scents, etc. when he can simply just step outside ? He told me I’m being a “bitch” and that if he’s the one paying the bills in his house he’ll smoke when and where he wants to which pissed me off because if I give up my own home to come live with you in yours and take care of it, keep it clean, live in it, sleep in it, then should be OUR home and I should get a say when it comes to smoking inside. But he don’t care how I feel about it, it’s not like I’m asking him to stop smoking. I’m simply asking him to do it outside and he can’t even do that. I don’t understand how such a small compromise for the better well being of our baby is so undoable and such a big deal to him. That’s the first thing I’ve asked him to change for when the baby gets here and that’s how he acted so now I’m just starting to get the feeling he’s not gonna be on the same page as me. I feel like he’s working against me not with me. I also am getting the feeling that I’m fixing to give up my own apartment to live in a house and take care of a house just to be reminded that it’s not “mine” because I won’t be paying any bills. That comment definitely rubbed me the wrong way. So now idk what I wanna do, would it be petty to not move in with him over this or what would you do ?