Is this childish?

Me and my husband live in a bad part of our city. I want to move but at the moment it is unrealistic. I might tell him I want to move more than I should but not even every month go I say it. but last night I had said it after the cops showed up at our house looking for someone who claimed they lived at my house. My husband than called me childish for always repeating I want to move. I guess I'm just looking to see if I am in the wrong so I can fix myself?