Am I wrong? Husband’s friend

So my husband and his bestfriend have been friends for years & he’s roomating with someone but he comes over like everyweek & not only that he always wants to spend the night. We’re in a two bed apt with a 3week old and a 19month old and it just annoys me but I don’t want to be rude and say cant come over. It’s 9pm and he’s been here since 12pm and asked my husband if him and this girl he’s talking to could spend the night. This would be the second time. I spoke to my husband about it already but he still always ask if it’s ok after I’ve already expressed how I felt. Am i over reacting? So now the kids and i are gonna be in the bed and hubby sleeps on the couch like wtffff. It pisses me off that the friend even asks. Like be considerate. Although my husband asked if it’s ok its like damn what do you think?