Guests visiting me in hospital

My first pregnancy my boyfriends mom came along with us every time I went into triage. Yes I like her no that’s not the issue but they talk about me as if I’m not there. When I had my daughter I said him, my mom, his mom and dad could be there that was it. Well instead of his dad coming his aunt came with her two kids (both 18+). And after I had her and was moved from the delivery room they were over every day I was there. I couldn’t pump or do what I needed to because they were there. And it was frustrating because no one acknowledged I was there. How should I go about telling my boyfriend that I don’t want guests until I’m ready? They just invited themselves and I barely got any sleep.