Should I be upset?

My husband invited his best friend over to spend the night. I already told him this weekend is my most fertile weekend. That it's bd time. I had to wake him up last night to have sex. And tonight he wants to invite his bf to stay the night and hang out with us all day tomorrow. Does this mean anytime or am I worrying over nothing?