Do you allow visitors when your baby is sleeping?

I was napping (rare occurrence lol) and my son was son was sleeping too. Well now my fiancé’s dad is here. He doesn’t care that our son is sleeping he just wakes him up. It’s very frustrating. Because he fights sleep so it’s very hard to lay him back down even though he didn’t get his nap out. I am tempted to tell my SO that he can’t come and wake our son, stay for 15 minutes and leave. I’m so exhausted. I’m a nursing student. So when he sleeps I work. My SO has been doing yard work, etc. can I get your opinion? Also I’d like to add he screams when his “papaw” picks him up because he doesn’t come around enough to be remembered.