Do I just tell him?

Hi guys I’ve been talking to someone on and off we planned on hooking up to be friends with benefits. I don’t live alone and often times when he would message me out the blue about coming from work to my place I would get nervous. I’m no rookie at this point to sneaking someone in I’ve done it 3 times. But also those were bad experiences so anyone else I came into contact with I kinda put them through a lot to come see me. Also I like it but morally ik going out as friends would be nice before sex. Anyways he wanted to come over my house but I would always say I’m “ on my period” or that “I’m sleepy” when in reality I’m kinda scared from past experiences. I’m kinda upset I didn’t let him come over and I tried asking him to see me today but I got no response. Men are everywhere but I think I should vocalize that I only put it off because I’m nervous. I want to have fun and have safe sex but I also am nervous I’m totally down but I don’t live alone and I’m thinking we should see each other more in broad daylight. We’ve been talking for four months I clearly wanna get down but I’m just not sure how to say it without seeming like a cry baby.