My sons absent father

Okay here’s the deal. I have an almost 2 year old with a man who is very absent. He’s not useless I will say he is relatively busy but probably not more than me or my husband? He comes around once a week on a Saturday (some weeks he doesn’t come at all) and stays for a few hours to hang out with him in OUR apartment. My son is still very uncomfortable around him and cries when I leave him with him because to my son his dad is a stranger.

The thing is, he is graduating a police academy here in feburary and his family is flying in from out of town to go. (Even though they didn’t want to fly out after i had our son when we were together 😂)

He wants my son for an entire weekend. My son has never spent a night alone with him. His father has never given him a bath or put him to bed.

What do I say when he asks? He’s asked before and I said we would talk about it when it gets closer and it’s getting closer. I just feel like it’s not fair for him to ask for a whole weekend.

My son has met his grandma on his dads side once when he was 8 months old and that’s it.

I don’t want to put my son in an uncomfortable spot.

His dad isn’t around for the times he’s sick, for the bad days and the days that plain suck because having a toddler is hard.

He never asks about him on the weekdays and his family doesn’t ask me about him at all. And if they ask his dad how he is I’m sure he lies and says oh he’s awesome even though he rarely sees himself And they want to play family with him for a weekend and I think it’s wrong.

Opinions ?