Are 1 year olds afraid when moms gone for weekend?

Shavawn
So, a little back story. My ex has some anger issues, but since we broke up he has been working on them. (But that's still a whole nother worry.) He's living two hours away from us by bus, and doesn't often have bus fare to come see the baby.  Baby won't take a bottle so when he does take him out, it can't be for toooo long. He's wanting to have him for the weekends, once he turns one. But my baby is incredibly used to me being with him at night, putting him to bed and sleeping beside him. And I'm terrified if he does spend the weekend with him when he's one, he'll think I'm just gone and he'll be sad and scared. It breaks my heart, and I wouldn't be able to put him through that. Do they generally know enough at that age to know Momma's not gone forever and they don't have to be afraid? Or should I stand my ground until he's a bit older and can handle it?