Feeling Guilty

I am currently 31W+3D and my SO babysits his sister's 1yo while she works.. However, the baby is clingy to me.. Don't get me wrong I love kids always have.. It's just for the past 2 weeks other people kids makes me irritable.. I feel so bad about it but for some reason I can't help it.. Any advice?! (Please No Harsh Comments)