Feeling guilty

Hi, this isnt really a question as such just looking to see if any other new mums are feeling the same. Anytime my baby is being looked after by his grandparents for a while I feel so guilty as if I should be the only one looking after him and worry what people will think that I have given my child away to be looked after for a few hours (he is only 6 weeks). Also felt like this yesterday after his dad let me have a longer lie, cried all afternoon because of how guilty I felt.