I think my baby will forget me..

UK
I've just returned to work, leaving my 5 month old with a nanny and I regret it. I feel like my baby will forget me. When daddy comes home he is super excited to see him and babbles with him. I come home first and I don't get any reaction. It's only been a week and all I want to do is cry..