What do I do?! ☹️

My 7 week old little boy has just started smiling!! BUT he will not smile at me... only at his dad and his grandad, he will only scream and cry around me. I look after him and cuddle him all day, i breastfeed him, I don’t get any sleep just to look after him and he doesn’t smile much at me. Am I around him too much or am I not doing enough? My boyfriend takes him in the morning whilst I catch up on sleep and apparently he’s always smiling but all he does is scream and cry, I get no reward as I don’t see his smile. What do I do?!