5 week old

My son is almost 6 weeks and he hasn't smiled :( i see so many peoples babies smiling around the same age. He'll smile when he's asleep but when I talk to him he just makes a mad face like wth are u doing/saying 😭 my daughter smiled within her first month of life... I feel so sad like I'm not doing something right or not giving him enough attention ?? Or I dont have a connection with him? Idk sounds dumb but I just feel bad 😕