First time mom...

Did any of you ladies find it hard to hang out with friends after you had a baby? Being at home all day with the little one leaves me a lot of free time and I’ve had some friends come by off and on to see me and I just feel weird now. I don’t have much to talk about because I’m here with my daughter all day plus I’m only 22 so most of my friends don’t have kids. When I’m with family it doesn’t bother me but when I’m with others I feel annoying that we have to plan around babies schedule and when she gets fussy I feel really bad. They all say it’s not a big deal but it’s hard hanging out with people who don’t have kids when that’s your whole life now. Am I alone in this or can you ladies relate?