Babysitting a possible neglected child

So I've recently started babysitting a 6 month old and I swear he is the sweetest thing. A very happy baby, loves to play by himself or with me and he absolutely LOVES my kitten. He's acts very normal and when I say neglected I don't mean beaten or anything. I dont find bruises or anything on him. What I mean is, the mother is very odd and doesn't very much acts like she cares about him. She didn't tell me feeding times, nap times, the fact he has a cold (he's been coughing and running a fever, I let her know), and she didn't even tell me his name. I've babysat him for about a week and a half, and every time his mom drops him off she doesn't hug or kiss him or say bye bye, she barely even speaks to me. When I looked for the little boys name on fb, I found that she has an older son and he's the only one she posts about. I still don't know the child's name... She also lives by my grandmother and she says that she sees parties going on over there all the time. It would just break my heart to see him not being loved enough at home. Does this sound like neglect? I just really want him to be okay..