Suspect my man is not honest

I met this guy in 2020 thru a mutual friend. And we started dating. Got pregnant for him 2022. We have a beautiful baby girl. Though he said he wasnt ready to become a dad. He relocated to leave with me and the baby. I have never met his family. He hides us from his family saying they are not good people. I mean his mom and sisters. The only family i know is his second cousin. Every time i bring it up he gets mad. Not sure what to think anymore. He says he told his mom about the baby but . I have never heard his mom ask about her grand baby when they are on phone. I my crazy or is this guy ashame of me and baby