My newborn baby doesn’t think of me as his mom!!

My baby is one and half months old. I was breast feeding him in starting but my baby and I both face some issue bcoz I have flat nipples . But I still tried to breastfeed him. After few days, I had to stop breast feeding him directly bcoz of too much cut and cracked nipples for few days. In between, my mom had to take him on her breast so that his habit would stay still. But when I got better, I tried to breastfeed him but he start crying too much and when my mom feeds him , he starts feeding right away. And now, my son doesn’t feel comfortable with me. He feel comfortable with my mother. He thinks my mom is his mother. I feel very painful sometimes about this? I really to breastfeed him directly on my breast . I literally don’t know what to do in this situation?