Selfish or Unselfish?

I had a baby and we are no longer involved. He has the bigger house, compared to my two bedroom apartment, more money, a larger support system, and a better lifestyle altogether. He wants to take the baby full time. Is it selfish that I want to keep my baby?