Trouble!

So there's this guy that I really like and have had a sexual relationship with this guy for sometime. The only thing that really stops us from being together is his baby's mother. She constantly is threatening to keep the baby away if he doesn't do what she says. So with that being said when ever he has free time he come over to me.  What should I do