Abusive baby daddy

Okay, so I'm 20 and pregnant with my first baby. I was in a very abusive and toxic relationship that I planned on leaving in January when I joined the Air Force but surprise I'm pregnant so I ended up leaving him because I can deal with the abuse but I knew it wouldn't be safe for this child. It's been 7 weeks and I have a safe environment and an AWESOME boyfriend who wants to raise the baby as his own. His family is also super accepting which is awesome! My question basically is if there is anything I can do so that he or his psycho family cant see the baby. It's just not safe! His grandma has swung on me, his mom has tried to hit me, he has hit me multiple times, been verbally abusive, and coerced sex from me. His grandma is schizophrenic with aggressive tendencies and has hit a child, also his mom is bipolar and I think he may be too. He has stalked me since the break up and harrassed me via text messages and calls. I blocked his number but he got a new number and had his mom call and text. I just want this baby to be safe and I know it wont be if it is with them. So is there anything I can do? I live in Florida if that makes a difference law wise.

Thank you so much in advance!