Apartment issues

So recently my fiance and i moved into an apartment complex that claimed they were taken over by new management and had revamped everything. Upon moving in everything appeared to be in perfect condition, new floors, new paint, new appliances etc.  Two days after moving in we saw a roach crawl through the vent from the upstairs apartment, i instantly freaked out because EW! So on the sheet they give us to report the current condition of everything in the apartment, i made a note that there were roaches in the apartment. Its been a month and we've not been told anything about them working on the issue. Since then we've been kept awake by rowdy neighbors and are pretty sure one of them is doing drug deals outside of her apartment. This morning we woke up to mold on the ceiling in the bathroom. Im beyond pissed and irritated. I knew there would be noise issues in an apartment complex but the roaches and mold? Absolutely not. Im 39 weeks pregnant and dont even want to be in our apartment. My fiance wants to pack up and leave and he thinks we can do just that, and not pay any fees because of the mold issue if we complain about it...  but im worried about the fees for terminating a lease early. Is there anyway to get out of this? Any loopholes because of the poor upkeep/maintenance? It  makes me angry to pay 600$ a month for this sh!t