What would you guys do?

So I have been living with my mil for 2yrs when we first moved here the apartment she lived in was in bad conditions landlord is a slum lord. Anyways so they aren’t renewing the lease we have to leave October 31st because they want the whole house to fix it which is understandable this house is old. We live on the main floor the 2nd floor is empty so they have been working upstairs for a few months already but they kept stopping because we would call the building department due to them not having a license to fix upstairs and 2nd bc we have children here and the house is old so it is not safe for them to be working up there while there are people still living here the ceiling tiles has fell 2 already the first time it didn’t fall on anybody the first time now the 2nd time it fell on my husband. So recently they have started to work again and they are working from 7-4 which is okay whatever but however they are making so much noise shouldn’t they wait till 9 like some people are still sleeping they are disrupting my kids sleep. Last night they started working at 9pm and didn’t stop until 2am they were drilling and just making so much noise I want to call the building department again but they really aren’t doing anything about these people and it’s like we are moving soon why can’t they just wait god forbid something falls on one of my children. What can we do ?? I