Need advice

Ok so I cleaned my cats liter box tonight. Which consists of me taking the bag of liter out and placing it in a trash bag. Then I tie it up and throw it away. I don't scoop or anything. Then I put new cat liner in with the new liter.  I have been avoiding this my whole pregnancy but I did it this time because I'm sick of my husband not cleaning it when it should be. He acts like its the hardest thing to do. And I felt obligated to do it because my cat deserves better then that. I literally was riding his ass for 5 days and he had yet to clean it. It took me 30 seconds to do and I was very carful to not touch the inside of the cat liner. I'm 36 weeks and 3 days. Do you think my baby will be ok? I know my doctor told me to avoid cleaning the box, but I really had no choice this time.