Gallbladder and Pregnancy

Last night I had to go to the ER because of excruciating stomach pain (for the 3rd time). This time was way worse and lasted way longer I literally felt like my insides would explode. I am currently 8 weeks pregnant. The Dr told me I have Gallbladder Sludge or biliary colic, and I will have to have my gallbladder removed if my OB will allow it. I'm really nervous for baby if I have to have surgery. Has anyone else had to have their gallbladder removed during pregnancy? I know they wait until the second trimester. Hopefully I can even make it that long :( I go to the OB tomorrow. This is the worst pain of my life