Weight worries at 5 weeks! 😔

I'm approaching 5 weeks and was already 15 (20 according to my husband) overweight prior to getting pregnant. I couldn't seem to lose it before getting pregnant and now I'm worried I will get way out of control with my weight. 
I already had a chubby middle section and now it seems like I'm showing at 5 weeks??? Am I going to be huge?
I'm trying to get to gym 4 times a week starting this week. I promised myself to eat clean and watch but it's so hard. My husband came home with his kids today with cookies, ice cream, chocolate and pizza. 
I'm terrified. My weight was a factor as it was with my husband before I got pregnant. I'm 5'8 and 170 but it's very noticeable in my neck, back and stomach... Not my butt hips or thighs. 
I'm just really scared I'll never bounce back