Overseas Trip

I am nearly 6 weeks pregnant and already had a trip booked to Nepal in November. The trip involves about 6 days of trekking in the Annapurna region. When I found out I though I shouldn't go but today my doctor said there is no reason why I can't go. Now I'm feeling very torn and unsure whether to go or not. It's also my first pregnancy so it's all new to me. Does anyone know much about trekking while pregnant and what do you suggest I do?