Am I right?

My bf is a nature photographer and recently met this cute Swedish biologist whom I met as well, she is doing an investigation and is going to go sailing in this river and needs the help of my boyfriend, he says this is something he has wanted to do his whole life but if I'm uncomfortable he'll just cancel, but he knows he will feel horrible if he doesn't go. I feel horrible if he goes on one hand, on the other I would feel horrible if I'm selfish and don't trust him. They are going away for few days... 
I don't know what's right, I know he loves me and that I can trust him but it's gonna be just the two of them, and things could lead to stuff we know happen.