Boyfriend and Guy best friend

Ok so I've been dating my boyfriend for about a year and some months i seem to not be able to trust him so  it make us fight everytime he goes out with out me  and just with his boy yea I get they need a boys night out or whatever but his friends are hoes always try to get with someone they want to use him as a wing man he just goes right along with it so everytime we fight I end up talking to my guy bestfriend me and him fucked once  but we always had like a thing but nothing ever  happen  until not that long ago   He listens to me and we can joke around and have a good time I have feeling for him but I just cant  seem to let go of my boyfriend 
What should I do ??