Orgasm Issues

So me and my boyfriend have had sex several times now, almost once a week . Yet, never had i had an orgasm with him. He has a few times , but i think it may have to do with the condoms we used , any advice as to why i am having trouble with this? Weve tried alot of positions and different lubricants and i get really close but never climax.