Lost🤦🏾‍♀️🌪💆🏾

So I have been with my boyfriend since the age of 17 and I will be 21 a couple of short days. He is everything I can ask for and more! And the relationship got deeper we started to have sex. But he could not remain hard for intercourse. At first it was no big deal and then it started to grow larger and larger of a problem for us both. It was a year and 6 months until I could not take it anymore and I start to look elsewhere for sexual things at this time I was about 18 or 19. I messed with 2 people one we started then stopped because we both felt wrong. The second was a one day stand just for sex. I told him about those and it just tore us apart. Because going elsewhere for sexual actions I tried being there for him be patient not focusing on sex trying to do fun activities and keep everything in good terms. Nothing helped. We broke off for a little bit we got back together because we realized sex or not we loved each other and had so much fun together. As thing start to ouch forward the relationship when back to where it was rocky terms. We tried not to make sex the main part of a relationship but if things aren't going right it's hard for it not to be. He would still talk and flirt with other girls like nothing was wrong with us and I guess that's where I started to lose my self because I started to think it was me. He can't flirt and everything with other girls but can't stay hard with me. He has never have sex with any other girl besides me but he had did other thing with them. I then slept with 2 more people he does not know about. I did this in hopes I get my grove back in hopes I feel loved that someone wants to be with me sexual. Just to feel wanted I that type of way. Fast-forward to present day and we are doing good not the problem is not totally fixed but is getting better he is able to stay hard sometimes now before it was months or end he couldn't stay hard for intercourse. My question is should I tell him about the other two guys or just let things be good now that we're are pushing forward and he is acting opening up to me. While we were having problems in bed I felt shut out and questioning everything like if he liked me and wanted to be with me as much as he says he does and we have a great time together then why can't he open up to me this way. Why can't we have that sexual connection also. I am very attractive(well that is what he says and lots of other men say lol) but he would always says it's not me it's him. He is doing this to his self. I am will do take suggestions that will help us move forward and have a happy and healthy relationship and sex life. Because we are very happy together until it is time for sex.