Too many?!

So before my husband I had relationships with 4 other guys..and after we got engaged it was kinda shaky ground it was an arranged marriage..I would still see my now ex..but I did have sex with my husband before marriage but had a relationship with my now ex soon afterwards..our engagement broke off for awhile he says it feels different like it doesn't hit where it used to before...I haven't told him about the relationship..what can I do now? the other guys was just bigger then his I guess :/