Too small ?

When I lost my virginity immediately after he accused me of being a liar bcos it just went it easy.. like cmon of course I'm not gna pop and scream when uve been fingering me for months lol .. anywhos when I had sex with another guy I had more trouble getting it in.. then later on another one put it in and I literally screamed n cried of pain all in between I have been sleeping with my first because he will always be different and special for me but I realised it's actually him that's the problem.. now his cock isn't small it's an average size and I'm a big girl as it is so that's why it always just slides in and feels like it gets lost in there lol he reckons he loves being in my pussy but sometimes I just feel like he wants that tight feeling .. I wanna let him know it's not that 'my pussy is loose' it's the fact that his dick is just too small for this pussy lol and I do get more natural pleasure from other guys but I still enjoy the sex with him yet I don't want to hurt his feelings so what the hell do I do in a situation like this ?