Ecstasy and small penis

I am dating this guy for over a month now, so I decided yesterday to sleep with him. I wanted something different, so I told him I wanna try Ecstasy. It was my first time to try it, so the experience was good. However, when we started making out, I saw that he had a small(very) penis, so I started telling him what’s in mind without thinking. I saw his face change and he looked sad, but I ended up sleeping with him just not hurt his feelings. I am confused if I should continue dating him or cut him loose as it’s gonna be just a waste of time. Also, I figured that he take a lot of drugs, maybe just to alternate his reality( as he never had a long relationship and now I know why!) what are your thoughts if you’re in my situation.