Too soon?

So my boyfriend and I have been dating for two months now and we just got past the point of being able to make out and him touching me (everywhere). I kinda am getting to the point where I need to do things to him but he still finds the topic uncomfortable and he says his “penis isn’t good” (whatever that means). Yesterday I got the courage to just stroke him but outside the pants and he ended up cumming, twice. But today he said we need to take a step back and I’m really confused. Why is it he can do whatever he wants with me and I’m very comfortable and he’s not when I do something?