New relationship

I’ve been going out with this guy for three months now, we had sex twice. He is the sweetest, gentle, funny. But he did say he had been unfortunate in the previous relationship and that he wanted to take things slow now. The problem is, we are having difficulty at sex, and part of it is because I have feelings for him and don’t know which feelings he has towards me. I want to talk, but am nervous about him freaking out because he said ‘to take things slow’. Any advice?