The L word

Does it matter who says "i love you" first? I feel like in a man and woman relationship, it should be the man who says it first? I honestly feel like i might be in love with him, but i'm scared that there's a chance that if i tell him he won't say it back. How did you tell your partner you loved them? How did it go?