Condoms

Is it alright if he rubs the tip of his penis up and down your clit/vagina with the condom on already? Would it wear down the condom or am I just paranoid?