Idk what to do

Hey guys...Its been a while since i posted and since this is anonymous it doesn't matter lol

Anyway, I have been talking to a guy who is a little different than most guys I've talked to, by different i mean he's a midget and i don't mean that to offend anyone. He's really sweet to me and I like him and he likes me but I'm scared of what other ppl will think. Mentally or emotionally I'm not strong enough for the looks and the comments like idk what to do and i wanted ur guys opinion please