i can’t wait anymore

me and my ex broke up about two months ago,and i have started talking to a new boy,we were really close while i was dating my ex but now we’re even closer and i want to be with him so bad,because me makes me so happy and i really like him but because of my ex everyone thinks that i’ve just moved on to quick,i’ve lost a lot of friends to,i had to tell the guy i like now that we couldn’t date because he wants to ask me out,but i don’t want to be hated anymore then i already am.any thoughts on wat i should do ??