15 and 18

My boyfriend is 18 and a senior and I'm 15 and a sophomore. A lot of people say the age difference is bad and he's just using me but I don't see anything wrong with it. Is 3 years really a big deal ?