School/bf

So I’ve been dating my bf for 4 years & I have a 1year old son. recently I told him I want to enroll in collage but he isn’t happy with it because he thinks guys will try talking to me.. he asked me to pick collage or our relationship... idk what to do? If I don’t go to collage I’ll never know what it was like n if I don’t finish at least I tried ? But please help girls... I also can’t wear certain things because he thinks I’m trying to get attention when I’m not.