Should I just get over this?

So I'm really into this guy and he's also really into me, however I found out that he's in the Boy Scouts and for some reason I found that to be a turn off and now I can't get over it! Should it really be something to be turned off by or should I just learn to like that part of him?