Should I be upset after finding out my bf that I live with did certain drugs?

My dad was an addict and drugs personally make me uncomfortable. Anything messed up my bf ever does is usually under influence. Idc about weed or booze in moderation but.....idk....
I don't wanna be ridiculous but I just don't like it