Can I use baby oil?

Kate
Me and my boyfriend have been together a while and don't use condoms since I'm on birth control. I knew you can't use baby oil as lube with condoms as it breaks them. Is this the only reason or is it bad for your vagina? Just curious as its easy and cheap to buy and would be ideal to use as lube