Kidney stones

So I was told I have kidney stones in both my kidneys 4.8 mm I'm ttc also and I read tht it causes a lot of problem during pregnancy it leads to miscarriage. My problem is I was taking prenatal and drinking lots of milk for 5 mts  both have a lot of calcium since I was told I have it I stp using both its been a mnt  now. I want to start using bk the prenatal should I or should I ask my doc before I use it?( my doc knw tht I was using it but he never told me not to use it it just tht I was told kidney stones comes from too much calcium)