Any Vegetarian ladies TTC?

I was wondering if anyone has experience with Ovega-3 and if you know if they are safe while TTC/pregnant? My nutritionist put me on these but they contain a small amount of rosemary oil. I heard this is something to avoid. They company says it contains a very small amount but I have to take 2 capsules per day. Any insight is appreciated. Thanks!