Baby girl named Ivy question

So my husband and I are pregnant with our second. We do not know gender yet. Yet knowing my family (my husband says we are cursed) it will be a girl. We have our boy name picked out already as we have had that picked out since before we even got pregnant with our first but we can’t decided on a girl name. Due to how many sister and girl cousins I have it is very hard to find a good name that no one else has. Our first daughters name is Isabella Rose (and we call her Izzy). Now my husband and I have narrowed it down to Ivy and Willa as or top picks for the next baby. I love Willa (he only likes it) and we both like Ivy but I am hesitant to name the baby ivy. I just see so many bullies making fun of Ivy. Poison Ivy. Does anyone have a daughter named Ivy. Does she get teased or am I over thinking it?

Thanks!