Confusing situations

Okay guys I need some advice -

So I have a friend that I work with who is really cool - smart, funny, beautiful, etc. and I kind of want to try and see if there's more than just friendship going on but here's the kicker - we're both in relationships. She's bi and married to a man but has told me she misses being with women and I'm a lesbian with a long term girlfriend. We both have loopholes given by our s.o. to where this wouldn't be cheating so don't worry about that - I would never want to hurt my girlfriend. But I can't stop thinking about this friend of mine and I don't know how to bring up the subject of me liking her without it being incredibly awkward. I don't even know if she's interested in me in the first place.

I guess what I'm asking for is some advice about this whole situation. Has anyone been in this situation before? What can I do to figure this out?