thinking about open marriage...?

me and my husband have been married for a few months but we've been together for almost 5 years. We have a beautiful baby boy who's just turned 7 months and we love him and we love each other to pieces and neither of us can really imagine a life without being married to one another. but having a baby and being an adult in that way is starting to take a toll on us. he's told me that he's missed being single sometimes and that he's thought about what it would be like to have sex with someone else because we were each other's first. and I thought about the exact same thing more than once. it's just starting to become stressful almost because we both miss the same things and aspects of being quote single but we've never really talked about it. we're both super uncomfortable with the thought of either of us dating someone else. and I have jealousy issues like anyone else so the thought of him with another woman kind of irks me but I think about being with other guys and women all the time. , so I feel like I'm being a hypocrite in that sense. I feel like we just need something in our marriage because it's feeling very routine and I'm worried that if we keep with the way it is we may not last very long because we're both wishing we were able to go out and hook up and come back and still love each other but we just can't cross that bridge and talk about it with each other. so my question is has anybody had or is it in an open marriage or relationship and how has it affected you