Wedding on the east coast, or Midwest?!

I'm from the east coast (NJ) and my fiancé is from the Midwest (NE) and we're trying to decide where to have our wedding. Out budget isn't huge but we're going for a more barn/boho wedding. His family for the most part is in the Midwest and California. My family is all on the east coast, including the majority of our wedding party. As well as the fact my dream venue is on the east coast. Where should we have the wedding? My family has more $$ to travel though they are bigger so we'd have to rent out a bigger black of hotel rooms. While his has less but they're much smaller. Anyone gimme some help? We live in NE now.