Feels like people always want me and my husband to not be together

People on both me and my husband's side have bad issues with us being together and they're over some of the dumbest things. I've been with my husband since I was 22 and he was 20. We are 25 and 23 now. Why some people in my life(certain family members) have an issue with is I'm christian and my husband is not. My husband was honest that he typically would not be with someone religious however we have the same morals. I'm very supportive of LGBTQ. My husband himself is pansexual. So is my church. When we got together and got engaged my husband said he hopes I understand that he will never be that Christian husband. He's not even the sole provider because he doesn't make much. He's a para so he only makes $12/hr. And I said that was fine. Some people in my life don't like that I married a non religious man but he still supports me. Helps out with my church. Volunteers at my church. He's the most supportive man ever.

The reason some people in his life(mainly his dad) are against our marriage is even more stupid. I was my husband's third person he had ever been with but the only person he's ever had sex with. I've had sex with people in the past but my husband lost his virginity to me. So he's never been sexually with anyone else and some people in his life wish he had explored more especially "as a man".

I just don't get why people in our life hate our relationship over things like this. We aren't abusive. We love each other. Why the hate? It's just frustrating

Edit: I understand some religious people believe in marrying someone of the same religion but why not just do that for yourself. How does me marrying outside my religion effect anybody besides ME. I think being hung up that I decided to marry outside my religion when it has no effect on them is dumb