Stay or walk away?

So my husband and I both want children. We’ve been married over a year. And since the beginning of the relationship we let each other know we wanted to have children. We started trying even before saying I Do!!! Well it never crossed our minds about infertility. Until someone said what’s wrong with you, why aren’t you pregnant? I felt horrible and kinda thought maybe I should look into it. I went to the Dr. found out I don’t ovulate. So far Clomid isn’t working. I’m to the point that I want to just tell my husband that he can just walk away and try to be happy with someone else who can give him a family bc unfortunately it’s not looking good for me. I love him deeply but I don’t want him to feel like he’s stuck with me and he lost his chance at being a Dad. Am I a bad person for thinking this way? Should I stay & hope he will still love me without ever experiencing being a Dad or walk away and give him that shot of being happy with someone else who can give him a family? What would you do?