Does having one tube and one ovary effect my chances of getting pregnant naturally?

My husband and I have been trying for over two and a half years. December will be 3 years.. I have NEVER been pregnant :( Is it still possible for me to get pregnant? I've spent so much money seeing doctors and for nothing to happen, it just scares me to think I might have to do more invasive treatments like IVF for a MAYBE it will work. my heart is hurting so bad. My husband and I are both about to be 25. We are healthy, active, young. I just don't understand. My brother has 2 babies and he is even younger than me and doesn't even take care of them. His girlfriend said that I am more helpful than he is and I don't get to see them often. Maybe God doesn't want me to be a mom.