Being with an older. Man then you??

I am 25 and my husband is 39 would that make it harder to conceive? Because of our age difference? I know probably a dumb question