How old is too old

So I have known this guy for a while as a friend. He is almost 20 years older than me and I think he is amazing person. We recently have started hooking up and the sex is amazing too. We have such an amazing connection and I love being around him. My heart wants to be with him but there is the age I crazy?