Sexless relationship

My fiancé and I have been together for about 4.5 years. We recently got engaged this past November.  We have 2 beautiful kids together and a wonderful life. However the one thing that is missing is OUR relationship. We are basically 2 people living together and raising 2 kids together. That's it. We do not have sex like at all. We probably had more sex in the first month before we found out I was pregnant with our first child then we have combined since I got pregnant. I wanted a second child so the only time we tried I got pregnant. I don't feel any love from him. Some days are the best but most days I wonder what we are really doing. I want to have sex! I'm afraid it's been so long it's going to be awkward and to think about it is kind of weird. I really don't know what to do or really what to make of this. This is all new to me. How can I have a relationship with him?