I need opinions

I've been with my boyfriend now for almost 3 years thins coming September, and we've had our ups and downs.  We don't have sex and I'm not bothered by it but it's a big deal to him.  And I'm not sure why but he tells me that he feels more like my friend than my boyfriend but I don't feel that's true. We have plans of marriage and children but at this point in my life I feel that sex isn't a big deal. What do I do?