I don't know if I should be concerned or flattered

So my boyfriend and I have been together for a little while now and we don't seem to have sex very often, like I'm talking maybe once a fortnight and we are both in our early 20's. He gets upset if I ask him why we don't have sex much and it was only the other day that he told me the reason. 
He said that he thinks sex should remain special. If we have sex frequently it will take away from romance and beauty of it. I really like that he wants it to remain special, but I really love being with him and just want to be with him always. 
I don't know if it's because my ex had the literally opposite vision of sex or what, but I don't know how to feel about this.