my bf has a lower sex drive than me...help?!

My boyfriend has a lower sex drive than me and I always take it personally when he doesn't want 
sexy time. I know he loves me but it is difficult for me feel it when he doesn't want me. We have had lots of talks about how it feels but I still feel like I over react when this happens. Does anyone else struggle with this? How do you make it work? Help!