How do I love him in his love language?

My partner’s love language is physical touch. My love language is acts of service. My partner and I are not yet married. I believe strict physical boundaries when it comes to physical touch because too much touching can lead to sex. And it’s happened! My partner is a cancer. I am a Libra. I don’t really believe the zodiac stuff but if anyone here does (like my partner) then you’ll know cancers can be touchy and affectionate. Anyway, he over does it sometimes and it annoys me because I like my own space sometimes. Like for example when I’m eating, I don’t really appreciate him rubbing my back while I’m chewing and staring close to my face. I’m okay with hand holding or pecks on the cheek, sometimes on the lips. My partner wants lots of affection. How do I love him in his language without coming off cold and withdrawn.