What's "too much" time??

I have a gay(male) best friend and a boyfriend . My best friend feels that I spend way too much time with my boyfriend and vise versa. I find myself having to compromise my time a lot, and then trying to also find time for myself. Of course I want to make them both happy but I feel as if my best friend doesn't fully understand or agree with me dating since he's single . My best friend gets really crabby and snappy at me whenever I say I'm going on a date with my boyfriend or doing ANYTHING with my boyfriend. My boyfriend on the other hand doesn't complain as much but at times, he does feel neglected and has told me so in a very calm, casual manner. Has anyone else had to deal with this ?? HOW do you deal with it? What exactly is too much time??