My mans mad at me!!

So my son is in 3rd grade.. So me and my mom went on his school trip today.. My man called to wake me up and then I talked to him around 9:30.. I was watching 3 kids and 1 likes to vandevoo off.. So I had to keep a close eye on him.. And on out way back he calls me so I quickly talk to him and then tell him I can't chat bc there are other people in the car so I couldn't hear... He got mad.. Then text me and said I don't know why we are even in a relationship you don't talk to me... Remind u he works in people's houses and he thinks I just want to be up his ass while he works.. Can some please help me! I don't want to break up with him.. I'm just not the clingy type