Baby's Grandparents on (Dads side)

Ok I am having a lot of problems with my baby's grandparents. I went to talk to them yesterday because they went behind my back and told my husband that they need to spend more time with Jayden they don't ever have enough. So I told them if they have a problem with Jayden's scheduling they can come to me not my husband he works 60 to 70 hours a week so its more added stress. I told them that the tomethey have with Jayden is enough time they see him at least 1 time a week. Wether they watch him or we come by. One week we were over there 5 days straight for at least 2-3 hours hours then we werent there for 2 days and they blew our phones up saying "we haven't seen Jayden you need to bring him over" so then I said "listen the time you have is what you get" if I was being honest I am not comfortable having Jayden being watched by them they are great grandparents I love them but I can't shake the feeling of panic ever time they have him. But no matter how much time I give them it's not good enough for them. Does anyone have this kind of problem and know what I can do to fix it?