Grandparents.

My husbands parents have had my toddler quite a bit. My husband is the only child that lives in the same state as his parents. They are the closer to our 19 month old more than any of their other grandchildren. Up until this point despite having issues with them respecting our wishes/boundaries we have continued to let them have our toddler very frequently. I am now currently 24 weeks pregnant with our second child and we really want to start being better with putting our child on a schedule with naps and a nighttime routine. We have tried this before and it was successful until he came back from spending a few days at his grandparents house. When he comes back he stays up very late and he also doesn’t listen to us. My husband works over night so me being pregnant and tired this is difficult for me. Recently my husband and I both agreed we would stop allowing him to go there so often and try to get him in a good schedule as well as teach him more before the baby comes. I don’t want his parents to be upset (which I know they will) but I also don’t want to have to deal with him not in a schedule and not listening when his little brother is here. Any advice?