relationship dilemma

my boyfriend and I have been together almost four years now every relationship has their ups and downs but I thought certain things should just be understood so we both have children just not together we had a miscarriage together I work at night he works in the day I have set days off and he doesn't I pick up a extra day at work giving up one of my off days so he tells me hope I have a baby sitter but if he is home why can't they stay at home if we in this together saying what if somebody call him to go out what should I do on this how can we come to agree on something