What the point in even asking?

So our LO is 5 months old. I’m a SAHM and I’m with them 24/7. I get to get out of the house when we go to our church’s midweek service on Wednesdays. My husband also attends service on Sundays. Our church has a service at 10:30, fellowship/lunch and in the afternoon a prayer group (this ends whenever it ends).

Every Sunday my husband goes to service, the lunch and then “asks” me about staying. I say “asks” because it doesn’t matter what my answer is because he does it right before the time for the prayer group. He always says it like “I’m not going to be home until after. If that’s okay with you?” Whether yes or no... he’ll be there for it. So whenever he asks it pisses me off. Like why are you even asking if you already know what you’re doing? Also, if I say no I feel like I’m a crappy person for keeping him from church. I’d like to go and have lunch/fellowship with other people. But he doesn’t want our baby out of the house during this time of year unless it’s for the doctor check ups.

I’m trying really hard not to be a crap wife. I don’t know why it pisses me off so much. 😔