am I over reacting

ok so my bf and I have a very good relationship, except for 1 thing. he always wants to go fishing. he spends our money on fishing stuff, not to excess but still annoys me. anyway my peev is, i hate that he goes fishing and leaves me alone with all 4 kids at home , he works hard and deserves some leisure time, not saying he doesnt. but when is my time off? when do i get to go and do something ALL day child free? am i over reacting? or should i should put up and shut up 😔