Am I an irresponsible parent?

Ok a little background.... I work 40 hours a week over 4 days. I’m currently a manager in a busy supermarket and enjoy my job although it’s stressful. This past week I’ve been late home from work on two occasions and had to cover a sick call for two hours one evening after hubby got home from work. He’s now calling me irresponsible because I had to work. I tried to explain to him that i worked the extra so that on my 3 days off I can relax and not have to worry about calls and messages from Work asking why this and that wasn’t done or them trying to call me in ect. I knew our little one was ok as she was with him and were currently trying to save for a house and pay off bills from when he was off sick from work so the extra money would really come in handy. In total I worked an extra 6 hours over 3 days. Does this make me irresponsible? I’m currently left feeling like the worlds worst parent. Our child is my world!