My son hates Karate

So my son did a few trial classes of karate. Now that my husband has him signed up course for 12 months. He hates it so much. I can’t get him to go during the week. He has a full blown meltdown and it’s to the point I can’t get him dress for it. Then I need to take my other son with me and he doesn’t want to leave the house. So then I have two kids with full on meltdowns. My kids are 6 and 4. Now for me I just want pull my son from karate. My husband is so against pulling him. Now my husband is not the one home trying to take him to karate or the one dealing with all the meltdowns. Now my son is also involved in Cub Scout. He loves going and gets really and is so happy going. I just don’t believe in forcing karate on him. He is telling me he doesn’t like it. I don’t know what I’m really looking for. I had talked to my husband a bunch of time about this too.