Son's boy scout troop leader said he doesn't think boy scouts is for our son

My husband was a boy scout and he really wanted our son to be a boy scout. He is very against them allowing girls to join boy scouts especially since it's not like boys can join girl scouts so he found the troop that had the hardly any girls. I don't think my son's boy scout troop has any girls at all actually. He's been in boy scouts several years and it's really important to my husband. But they were selling popcorn today and my son's troop leader told me today that he just doesn't think boy scouts is for my son. My son is 13 now and he said trying to get him to do anything they do is like pulling teeth. He was off in a corner at the Walmart they were selling at reading and last time they went somewhere he was drawing. He said he's spoken to my husband about it several times and my husband keeps pushing it but our son not wanting to be here is just making things harder for everyone. He doesn't like their activities. He doesn't like boy scouts camp. It's hard to get him to participate. And that may be we should just let this one go and sign him up for art lessons or a book club or video game club (real thing at the high school he will go to next year). I talked to my husband and he's saying no. He just needs to be pushed and boy scouts is what he needs. But it just sounds like our son is taking just taking away time from other kids when his scout leader having to pull teeth to get him to participate.