Taking Birth Control & Not Telling Your Partner. Is That Ok?

Ok, so before I was married to my husband now of 7 years I was married previously with 2 children (one is severely autistic). After I got married to my second husband we did have a child. I was nervous the whole time, got gestational diabetes and was just nervous the child maybe autistic. I love my children so much but I really don't want anymore. I have a lot with the three that I have. My oldest is almost 20. I talked to my husband and he just doesn't understand. Do you think I would be wrong to take birth control and not tell him? I just don't want to fight about it anymore.