Exemptions for tax

Now that we have a baby, I finally decided to adjust the number of exemptions I claim for taxes. I filled out the worksheet on the w-4 form and it has me claiming 6 exemptions even though there's only 3 in my family. This decreased the amount of taxes being taken out of my pay by almost $100, which is nice for now, but when April comes around, I don't want to owe the government a ton of money! I am working full time, bringing home the majority of the income. My husband works part time. How many exemptions should I claim?