Confused

So my husband and i want children really bad. Hes got baby fever and wants one like yesterday which is fine because so do i. We have sex on a regular basis and hes down with having it whenever. But ive noticed that every time i tell him im ovulating we dont have sex. He doesnt try, doesnt talk about sex, its like he avoids it. Ive asked him time and time again are you sure you want kids he says yes then i ask are you sure you want them with me he says yes. Then usually a week later he will be like so are you pregnant, have you taken a test. Im so confused!! Any advice?