"If it happens it happens" TTC

Elizabeth
About a month ago my husband and I had a discussion during which he thought we sort of settled the "should we/shouldn't we TTC" debate.  I've been telling him I'm ready for a while now and he finally said he thought he could be ready.  At first he said we could start trying, but then he sort of ended it with the "not necessarily actively trying but if it happens it happens" sort of thing.  At first I took it just fine.  We started having sex a lot more (our sex life was almost nonexistent for a while) and we were much happier.  We had sex during my fertile window and it kind of got my hopes up.  My period is due tomorrow and evening I had hope before, I'm starting to lose it just because I've been disappointed so many times before.  Here lies the problem: I'm afraid to talk to my husband about how I feel.  Our relationship is great and normally we can tell each other anything, but lately he's been giving me a vibe like kids are way off in the future for us.  He'll even say things like "by the time our kids our born there'll be way more Star Wars movies" (we're nerds, okay?).  If my period comes and I'm depressed I'm afraid he'll just be annoyed with me if I say anything, and if it doesn't and I'm pregnant I'm afraid he won't be ready.  We've had the same conversation/argument countless times and I'm just sick of it.  I feel like I'm lacking the advantages of a couple actively TTC because I can't really go to him.  Has anyone else had a similar situation?