Focus on career or TTC

Okay so my man and I kind of started TTC two months ago (we're not exactly trying, but we're not preventing either), but now my future career took some new turns and I really feel like I need to focus on my career. Is it wrong to stop trying for a year to focus on my career? I feel like I really upset him.. it's not that I don't want a baby, because I so desperately want to be a mommy and I can't wait to start a family with the love of my life, but it's just not the right time anymore. Anyone feel the same or going through anything similar? I know it's my decision, but what would you guys do in this situation? Just curious.. And I guess I just needed to vent about it.