Not trying, but not preventing

My husband and I got married in December, and we had decided shortly after that we were going to stop preventing pregnancy, but not actively begin trying. How did you decided it was time to make the switch to actively trying to conceive? We both want to, but we also want to take a bit to enjoy ourselves just the 2 of us for a little longer. I feel like I am much more committed and comfortable with actively trying to conceive than my husband.