BABY HUNGRY

I have been very baby hungry for a bit now,  me and my man have been together for 4 years now. We live together and everything and we basically are married but without the ring or title. We have had the "talk" about babies and such. 
Is it the right time to start trying for a baby?