Discouraged

I've been married for 2 1/2 years now. I went off bc about a year and 4 months ago. We haven't been to serious abt ttc but have not been preventing. Recently I find myself so jealous and sometimes mad abt others getting pregnant so easily. (Even though I'm completely happy for them) but it drives me nuts that people who aren't ready for children or people on drugs and what not pop out kids left and right. Just trying to stay positive ?