Plan b

My partner and I have been together for 7 years. 4 months ago I decided to stop birth control since I had been on it for 10 years and was having health issues. Recently my partner and I got carried away and I took a plan b the next day. I can’t help but to be angry because I’m ready to start a family and that could’ve been it. I know as a couple we aren’t ready for it and he also isn’t ready personally but idk why it’s so upsetting to me. Am I wrong?