Do I get mad?

Me and my SO has been together for 5, almost 6 months. But we’ve been off and on for the past 4 years. Breaking up due to: Immature actions, Work, school, other people.. it was never the right time for us but now we’re going strong. When I was 12, i was diagnosed with PCOS, the following year, my periods became irregular. It would skip 6 months at a time... causing me to take some pills that would make me come on and use birth control to regulate it. Fast forward some years... I’ve been dying to have a baby of my own.. I’ve baby sat other people’s kids, cared for my cousins baby for a few months because of legal situations. I brought up the baby scenario with him and he asked my reasoning for it... I told him because of the PCOS, I’m terrified that the longer we wait, the slimmer my chances become. After constantly having this heated discussion with him, he comes to me and says: babe, I thought about it. Yes, let’s have a baby. And we actually started planning it and getting into it, everything. I thought everything was fine until he told me that he thinks we should wait which crushed me inside. He went on and on about how he thinks we should have more time to ourselves, how we should focus on ourselves and take things slow but we had already agreed that this is what we both wanted and no matter what obstacles would be there, we’d face them together. Now, he won’t budge, he keeps telling me no, he doesn’t want the baby. So, I stupidly agreed to wait for the baby (if I can still have one, that is) even though it’s tearing me up inside.. and you’d think that he’d have a heart and wanna try to comfort me.. but he doesn’t. Instead, he just gets on his game and ignores me. I found him crying in our room while he was looking at his laptop. When he saw me, he wiped his face, closed his laptop, denied crying and fell asleep... me being the nosey person that I am, I opened his laptop and saw that he was searching up about PCOS, and statics about it... should I be mad at him, or am I talking this out of proportion?