Breaking up with my partner

My partners grandfather passed away 2 days ago but I've been feeling quite drawn apart this past few weeks. Today when he found out I had pcos and trouble conceiving naturally he freaked and went crazy at me saying things like his baby will always be number one (past relationship) I feel like he'd be better with someone that can give him more children easily instead of someone who will take more work getting there like me. Would I be a bitch if I ended it now?