Am I right to feel this way?

My husband has two children from a previous marriage, she was 17 and got pregnant within a month of them being together.. fast forward, he’s been divorced for 6 years and we’re now married and have been ttc for over a year.

I want children more than anything and it’s hurting me that it hasn’t happened yet. But my husband will joke about it saying “I already have kids” “if we can’t have any it’s your fault” or “well you can’t get pregnant”

He says things without thinking all the time but he knows it hurts my feelings.

I’m angry, jealous and sad about the whole situation. He apologized about it but he’ll probably say it again..