So upset!!

SO and I have been ttc, lucked up and got pregnant last cycle, which ended up a chemical pregnancy. SO was very understanding, also stating we could definitely try again. Today I brought up the situation and he said he honestly did not want to try again, during my FW. I don’t know rather to be upset or not. Yes, I’m very upset but then I feel as if it’s selfish of me for even being upset. Any advice?