Am I being too sensitive?

Ok so I’m engaged to a man I have thought to be the most wonderful man. The last year for us has been a little rocky because of some inappropriate things happening between him and a female friend and coworker whom is actually married. We had a miscarriage in the winter and trying to have our rainbow baby now. I had bariatric weight loss surgery and had to wait until my doctor approved me to get pregnant. My key ovulation days were Friday and Saturday. My doctor told both of us we had to have sex those two days. We didn’t have sex until Sunday because he was too busy, I was upset at first but decided to let it go. I’ve been feeling really yucky since yesterday and food hasn’t stayed down well for me. My doctor wanted me to be eating every 3 hours and I have not done great with that but I try. I saw my doctor this morning and he ripped me apart about everything, from not being sexually active on the right days to not eating enough. I texted my fiancé to tell him what happened and his response was even more harsh than the doctors was. He told me “you are the one that wanted the surgery and a baby so you need to get over it and do what you need to do, and it doesn’t matter to anyone if you eat the exact same thing every day forever as long as you man up and do what you’re told” I could only muster up an “ok” for a response but now I just want to quit. I don’t think I want to have a baby with him seeing how unsupportive and harsh he is. He wasn’t supportive during my surgery either and even had a huge fight with me the day I came home and disappeared for over a week. I tend to blame myself because I’m bipolar and I know I’m difficult to deal with but I don’t feel like the hostility was warranted this time. Sometimes he is the sweetest man on earth but lately this is the man I interact with day to day. Am I being a crybaby?