Endocrinologist doctors upsetting comments

So yet again I get to deal with the comments of “ at least you have 2 beautiful children if we can’t get things to work”. I am thankful as hell for my boys. My oldest was a rainbow baby so I know the tremendous value of a healthy baby. This in no way lessens my pain of not being able to conceive or even figure out what the issues is. I am finally in a great place in life with a person I feel so great with. We are creating a whole new life together. So of course I want to actually have a drama free experience with my partner. I am just so frustrated and don’t know what to feel.