Remarks from friends and family

How did you deal with insensitive remarks from family and friends. I know most don’t mean it the way it sounds. But when someone says something like “at least you were only 5 weeks along” or “it’ll happen when its meant to happen” it kills me inside. Just because it happened at 5 weeks along doesn’t mean I don’t get to grieve my loss as well... I never really know what to say or how to respond. My boss asked me if I was “really truly ready”, because husband and I didn’t expect that we’d end up pregnant my first cycle off the pill. Insinuating it was for the better.... and I cried the whole way home. Is this just something you have to deal with and hope it gets better? Or did you say something/what was your response in these situations.