Water making me feel sick

I just recently changed the filter in my fridge and I notice every time I drink water from there I instantly feel queasy. I haven't been putting ice in it so it's just slightly cold. When I drink iced water while I'm out or something I don't feel nauseated. Do you think it's maybe just the temp of the water? Hoping it's not something to do with the water itself 😣 anyone else have this problem?