Is this passive aggressive ?

I 25F have been seeing this guy 22M for a few months. Today we went to see the eclipse and I joked about staring into the sun and said something like “it’s been nice knowing you”. He responded with “for the most part it has”. He said it in a non joking tone and I asked what he meant. He said something along the lines of “it’s been nice getting to know for the most part. There are some things I change tho”. He didn’t explain further.

For context he was upset with me a couple weeks ago for spending time with my guy friend, but didn’t say anything about it. Instead he asked me to hang out and then was mean and passive aggressive the entire time. He then apologized and said he was upset and took it out on me. Another thing he randomly said was “my ex would think you’re whore” like… out of no where.