Confused, is it jokes or seriousness?

Long post I’m sorry. Just need advice/opinions. I have been talking to this guy for a few months, we’ve hooked up twice. A little while afterwards he had asked me how I was doing and I told him I didn’t feel good and was nauseous. He proceeded to ask me if I was pregnant. I laughed it off because I knew we were safe. Well, this morning he was bringing me back to my house before work and he asked the same thing. I was a little concerned but still laughed it off and said “you wore a condom so I guess not” and he proceeded to say “ didn’t know maybe the condoms had a hole in it or something”. I replied and said he should know if it did but he just brushed it off. Should I be worried or take it as jokes??

Just so it’s known I know condoms aren’t 100% effective.