Sexual assault?

So about 2 years ago I went to a walkin clinic because my doctor was away. I got a male doctor and he prescribed me yeast infection pills after I told him my symtoms. When I took the pill I didn't feel any better, instead I felt worse. I went back to see that same doctor. He said that we should take a few swab samples to make sure it's not another type of infection. There was a nurse assistant in the room with us. Here's what I thought was strange. The swabs seemed to take quite a bit longer to do than expected. He didn't use a speculum because I was extremely red raw and sore so he just used his fingers (with gloves). I apologise if this is tmi, he had a finger inside my vagina and was kind of twisting it back and forth and he said he needed to get enough discharge on the swab. Is that normal? He also asked if I had recently had sex and I said no. He then said I seemed quite tight. I'm not sure if he actually meant it in a sexual way. Do you think his actions were innapropriately sexual? I feel kind of weird about it and I'm not sure if maybe he meant it in an innocent way. I'm also so used to having my same female doctor. She's very fast at what she does and this guy seemed to take a longer time down there. I'm not sure if maybe he just wasn't used to taking swabs, I'm sure female doctors do this more than males. Since it was a while ago I feel like my memory is a bit fuzzy on every small detail. Sorry for some reason this has been on my mind and I wanted opinions.