Should I use a condom with my mini pill?

I am currently on the mini pill...and I have never been with anyone other than my boyfriend and have never had any sexual problems. My boyfriend has been with two other women before myself and is absolutely certain he has no sexually transmitted infections or other possible sexual problems...we are quite excited to have sex without a condom but I know he has once before, should I be worried about that risk? I am already aware of the unlikely but possible pregnancy factor by the way. Thanks x