The amount of girls my SO has been with

I've only been with (had sex with)  4 people and my boyfriends been with 22 people... I was wondering should I be bothered by that? I find myself getting paranoid and jealous and constantly comparing myself to other woman knowing he's seen so many other bodies. Is it wrong that it made me paranoid? I've never had a one night stand I've been committed to everyone I've slept with and my boyfriend has had plenty one night stands. What do you think ladies? Am I being silly or is it logical to be freaked out