should i be upset?

Shay

my boyfriend just often goes over to girls houses, i know nothing happens but it makes me uncomfortable and upset

do i have a right to be upset? or is this a petty thing?