Am i being ridiculous?!

My boyf and I are temporarily living in different states. I get a bit sad and jealous when i see him hanging out with other girls, even though I know he is loyal and faithful to me. Whenever i bring it up he gets mad and thinks i dont trust him. Am i being silly?!