Relationship.

My boyfriend is constantly with his one friend. He promises we'll spend time when he gets out or work(I work day and he works night) and when he comes home he always brings his friend with him and on his day off his friend is always here. What should I do or say. Is it wrong for me to be upset?