Need to vent

I think I want to break up with my bf. He’s very sweet but he was in a long relationship before me and I’m the only girl he went on a date with afterwards. Basically he has kept a lot of her things and pictures around. He said he loves me but he’s not comfortable saying it. I think because he loves her still. I had surgery and even then didn’t say it. I’m more annoyed that he said he loved me at all because if you do then you would want to say it. Then the other thing is we are so different. Different politics and a different way of life. He was able to do whatever he wanted growing up and I didn’t find out until later on but he used to experiment with drugs not just weed and so does his family. He doesn’t do that now because of his profession hence why I thought he was straight edged but I worry about raising kids. I think he be fine with them doing things and I would not be ok. I grew up very very different. And he has a very immature personality. I feel bad but I just feel like it’s not working.