Boyfriend who has a baby mom

Hey ladies I need some opinions please!!!! Me and my boyfriend have been together for a while, he has a child with someone else the child is 6. They haven’t been together for 5 years now. My issue is I believe he loves his ex still and I know it’s the baby’s mom so I know he will always have that love for her but he refuses to say he loves me and I also understand people don’t say it if they don’t mean it but I just feel some type of way like if the babys mom was to say she missed and wanted him back that he would just leave me.. I’ve expressed this to him several times but he just gets angry with me and brushes it away... please help