I need advice!

So I'm currently engaged and I'm happy most of the time . I just over think and worry a lot because he doesn't show affection or talk about how he feels at all. I do know he loves me and I know that's what matter most but I've talked to him about it and he said "he's always been this way" . Does this mean I'm not the one for him? What does this mean? And what can I do ? Girls I need your help, this is breaking me down .