Lack of affection

I have been with my boyfriend for over 4 years, and have lived together most of that time, buying a house in 2020.

When we moved it was a big move for him as he was leaving the area that he grew up and where his kids lived. The move was his idea and after a grieving period, he really grew in to himself and became so confident.

I have been struggling with CPTSD and I am out the other end. For a while now there has been a lack of affection from my partner. My love language is physical touch and it really affects me, especially because when we got together, he couldn't keep his hands off me, it stopped when we moved.

I ask him and tell him exactly what I need and he just won't do it. When I ask why, he says "I just don't like touching people" or "it's really hard being with someone who sees the world so negatively".

I feel a bit gaslit because I don't think I am asking for much, given he was affectionate in the relationship before.

Am I being selfish telling him that he needs to work on being affectionate towards me or the relationship won't work?

I ask him all the time what he needs from me or if there is anything I can do to male the relationship better, and he just says he doesn't know.