Planning baby’s first birthday party

So I have actually started planning my babes first birthday party and I’m having a very hard time with the guest list. First off we rented a hall for the day (less cleaning before the party 😂) so one side of my family is very large (My father has 6 siblings) and only 2 have made an effort my whole life. So for my son first birthday would you even invite the other 4 who have not even met my son or would you invite only the family who has actually been there?