Trouble latching

Mia🐇
My baby is 2 weeks old and confusing me...
He's exclusively breastfed and gaining weight/having plenty of diapers but it's really time consuming feeding him because he has trouble latching and we have to try over and over again every time we nurse. 
He will open his mouth wide, shake his head side to side a bit and position himself to have a good deep latch but then doesn't actually latch...he pushes away over and over. 
The only way I can get him to latch is to pull his head onto the breast at just the right moment but it feels too forceful and like I said takes many tries. 
Advice??