My baby wont latch

My baby is officially five days old, at the hospital on the first day he will latch perfectly as the days went by he just began to refuse my boob everytime I try to feed him he begins to cry and pushes my boob away, I really want to breastfeed my baby ... I have supplemented with formula.. I think my areola is too big for him and plus my nipples are flat... any tips?