Starting to stress.

I had my baby on 12/10 at 11:31pm. He did great nursing 12/11 and 12/12. All of a sudden on 12/13 before going home he stopped. I dont know if its because my milk actually came in. Ive been having to pump to maintain my supply because I still attempt to latch him every feed. We did have to supplement some formula and give a binky because he needed to be under bilirubin lights for a little over 24 hours so he had to stop using me as a binky. Problem is he's no longer emptying the breast he favored. At all. He won't stay latched. He gets it, pulls a few times, then unlatches and screams. We've had trouble with one side. I expect it with one side. But now im not sure what to do to get that latch again. I do t want to lose this bonding i didnt get with his sisters. I did start to swell. Could this cause it? I dont know what I'm doing wrong. Lactation basically told me keep trying and he'll eventually get it. He wants to cluster feed but im doing something wrong. I feel like I keep failing him.