Bottle to breast?

My LO is 2 weeks old. He was in the nicu for a week (full term 39 weeker but had jaundice and other minor issue). Anyways, they bottle fed him in the nicu and now I am having trouble nursing. I’ve had to pump and bottle feed at home to keep him fed but I’d love to be able to nurse directly for convenience sake. I try to put him on the boob once or twice a day just to see if he will take it but even though I wait until he’s hungry, most of the time he will just suckle but not feed or get frustrated and cry and push it away because it’s not as easy as the bottle. My supply and let down is good. I’ve tried a nipple shield which helps him latch but still he doesn’t swallow. I worked with a lactation consultant twice while in the hospital and had the same issues which went unresolved. Does anyone have any tips for this particular problem? Should I just keep trying and maybe when he’s bigger and stronger he’ll get it? This is my first.