Baby doesn’t like my breast milk

My baby is two weeks old, he will latch but eventually get irritated & makes a face like he’s disgusted. So I started formula feeding him and pumping. I do still try to give him the boob but still no change. If I pump and try to give it to him he does the same thing, eventually he gives in & attempts to drink it then chokes on it (almost as if he’s forcing it back up because he doesn’t like it) I don’t know it’s weird. Any tips? I just got a electric breast pump & I was feeling confident about it again but nope my baby isn’t having it🥺 I really want this to work!