Baby hates & loves swaddling?

Am I doing this right?

Our little 3 day old SCREAMS like I am trying to murder him while swaddling him up. He'll fight it the whole time, and I have to pin his arms down forceablly to make it work. It often end with one arm poking out a bit anyway.

BUT! Once he's in, and if for the love of all that is good I get both arms pinned down, he sleeps like a baby 😉

So I guess my question is: Am I doing more harm by putting him and myself through this extremely stressful process? I'm not sure if when people say "my baby didn't like swaddling so we gave up", that it was because of the process or because they didn't sleep well in it. Because the end result works, but getting him there has been Hell so far.

Thoughts?

I'm looking at zip up swaddles or the special swaddle blankets with tabs and velcro or whatever to maybe make this easier. So any recommendations for a newborn would be amazing too.