8-10 hours in swing...move to crib?!

So baby boy just turned 3 months yesterday. For about 2 weeks he's been giving me 8-10 hours of sleep in his swing. He clearly loves it but I'm just wondering when should I make the switch to the crib? I've tried it a couple times and once he gave me 2 hours and the other time 5 hours but just was hysterical so I ended up putting him back in his swing. Am I creating a "swing monster" this young?? 😐