Human pacifier!

Destiny
My LO at night wants to stay on to sleep. I take her off and BOOM 5mins later she is awake and screaming!! I've tried everything to giving her a pacifier to setting her in her bouncer and nothing but latching on is calming her. I feel like I pacifier!! She isn't eating just playing with it. And she is even starting to bite it as well (she's only almost 2months old) PLEASE PLEASE tell me other mommies are have gone thur this and have successfully stopped being a pacifier! I need any advice or tips I can get. FT Breastfeeding mom here.