How do I get my baby to sleep without bottle

I have been working on getting my 4 month to bed at night with no bottle. We feed until she is sleepy and help her fall asleep by shushing her. Question is, is that how I do it in middle of the night also? Let her snack and take it away when she wants to start falling asleep? Or any tips and tricks that helped you? Thanks in advanced. she won’t take a pacifier