Introducing a bottle

What are your experiences with introducing a bottle to breastfed babies? Mine is four weeks and exclusively breastfeeds, starting to think about when to start pumping and introducing a bottle. It would be nice to have my husband do a feeding once a day or if I need to go out briefly. I’ve heard from some moms that once their baby had a bottle they would refuse the breast, or waiting too long and they refuse a bottle. Don’t want to mess with a good thing, but do want to have this option in the future.