Breastfeeding & pacifier

I've been exclusively breastfeeding since my daughter was born four weeks ago, and we are just introducing her to a bottle maybe once or twice a week that my husband gives her so she will be ready for daycare. I pretty much feed her on demand, or at least try every couple of hours (she wakes herself up now every 2-3 hours).
The past few nights, she will not sleep without my nipple in her mouth. I'm totally fine with her breastfeeding until she falls asleep, but she will fall asleep and unlatch and then a little while later she will scream and then want to latch on again to sooth. I was wondering if I should give her a pacifier & if that will mess with our breastfeeding relationship. I think it could keep her content when she is done eating.