Paci and breastfeeding

My baby was given a soothie pacifier after his pku and circumcision in the hospital, but we waited until 2 weeks old to start giving it to him at home. He's taken to it just fine and it doesn't stop him from breastfeeding but there's one thing: Around the time I started giving him the paci, my boy has started "playing" with my nipple more than latching on, even if he's just let go from being latched. It's not all the time but often enough that I'm curious. I wonder if he does that when he's not so much hungry and just wanting to suck but sometimes he seems so frustrated and based on cues and timing he should be hungry.