talking dirty

Me and my boyfriend have never really talked dirty. It's been a very relaxed relationship and full of laughs and fun times. But when it gets to sexual stuff it's very quiet. He's not into all that "daddy" sort of Thing, but neither am I which helps. I just want to spice it up and I kinda like the idea of talking dirty but I don't feel like he'll be into it, how do I approach it? Should I just try? Although I don't want to freak him out. Although I think If we talk about it how many think I'm joking