Meeting His Father

 I have been with my boyfriend for over half a year and I still haven't met his father. Their relationship is pretty normal from what I can tell. Every time I ask my boyfriend he just says he wants to keep me so he doesn't want me to meet him or makes jokes about meeting him on our wedding day. He basically told me he doesn't want his dad to embarrass him but deep down I feel like he thinks I'm an embarrassment. I've met almost all of his family on his mother's side but none on his dad's. I don't want to push the topic if he isn't comfortable with the idea but it's really starting to bug me. Should I be concerned?