Can I change my baby’s name without the father present?

Me and my SO regret the name we chose for our son, we chose a religious name solely so that his mom would approve. We both realize that was a terrible mistake and have since researched how to change his name.

The only problem is that my SO works the hours that the department of health is open. Would I be able to go in alone and have our sons name changed? My SO is willing to write a consent form or even video call if needed. We’ve contacted someone about this but they weren’t able to help. It’s a far drive and I don’t want to go all the way over there for nothing.