Do you wear your wedding ring with a newborn?

My husband honestly seems a little upset that I don’t wear mine anymore. But honestly I’m scared to scratch my baby with the diamond part it’s kinda sharp enough to scratch. Am I the only one like this?