Can I change my babies name?

My son is 3 weeks old. I'm in California. Can I change his middle name? We already received his social security card and medical insurance card. I just feel like I was pressured into putting his middle name to be my MIL's dad's name and I hate the name. Every time I see his full name I cringe. I'm not proud of it but i can't help myself 😞