Has nothing to do but advice

So me and my husband been married next month for 6 years I never changed my last name because I never got around it within the first month after the wedding as I was pregnant and going to college full time and working my husband once told me to my face that he didn’t care if I had his last name as long as our daughter did so I took it to heart I always meant to but give me a break i had a lot going on at the time so I didn’t change due to what he told me and now that we this far in our marriage I always feel down want to change my name but idk how to go by it as in when I tell him his like whatever I don’t care taken you this long but I know he would want me to change my last name what I mean is I want to but I don’t wanna show him and him not care what so ever about it am I in the wrong or what should I do I know I should of changed it a long time ago but I just kept putting it off do to part from what he would say and some rough patches we had here and there but at the end I don’t see us ever leaving each other either so I know I need to do it sooner or later but has anyone gone threw this ?