Secretly hoping for #3

So my kids are almost 11 years apart. I had been diagnosed with PCOS years ago and had tried clomid and then fermera for 5 cycles before conceiving my second. I have always wanted a big family and kids close in age. My husband says he doesn't want any more kids but we don't use any sort of perfection to prevent pregnancy I feel guilty for wanting another baby. Who gets the deciding factor? He doesn't want any more but I do...not using any protection I secretly hope I can conceive another baby. Is that wrong of me? Do you think it's even possible. I'm 32 and no cycles but I have been exercising more and have been having cramps on and off for almost a month now.