Do you regret having more than one child?

I have a 14 month old boy, I am 4 months pregnant with my second son, and I am really starting to regret this pregnancy. Our families keep telling me that my 14 month old needs to grow up because he is not going to be the baby of the house anymore. I keep hearing that I hold him too much and that he needs to get used to not having my attention. They also keep telling me that he is going to hate his sibling and that he will miss not being the only child. I feel guilty about not waiting longer to have another baby and letting my son be the only baby for longer. I am really regretting this pregnancy. I do not feel connected to this new baby and I am hoping I will feel differently about it once he is here.