New moms- do you work full time?

My son is three months and I currently work 5 days a week 8-5.. I feel so incredibly guilty and have a constant pull to be at home with my son. I miss him and I’m so sad that I can’t be the one to care for him throughout the day. He is growing so fast and I’m missing out on so much. All of the other moms I talk to say they stayed home and the ones who didn’t say they wish they would have. The thing is, if I leave my job I loose my benefits and I won’t be able to ever find another as good as this one. Plus we need the money. Do you moms work full time as well? I just need to know that I’m not a bad mom for being away from my baby so often and Im afraid I will regret missing these precious moments.