Losing Weight Postpartum

Betthany • Stay at home wife and mother. Married my best friend Nick 6/28/14 and gave birth to our son Noah 1/4/15.
I swore I wouldn't be "that woman" and stress over losing the baby weight. However, here I am 3.5 months postpartum and have only lost like 10 lbs. I couldn't breastfeed like I was hoping, I tried everything and just couldn't produce any more milk than .25 ounces. I know they say it takes 9 months to put it in so it'll take 9 months to take it off, but shouldn't I be losing more than I am? Any advice or ideas would be great. I'm back to eating healthy and tracking calories and I workout when I can. (At least 4-5 days a week for 30-60 mins).