2-3 Week Maternity Leave?

Is it crazy for me to expect to be back to work after 2-3 weeks? I'm worried about losing my job if I take much longer than that.

We're a small company and not covered by FMLA so my position could be dissolved and I won't be able to do a thing. My boss always gives me a hard time for vacation/sick leave when it's a single day.

Has anyone managed a 2 or 3 week recovery after baby arrives?