Is it too early?

So I'm 4 weeks postpartum and I really want to go back to working out I don't have my dr visit until 2 more weeks but I was wondering if it's too early to go back to the gym?