Can I start breast feeding?

My baby hasn’t been doing good on formula he gets pissed whiney gassy and literally takes a hr after feeding him to calm him down I guess maybe cause of his gas and stomach and he’s only 4 days old so I have to wait 2 weeks before I see a doctor which I hate to get him out in public but I’m really wanting to start to breast feed to maybe help him out if possible but don’t want to wait 2 weeks to talk to a doctor about it can I start on my own like i need some advice I swapped him formula today which I know that don’t help or see a difference for about a week anyone???