IVF questions

Hi ladies. I have been TTC for 3 years with no luck. I am getting nowhere with my OB and was wondering if I am allowed to just skip the OB and go straight to the RE without a referral or is it best to get a referral from the OB first?