Taking so long ttc!!

Jackie • Pregnant with baby #1 thanks to glow ❤
My boyfriend has very very low sperm count, the Dr prescribed him clomid he's almost been taking it 3 weeks, how long does it take for it to make a difference, should we just go to a fertility specialist?