Gp refusing to refer me to the hospital untill 18-20 weeks

I’ve spoken to the hospital and they have told me that I should have been referred weeks ago and there’s a 6 week waiting list for the hospital so I need a referral ASAP and my gp is straight out refusing to refer me. I’ve booked in to see another doctor but the absolute mess around and stress this has brought! With my first Bub I didn’t have a problem it was all done the minute i was confirmed pregnant! I don’t understand why he won’t refer me when the hospital is asking for it. (14 +3 weeks) not midwife or antenatal appointments yet and with my daughter I had my first midwife appointment by 12 weeks🤦🏼‍♀️ just abit annoying