Can’t continue work while 11 weeks pregnnat

So I’m part time I work cleaning peoples homes and I’m currently 11 weeks pregnant iv discovered that no matter what type of gloves and mask I use I feel faint and dizzy with all the cleaning chemicals each client has their own cleaning products and I seem to be reacting badly this has never happened before as iv had this job for 1 year my doctor says it’s probably due to my sensitivity being high while pregnant any advice on what to do