Opinions please (I did a bad thing)

Ok so I have been tracking my ovulation since January since I have extremely irregular cycles (like months to years between periods). I have ovulated once in March and once in September. I had already talked to my ob about Clomid but wasn't ready at that time. After af early this month I got started on Clomid. Problem is hobby is against any "artificial help" like meds. So I didn't tell him. How bad is this going to bite me in the butt?