steroids... uhhh

So my boyfriend has done steroids on and off for the last 5 years. I know he's been to an endorcrynologist and they prescribed him clomid, however it was just for basic testosterone production. He got off steroids about 2 weeks ago and has continued to take clomid. Has anyone had trouble conceiving with someone whose done steroids? He has friends who have gotten their wives pegegnany while on cycle but we seem to be having problems.