adderall and nursing

My dr said it's my choice. I take 20mg 2x a day. I currently Night nurse. Anyone notice any affects on their little ones if at all? I know the supposed affects; loss of appetite, insomnia, rapid heart race. Just curious to know before I decide to actually start back on it and (reluctantly) stop nursing all together. I have severe ADD, OCD, and anxiety and my dr thinks I need to start again in order to get back to as normal of a schedule as we can and life with now 3 kids. TIA