Maca for men

Have any men taken maca root and had negative effects? Me and husband have been taking it for maybe 3 weeks to increase libido. Neither of us have noticed any positive effects, but are worried it could be harmful for him. The dr said its not proven to do anything good or bad.