Visitation or supervised visitation?

My ex and I have agreed for him to have visitation with our 7 month old like it has been since he was born. We want to get the legal paperwork done saying that he's only getting visitation. So my question is I'm not comfortable with him being alone with the baby so would he be able to take the baby out alone during visitation? He's never been alone with him, my mom and I have always watched him. Or should In just ask for supervised visitation since that's basically what it has been? Do we have to go through the court since we are agreeing on it? Or can we just file some paperwork?