Dating my manager???

So, my manager has liked me for quite some time now and I like him as well. We have spent time together outside of work and our first actual date is next week. Is this a bad idea?