I have an assortment of rat tail files that i typically use for reaming out handles. The files need to cleaned as you go along, but I still found it to work best for me. I have put it the files into the drill before and found it to be a very quick process.
Another reason to run the drill in reverse is to prevent the file from digging in and pulling the cork handle into the chuck.