The paper has done the trick though, no movement with my finger now on the far end of the tool
Well using arm power alone to flick the chuck around, and the smallest of small cuts, I've got a finish that I think I'd be happy with, much less chatter, and a shiny finish, so tool isn't a problem...