Sure, tighten just enough that it does not spin. Duh!
Try this approach. Each time, tighten the drawbar to the max that will allow reasonable force to remove the tool. I suggest experimenting, using a click torque wrench and establish just what that number might be. Start low and work up...