Bob,
my skills aint near yours but i do a similar operation on the touch holes for the BP rifles
i stuffed more ends this way than i can remember,
I did learn that a small end mill through the first 2-3 fins ( plates in my case) stopped 95% of the distortion
the end mill did not distort if it touched the body, it just milled a groove and i could adjust
drilling was lots easier and way more reliable after i learned this
dunno if it helps you, but maybe..
cheers
jack