Well, I bit the bullet and ordered the ASME spec for spindle noses for $35.
The spec can be ordered here:
http://www.asme.org/products/codes---standards/spindle-noses-for-tool-room-lathes--engine-lathes- This spec has a drawing in it that is essentially all you need to make this part, except for the 4 through holes to attach to a rotary table. I was stuck at trying to reverse engineer the spindle on my lathe and get some of the angles / dimensions and I just gave up - $35 bucks and now I have all the dimensions I could ever want for the cam locks, pins, etc for all the spindle sizes.
I used 5" diameter hot rolled 1018 steel. It cut beautifully on the lathe (bright blue chips) but in retrospect I should have chosen something that could be nitride hardened (1018 isn't suitable for nitriding). I'll probably just use it unhardened and be very careful with it and / or touch it up if it ever gets messed up. I made it once I can make it again!
Here is a picture of where I am at now. Unfortunately I am stalled out as my mill is down for repair (long story there). I will post my completed unit when I am done.
I know the hold downs are not suitable. They are just temporary / lightly holding it until I find a suitable bar in scrap pile to hold down across the top, and I didn't want the parallels coming out. They are there cause obviously I wanted a space underneath for the drill to break through so I don't ruin my rotary table in the process.
Regards,
Mike