Gordon,
What you have asked for is the same as asking how long a piece of string is when you haven't got anything to measure it with.
I have great difficulty producing bad finishes as everything on my machine is set up to the best it can be.
You don't mention what mill you have, if it is a basic X2 with the swivel at the bottom of the column, then you will maybe need a few mods to solve the problem as it sounds like the head is swinging side to side, causing a permanent trailing cutting edge, depending on the direction of cut, whereas with a Bridgy, even with a bluntish cutter the results should be very good. Lack of rigidity somewhere on the machine is a normal cause of bad surface finishes, plus having table and column jibs not correctly adjusted, in fact Shopshoe has covered most of the problems.
See if it cuts any better in the Y axis, if it does, then that really does point to the head swinging in the X axis.
How rigid is your machine vice? If it is like a drill vice, then you may as well stick your metal to the table with chewing gum.
With reference to your asking about speeds and feeds. You can't rely on the charts that are floating about, they are for industrial machines and most probably have no relationship to what you are trying to achieve.
I will tell you what I do.
Razor sharp cutters always, very fast spindle speed with very slow feed speed. The depth of cut doesn't really come into it, but as a rough rule, with everything rigid, 1/2 of the cutter diameter is your max, when either cutting down onto the material or cutting along it's edge, so 1/4" cutter can have a cut of 1/8".
Tell or show us what you have to work with, and I am sure someone will be able to solve your problems.
John