Good question - climb or conventional. I've given that some thought as I'm cutting a channel in a radius. So it's really both climb milling and conventional milling I guess. I was thinking that perhaps that milling a channel is both, and that the inside radius cut is going at a different (slower) speed than the outside cut, that that may be a contributor to the chattering? Thoughts?
It is hard to say, id consider lowering the depth of cut. If you still have chatter say after cutting the depth of cut in half then id have to say you have mechanical issues someplace in the machine. I wouldn't trust that rotary table actually. It is hard to tell without inspection but many of the Chinese imports are not fitted up well.
Do feel free to adjust spindle speeds to find the machines happy zone. Normally you would adjust downward but sometimes an increase in RPMs can move the machine out of the Zone where it easily chatters.
Other things to consider:
Keep the end mill as short as possible.
Lock all unused axis down tight. If you have too loch down all the gib bolts. This to try to turn the machine into one massive piece of cast iron.
If the column on the mill is a box section consider filling it with epoxy granite.
There are many end mill designs out there that try to address issues with surface finish, harmonics and the like. Sometimes the simple and cheap end mills just don't work well.
Avoid cutting channels with full size end mills. Cut under size and then clean up with a full depth cut on each wall.
As others have pointed out drilling is perhaps the most efficient thing you can do on these small mills. Chain drill and even consider cutting out much of the waste by hand.
Probably should have mentioned this before but make absolutely sure you aren't recutting chips. This is actually a huge issue as it not only induces vibration it can also ruin an end mill pretty quickly if the material works hardens at all. Chip evacuation is a huge issue on deeper slots.
Keep the cutter flooded with coolant.
In any event a lot of ideas thrown out to give you some possibilities.