Contact points are not flat as manufactured. Usually one is slightly convex and the other is flat. This gives a defined touch zone and makes for an accurate gap when set with a feeler gage. It also allows slight misalignment and rubbing block wear without compromising contact area. So don't file them too much as you are distorting the shape.
WOB
WOB
