kb,
What abby said, you can make them as small as the eye can see, . . . but one thing you need to be aware of is that rarely is a square broached hole fully square. The pilot hole is usually drilled a bit oversize so that the broach only removes, or notches, the four corners. Some manufactured square holes (sleeves for instance) are fully square, but typically a hand broach does not attempt to remove all the material within the hole that isn't a square.
If you were to make a broach (easily done) it would be beneficial in this case, where gears are to run together, to form a pilot or guide on the broach which would keep the broach centered as it proceeded through the pilot hole. Otherwise the broach might drift or skew and the gears would probably end up having a tight spot in the running fit.