I still say drum sander bit in a drill, a few passes around the hole will do it in about the same time it takes to read this.
No jigs, no routers, no saws, no files. Just around and around the inside edge of the hole.
I just did this for a Black Widow 18 in. speaker.
Had a cab spec'd and build for it, though the hole was off by a 1/8 of an inch. Took a drill with a drum sander bit, round and round in the hole and chamfered or rounded the edge as agedhorse said. Done in about 5-10 minutes. Really.