I use open arena. I have 27 folders with 200 arena maps each. I symlinked the "main files" (modified sets of pk3 with textures, models, bots, etc) into each directory and just run a directory as a mod. I also made a script that generates a map cfg file from the pk3s, so openarena can randomly load maps.