Hi everyone. I'm a newb here, but hopefully that won't detract too much from an idea as to how to potentially improve the speed of track judgment/posting without sacrificing quality. I searched for a thread that was about this topic, but only saw it addressed as a sort of sub-topic in this thread. Hopefully not beating a dead horse here.
Anyway, I have an idea that may be useful for both the community and especially the judges, who seem to have a rather large workload to deal with. Considering how much they type out for each review, and how much time it takes for me to even compose a post like this one, it's not a task I envy. Given that the purpose of the judging system is primarily to set a minimum bar of quality, I feel like a large part of this task could be distributed to a larger part of the community. My idea is a two-stage approach, with the initial stage being something along these lines:
Create a user category of "sub-judges" (or whatever title would work) comprised of volunteers whose basic judging credentials are based on having some number (1-4?) of already accepted remixes.
Create a standard judging form that resembles the checklist from this forum to reduce the level of time commitment from sub-judges (with space for freeform commentary at the end). The aggregate of the forms can show a succinct basis of the reasons for the ultimate binary result of yes or no.
The results of these sub-judgments could be used as either a simple reference for the actual judges, or could be used to automatically reject remixes where the ratio of "yes" votes falls below a certain percentage (say, 20-30% or so?) with a minimum of number of sub-judgment submissions (I dunno, 10? 20?). Hopefully the end result of a system like this would be to reduce the workload of the judges while keeping things fair and transparent.
I know this isn't a perfect solution by any means, and would create some extra work for the site designers/admin to create this little system, but hopefully not too much.
Thoughts?