Reply
 
Thread Tools Display Modes
  #391  
Old 06-20-2012, 06:52 PM
Rexy's Avatar
Rexy Rexy is offline
Beverley Wooff, Project Chaos Assistant Director
Bonus-Kun (+3000)
OC ReMix Artist Profile
 
Join Date: Apr 2003
Location: UK
No, if anything my votes were anything OTHER than rash and random. I had set a clear criteria when I went on to cast my votes - arrangement values, production values, and homage to the source. For me, FF6 is the BEST entry in the entire series, so it had to do a lot to win over the homage part. Here's how I labelled my votes:

1 - Fitted none of the criteria
2 - Fitted some of the criteria, with some glaring flaws
3 - Fitted two or three of the criteria, again depending on the track's weakness - overall not bad
4 - Fitted all of the criteria and was an enjoyable listen
5 - Fitted all the criteria and COMPLETELY BLEW MY MIND

Of course, people would have different opinions on how they feel about everything, and I stated my opinions on your track earlier Brad, but you just have to accept the loss and use it as motivation to get better.

I was just like you once though - I was pissed at the Dwelling of Duels during 2005-2006 for similar reasons on me working hard with what I have but simply not scoring well enough, and feeling that I was simply being buried by more 'conservative arrangements' and weaker produced entries, hence for a long time I had no idea what I had to do to place well enough, and in the times I did they'd see me as 'not being true to myself'. I eventually took a break from competing in the following few years, and now I do compete every now and again, taking into account the general DoD following when participating.

A long-winded statement, but the point is, it's not a good idea to complain if it means changing your style into something you're not happy with - instead, use it as a foundation to improve on what you have, and take every piece of valid criticism you can.
__________________
Reply With Quote
Sponsored Links

Please register to remove the above advertisement.
  #392  
Old 06-20-2012, 07:01 PM
Brad Stark's Avatar
Brad Stark Brad Stark is offline
 
Join Date: May 2012
Location: Vancouver
Quote:
Originally Posted by Brandon Strader View Post
That thought crossed my mind, but I'm pretty sure there was protection in there to prevent people from putting in "fake votes", or stuffing the ballot box... right?
My point is that the best tracks in this competition definitely deserved better scores than they got, and is there really anyone here who would debate that point? 3.4 average score for 3rd place makes no sense at all any way you slice it.
Reply With Quote
  #393  
Old 06-20-2012, 07:07 PM
Brandon Strader's Avatar
Brandon Strader Brandon Strader is online now
Random Encounter Director, The Root of All Evil Director
Joe Musashi (+7000)
OC ReMix Artist Profile
 
Join Date: Dec 2002
Location: United States
Quote:
Originally Posted by Brad Stark View Post
My point is that the best tracks in this competition definitely deserved better scores than they got, and is there really anyone here who would debate that point? 3.4 average score for 3rd place makes no sense at all any way you slice it.
Yeah, 3 out of 5 is an average score.
Reply With Quote
  #394  
Old 06-20-2012, 08:12 PM
Otakatt's Avatar
Otakatt Otakatt is offline
Red Mage (+400)
 
Join Date: Jun 2006
I know it seems like scoring 3ish is bad, but I think that's actually really good given the method of voting.

There's this t-shirt site out there that has a 1-5 voting system, with tooons of people voting on the designs. The best designs that get printed and people adore usually hover around 3, or a high 3. Everyone else gets 1, or a low 2 if they're especially lucky. I hate to say "it's just the nature of the voting system" but I can't think of another way to put it.

The only way you'd get a high mark is if you scored lots of 5s. 5, to me, is perfection. It's the best score. It's also one that NO ONE should be handing out like candy. While I didn't finish voting on all the tracks and didn't get a chance to listen to them all during the voting period, I didn't feel anything I had listened to was perfect, therefore I didn't give anything a 5. That includes the track that eventually won this competition. I believe I gave it a 4, and that was rare. I might have given out two 4s? Maybe a few 3s, a fair amount of 2s, but no 1s. 1 = poor and I didn't feel anyone's track was poor.

It's also hard to say what criteria people are using to judge these tracks. And music (anything creative, really) is a hard thing to judge, particularly using a 1-5 method. We could vote on these one way today, and then tomorrow we'd revote and not be entirely consistent. My favorite track of what I did hear, I actually gave a 3 to. It was a Blackjack theme, and sounded SO 80s, I loved it. XD However I felt it strayed far away from the source and was a bit too liberal, so I thought it'd be unfair to give it a 4 or 5.

TL;DR: The results don't look suspicious to me and match up with every other 1-5 voting system I've seen. We should be very careful about accusing anyone of doing anything shady, especially when zirc has been careful to make sure no shenanigans are going on.

I hope people can use it all as a growing experience and not be too upset if they didn't rank in the top 10 or whatever. The 1-5 voting system is harsh and a low average doesn't automatically make you terrible. So everyone should keep at it, nothing I heard was outright terrible and there's definitely a lot of promise going on.

And no Locke theme? Really guys? :P
__________________
Reply With Quote
  #395  
Old 06-20-2012, 08:51 PM
zircon's Avatar
zircon zircon is offline
Andrew Aversa, Voices of the Lifestream Director, Balance and Ruin Co-Director
Sheng Long (+10000)
OC ReMix Artist Profile
 
Join Date: Feb 2003
Location: Baltimore
Quote:
Originally Posted by Brad Stark View Post
Yea I know, but the numbers don't lie.

It looks like there were a lot of people spamming low votes which brought down the scores. If people were being "harsh" the voting would uniformly reflect low scores for everyone, but they do NOT. The lowest scores were only 1.7 average away from the top score. That is really absurd.

Looking at the third place vote: Sole Signal - "Throne Reborn" (313 pts).

With 91 voters that averages out to 3.4. For the third place track?? Kind of makes me feel better about my rediculous average score of 3.1. Whether it was a campagin of people trying to win or just a lot of composers spamming low votes for everyone else in the competition, it doesn't reflect too well on some people here.

I'd be interested to see if there was a bunch of people voting a small number of 5's and no 4's and mostly 3's and 2's because that's what it sure looks like.
I don't know why absolute scores are relevant here. We've already established that people have different views on what a "1" is, what a "3" is, etc. Even if I went out of my way to try and tell people how to vote, they would ignore it and vote the way they want. However, because each individual applies the same bias to every vote they do, it all evens out when you look at 91 total responses. One person might have an average low score, another person an average high, but they will still have remixes that they rate lower and higher than their average.

In other words, it doesn't matter that the top mix had a 3.4 (or what have you). It wouldn't matter if it had a 2.0. As long as there is enough of a spread to differentiate the rankings (and there was), it's good enough to say with confidence what entries people liked the most.

There are many other systems we could have used. For example, we could have asked people to name their top 3, 5 or 7 remixes. However, in such a system, there would be an enormous disparity between the mixes considered to be 'better' and those considered to be 'worse'. It would be basically impossible for mixes in, say, the 25th percentile to beat those in the 5th percentile. It's not a good system. This one is definitely the most fair that I (or anyone else) could think of.

Finally, again, I didn't see any evidence of irregular voting patterns.
__________________
Original albums, tutorials, videos, free music at zirconMusic

Kontakt samples for composers & remixers: Impact Soundworks

twitter | facebook | youtube

Last edited by zircon; 06-20-2012 at 08:53 PM.
Reply With Quote
  #396  
Old 06-20-2012, 09:04 PM
Melbu Frahma's Avatar
Melbu Frahma Melbu Frahma is offline
David
Akuma (+1100)
 
Join Date: Mar 2010
Quote:
Originally Posted by zircon View Post
However, because each individual applies the same bias to every vote they do, it all evens out when you look at 91 total responses. One person might have an average low score, another person an average high, but they will still have remixes that they rate lower and higher than their average.
^

Tried to get at that with my last post.

Quote:
Originally Posted by zircon View Post
In other words, it doesn't matter that the top mix had a 3.4 (or what have you). It wouldn't matter if it had a 2.0. As long as there is enough of a spread to differentiate the rankings (and there was), it's good enough to say with confidence what entries people liked the most.
This. If anything, if you ask me you're looking at it the wrong way - treat what the top-ranked mix got as the ceiling for the spread (instead of a "perfect" 5), and all of a sudden that 3.4 looks a hell of a lot better.
__________________

Reply With Quote
  #397  
Old 06-20-2012, 09:54 PM
DrumJ8's Avatar
DrumJ8 DrumJ8 is offline
Goomba (+100)
 
Join Date: May 2012
Quote:
Originally Posted by zircon View Post
Even if I went out of my way to try and tell people how to vote, they would ignore it and vote the way they want.
Everyone will vote how ever they want, that's just going to happen. Yes, it would be better if everyone voted with certain criteria set in place, and the more sophisticated system the better, but that just isn't always going to be the case, and everyone's system will be different.

I have a lot to learn in terms of production (as evidenced in my 23rd and 25th place wa ha ) and I'm not as familiar with the source tracks as others may be. There are so many factors that go into everyone's individual opinions, but I think that the voting system put into place was as fair as it could be.

Admittedly, I based my voting mostly on enjoyability reminiscent of the Netflix star system (hated, didn't like, like, really liked, loved). It wasn't the best voting system but it's still valid. Everyone won't universally like and dislike the same tracks. E.g. my favorite tracks came in 1st place, and 18th place. And the 1st place winner XPRTNovice stated that his favorite track was Track 1, which I believe came in 19th place.

I think my point got diluted.. Anyway, the voting was going to have varying opinions and I don't think the voting system was at fault for that at all.
Reply With Quote
  #398  
Old 06-20-2012, 10:21 PM
Mikeaudio's Avatar
Mikeaudio Mikeaudio is offline
Michael Isel
Goomba (+100)
OC ReMix Artist Profile
 
Join Date: Mar 2007
Location: Pittsburgh
Lets not all forget, that voting from 1 - 5 through an ocremix.org contest, is a heck of alot better than what other websites would demand requiring quality (no disrespect to other websites e.g. newgrounds). If 5 means perfect, then 3 still would mean pretty darn good and a 1 would mean that it needs work. Needs work doesn't mean its crap. And lets not forget that one of the biggest functionalities that ocremix has besides providing quality remixes for videogame music lovers is pushing engineers,musicians, producers and whoever will send in their mixes to be better at what they do. I know I'm not the only one who has learned quite alot about my craft from just sending in remixes and reading and studying the judge panel comments.
__________________
Reply With Quote
  #399  
Old 06-20-2012, 10:37 PM
Fictionalhead's Avatar
Fictionalhead Fictionalhead is offline
Dan Meyer
 
Join Date: May 2012
Send a message via AIM to Fictionalhead Send a message via MSN to Fictionalhead Send a message via Skype™ to Fictionalhead
Quote:
Originally Posted by Rexy View Post
In other words... with the exception of Fictionalhead's tracks, all of them are in alphabetical order for arrangement title. Shouldn't be too hard to figure out.
There was an email problem getting mine submitted, so I think they got tacked on the end My only concern was that in being the dead last tracks not as many people would listen to them. I think the last time I checked (a week or so before the end of voting), the first song in the poll had like 250 listens, and my track (the last one) had like 100.

So at bare minimum it would seem at least 150 people started the poll, and then stopped before getting to my track, or *gulp* voted for mine without actually listening to it. Which I sincerely hope no one would do (to me or anyone). Though the fact that both of my tracks which were dead last in the list scored exactly the same is a little disheartening. But oh well, the vote's the vote.

Quote:
Originally Posted by Brad Stark View Post
With 91 voters that averages out to 3.4. For the third place track?? Kind of makes me feel better about my rediculous average score of 3.1. Whether it was a campagin of people trying to win or just a lot of composers spamming low votes for everyone else in the competition, it doesn't reflect too well on some people here.
I know for myself, I used the whole scale. Obviously all of the tracks had enough originality and production to push them into the 3-5 range. So that considered, if we followed your logic, you'd only have 2 points to fluctuate between 34 tracks. I know when I listened to them I had more opinion than that. There was definitely more than just 2 point differentiation between the ones I loved (#14 - Meccaneer was my fave, followed by #7 - Rexy, good job), and the ones I didn't care for.

So for that reason, I weighted my scoring. I gave 1's to the tracks I liked least, and 5's to those I liked most. Yeah, it's kind of against what the rules said to judge on, but again, if we were only taking into account the quality of the track distanced from our own personal taste, there would be no reason for public voting at all really.

Quote:
Originally Posted by zircon View Post
However, because each individual applies the same bias to every vote they do, it all evens out when you look at 91 total responses.
And this too, is another reason it doesn't matter. If you inflate this effect to it's maximum impact, then the people like me who used the full scale (1 = least liked, 5 = most liked), we just influenced the scoring less than someone who used a scale like (3 = least liked, 5 = most liked), because over the course of our whole survey, we gave out fewer points towards the final total. The only way to avoid this would be to have a voting scale of 1-34, where you had to rank each song once, to make sure everyone doled out the same amount of points, and that's just ridiculous and unrealistic.

And on a side note, to all us guys who scored in the middle (woo, #18 pride!), think of it this way -- You probably didn't have people saying they absolutely 5'ed it, but you didn't have people absolutely 1'ing it either. We are the "yeah, this is pretty good" tracks that didn't eclipse the stand-outs, or fall into obscurity. Or at least that's what I like to tell myself

Kudos to everyone -- the full track zip file makes for a good playlist.
Reply With Quote
  #400  
Old 06-20-2012, 11:03 PM
zircon's Avatar
zircon zircon is offline
Andrew Aversa, Voices of the Lifestream Director, Balance and Ruin Co-Director
Sheng Long (+10000)
OC ReMix Artist Profile
 
Join Date: Feb 2003
Location: Baltimore
I do apologize that I wasn't able to get total randomization, eg. each user would get tracks in a different order. I couldn't find any way to do it without spending hundreds of dollars.
__________________
Original albums, tutorials, videos, free music at zirconMusic

Kontakt samples for composers & remixers: Impact Soundworks

twitter | facebook | youtube
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT. The time now is 02:57 PM.


Powered by vBulletin® Version 3.8.1
Copyright ©2000 - 2013, Jelsoft Enterprises Ltd.