It’s been ten days since the implementation of the new voting system, so I thought I would keep everybody up-to-date with how things are shaping up.
First thing to report is that voting is up. The number of basic votes cast per day added to the number of TPA votes cast per day is about 30% higher than the previous week’s number of basic votes cast. So it seems that many people were not using the old system and were encouraged by the new one. So for those who were afraid that the new voting system will lead to people moving away from voting, rest assured, it didn’t happen.
Second, the voting form wording change is affecting scores mildly. The median of votes cast after the change is lower. It currently stands at 8.00 compared to 8.82 prior to the change. Of course, the Q Score is compensating for this difference and the Q Scores are more consistent.
The number of TPA votes is about 30% of the basic votes number. So, it’s quite high. I didn’t expect it to be this high. So, I’m not going to keep individual TPA votes indefinitely. I can’t. I haven’t decided how long to keep them, I’ll wait for future development to guide this decision.
The Appeal component of the TPA is now a part of the Q Score. It’s processed as a basic score.
During the implementation, I changed the minimum number of votes needed to show the score on the site from 10 to 15.
The expected developments are that some authors and few readers are still trying to find a concrete relationship between the Q Score and the regular score and since they don’t have any hard numbers, many are just ending up being confused and already declaring the new system to be a failure.
My advice to those who are trying to correlate the scores is: Don’t. You don’t have the numbers and if I gave you the exact formula, you will still be missing the data used in the formula to calculate things.
Yes, relative positions of stories may change between the old score and the Q Score and that’s because different posting and updating dates of stories affect the Q Score a lot. So unless you can dig the data from the database, the exact formula won’t be much help.
The unexpected development is that so far, I’m getting a lot more support for the Q Score from readers and few authors. I’ve received many requests to remove the old scores completely and just leave the Q Score and the TPA (many of those requests came from premier members). Reasons given in the requests are that the score next to the Q Score are confusing things and that with all the data presented in the tables, there is too much info to scan through making the site harder to use.
I’m starting to lean in that direction already. If I receive more requests of the same, I will start the process of removing the old average scores and just leave the Q Scores. When/If I start that change I will make it so that the TPA score is also hidden if the number of votes is below 15.