this post was submitted on 27 Dec 2024
61 points (91.8% liked)

Anime

2018 readers
72 users here now

This community is the place to discuss and ask questions about anime, anime news, and related topics.

Currently airing show discussion threads are created by our resident bot, rikka@ani.social. If it doesn't make a thread for an episode that you want to discuss, see the user guide on the wiki for instructions on how to ask rikka to make a thread for you to use.

Check out our wiki to find:

Rules

More complete rules on the wiki.

Related General Communities

rikka

founded 2 years ago
MODERATORS
 

Vote Here!

I hope everybody is having a great end of the year! I just wanted to remind everybody that voting is closing at ~05:00 UTC on December 30th for the Anime Awards. In case you missed it, there are also other mediums you can vote for:

Finally, a shout out to @NineSwords@ani.social for the graphic.

you are viewing a single comment's thread
view the rest of the comments
[–] tobogganablaze@lemmus.org 6 points 1 week ago (1 children)

If I don't know a show and just don't select anything, that's hopefully is not the same as giving it a 0 score, right?

[–] wjs018@ani.social 7 points 1 week ago (2 children)

It does. There was a bit of a discussion about this in the voting announcement thread here. Basically, I wanted to do ranked choice voting, which isn't as punishing to shows that don't get a vote, but that type of question didn't work in some browsers, so we fell back to the STAR voting. It should still result in more accurate results than a single, non-transferable vote though. It's something I want to fix for the next time we do this (if we do).

[–] Endmaker@ani.social 2 points 6 days ago* (last edited 6 days ago) (1 children)

If you implemented the voting algorithm (STAR in this case) in the code instead of just using a library, consider implementing this more generalized variant of STAR; not sure if there is a name for it:

Instead of scoring candidates from 0 to 5, allow voters to give scores between m and n inclusive, where m and n are integers. If the voter choose not to give a score to a candidate, assign a default score of k where k is an integer and m <= k <= n

For example,

m = -2  # minimum score
k = 0  # default score
n = 3  # maximum score

What I liked about scoring methods - that I'm unsure if ranked-choice voting methods can achieve - is how expressive a voter can be.

For example, if I like anime A way more than anime B and hence want to give A a much higher chance of winning, I can express it in my scores (e.g. by giving A a score of 3 and B a score of 0)

Another case is if I absolute detest an anime C, I would be able to give it a score of -2.

Note that allowing negative scores likely come with its own problems, especially with strategic voting.

Also note that the typical scoring method - that's being used for Lemmy ani.social awards right now - simply uses the following parameters:

m = 0  # minimum score
k = 0  # default score
n = 5  # maximum score

I don't think other commenters' complaints are really about STAR itself, but its parameters of m, n and k during the scoring phase.

If these parameters can be properly tuned such that unvoted candidates get a middle score instead of the lowest score, that should solve the problem where these unvoted candidates appear to be voted against.

P.S. I'm still of the opinion that these awards are just another form of popularity contest, so if a candidate hardly get voted for because it was barely watched by most of the voters, that means that majority of the voters won't really want it to win anyway.

[–] wjs018@ani.social 4 points 6 days ago

these awards are just another form of popularity contest

Pretty much what they are guaranteed to be. If people are looking to things like this to uncover hidden gems, then they are looking in the wrong place. Something like a critic's awards would be better (or something like the jury selections from the reddit awards).

Your idea of modifying the default behavior of STAR is interesting. I don't think I will have time to whip that together before the end of this awards campaign, but it is something you could kind of simulate by replacing the scores of all the blanks as the average of the non-blanks. That moves any blank responses closer to the k value in your examples.

I plan on releasing all the votes and the code I used to analyze them in a github repo so people can use their own tools to visualize or analyze the votes as they see fit (at least for anime + manga; ln's are a bit trickier due to the low number of responses). So, we could essentially re-run the votes using alternate systems to see how things may or may not have changed.

For the sake of this awards season, I am just going to count blanks as a 0 since that is the default STAR behavior and what is implemented in the library I am using.

[–] tobogganablaze@lemmus.org 7 points 1 week ago

I didn't catch that. Now I feel sorry for some shows I've heard great things about but didn't vote on.

Also if Frieren doesn't win all categories, I'm calling electetion fraud. So you better find me some votes!