Forum Settings
Forums

How is variable "m" in the MAL score determined?

New
Feb 13, 2020 5:09 AM
#1

Offline
Oct 2019
14
Firstly, I was unsure where to put this. It still doesn't feel right in "support", but it definitely didn't fit anywhere else.

I tried to do a quick search using keywords and couldn't find anyone talking about this. In light of the recent changes to scoring and troll prevention, I wanted to bring this up.

I decided to take a peek at the actual scoring definition shown here: https://myanimelist.net/info.php?go=topanime

How is "m = Minimum number of scored users required to get a calculated score" actually decided?

Is it a flat value across all shows, or does it change based on variables? If it changes on variables, how does it change? This was the only missing component I found to that formula.
Feb 13, 2020 5:27 AM
#2

Offline
Feb 2020
48
It used to be a flat 50, but It's now changed and hidden to help prevent people from breaking the anti-brigade code.
Here's an internet archive of it before the changes.
Feb 13, 2020 5:48 AM
#3

Offline
Oct 2019
14
Dang, really? That kinda throws the whole score out the window then. I know these scores aren't supposed to be taken to the T, but it still is annoying to not know what the value is or how it may differ day to day, or even between shows if possible.

I get the need to prevent brigading, but I would think their new limits would be enough for that. Now that the value is arbitrarily variable, it kinda defeats the purpose of a score in the first place if you can't calculate it manually by hand.
Feb 13, 2020 5:59 AM
#4

Offline
Feb 2020
48
It also might still be a flat 50, and they simply forgot about mentioning it when they rewrote the page. I could't say for sure.
Feb 13, 2020 8:09 AM
#5

Offline
Feb 2010
34616
I just quickly checked out a few recently added music videos (since those are often unpopular and only have 1 episode so there are no scores that don't count because of the 1/5th rule) and on the surface it does indeed seem like the slightly raised the number, as I found one entry that had 65 scores displayed on the stats page but no score displayed yet.

But I also found an entry with 150 scores that already had a weighted scores so it has to be somewhere between 65 and 150 when an entry first crosses that threshold needed for a weighted score. Or it could be that 15+ scores from that first entry count as illegitimate accounts with the new algorithm and therefore don't count, and it still is 50 after all. Somehow I find that more likely, because I know that there are a bunch of bot accounts who just add every entry that gets added to the DB. But of course I don't know for sure what's the case.
I probably regret this post by now.
Feb 13, 2020 9:16 AM
#6
ᕙ(⇀‸↼‶)ᕗ

Offline
Aug 2014
8905
It is very likely keeping the 50 minimum scores, with a new check for account validity.

Examples:
Yume wo Misete has been scored by 55 users according to the score stats. 54 members are displayed on the main page for the weighted score (one user is not counting towards the weighted score).

Minna e wo Check has been scored by 59 users according to the score stats. No members are displayed on the main page with the weighted score kept as N/A (at least 10 users are not counting towards the weighted score).
KwanthemasterFeb 13, 2020 9:22 AM
Feb 13, 2020 11:05 AM
#7

Offline
Feb 2020
48
Kineta said:
When Xinil first designed the calculation this way, MAL's DB was super tiny and the minimum user count to give a weighted score was 50 members. All entries with less than 50 scored users were simple averages and could not enter the ranking. (So you'd see LNs with scores of 10.00 and 3 scored members.) We tossed the unweighted score for N/A with these changes, and adjusted m a bit in the calculation to insulate lower member entries from attack. The flip side of insulating them is that they also cannot stray as far from the average score of the database as they could before (until they get more scored users). Rokujouma no Shinryakusha has only 656 scored users, so if all scores were counted and m was still 50, it would even still be forced down by probably ~0.1. (Note: IMDb uses the same formula.)

This could very well be the case with Nogi Wakaba, too. However, since it has a lot of suspicious activity on it, I'll go through it manually to check.

Based on this post from the announcement thread, it seems like m has been changed to something other than 50.
Feb 13, 2020 11:08 AM
#8

Offline
Sep 2018
14390
It probably still is 50. Anime with vote briganding are calculated differently than with the traditional method though.
Feb 13, 2020 11:16 AM
#9
Lead Admin
Faerie Queen

Offline
Aug 2007
6423
Remember all the scores in the database are still updating and will be for many days yet (also probably why things are fluctuating by 0.01~0.02).

We decided not to make m public anymore. We don't give the database average score either, so in theory, the scores for low member series have never been able to be calculated perfectly. I don't think it will be super hard to figure out what it is, but at the same time, I think it has little meaning for most users while high meaning for potential malicious users.

More topics from this board

» Why is Myanimelist not working in Dubai?

ConstantReader - 4 hours ago

0 by ConstantReader »»
4 hours ago

» How do I transfer all my Anime onto a different account?

REKT - Dec 10, 2014

15 by Thunder_lol »»
Yesterday, 2:58 PM

» How can I see the date I added an entry to my list? (if I didn't mark an episode as watched)

EterTC - Feb 14, 2023

24 by ShaggyZE »»
Yesterday, 7:57 AM

Sticky: » Club President Request Thread ( 1 2 3 4 5 ... Last Page )

Kineta - Aug 7, 2010

783 by noDATAknown »»
Yesterday, 5:26 AM

» I would like to report some suspicious message I got.

jacobPOL - Oct 9

5 by jacobPOL »»
Oct 9, 2:31 PM
It’s time to ditch the text file.
Keep track of your anime easily by creating your own list.
Sign Up Login