AI4D Africa’s Anglophone Research Lab Tanzania Tourism Classification Challenge
Helping Tanzania, United Republic of
$1 000 USD
Completed (over 4 years ago)
Classification
525 joined
180 active
Start
01 Jun 22
Close
01 Jul 22
Reveal
01 Jul 22
Submission Leaderboard Scoring
Help · 9 Jun 2022, 14:20 · 2
I think there might be an issue with the scoring formula used on the leaderboard.
For example, I randomly changed the name of the columns from ['High Cost', 'Higher Cost', 'Highest Cost', 'Low Cost', 'Lower Cost', 'Normal Cost'] to ['High Cost', 'Higher Cost', 'Lower Cost', 'Normal Cost', 'Low Cost', 'Highest Cost'], and I got the same log loss score on the leaderboard for both submissions.
Should this be? I'm just wondering
There might be a problem in this case I did this and I got different score.
If it's the same log loss you meant to say, then yes, irrespective of how you arrange the columns you should get the same score.
However if you meant different scores on the leaderboard after shuffling the columns, then there is an issue with calculating the logloss score from @Zindi