Primary competition visual

Microsoft Learn Location Mention Recognition Challenge

$5 000 USD
Completed (~2 years ago)
Natural Language Processing
Generative AI
1284 joined
365 active
Starti
16 May 24
Closei
13 Oct 24
Reveali
13 Oct 24
User avatar
tungtung
Can the organizers refresh leaderboard?
Platform · 21 Sep 2024, 15:38 · 6

As we knew, the old data is flawed and the current leaderboard does not reflect new situtation. Maybe the organizers should delete old leaderboard and only show new submission after Sep 18?

Discussion 6 answers
User avatar
Muhamed_Tuo

Yeah, they really should reset it.

I stopped making any more submission because it's meaningless with the current standing.

Upvotes 1
User avatar
Moujoudix

keep in mind that the top 10% are required to share their code, so basically anyone that used unallowed dataset will be disqualified.

Upvotes 1
User avatar
MICADEE

@tungtung Well said. I just wish @zindi can make things easier for everyone. Because i am stuck and fed up. Seeing your model scores improving gradually on leaderboard is the source of inspiration for any participant on any platform. So i still don't understand why this is different.

Upvotes 2
User avatar

I don't know what has become of @zindi lately. This is very frustrating for participants.

Upvotes 0
User avatar
Koleshjr
Upvotes 0
User avatar
ZINDI

Hi everyone,

We are not resetting the leaderboard, as there is nothing preventing anyone from making the same flawed submissions after the reset. As always on Zindi, all submissions using disallowed data will be disqualified during code review.

We invite everyone who made submissions using the data leak to message us privately (zindi at zindi dot africa) to request that we remove those specific submissions from the leaderboard if they are interested in the leaderboard being a true reflection of current standings.

We recognise that this is not an ideal situation, but it is the best outcome given the circumstances. We appreciate your patience, understanding and support, and reassure you all that the best submission will win regardless of current leaderboard standings!

Upvotes 2