Primary competition visual

Kenya Clinical Reasoning Challenge

Helping Kenya
$10 000 USD
Completed (over 1 year ago)
Prediction
Natural Language Processing
SLM
1676 joined
439 active
Starti
03 Apr 25
Closei
29 Jun 25
Reveali
30 Jun 25
User avatar
Knowledge_Seeker101
Freelance
Community Idea: On Metrics
Platform · 2 Jul 2025, 20:39 · 4

Hey Zindians! 👋 I’ve been thinking about how we can make our competitions even more impactful and aligned with real-world needs. One idea that came to mind is this: 💡 What if Zindi involved the community in selecting the evaluation metric before the actual competition starts? Here’s how it could work: 🔹 A “placebo” challenge is launched with just the problem statement and a sample dataset. 🔹 Zindians propose custom evaluation metrics along with baseline models or justifications for why their metric makes sense. 🔹 The most optimal, fair, and client-aligned metric is then selected — and used in the real competition. This would: ✅ Engage the community beyond just competing ✅ Promote fairness and innovation in how solutions are scored ✅ Ensure better alignment with what the client actually values It could even come with small rewards for the best metric proposals. What do you think, fellow Zindians? @Zindi

Discussion 4 answers
User avatar
yehoshua

Great 😃

Upvotes 1
User avatar
DavisyAmbassador
Zindi Ambassador

I real do like the idea and I support it.

Upvotes 2
User avatar
meganomalyZindi Staff
Zindi staff member

Hey @Knowledge_Seeker101 I love this suggestion, thank you for sharing it! We agree that getting the community involved in shaping evaluation metrics could drive fairness, innovation, and real-world impact. We’ll see if we can test out this approach in a future challenge and gather feedback from the community on how it works in practice. Stay tuned!

Upvotes 2
User avatar
Knowledge_Seeker101

That's great 👍 thank you for the consideration

Upvotes 0