Primary competition visual

Digital Green Crop Yield Estimate Challenge

Helping India
€9 400 EUR
Completed (almost 3 years ago)
Prediction
1380 joined
677 active
Starti
04 Sep 23
Closei
03 Dec 23
Reveali
03 Dec 23
User avatar
tomy4reel
Nexford University
ID_ECWVAC40SNWB not scored
Help · 4 Dec 2023, 10:58 · 8

I tried changing my prediction for ID_ECWVAC40SNWB from around 6000 to 0 but observed no difference in both public and private lb

Discussion 8 answers
User avatar
Koleshjr
Upvotes 3
User avatar
yanteixeira

This ID was one of my potential outliers. It seems that the outliers, which we already knew existed, were actually not counted towards the final score. It's a strange decision by Zindi.

Upvotes 5
User avatar

Because of the metric, we're asked to make a model that predicts mainly the outliers. Then proceeds to remove them from the test data :)

Upvotes 4
User avatar
Koleshjr

haha

Upvotes 0
User avatar
kamelyamani

Thank you @tomy4reel to pointing out this issue !

Upvotes 1
User avatar

How do you detect outliers in the test sets?

Is it like, the values where different models give very different results are suspicious, and then you waste a submission to change the value and see if score changes?

Upvotes 1
User avatar
Koleshjr

in simple terms: Lb probing but thats easy for the public test set, the hard part is for the private test set, now that requires skills, and lots of hoping you made the right decision but for a guy like @kamelyamani he is good at it, and he has promised to share how he did it

Upvotes 1
User avatar
kamelyamani

@db @Koleshjr I’ve just shared my solution here: https://zindi.africa/competitions/digital-green-crop-yield-estimate-challenge/discussions/19719

Upvotes 0