Primary competition visual

SUA Outsmarting Outbreaks Challenge

Helping Tanzania, United Republic of
$12 500 USD + AWS credits
Completed (almost 2 years ago)
Prediction
817 joined
390 active
Starti
06 Dec 24
Closei
31 Jan 25
Reveali
01 Feb 25
Linkage process
Help · 29 Dec 2024, 19:29 · 15

Idk why the starter notebook gives a higher score eventhough the linkage process in it is totally wrong , when i corrected it i found that it got lower score , any help ?

Discussion 15 answers
User avatar
Koleshjr

What do you mean the linkage process is totally wrong?? I think the approach used in the starter notebook is ssound enough? Given that there are no matching lat lon pairs the only other logical way is to use the closest lat lon pair or can you explain why it is wrong?

Upvotes 0
User avatar

Yes, but that is not enough. Consider looking for an example like ('ID_3a11929e-3317-476d-99f7-1bd9fb58f018_12_2022_Dysentery') for month == 12 and year == 2022. It has been linked with waste_Month_Year = 5_2021, toilet_Month_Year = 4_2020, and water_Month_Year_lat_lon = 12_2023_-8.62966_68.23589, which seems like a mess. While it is true that these places are close to each other, they provide incorrect information regarding the true date, which should be month == 12 and year == 2022. If I am wrong about anything, please explain where my mistake is.

Upvotes 2
User avatar
Koleshjr

Ah great! Thank youuu!! Also tbh you can get 6 score without the linkage process. So you should try that too. I am yet to find a good way to use the additional dataset to improve my score. I don't know if the 5 guys are using the additional datasets?

Upvotes 1
User avatar

yes my best score is without the additional datasets i removed them until i find a better approach , I think the 5 guys are using them but with another linkage approach

Upvotes 0
User avatar
Koleshjr

okay good luck , let's hope to reach the 5 guys

Upvotes 2
User avatar
Upvotes 1
User avatar
Koleshjr

damnnnnn that's crazzyyyyyy

Upvotes 1
User avatar
CodeJoe

I have given up😭😭

Upvotes 0
User avatar
Koleshjr

I mean don't, fight till the end. Never every give up. You don't know if you will find something creative along the way

Upvotes 2
User avatar
CodeJoe

@Koleshjr That's true, I think I'd continue. Thank you so much for the encouragement.

Upvotes 1
User avatar

When you say without the linkage process, you mean just using the train.csv file and ignoring the waste, and toilet csvs? I feel like there isnt enough info in this one file in order to build a good model but I may be missing something

Upvotes 0
User avatar
CodeJoe

Yes but it gives a good score.

Upvotes 1
User avatar

Using the raw data alone or would you recommend ensemble learning with different GB / tree models?

I also feel like theres something more we are missing. MAE scores offline dont seem to correlate well to LB scores lol

Upvotes 0
User avatar
CodeJoe

It can correlate if you group location before training. However you might get a score around 6. Honestly you can even get a 5 score with just one model from catboost to lightGBM. Xgboost did not really give me a good score. Good luck!

Upvotes 1