Primary competition visual

African Credit Scoring Challenge

Helping Africa
$5 000 USD
Completed (almost 2 years ago)
2064 joined
1020 active
Starti
29 Nov 24
Closei
12 Jan 25
Reveali
13 Jan 25
User avatar
josh_amayo
Oval
CV vs LB
Data · 3 Jan 2025, 16:03 · 7

Are people still having disparity between LB and CV? My CV has gone up to 0.91 but lb score still plateau-ing at 0.68. Seen many people break the 0.7 mark so curious how people got over this disparity

Discussion 7 answers
User avatar
preciousgift

Experiencing the same here.

Upvotes 1
User avatar
BanterGent96

2 theories:

1. Some of the people who have lb scores over 0.7 just have models that are highly overfit and their private scores will be lower

2. They genuinely have better models and found a clever way to account for the differences between the distributions of Train.csv and Test.csv as well as the imbalance in the data

Upvotes 2
User avatar
josh_amayo

Quite the conundrum, whether to trust the model with better Cv scores or lb scores

Upvotes 0
User avatar
Mohamed_Elnageeb

you h've got two submissions 😉

Upvotes 1
User avatar
josh_amayo

Haha true, will just submit the best of both and hope for the best

Upvotes 0
User avatar
EbiendeleAmbassador
Zindi Ambassador

The best advice is to trust your approach because the shake up is going to be crazy once the comp is over

Upvotes 0
User avatar
GIrum

it is just Good cross validation method solves a lil bit of this problem. for me my CV is 0.82 and LB is 0.72, it correlates well i guess

Upvotes 0