Primary competition visual

Absa Customer Income Prediction Challenge

Helping South Africa
$5 000 USD
Completed (over 3 years ago)
Prediction
347 joined
53 active
Starti
29 Nov 22
Closei
26 Feb 23
Reveali
26 Feb 23
User avatar
Pieterkii
Submission format and data
Data Ā· 13 Dec 2022, 10:50 Ā· 7

Unless I missed something, I think the competition description and sample submission are misleading as they both suggest a submission with raw NET income; I realised from the leaderboard errors that I should submit group codes instead (unless the entire public set just happens to be incomes less than R20.)

Considering people's scores: an RMSE of 5 isn't very good since it means that the predictions have a standard deviation of 5 income groups, so I don't think anyone is submitting the format expected.

Discussion 7 answers
User avatar
skaak

?

Look at this thread https://zindi.africa/competitions/absa-customer-income-prediction-challenge/discussions/14364

I think you need to submit net income / 1000

Upvotes 0
User avatar
Pieterkii

Thanks, would be nice if this was stated somewhere.

Upvotes 1
User avatar
skaak

Agree!

This *needs* to be stated explicitly.

@zindi @amyflorida626 this probably will continue to cause confusion, can you perhaps clarify somewhere visible that we have to predict

income / 1000

in the subs.

Upvotes 1
User avatar
skaak

Thanks amy!

Hmmmm - it does make a difference. I just subbed two files. The same content, but different formatting. The one looks something like this

xxxx,6.830256795307339

and the other follows Train formatting

xxxx,"6,830.256795307339"

and there is a *small* difference in score.

Upvotes 1
User avatar
skaak

No prob amy, of course, we all make mistakes ... that no matter, bounce back is what matters!

Thanks for discussion post, I think that will really be great to clarify to all.

Perhaps scoring system is also partly to blame - it should have rejected the funny format, how does it know to score correctly?

Anyhow, thanks amy ... look forward to the post

Upvotes 0
User avatar

After reading these posts, including "Updated reference file: back to basics". I am still unsure of the format needed for the DECLARED_NET_INCOME in the submission.

If my ML predicts that a customer's DECLARED_NET_INCOME is R1 234,56 then which of these is a correct submission?:

a) 1234.56

b) 1.23456

c) other?

Upvotes 0
User avatar
Pieterkii

The answer is a. At least I hope.

Upvotes 1