Unless I missed something, I think the competition description and sample submission are misleading as they both suggest a submission with raw NET income; I realised from the leaderboard errors that I should submit group codes instead (unless the entire public set just happens to be incomes less than R20.)
Considering people's scores: an RMSE of 5 isn't very good since it means that the predictions have a standard deviation of 5 income groups, so I don't think anyone is submitting the format expected.
?
Look at this thread https://zindi.africa/competitions/absa-customer-income-prediction-challenge/discussions/14364
I think you need to submit net income / 1000
Thanks, would be nice if this was stated somewhere.
Agree!
This *needs* to be stated explicitly.
@zindi @amyflorida626 this probably will continue to cause confusion, can you perhaps clarify somewhere visible that we have to predict
in the subs.
Thanks amy!
Hmmmm - it does make a difference. I just subbed two files. The same content, but different formatting. The one looks something like this
and the other follows Train formatting
and there is a *small* difference in score.
No prob amy, of course, we all make mistakes ... that no matter, bounce back is what matters!
Thanks for discussion post, I think that will really be great to clarify to all.
Perhaps scoring system is also partly to blame - it should have rejected the funny format, how does it know to score correctly?
Anyhow, thanks amy ... look forward to the post
After reading these posts, including "Updated reference file: back to basics". I am still unsure of the format needed for the DECLARED_NET_INCOME in the submission.
If my ML predicts that a customer's DECLARED_NET_INCOME is R1 234,56 then which of these is a correct submission?:
a) 1234.56
b) 1.23456
c) other?
The answer is a. At least I hope.