Primary competition visual

Lacuna Solar Survey Challenge

Helping Madagascar
$5 000 USD
Completed (over 1 year ago)
Computer Vision
Prediction
737 joined
247 active
Starti
14 Feb 25
Closei
23 Mar 25
Reveali
24 Mar 25
True evaluation metric for Lacuna Solar Survey Challenge ?
Platform · 15 Mar 2025, 00:07 · 5

Dear @AJoel , could you please confirm that the evaluation script for this challenge is indeed using MAE .

I have just made some experiment on my best submission which makes me believe that the metric used for this challenge is RMSE .

Looking forward to hearing your answer on this .

@zindi

Discussion 5 answers
User avatar
nymfree

interesting

Upvotes 0
User avatar
Muhamed_Tuo

Hey @PUBG, do you mind elaborating on the experiment you did to come to this conclusion ?

Upvotes 0
User avatar

I have clipped my target values to 100 and this has significantly increases my LB score by 0.6 ~ .

Upvotes 1
User avatar
AJoel

Hi @PUBG

The evaluation metric for the Lacuna Solar Challenge is MAE.

Upvotes 1