Primary competition visual

Wadhwani AI Bollworm Counting Challenge

Helping India
€15 000 EUR
Completed (almost 4 years ago)
Object Detection
Computer Vision
845 joined
145 active
Starti
23 Sep 22
Closei
04 Dec 22
Reveali
04 Dec 22
Shakeup
Connect · 3 Dec 2022, 13:31 · 25

Shakeup is coming... Good luck to everyone

Discussion 25 answers
User avatar

haha...lol, all the best!

Upvotes 1
User avatar
flamethrower

Maybe not, I think the guys at top are doing something special.

Upvotes 2
User avatar
Upvotes 0
User avatar

i doubt that the ground truths is correct.

in my case, there are several test images contains pbw, but when I put the count into the submission the MAE increases compare with when the count for those images is 0.

Upvotes 3
User avatar

I have also checked it seems to be correct

Upvotes 0
User avatar

'id_0660586f3ed26178d08c6636.jpg',

'id_0b2ce8235c041126ca62d9c1.jpg',

'id_0c2a4b8393c3c0dc26fe18bb.jpg',

'id_15fc1f078865759ff45638e6.jpg',

'id_169f24d5f7cb7b21fe60df1e.jpg',

'id_1c96db4131c3fab81949a9fd.jpg',

'id_22e2598aa43a8cd0a7fdb5df.jpg',

'id_2510cb8b891d54dd1570ecc5.jpg',

'id_253e58c20f3dfbcef9db86c5.jpg',

For example, can you check these?

Upvotes 0
User avatar

It seems to be another worms? None of them when I put count for has improve my LB

Upvotes 0
User avatar

i don't think it's another worms :v

Upvotes 1
User avatar

oh really? So your opinion is ground truths are not correct?

Upvotes 0
User avatar

yes, since they said they annotated them automatically by tool.

Here is the full list:

'id_0660586f3ed26178d08c6636.jpg',

'id_0b2ce8235c041126ca62d9c1.jpg',

'id_0c2a4b8393c3c0dc26fe18bb.jpg',

'id_15fc1f078865759ff45638e6.jpg',

'id_169f24d5f7cb7b21fe60df1e.jpg',

'id_1c96db4131c3fab81949a9fd.jpg',

'id_22e2598aa43a8cd0a7fdb5df.jpg',

'id_2510cb8b891d54dd1570ecc5.jpg',

'id_253e58c20f3dfbcef9db86c5.jpg',

'id_259990c7e44466c1853ac2fe.jpg',

'id_284f01098fe5bd92d93cc883.jpg',

'id_291c3927b05f73a336bd791f.jpg',

'id_2e7277d3546e5959d4c4b5ca.jpg',

'id_33dc6bd2f9f3c54ad6c03e1f.jpg',

'id_35d66ed5826a36d6e75053c6.jpg',

'id_38aed360b54c1e388e713440.jpg',

'id_447bca3dd59e31efab6719dd.jpg',

'id_4e186cb9161481297072821f.jpg',

'id_553f205c03ad2267d1073295.jpg',

'id_57701dfba47796b86b81e667.jpg',

'id_57eefc079173a65293e00c49.jpg',

'id_6055a3f37d25ac3a72d48b70.jpg',

'id_616bac757f4121ec2c319ff1.jpg',

'id_6737603b610159ab05ec356a.jpg',

'id_69378b6d40a23b51e72ed293.jpg',

'id_70986ad58af6664bf6fd5c6f.jpg',

'id_722d421d27db409c84cd90f1.jpg',

'id_75ec767e2219455019c1479c.jpg',

'id_78c79994c0fc9a2b4ccde17a.jpg',

'id_7e51b6cd7c803c9be4fbd0ab.jpg',

'id_8018014190322c8b2aa2cc25.jpg',

'id_8568d9e1533d530d168c7a04.jpg',

'id_8d0c3546d3ec9335339fbe32.jpg',

'id_8ddb685e1e2e2541bef9e6b1.jpg',

'id_91c21353aad56c62e5663129.jpg',

'id_9782d37ca668b5e66d4c3cfd.jpg',

'id_9a86018c21369815ffca0b07.jpg',

'id_a79b37b318ba77014b645ae0.jpg',

'id_a9cdb42497f9fd81c8e14880.jpg',

'id_b11d7e28d21c8c0b4507d94b.jpg',

'id_b8e7b3fe9aecae663a3cb687.jpg',

'id_ba6406be65dd3658d5d15bb9.jpg',

'id_bfda5d27ab0701de4cd48a40.jpg',

'id_bff124ee45fc42692656fd48.jpg',

'id_cba3ee362a28041a9c37641f.jpg',

'id_cf25b62de3e859747098a445.jpg',

'id_d696413c7f76d077d69bb605.jpg',

'id_e062aea6d9c3388be5e93ff1.jpg',

'id_e12b4de3a39da61ecadc349c.jpg',

'id_e76a6ba0911184c4bd8dd6b4.jpg',

'id_e86db6164f04c87a1a9ba7ed.jpg',

'id_eecae5c7d33eb81d2f308f8f.jpg',

'id_c9b824b2e88a356a98c4d25f.jpg',

'id_f89153e9ea4ee941935daef0.jpg'

Some may not change your MAE because it's in private test, but most of them will increase the MAE. I have manually check them by hand, and with yolo I can detect them as well, not another worms

Upvotes 0
User avatar

If so, would you trust your model or the ground truth?

Upvotes 0
User avatar

since they said in here: Worm count discrepancy - Zindi

could you trust the ground truth as there are errors in there?

Upvotes 1
User avatar

I think the boxes is correct. May be some error when they count the number of worms lead to different? I still suppose that your worms list above are not contains pbw

Upvotes 0
User avatar
Upvotes 0
User avatar

Waiting to see what the Magic Is

Upvotes 2
User avatar
Koleshjr

Maybe after the competition you guys share how you handled this problem? I am struggling breaking out from the 2.5-3 mae range. I would appreciate that. @mithilsalunkhe @tinyswish

Upvotes 0
User avatar

I will surely share it once I get the time

Upvotes 1
User avatar

@VictorDurnov @cloudyy be sure to share your approach later, it's very interesting :D

we've tried everything, we could think of, but couldn't manage to get CV lower than 1.45, we're waiting for your solution

edit: wild guess, - pseudo-labels, correct (some) labels with detector or something :D

Upvotes 3
User avatar

Nothing special in my case, I just was fooled with public leaderboard) I'm also interested to hear about the winning solutions

Upvotes 0
User avatar

I would be intrested in your solution too , how did you manage such a good public lb score

Upvotes 0
User avatar

It was just first simple regression model without using bboxes etc and it surprisingly give me 3rd place on public lb with first submission) So, this is fooled me)

What is your solution?

Upvotes 3
User avatar
Upvotes 2
User avatar

some kaggle GM magic :o

We've used swin-large, trained for 40 epochs, simple MAE, imgsize 384

We've tried beit_large with resolution 512, but it didn't improve the CV, as for the split, we first log-binarized the per-worm target and then stratified on these bins

But the best sub was with yolov7, detector works very well on private lb

Upvotes 1
User avatar

im using dino by detrex, however, i am still doubting the ground truth, minor error can lead to different private score

Upvotes 0
User avatar

I will share my solution later, but I've done overfit public LB :)

Upvotes 1