Primary competition visual

R.O.A.D. Barbados Historic Handwriting Challenge

Helping Barbados
$25 000 USD
Closing soon! (3 days left)
Optical Character Recognition
Natural Language Processing
1984 joined
749 active
Starti
03 Jul 26
Closei
04 Oct 26
Reveali
05 Oct 26
Rules clarification: self-training / pseudo-labeling on the test images
23 Jul 2026, 14:13 · 2

Hi Zindi team,

A rules clarification on using the test set during training.

Is it permitted to use the provided test images in training via self-training / transductive learning, specifically:

1. run our own trained models on the test images,

2. keep only high-confidence lines where several models agree (labels produced entirely in code, never manually),

3. add those test images + their model-generated labels back into the training set and continue training?

The constraints on our side:

- No external data; only the images provided for this challenge are used.

- No external labels; the pseudo-labels are generated in code by our own models from the provided test images; nothing comes from outside the competition.

- No manual labeling.

I ask because the rules say "you may use only the datasets provided" (the test set is provided data), but the clarification in the "hyperparameter search & training-data cleaning" thread noted decisions should be made "with no use of test data or external labels." Could you confirm whether that applies only to training-data cleaning, or whether using the test images for self-training is also disallowed?

Thanks!

Discussion 2 answers
User avatar

Could a Zindi organizer please confirm this explicitly? The rules permit openly available pretrained models and the challenge-provided datasets, but they do not clearly state whether Test images may be used transductively for pseudo-label self-training. Is the three-step workflow above allowed, or must the Test images be used only for inference? We will not use Test-image pseudo-labels for training unless Zindi confirms in writing that it is permitted.

Upvotes 0
User avatar

Im also wondering. Any updates?

Upvotes 0