Primary competition visual

Kenya Clinical Reasoning Challenge

Helping Kenya
$10 000 USD
Completed (over 1 year ago)
Prediction
Natural Language Processing
SLM
1676 joined
439 active
Starti
03 Apr 25
Closei
29 Jun 25
Reveali
30 Jun 25
Does multi-prompt inference per sample require tighter per-prompt latency constraints?
Platform · 16 Jun 2025, 22:14 · 0

If I'm using multiple prompts per data point during inference, should I aim for a lower latency per prompt to keep overall processing time in check?

Discussion 0 answers