Skip to content

fix(distill): evaluate timeout 2h -> 5h - #178

Merged
ronaldtse merged 1 commit into
mainfrom
eval-timeout
Sep 4, 2026
Merged

fix(distill): evaluate timeout 2h -> 5h#178
ronaldtse merged 1 commit into
mainfrom
eval-timeout

Conversation

@ronaldtse

Copy link
Copy Markdown
Contributor

The Hebrew layerdrop full-set eval hit FunctionTimeoutError at the 2h ceiling (teacher ByT5-base + student over 1,864 long sentences). Raised to 5h per the measured-work precedent (parity's 12h raise, PR #144).

The s46-era Hebrew eval decodes a ByT5-base teacher plus the student
over 1,864 long sentences; the 2h ceiling killed full-set evals
mid-run and the watchdog restarted from scratch each time.
@ronaldtse
ronaldtse merged commit 6061827 into main Sep 4, 2026
3 checks passed
@ronaldtse
ronaldtse deleted the eval-timeout branch September 4, 2026 23:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant