Skip to content

About

Benchmark runs for keyline: every real-model run, its transcript and renders

Resources

Stars

0 stars

Watchers

0 watching

Forks

Latest commit

 

History

5 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 
 
 

Repository files navigation

keyline-bench

Benchmark runs for keyline: every real-model run, kept whole (prompt, every turn and tool call, renders, summary), so a change is judged on runs, not guesses.

  • reference-ad/: Claude Code builds the reference ad through keyline; one folder per run, results.tsv across runs.
  • versus-browser/: the same model makes the same images with keyline, HTML + headless Chrome, and Playwright MCP. Its README is the benchmark page on keyline.dev.

The harness is keyline's tests (tests/llm_e2e.rs, tests/versus_browser/). Check this repo out beside keyline as keyline-bench, or point KEYLINE_BENCH at it, and runs land here. Run them from keyline's root; the commands are in each README.

Licensed like keyline: FSL-1.1-ALv2.

About

Benchmark runs for keyline: every real-model run, its transcript and renders

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages