Skip to content

Actions: ParsaVictor/code-context-engine

Actions

Continuous Empirical Benchmarking

Actions

Loading...
Loading

Show workflow options

Create status badge

Loading
benchmark.yml
289 workflow runs
289 workflow runs

Filter by Event

⌥ + click/return to exclude

Filter by Status

⌥ + click/return to exclude

Filter by Branch

⌥ + click/return to exclude

Filter by Actor

⌥ + click/return to exclude
Continuous Empirical Benchmarking Continuous Empirical Benchmarking #289: Scheduled
1m 22s main
main
1m 22s
Issue mode: long reports use the whole-question ranking (SWE-bench Lite dev hit@3 0.250 → 0.583) Continuous Empirical Benchmarking #288: Pull request #131 synchronize by ParsaVictor
1m 52s phase-n/issue-mode
phase-n/issue-mode
1m 52s
Issue mode: long reports use the whole-question ranking (SWE-bench Lite dev hit@3 0.250 → 0.583) Continuous Empirical Benchmarking #287: Pull request #131 synchronize by ParsaVictor
1m 46s phase-n/issue-mode
phase-n/issue-mode
1m 46s
Issue mode: long reports use the whole-question ranking (SWE-bench Lite dev hit@3 0.250 → 0.583) Continuous Empirical Benchmarking #286: Pull request #131 synchronize by ParsaVictor
1m 55s phase-n/issue-mode
phase-n/issue-mode
1m 55s
Issue mode: long reports use the whole-question ranking (SWE-bench Lite dev hit@3 0.250 → 0.583) Continuous Empirical Benchmarking #285: Pull request #131 synchronize by ParsaVictor
1m 44s phase-n/issue-mode
phase-n/issue-mode
1m 44s
Issue mode: long reports use the whole-question ranking (SWE-bench Lite dev hit@3 0.250 → 0.583) Continuous Empirical Benchmarking #284: Pull request #131 opened by ParsaVictor
1m 54s phase-n/issue-mode
phase-n/issue-mode
1m 54s
Optional code-aware embeddings (jina-code v2): ripgrep plain-language… Continuous Empirical Benchmarking #283: Commit 66c1344 pushed by ParsaVictor
4m 53s main
main
4m 53s
Optional code-aware embeddings (jina-code v2): ripgrep plain-language 0.500 → 0.667 recall, 0.156 → 0.347 precision Continuous Empirical Benchmarking #282: Pull request #130 synchronize by ParsaVictor
1m 57s phase-j2/jina-code
phase-j2/jina-code
1m 57s
Optional code-aware embeddings (jina-code v2): ripgrep plain-language 0.500 → 0.667 recall, 0.156 → 0.347 precision Continuous Empirical Benchmarking #281: Pull request #130 opened by ParsaVictor
1m 10s phase-j2/jina-code
phase-j2/jina-code
1m 10s
Measured: outside baselines + fresh click holdout; packet: folds once… Continuous Empirical Benchmarking #280: Commit 8c24855 pushed by ParsaVictor
1m 47s main
main
1m 47s
Measured: outside baselines + fresh click holdout; packet: folds once, server guesses not 'missing' Continuous Empirical Benchmarking #279: Pull request #129 synchronize by ParsaVictor
1m 26s gold/concept-holdout2
gold/concept-holdout2
1m 26s
Measured: outside baselines + fresh click holdout; packet: folds once, server guesses not 'missing' Continuous Empirical Benchmarking #278: Pull request #129 opened by ParsaVictor
1m 54s gold/concept-holdout2
gold/concept-holdout2
1m 54s
plain-language questions trust the whole-question ranking; skeleton n… Continuous Empirical Benchmarking #277: Commit d7d1120 pushed by ParsaVictor
1m 47s main
main
1m 47s
Plain-language: trust the whole-question ranking; fix skeleton panic; baseline comparison script Continuous Empirical Benchmarking #276: Pull request #128 opened by ParsaVictor
1m 48s phase-k/plain-language-evidence
phase-k/plain-language-evidence
1m 48s
1.1.0: plain-language questions (ripgrep holdout 0.042 → 0.500), stdo… Continuous Empirical Benchmarking #275: Commit 541490c pushed by ParsaVictor
2m 2s main
main
2m 2s
1.1.0: plain-language questions (ripgrep holdout 0.042 → 0.500), stdout fix, cold start Continuous Empirical Benchmarking #274: Pull request #127 synchronize by ParsaVictor
1m 48s concept/gold-and-fixes
concept/gold-and-fixes
1m 48s
1.1.0: plain-language questions (ripgrep holdout 0.042 → 0.500), stdout fix, cold start Continuous Empirical Benchmarking #273: Pull request #127 synchronize by ParsaVictor
2m 0s concept/gold-and-fixes
concept/gold-and-fixes
2m 0s
1.1.0: plain-language questions (ripgrep holdout 0.042 → 0.500), stdout fix, cold start Continuous Empirical Benchmarking #272: Pull request #127 synchronize by ParsaVictor
1m 50s concept/gold-and-fixes
concept/gold-and-fixes
1m 50s
1.1.0: plain-language questions (ripgrep holdout 0.042 → 0.500), stdout fix, cold start Continuous Empirical Benchmarking #271: Pull request #127 synchronize by ParsaVictor
1m 47s concept/gold-and-fixes
concept/gold-and-fixes
1m 47s
1.1.0: plain-language questions (ripgrep holdout 0.042 → 0.500), stdout fix, cold start Continuous Empirical Benchmarking #270: Pull request #127 opened by ParsaVictor
1m 37s concept/gold-and-fixes
concept/gold-and-fixes
1m 37s
fix(mcp): keep stdout for JSON-RPC only (#126) Continuous Empirical Benchmarking #269: Commit b9efbaa pushed by ParsaVictor
2m 5s main
main
2m 5s
fix(mcp): keep stdout for JSON-RPC only Continuous Empirical Benchmarking #268: Pull request #126 opened by ParsaVictor
2m 9s fix/mcp-stdout-clean
fix/mcp-stdout-clean
2m 9s
Continuous Empirical Benchmarking Continuous Empirical Benchmarking #267: Scheduled
1m 52s main
main
1m 52s
github: a code of conduct written for this project (#125) Continuous Empirical Benchmarking #266: Commit bdd6ede pushed by ParsaVictor
1m 37s main
main
1m 37s
github: a code of conduct written for this project Continuous Empirical Benchmarking #265: Pull request #125 opened by ParsaVictor
1m 52s code-of-conduct
code-of-conduct
1m 52s