Skip to content

Actions: EvolvingLMMs-Lab/lmms-eval

Actions

All workflows

Actions

Loading...
Loading

Showing runs from all workflows
2,500+ workflow runs
2,500+ workflow runs

Filter by Workflow

⌥ + click/return to exclude

Filter by Event

⌥ + click/return to exclude

Filter by Status

⌥ + click/return to exclude

Filter by Branch

⌥ + click/return to exclude

Filter by Actor

⌥ + click/return to exclude
fix(mmmu_pro): parse vision answers and read the explicit 'Answer: X'… Claude Code #1500: Issue comment #1545 (comment) created by pufanyi
9s
9s
ci: enforce E2E evidence for existing evaluation code (#1547) Lint #3686: Commit 42296f8 pushed by pufanyi
22s main
main
22s
ci: enforce E2E evidence for existing evaluation code (#1547) PR Evidence Validator Tests #2: Commit 42296f8 pushed by pufanyi
45s main
main
45s
ci: enforce E2E evidence for existing evaluation code (#1547) Line Stats #205: Commit 42296f8 pushed by pufanyi
8s main
main
8s
ci: enforce E2E evidence for existing evaluation code (#1547) Hermetic CPU Contracts #92: Commit 42296f8 pushed by pufanyi
2m 28s main
main
2m 28s
ci: enforce E2E evidence for existing evaluation code PR Evidence Validator Tests #1: Pull request #1547 opened by pufanyi
11s fix/require-e2e-evidence-for-runtime-changes
fix/require-e2e-evidence-for-runtime-changes
11s
ci: enforce E2E evidence for existing evaluation code Lint #3685: Pull request #1547 opened by pufanyi
27s fix/require-e2e-evidence-for-runtime-changes
fix/require-e2e-evidence-for-runtime-changes
27s
ci: enforce E2E evidence for existing evaluation code Hermetic CPU Contracts #91: Pull request #1547 opened by pufanyi
1m 17s fix/require-e2e-evidence-for-runtime-changes
fix/require-e2e-evidence-for-runtime-changes
1m 17s
ci: enforce E2E evidence for existing evaluation code PR E2E Evidence #13: Pull request #1547 opened by pufanyi
9s
9s
relax_exact_match treats free-text ground truths beginning with A-H as multiple-choice letters, so wrong answers sharing the gold's first letter score 1.0 (chartqa_reasoning) Claude Code #1499: Issue #1546 opened by shaurya416
1s
1s
fix(mmmu_pro): parse vision answers and read the explicit 'Answer: X'… PR E2E Evidence #12: Pull request #1545 ready_for_review by superAIyah
7s
7s
fix(mmmu_pro): parse vision answers and read the explicit 'Answer: X'… PR E2E Evidence #11: Pull request #1545 edited by superAIyah
8s
8s
fix(mmmu_pro): parse vision answers and read the explicit 'Answer: X'… PR E2E Evidence #10: Pull request #1545 edited by superAIyah
12s
12s
fix(mmmu_pro): parse vision answers and read the explicit 'Answer: X'… PR E2E Evidence #9: Pull request #1545 edited by superAIyah
10s
10s
fix(mmmu_pro): parse vision answers and read the explicit 'Answer: X'… Hermetic CPU Contracts #90: Pull request #1545 synchronize by superAIyah
9m 22s superAIyah:fix/mmmu-pro-answer-marker
superAIyah:fix/mmmu-pro-answer-marker
9m 22s
fix(mmmu_pro): parse vision answers and read the explicit 'Answer: X'… Lint #3684: Pull request #1545 synchronize by superAIyah
27s superAIyah:fix/mmmu-pro-answer-marker
superAIyah:fix/mmmu-pro-answer-marker
27s
fix(mmmu_pro): parse vision answers and read the explicit 'Answer: X'… task-input-ab #420: Pull request #1545 synchronize by superAIyah
2m 27s superAIyah:fix/mmmu-pro-answer-marker
superAIyah:fix/mmmu-pro-answer-marker
2m 27s
fix(mmmu_pro): parse vision answers and read the explicit 'Answer: X'… PR E2E Evidence #8: Pull request #1545 synchronize by superAIyah
9s
9s
fix(mmmu_pro): parse vision answers and read the explicit 'Answer: X'… task-input-ab #419: Pull request #1545 opened by superAIyah
2m 18s superAIyah:fix/mmmu-pro-answer-marker
superAIyah:fix/mmmu-pro-answer-marker
2m 18s
fix(mmmu_pro): parse vision answers and read the explicit 'Answer: X'… Hermetic CPU Contracts #89: Pull request #1545 opened by superAIyah
1m 21s superAIyah:fix/mmmu-pro-answer-marker
superAIyah:fix/mmmu-pro-answer-marker
1m 21s
fix(mmmu_pro): parse vision answers and read the explicit 'Answer: X'… Lint #3683: Pull request #1545 opened by superAIyah
21s superAIyah:fix/mmmu-pro-answer-marker
superAIyah:fix/mmmu-pro-answer-marker
21s
fix(mmmu_pro): parse vision answers and read the explicit 'Answer: X'… PR E2E Evidence #7: Pull request #1545 opened by superAIyah
8s
8s
feat(mmstar): add mmstar_hybrid, a per-question answer-format protocol PR E2E Evidence #6: Pull request #1522 edited by superAIyah
9s
9s
feat(mmstar): add mmstar_hybrid, a per-question answer-format protocol Lint #3682: Pull request #1522 synchronize by superAIyah
25s superAIyah:feat/mmstar-hybrid-protocol
superAIyah:feat/mmstar-hybrid-protocol
25s
feat(mmstar): add mmstar_hybrid, a per-question answer-format protocol task-input-ab #418: Pull request #1522 synchronize by superAIyah
2m 35s superAIyah:feat/mmstar-hybrid-protocol
superAIyah:feat/mmstar-hybrid-protocol
2m 35s