Skip to content

Add generic private grading delivery workflow / 增加通用私有阅卷交付流程 - #72

Merged
yyuan308 merged 1 commit into
mainfrom
codex/generic-grading-delivery-v5-4
Sep 1, 2026
Merged

yyuan308 merged 1 commit into
mainfrom
codex/generic-grading-delivery-v5-4

Conversation

@yyuan308

@yyuan308 yyuan308 commented Sep 1, 2026

Copy link
Copy Markdown
Collaborator

English

Summary

  • Makes the live grade-homework skill course-neutral: all score allocations, partial-credit rules, and subject-specific decisions now come only from a frozen course package.
  • Adds private roster validation, complete multi-page submission grouping, safe rendering manifests, grades.csv, review.csv, feedback records, and marked-page PNG/PDF output.
  • Requires praise annotations for score-bearing work, deduction annotations for non-full leaves, and review annotations for uncertainty in production mode.
  • Keeps Codex and Claude skill mirrors synchronized and records a reproducible v5.4 generic-delivery snapshot.

Validation

  • 495 benchmark-core tests passed.
  • 85 benchmark-physics compatibility tests passed.
  • Snapshot, registry, privacy audit, mirror synchronization, and ignored-data checks passed.

Privacy and limits

  • No roster, scan, answer, transcript, per-person grade, raw model output, or heldout data is included.
  • This change is a delivery-contract and synthetic-test revision only. It makes no course-specific accuracy, production, or teacher-replacement claim.

Next steps

  • Freeze a course-specific package with the course owner.
  • Run an owner-approved private dry run and inspect marked pages plus review.csv.
  • Obtain separate authorization before any model grading run or course-specific evaluation.

中文

内容

  • 将 live grade-homework skill 改为通用流程:分值、部分分、学科规则只来自本次冻结的 course package。
  • 增加私有 roster 校验、整份多页试卷聚合、安全渲染 manifest、grades.csvreview.csv、反馈记录和圈点 PNG/PDF。
  • 生产模式要求:有得分的作答必须有表扬标注,非满分必须有扣分标注,不确定项必须有复核标注。
  • 同步 Codex 与 Claude skill 镜像,并登记可复现的 v5.4 通用交付快照。

验证

  • 495 项 benchmark-core 测试通过。
  • 85 项 benchmark-physics 兼容测试通过。
  • 快照、registry、隐私审计、镜像同步和忽略数据检查均通过。

隐私与限制

  • 不包含 roster、扫描件、作答、转录、逐人分数、原始模型输出或 heldout 数据。
  • 本 PR 只实现交付合同和合成测试,不宣称课程准确率、生产能力或教师替代能力。

下一步

  • 与课程负责人冻结课程专属 package。
  • 在私有环境进行经授权的 dry run,并检查圈点页面与 review.csv
  • 任何模型运行或课程专项评估都需要单独授权。

@yyuan308
yyuan308 force-pushed the codex/generic-grading-delivery-v5-4 branch from ac82361 to 95b2d48 Compare September 1, 2026 17:10
@yyuan308
yyuan308 merged commit a410391 into main Sep 1, 2026
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant