Skip to content

Integrate C1 and evidence-driven benchmark candidate selection - #8255

Open
huangruiteng wants to merge 155 commits into
codex/edgebench-r35-signed-candidate-20261107from
codex/edgebench-r36-aggressive-20261107
Open

huangruiteng wants to merge 155 commits into
codex/edgebench-r35-signed-candidate-20261107from
codex/edgebench-r36-aggressive-20261107

Conversation

@huangruiteng

Copy link
Copy Markdown
Collaborator

Long-running benchmark workers should spend fewer interactions recovering control context and use observed candidate outcomes when choosing their next experiment. This research integration combines C1 with candidate-selection guidance and optional process-group observations, including the real native benchmark entry paths.

This PR targets the preceding research integration branch. It does not promote this treatment to the default product or claim a measured task-score gain.

Changes

Evidence and limits

The complete native checkpoint/context regression selection passed 96 cases, with 11 platform skips. The candidate-selection checks exercised actual SQLite work and periodic projections as well as typed measurement scopes. The resource producer was independently checked on Linux against phase-shifted allocation, output-file failure and feature-off cases; the real wrapper installer was checked against missing and shadowed producers. Component PRs retain their exact-head reviews and required local gates.

A paired deterministic control journey reduced normal commands from four to three and model-visible bytes by about 26.7%. Including refusal and replay reduced bytes by about 17.6%; replay itself grew. Single-sample tool latency regressed, so these measurements do not establish lower total latency, billed token cost or better task outcomes. Host-internal capture transport savings are reported separately from model-visible savings.

Natural model adoption, sustained score growth and full cost remain unqualified. New single-treatment runs can test operational adoption and provide diagnostic comparisons with historical runs; they do not form a new matched four-arm experiment. Native account routing remains unchanged.

The combined branch is a research artifact. The upstream C1 default-retirement and broader natural-provider qualification gates remain open; component merge-readiness does not settle those gates.

loopx-agent and others added 30 commits November 5, 2026 05:46
…h main

Retain the complete checked decision across production callers, reuse main Progressive/Delta presentation and keep late transport options in derived views. Preserve original capture, numeric identity, failure and explicit-off semantics.

Co-authored-by: aihop <4408344+hhyykk@users.noreply.github.com>
Signed-off-by: LoopX Agent <337587101+loopx-agent@users.noreply.github.com>
Cover checked source fidelity, real File/SQLite caller settlement, native transport recovery, numeric observations and source-entrypoint parity. Retain independent semantic oracles and historical failure boundaries.

Co-authored-by: aihop <4408344+hhyykk@users.noreply.github.com>
Signed-off-by: LoopX Agent <337587101+loopx-agent@users.noreply.github.com>
…on limits

Keep paired RFC checkpoints, production caller contracts and historical negative cost evidence. Integration and retry results do not establish original-workload net benefit or installed delivery.

Co-authored-by: aihop <4408344+hhyykk@users.noreply.github.com>
Signed-off-by: LoopX Agent <337587101+loopx-agent@users.noreply.github.com>
Signed-off-by: LoopX Agent <337587101+loopx-agent@users.noreply.github.com>
Signed-off-by: LoopX Agent <337587101+loopx-agent@users.noreply.github.com>
Signed-off-by: LoopX Agent <337587101+loopx-agent@users.noreply.github.com>
Signed-off-by: LoopX Agent <337587101+loopx-agent@users.noreply.github.com>
Signed-off-by: LoopX Agent <337587101+loopx-agent@users.noreply.github.com>
Signed-off-by: LoopX Agent <337587101+loopx-agent@users.noreply.github.com>
Signed-off-by: LoopX Agent <337587101+loopx-agent@users.noreply.github.com>
Signed-off-by: LoopX Agent <337587101+loopx-agent@users.noreply.github.com>
Signed-off-by: LoopX Agent <337587101+loopx-agent@users.noreply.github.com>
Signed-off-by: LoopX Agent <337587101+loopx-agent@users.noreply.github.com>
Signed-off-by: LoopX Agent <337587101+loopx-agent@users.noreply.github.com>
Signed-off-by: LoopX Agent <337587101+loopx-agent@users.noreply.github.com>
Signed-off-by: LoopX Agent <337587101+loopx-agent@users.noreply.github.com>
Signed-off-by: LoopX Agent <337587101+loopx-agent@users.noreply.github.com>
Signed-off-by: LoopX Agent <337587101+loopx-agent@users.noreply.github.com>
Signed-off-by: LoopX Agent <337587101+loopx-agent@users.noreply.github.com>
(cherry picked from commit dcc1d50)
Signed-off-by: LoopX Agent <337587101+loopx-agent@users.noreply.github.com>
Signed-off-by: LoopX Agent <337587101+loopx-agent@users.noreply.github.com>
Signed-off-by: LoopX Agent <337587101+loopx-agent@users.noreply.github.com>
…ources

Signed-off-by: LoopX Agent <337587101+loopx-agent@users.noreply.github.com>
Signed-off-by: LoopX Agent <337587101+loopx-agent@users.noreply.github.com>
…er-20261103T062012Z

Signed-off-by: LoopX Agent <337587101+loopx-agent@users.noreply.github.com>
Signed-off-by: LoopX Agent <337587101+loopx-agent@users.noreply.github.com>
Signed-off-by: LoopX Agent <337587101+loopx-agent@users.noreply.github.com>
Signed-off-by: LoopX Agent <337587101+loopx-agent@users.noreply.github.com>
Signed-off-by: LoopX Agent <337587101+loopx-agent@users.noreply.github.com>
Signed-off-by: LoopX Agent <337587101+loopx-agent@users.noreply.github.com>

# Conflicts:
#	docs/architecture/rfcs/controller-executor-unified-contract-v0.md
#	docs/architecture/rfcs/controller-executor-unified-contract-v0.zh-CN.md
#	loopx/cli_commands/quota_capture.py
#	loopx/control_plane/quota/turn_envelope.ts
#	loopx/control_plane/turn_driver/codex_execution_preparation.py
#	tests/control_plane/test_quota_execution_preparation.py
#	tests/control_plane/test_quota_settlement_cli.py
#	tests/control_plane/test_refresh_settle_turn.py
Signed-off-by: LoopX Agent <337587101+loopx-agent@users.noreply.github.com>
loopx-agent and others added 27 commits November 7, 2026 07:58
Signed-off-by: LoopX Agent <337587101+loopx-agent@users.noreply.github.com>
Signed-off-by: LoopX Agent <337587101+loopx-agent@users.noreply.github.com>
Signed-off-by: LoopX Agent <337587101+loopx-agent@users.noreply.github.com>
Signed-off-by: LoopX Agent <337587101+loopx-agent@users.noreply.github.com>
Signed-off-by: LoopX Agent <337587101+loopx-agent@users.noreply.github.com>
Signed-off-by: LoopX Agent <337587101+loopx-agent@users.noreply.github.com>
Signed-off-by: LoopX Agent <337587101+loopx-agent@users.noreply.github.com>
Signed-off-by: LoopX Agent <337587101+loopx-agent@users.noreply.github.com>
Signed-off-by: LoopX Agent <337587101+loopx-agent@users.noreply.github.com>
Signed-off-by: LoopX Agent <337587101+loopx-agent@users.noreply.github.com>
…#8245)

Signed-off-by: LoopX Agent <337587101+loopx-agent@users.noreply.github.com>
Signed-off-by: LoopX Agent <337587101+loopx-agent@users.noreply.github.com>
Signed-off-by: LoopX Agent <337587101+loopx-agent@users.noreply.github.com>
Signed-off-by: LoopX Agent <337587101+loopx-agent@users.noreply.github.com>
Signed-off-by: LoopX Agent <337587101+loopx-agent@users.noreply.github.com>
Signed-off-by: LoopX Agent <337587101+loopx-agent@users.noreply.github.com>
Signed-off-by: LoopX Agent <337587101+loopx-agent@users.noreply.github.com>
Signed-off-by: LoopX Agent <337587101+loopx-agent@users.noreply.github.com>
Signed-off-by: LoopX Agent <337587101+loopx-agent@users.noreply.github.com>
Signed-off-by: LoopX Agent <337587101+loopx-agent@users.noreply.github.com>
feat(explore): ground work choices in paired goal outcomes
Signed-off-by: LoopX Agent <337587101+loopx-agent@users.noreply.github.com>
Signed-off-by: LoopX Agent <337587101+loopx-agent@users.noreply.github.com>
Signed-off-by: LoopX Agent <337587101+loopx-agent@users.noreply.github.com>
Reuse the committed quota capture in native benchmark preflight
…ration

Observe aggregate memory in local work probes
Opt in to local work probes from SForge heartbeat

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants