From c682f10f8f54998dafbddc1b47cdc9e094e4afbf Mon Sep 17 00:00:00 2001 From: Aaron Smulktis Date: Wed, 9 Sep 2026 10:33:14 -0400 Subject: [PATCH 1/2] [Docs] Pin v1.0-paper as the reproducibility tag in the README `main` is about to diverge from the tree the arXiv:2511.20766 results were produced against -- PR #72 removes the per-app `appearance` config group in favour of a shared theme plus per-app layout, so the paper's variation overrides stop resolving. Point anyone reproducing our numbers at the `v1.0-paper` tag instead, and say plainly that everything after it is free to move. --- README.md | 15 +++++++++++++++ 1 file changed, 15 insertions(+) diff --git a/README.md b/README.md index db94044e..3941736d 100644 --- a/README.md +++ b/README.md @@ -87,6 +87,21 @@ https://github.com/user-attachments/assets/40482d53-9481-4e48-962b-eb384e94e3c7 +## Reproducing the paper + +`main` moves. The [`v1.0-paper`](https://github.com/facebookresearch/OpenApps/releases/tag/v1.0-paper) tag pins the last tree that runs the variation grid from [arXiv:2511.20766](https://arxiv.org/abs/2511.20766) as published — check it out if you are reproducing or comparing against our setup: + +```bash +git clone https://github.com/facebookresearch/OpenApps.git +cd OpenApps +git checkout v1.0-paper +uv sync +``` + +Everything after that tag is free to diverge. The first such change is the appearance refactor: the per-app `appearance` config group is replaced by a shared `apps/theme` (look) plus a per-app `apps//layout` (structure), so overrides written as `apps/todo/appearance=dark_theme` no longer resolve on `main`. See [App variations](https://facebookresearch.github.io/OpenApps/#app-variations) in the docs for the current axes, which include a table mapping every old `appearance` value onto its replacement. + +The tag is the config surface the paper used, not a byte-exact snapshot of the runs: it carries the app, task and harness fixes landed since publication, some of which move rewards (map tasks now match coordinates by ground distance, for example). Expect small differences from the published tables. + ## Contributing We welcome pull requests with new features or issues via GitHub. From 126412e3b01d719c3e3dbbd765a189610da03ea8 Mon Sep 17 00:00:00 2001 From: Smokey Date: Wed, 9 Sep 2026 10:47:12 -0400 Subject: [PATCH 2/2] Potential fix for pull request finding Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com> --- README.md | 3 +-- 1 file changed, 1 insertion(+), 2 deletions(-) diff --git a/README.md b/README.md index 3941736d..5f9e1fbb 100644 --- a/README.md +++ b/README.md @@ -89,8 +89,7 @@ https://github.com/user-attachments/assets/40482d53-9481-4e48-962b-eb384e94e3c7 ## Reproducing the paper -`main` moves. The [`v1.0-paper`](https://github.com/facebookresearch/OpenApps/releases/tag/v1.0-paper) tag pins the last tree that runs the variation grid from [arXiv:2511.20766](https://arxiv.org/abs/2511.20766) as published — check it out if you are reproducing or comparing against our setup: - +`main` moves. The [`v1.0-paper`](https://github.com/facebookresearch/OpenApps/releases/tag/v1.0-paper) tag pins the paper-era config surface used for the variation grid in [arXiv:2511.20766](https://arxiv.org/abs/2511.20766) — check it out if you are reproducing or comparing against our setup: ```bash git clone https://github.com/facebookresearch/OpenApps.git cd OpenApps