diff --git a/docs/index.md b/docs/index.md
index b44ede4..9133d12 100644
--- a/docs/index.md
+++ b/docs/index.md
@@ -100,8 +100,9 @@ episodes, and the clip is the episode with the median return, not the best
 one. `dppo-policy · FPO` is missing because it cannot exist: FPO trains flow
 policies only. The three pi0.5 clips all start from the same scene, the first
 one the released policy solves, and the numbers under them come from
-fifty-episode evaluations. pi0.5 falling to zero after one FPO iteration is a
-defect of ours we are still tracking down, not a finding about FPO. The
+fifty-episode evaluations. pi0.5 used to fall to zero after one FPO
+iteration; the defect was ours, in how our FPO scored an action chunk, and
+with FPO++'s way of scoring it the policy survives ([E32](https://github.com/PlugRL/plugrl-server/tree/main/experiments/e32-pi0-fpo-plus-plus)). The
 scripts that made all of this are in
 [figures/coverage](https://github.com/PlugRL/plugrl-server/tree/main/figures/coverage).
 
@@ -139,6 +140,13 @@ were pre-registered, and one of them is falsified. The numbers, the recorded
 environment of both processes, and what none of it supports:
 [E11](https://github.com/PlugRL/plugrl-server/tree/main/experiments/e11-vla-rl-libero).
 
+The collapse turned out to be ours. This FPO scored an action chunk by
+averaging the error over all 320 of its elements, most of them padding or
+steps the client never executed; scored as FPO++ scores it - the executed
+steps and the dimensions LIBERO uses - one update leaves pi0.5 at 33 of 50
+([E32](https://github.com/PlugRL/plugrl-server/tree/main/experiments/e32-pi0-fpo-plus-plus)). That it survives is all this shows: nothing yet says RL
+makes it better.
+
 ## The environment side needs neither CUDA nor a GPU
 
 The training server is 6.5G and wants a GPU. The machine running environments
diff --git a/docs/index.zh.md b/docs/index.zh.md
index 767154a..72d3ddd 100644
--- a/docs/index.zh.md
+++ b/docs/index.zh.md
@@ -85,8 +85,9 @@ PlugRL 把策略、算法和环境拆开，所以真正值得回答的问题是
 每段视频都取自三个种子里最后十轮回报居中的那个种子的最终检查点。这个检查点评估了五
 个回合，放出来的是回报居中的那一回合，不是最好的那一回合。表里没有 `dppo-policy · FPO`，
 因为这个组合不存在：FPO 只能训练流策略。pi0.5 的三段视频都从同一个场景开始，也就是原
-版策略能完成的第一个场景；视频下面的数字来自 50 个回合的评估。pi0.5 一轮 FPO 后掉到
-零，是我们平台的问题，还在排查，不是关于 FPO 的结论。生成这些内容的脚本在
+版策略能完成的第一个场景；视频下面的数字来自 50 个回合的评估。pi0.5 以前一轮 FPO 后
+就掉到零，问题出在我们这边——这里的 FPO 给动作块打分的方式不对，换成 FPO++ 的打分方式后
+策略就不再被毁（[E32](https://github.com/PlugRL/plugrl-server/tree/main/experiments/e32-pi0-fpo-plus-plus)）。生成这些内容的脚本在
 [figures/coverage](https://github.com/PlugRL/plugrl-server/tree/main/figures/coverage)。
 
 训练端和环境端连 Python 环境都不共用。训练这些格子的服务端，没有一台装了 MuJoCo、robosuite
@@ -116,6 +117,11 @@ FPO 用回传的反馈训练。边界本身没有任何改动，变的只是策
 进程各自被记录下来的环境，以及这些数据**不能**支持的结论，见
 [E11](https://github.com/PlugRL/plugrl-server/tree/main/experiments/e11-vla-rl-libero)。
 
+这次归零后来查清了，原因在我们：这里的 FPO 给一个动作块打分时，对全部 320 个元素的
+误差取平均，其中大部分是补零的维度或客户端根本没执行的步。按 FPO++ 的方式打分——只算
+执行了的步、只算 LIBERO 用到的维度——一次更新后 pi0.5 还有 33/50（[E32](https://github.com/PlugRL/plugrl-server/tree/main/experiments/e32-pi0-fpo-plus-plus)）。
+这只说明它不再被毁，还不能说明强化学习能让它变好。
+
 ## 环境端既不需要 CUDA，也不需要 GPU
 
 训练端有 6.5G，而且要一张显卡；跑环境的那台机器不必如此。LIBERO 环境端可以装成
diff --git a/docs/javascripts/coverage.js b/docs/javascripts/coverage.js
index 619abaf..9bd7c47 100644
--- a/docs/javascripts/coverage.js
+++ b/docs/javascripts/coverage.js
@@ -49,7 +49,7 @@
       clientNote: (e) => `uv sync --extra ${e.extra}: ${e.packages}`,
       cmdHint:
         "Click another cell: the highlighted words are what changed. Shown with seed 0 " +
-        "(the experiments ran seeds 0-2); the client's episode count is only an upper bound, " +
+        "(each experiment ran three seeds); the client's episode count is only an upper bound, " +
         "the server ends the run.",
       vlaHint: "Cluster paths are placeholders; the linked script has the rest.",
       copy: "Copy",
@@ -87,7 +87,7 @@
       client: "环境客户端",
       clientNote: (e) => `uv sync --extra ${e.extra}：${e.packages}`,
       cmdHint:
-        "点另一格：高亮的就是变了的词。这里统一写成种子 0（实验跑的是 0 到 2 三个种子）；" +
+        "点另一格：高亮的就是变了的词。这里统一写成种子 0（每个实验跑了三个种子）；" +
         "客户端的回合数只是个上限，什么时候停由服务端决定。",
       vlaHint: "集群上的路径用占位符代替，完整内容见链接的脚本。",
       copy: "复制",
diff --git a/docs/media/coverage-grid.jpg b/docs/media/coverage-grid.jpg
index 49a5c82..b30f59c 100644
Binary files a/docs/media/coverage-grid.jpg and b/docs/media/coverage-grid.jpg differ
diff --git a/docs/media/coverage/coverage.json b/docs/media/coverage/coverage.json
index 259dd3d..ffe6e5d 100644
--- a/docs/media/coverage/coverage.json
+++ b/docs/media/coverage/coverage.json
@@ -1 +1 @@
-{"rows":[{"id":"fpo-fpo","label":"fpo-policy · FPO"},{"id":"fpo-dppo","label":"fpo-policy · DPPO"},{"id":"dppo-dppo","label":"dppo-policy · DPPO"}],"columns":[{"id":"cheetah","label":"HalfCheetah-v5"},{"id":"hopper","label":"Hopper-v5"},{"id":"walker","label":"Walker2d-v5"},{"id":"square","label":"robomimic square"}],"ranges":{"cheetah":[-534.5,2154.1],"hopper":[11.2,2575.4],"walker":[-2.6,1570.6],"square":[0.0,1.0]},"cells":[{"id":"fpo-fpo-cheetah","row":"fpo-fpo","column":"cheetah","status":"learns","experiments":["E6","E16"],"note":"about −300 → 1,346–2,050","note_zh":"从约 −300 升到 1,346–2,050","seed":0,"curves":[[-340.4,-335.1,-377.7,-290.9,-265.6,-234.9,-246.0,-163.0,-259.4,-136.0,-135.2,-69.6,-60.2,-38.2,-51.8,-25.7,6.9,9.9,-25.6,2.0,-1.8,11.9,5.3,85.3,36.9,82.5,156.8,191.4,256.4,320.3,333.9,411.2,222.5,479.0,370.1,510.8,366.7,575.6,356.1,577.8,179.9,550.5,456.0,553.7,666.0,781.8,575.6,748.5,609.9,827.7,403.7,390.6,559.3,609.3,576.3,700.3,699.8,885.3,841.0,981.2,964.4,526.1,1008.3,1045.2,769.8,1031.7,766.6,1052.7,1090.7,838.4,1073.5,830.8,828.6,1156.7,1237.0,1190.5,1281.6,1265.4,1072.7,1361.7,1382.7,1385.1,1017.1,1412.4,1479.8,1472.5,1523.0,1530.3,1521.3,1563.3,1612.0,1641.7,1668.9,1262.2,1465.3,1412.7,1029.3,1304.5,1496.1,1643.1],[-358.6,-285.2,-262.2,-318.8,-357.6,-256.9,-199.5,-134.8,-216.0,-207.4,-210.1,-136.2,-64.2,-140.5,-169.7,-87.4,-28.8,-61.1,9.8,62.7,58.5,120.6,101.9,255.1,291.8,314.5,409.8,105.8,425.2,387.7,611.7,373.6,651.0,570.7,651.4,731.0,748.0,740.1,825.2,414.0,816.5,674.3,805.7,815.2,864.5,877.4,1022.2,904.5,926.0,1007.5,760.4,1056.0,1048.0,1203.5,1186.1,1111.5,1250.9,1307.5,1257.8,1242.5,1298.1,1327.0,1254.8,1435.7,1235.9,1511.2,1509.7,1469.5,1649.6,1417.7,1651.7,1001.0,1738.4,1757.2,1629.4,1718.8,1671.9,1728.0,1593.8,1832.3,1903.5,1556.2,1717.0,1666.3,1703.9,1803.4,1885.9,1829.2,1901.7,1926.3,1953.9,1951.7,2001.3,1935.2,2038.4,2154.1,2087.5,2112.3,2142.7,2117.7],[-285.4,-322.1,-281.0,-312.1,-282.8,-366.2,-209.1,-230.4,-226.3,-218.5,-186.8,-240.5,-188.6,-173.8,-149.1,-143.0,-67.5,-42.8,-29.8,-14.3,39.6,120.2,164.5,147.4,213.9,254.8,241.4,335.0,364.0,417.4,350.1,504.7,500.1,528.4,617.6,621.9,637.6,767.6,679.0,682.6,771.3,776.9,862.2,755.4,802.5,845.3,830.6,866.6,948.2,987.4,875.9,631.9,729.0,1026.7,960.3,987.3,951.3,1074.2,1061.3,1166.7,1234.0,902.6,1036.4,967.0,1175.8,1212.3,1253.0,1027.4,1173.7,1013.4,1068.9,1073.1,1068.0,1311.7,1503.5,998.7,1136.5,1213.3,1293.7,1163.1,1330.8,1183.8,1042.3,1134.6,1460.8,1223.6,1221.7,1402.3,1296.6,1255.1,1257.0,1188.4,1551.9,1299.1,1236.8,1303.3,1590.8,1281.4,1392.2,1356.2]],"clip":{"cell":"fpo-fpo-cheetah","episode":5,"of":5,"return":1609.1,"length":1000,"success":false,"returns":[1679.4,1734.1,1529.3,1255.2,1609.1],"seconds":8.0,"speed":1.0},"train":{"server":["fpo-policy default fpo default","--port 8000 --seed 0 --policy.device cpu","--algo.buffer-size 4096 --algo.global-steps 409600"],"client":["mujoco-v1 --server-host 127.0.0.1 --server-port 8000","--num-envs 1 --num-episodes 100000","--env.name HalfCheetah-v5 --runner.replan-steps 1 --runner.seed 0"],"env":"mujoco","source":"experiments/e16-critic-restart/phase_a.sh"}},{"id":"fpo-fpo-hopper","row":"fpo-fpo","column":"hopper","status":"learns","experiments":["E23"],"note":"15–19 → 1,587–2,006","note_zh":"从 15–19 升到 1,587–2,006","seed":2,"curves":[[16.3,21.1,31.3,61.3,79.8,122.0,144.4,176.3,202.4,218.7,235.0,237.1,253.5,279.0,299.1,318.8,365.7,387.2,395.0,424.1,405.6,458.4,488.4,594.9,629.7,618.5,713.7,761.4,837.1,992.3,916.2,737.8,987.1,877.4,809.6,1090.9,976.2,1146.0,861.4,1185.3,1139.3,958.8,845.2,1510.4,1285.9,1282.2,819.3,1019.5,1357.1,1153.2,1712.9,1572.2,1525.4,1176.6,986.4,929.7,1197.9,1510.9,1374.2,985.7,950.0,1026.2,1147.8,997.9,966.6,1476.1,1244.0,1337.1,1375.7,1216.6,1268.1,1431.9,1477.4,1247.6,1402.8,1990.0,1794.1,1640.2,1019.8,1538.6,1370.3,1004.0,1542.7,1438.4,1834.1,1791.8,1201.4,1446.0,1412.9,1275.7,1309.2,1672.3,1535.9,1615.4,1118.2,1283.4,1443.9,1684.7,1887.6,2320.3],[19.1,21.9,35.5,56.9,102.1,143.6,179.2,203.1,230.9,238.0,219.6,245.0,224.0,241.9,246.6,251.0,277.5,300.8,332.8,374.0,350.0,322.4,373.0,382.2,393.4,359.7,383.5,374.1,430.1,404.8,474.8,469.2,499.1,652.8,598.3,704.4,653.0,662.1,826.7,762.7,791.9,814.1,982.3,877.7,875.8,941.5,958.7,948.3,1171.5,1209.7,1300.9,1291.2,1241.1,1235.8,1464.6,1268.4,1512.1,1203.2,1126.3,1564.9,1363.8,1402.2,1227.4,1961.2,1837.7,1947.1,1776.6,1903.2,1636.3,2113.4,2164.5,1415.0,1638.8,2050.3,1437.3,2444.6,1880.1,2004.9,2482.8,1954.1,2112.4,1605.2,2089.8,1956.5,2575.4,1967.4,1940.4,1904.4,2377.3,1786.3,1962.7,2441.6,1851.2,1777.1,2307.6,2574.9,1838.0,1253.3,1840.8,2210.8],[14.5,18.5,35.6,53.8,92.8,121.4,163.1,182.8,228.8,218.6,220.6,235.1,234.7,245.9,263.1,293.0,327.1,324.1,373.7,363.5,376.5,369.8,400.2,450.0,451.8,571.1,628.2,644.8,798.6,855.9,797.8,886.9,1215.1,1571.2,1118.4,1325.9,1151.5,1258.1,1181.0,1339.7,1653.9,1443.2,1272.4,1170.1,1496.0,1105.7,1419.7,1108.2,1331.0,1495.4,1199.6,1558.2,1887.1,1229.5,2034.4,1517.2,1874.0,1567.6,1480.9,1612.7,2081.5,2017.8,2152.4,1691.2,1639.1,1439.9,1502.0,1232.2,1507.7,1476.2,1523.9,1233.4,1599.6,1672.5,1999.0,1821.7,2038.0,1733.4,2177.0,1677.7,1841.6,1858.1,1965.0,1929.9,2263.2,1629.4,1926.7,1449.4,2316.0,1768.6,2306.9,2057.3,1852.1,1950.5,1221.7,1498.2,1880.3,1569.4,1571.5,1852.7]],"clip":{"cell":"fpo-fpo-hopper","episode":2,"of":5,"return":1123.2,"length":360,"success":false,"returns":[2789.9,1123.2,2846.4,468.1,456.9],"seconds":3.0,"speed":0.973},"train":{"server":["fpo-policy default fpo default","--port 8000 --seed 0 --policy.device cpu","--policy.obs-dim 11 --policy.action-dim 3","--algo.buffer-size 4096 --algo.global-steps 409600"],"client":["mujoco-v1 --server-host 127.0.0.1 --server-port 8000","--num-envs 1 --num-episodes 100000","--env.name Hopper-v5 --runner.replan-steps 1 --runner.seed 0"],"env":"mujoco","source":"experiments/e23-hopper/run.sh"}},{"id":"fpo-fpo-walker","row":"fpo-fpo","column":"walker","status":"learns","experiments":["E24"],"note":"about 0 → 964–1,101","note_zh":"从约 0 升到 964–1,101","seed":1,"curves":[[0.7,1.9,10.7,34.4,82.6,129.7,199.9,237.7,205.4,263.3,367.4,337.5,348.6,333.0,295.4,340.1,331.0,312.3,325.1,366.6,315.0,318.5,341.0,325.9,270.0,317.1,328.2,338.2,522.6,551.8,423.1,330.4,297.0,512.2,375.0,340.4,333.9,321.6,309.4,300.0,375.0,322.8,341.0,371.4,352.0,374.5,391.5,436.9,426.6,449.7,553.6,635.4,727.9,704.6,546.9,621.1,722.3,741.0,682.8,604.1,614.4,854.6,727.9,676.9,765.7,1162.1,840.5,687.8,701.1,648.6,683.8,783.0,751.0,717.6,1030.8,944.4,738.7,674.4,902.5,1238.0,770.5,824.2,598.6,1122.9,1172.4,900.4,907.7,974.6,1107.7,886.2,901.8,1165.2,1024.7,1044.9,780.2,1066.5,909.6,892.1,987.0,868.3],[-0.3,0.8,7.9,31.4,47.2,107.5,224.2,155.5,208.4,282.9,298.4,245.3,277.6,335.8,303.3,303.4,296.0,337.3,330.8,329.4,334.9,294.6,319.8,287.9,321.7,292.6,312.1,337.3,336.4,351.1,333.5,397.0,322.3,380.4,404.4,321.6,362.7,348.6,332.0,330.9,337.2,316.9,333.5,331.5,327.1,334.2,383.5,347.4,362.1,359.4,377.7,359.7,393.2,392.0,416.8,434.5,410.1,375.1,406.9,413.7,433.7,397.2,440.9,495.9,458.8,455.9,504.1,537.1,496.4,599.0,751.8,691.0,784.7,840.0,913.3,762.6,882.0,875.6,864.6,995.1,1043.6,961.0,978.4,1012.3,1129.0,906.5,892.3,832.7,763.1,881.6,1058.2,1032.4,1076.8,991.3,846.8,1042.1,1051.7,868.9,918.7,1378.1],[0.6,1.5,7.7,28.2,64.7,145.2,200.0,201.2,256.2,217.2,246.8,279.8,316.7,257.1,311.0,303.2,232.2,304.3,314.1,336.8,327.1,321.9,348.0,353.3,430.8,356.0,442.6,327.7,387.8,368.5,467.1,354.3,404.5,337.4,329.7,329.7,328.2,311.0,387.0,337.4,488.8,419.6,477.3,385.7,377.9,428.6,571.4,447.4,433.3,479.6,517.5,520.1,555.3,592.9,702.3,669.5,593.1,733.4,678.6,768.3,599.3,728.6,988.6,1054.1,600.5,680.7,953.6,823.6,872.9,986.6,1030.2,1197.6,1056.5,1032.6,1009.6,949.7,1024.4,1061.3,1165.9,1150.1,996.1,1259.8,1298.4,1331.6,979.3,1257.1,1238.0,1370.2,1031.2,1570.6,810.7,1048.3,1088.8,1401.1,1227.8,1105.7,1192.6,932.1,1052.2,1150.4]],"clip":{"cell":"fpo-fpo-walker","episode":5,"of":5,"return":837.7,"length":310,"success":false,"returns":[821.9,1329.9,440.2,933.0,837.7],"seconds":3.0,"speed":0.84},"train":{"server":["fpo-policy default fpo default","--port 8000 --seed 0 --policy.device cpu","--policy.obs-dim 17 --policy.action-dim 6","--algo.buffer-size 4096 --algo.global-steps 409600"],"client":["mujoco-v1 --server-host 127.0.0.1 --server-port 8000","--num-envs 1 --num-episodes 100000","--env.name Walker2d-v5 --runner.replan-steps 1 --runner.seed 0"],"env":"mujoco","source":"experiments/e24-coverage/run_cell.sh"}},{"id":"fpo-fpo-square","row":"fpo-fpo","column":"square","status":"runs","experiments":["E27"],"note":"no success yet: sparse reward, random start","note_zh":"还没成功过：稀疏奖励、随机初始化","seed":0,"curves":[[0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0]],"clip":{"cell":"fpo-fpo-square","episode":3,"of":5,"return":0.0,"length":400,"success":false,"returns":[0.0,0.0,0.0,0.0,0.0],"seconds":8.0,"speed":1.0},"train":{"server":["fpo-policy default fpo default","--port 8000 --seed 0 --policy.device cpu","--policy.obs-dim 23 --policy.action-dim 7","--policy.state-keys robot0_eef_pos robot0_eef_quat robot0_gripper_qpos object","--algo.buffer-size 4096 --algo.global-steps 81920"],"client":["robomimic-v1 --server-host 127.0.0.1 --server-port 8000","--num-envs 1 --num-episodes 100000","--env.name square-img --env.agentview-image-size 84 84","--runner.replan-steps 1"],"env":"robomimic","source":"experiments/e27-robomimic/run_cell.sh"}},{"id":"fpo-dppo-cheetah","row":"fpo-dppo","column":"cheetah","status":"flat","experiments":["E17","E18"],"note":"no learning in 409,600 steps","note_zh":"409,600 步内没学会","seed":1,"curves":[[-356.0,-332.8,-259.5,-311.2,-291.9,-259.6,-288.4,-311.9,-274.5,-302.5,-249.1,-272.2,-344.0,-278.0,-314.1,-237.6,-292.4,-300.2,-303.8,-254.2,-274.4,-306.4,-269.5,-327.4,-353.7,-271.6,-332.5,-353.4,-368.4,-414.5,-320.5,-332.0,-307.7,-357.6,-308.6,-261.7,-325.9,-301.3,-305.3,-286.0,-309.6,-325.4,-370.0,-308.9,-329.1,-278.6,-265.3,-309.4,-345.0,-305.2,-290.8,-238.3,-278.1,-276.9,-343.0,-297.4,-257.7,-343.8,-366.4,-300.1,-304.8,-300.3,-248.5,-281.9,-347.9,-361.5,-323.6,-306.4,-319.6,-245.1,-232.5,-291.4,-262.0,-295.9,-333.9,-282.0,-271.7,-254.4,-270.9,-321.0,-369.3,-295.9,-417.8,-260.7,-235.4,-260.4,-284.5,-292.8,-307.2,-358.0,-262.0,-285.5,-339.6,-290.8,-252.5,-312.3,-230.3,-324.2,-355.3,-283.9],[-356.8,-254.9,-322.7,-326.3,-411.7,-274.7,-242.7,-429.7,-292.4,-287.5,-300.0,-393.1,-327.0,-332.1,-317.4,-289.4,-269.5,-319.9,-318.7,-331.2,-261.5,-311.8,-273.4,-293.5,-305.4,-370.5,-315.2,-323.6,-328.2,-315.7,-370.1,-275.7,-249.5,-347.6,-360.9,-333.7,-250.1,-306.5,-317.8,-292.6,-367.4,-401.6,-256.4,-339.9,-304.2,-281.1,-340.2,-274.5,-311.0,-292.5,-351.2,-329.0,-333.2,-327.3,-292.4,-359.2,-344.2,-320.8,-231.9,-279.0,-341.4,-371.0,-328.5,-351.9,-349.9,-247.2,-381.0,-289.9,-265.7,-289.1,-320.0,-273.5,-285.5,-305.8,-324.6,-365.8,-306.5,-301.4,-359.4,-282.9,-276.1,-331.0,-279.7,-338.1,-271.1,-323.0,-272.0,-366.9,-294.8,-279.5,-289.0,-362.6,-261.8,-302.1,-326.8,-268.7,-320.1,-318.9,-242.2,-305.0],[-290.2,-381.6,-379.0,-356.2,-304.4,-296.8,-286.5,-244.4,-333.2,-249.9,-324.7,-259.9,-275.7,-262.4,-203.7,-271.7,-239.1,-336.1,-333.9,-223.7,-321.3,-249.5,-349.5,-300.0,-271.6,-294.2,-296.7,-353.8,-335.7,-331.6,-277.8,-309.9,-317.4,-277.2,-263.7,-275.1,-348.1,-299.5,-305.6,-348.1,-339.4,-344.1,-269.0,-324.5,-245.1,-266.3,-317.9,-415.9,-311.3,-241.6,-293.7,-342.1,-373.2,-255.5,-298.9,-419.2,-348.7,-362.3,-230.7,-271.8,-254.4,-217.5,-296.1,-251.7,-218.9,-278.8,-331.4,-240.6,-225.3,-348.3,-258.2,-249.9,-262.0,-289.2,-317.4,-338.4,-300.7,-206.7,-300.4,-287.3,-249.0,-285.6,-317.1,-273.2,-244.2,-249.1,-347.5,-262.2,-295.4,-355.2,-319.3,-327.7,-282.2,-323.5,-327.6,-335.2,-311.3,-284.1,-249.4,-337.8]],"clip":{"cell":"fpo-dppo-cheetah","episode":2,"of":5,"return":-345.7,"length":1000,"success":false,"returns":[-425.3,-345.7,-305.4,-312.7,-418.8],"seconds":8.0,"speed":1.0},"train":{"server":["fpo-policy default dppo cheetah","--port 8000 --seed 0 --policy.device cpu","--algo.buffer-size 4096 --algo.train-itrs 100"],"client":["mujoco-v1 --server-host 127.0.0.1 --server-port 8000","--num-envs 1 --num-episodes 100000","--env.name HalfCheetah-v5 --runner.replan-steps 1 --runner.seed 0"],"env":"mujoco","source":"experiments/e18-dppo-normalised/run.sh"}},{"id":"fpo-dppo-hopper","row":"fpo-dppo","column":"hopper","status":"flat","experiments":["E28","E29"],"note":"no learning; with 10× the noise, +74 to +106","note_zh":"没学会；噪声放大 10 倍后 +74 到 +106","seed":0,"curves":[[14.9,17.3,14.3,13.7,18.0,14.8,14.4,16.1,18.1,13.9,16.3,14.7,15.6,14.3,15.2,17.6,17.1,14.4,15.8,15.4,17.6,14.3,16.0,16.7,16.7,18.7,17.7,17.2,17.0,17.7,15.9,16.8,19.5,16.6,18.0,20.4,17.0,17.8,19.0,17.6,18.2,16.8,15.3,16.4,19.8,21.2,21.4,18.5,21.6,17.0,17.6,15.5,18.4,17.1,19.3,16.4,19.7,17.9,21.5,17.2,19.1,20.9,22.0,21.5,20.4,17.1,19.5,22.3,24.3,18.2,19.6,20.9,20.1,22.2,17.8,25.0,21.3,21.3,21.3,22.0,19.3,22.1,22.2,24.9,21.6,20.8,20.1,22.5,24.2,21.0,21.8,25.3,25.9,26.4,27.4,27.7,26.6,23.3,26.2,24.9],[19.7,19.3,15.5,16.7,17.7,19.9,18.9,19.1,17.4,19.3,18.6,16.0,16.6,15.9,18.4,19.5,18.6,16.4,17.7,18.6,17.2,18.2,18.2,17.9,17.2,19.8,21.1,18.9,18.5,19.8,19.3,17.5,19.0,19.1,19.4,21.3,17.0,18.0,20.5,19.0,19.8,17.9,17.7,18.0,19.5,19.8,21.0,20.3,18.9,19.6,17.5,20.3,21.4,18.8,19.7,18.2,18.1,18.4,20.4,20.3,18.1,18.1,20.3,23.0,22.2,20.5,20.8,21.6,21.7,23.2,20.5,25.6,18.3,22.1,22.6,23.8,19.4,20.7,21.8,23.1,20.1,23.8,26.1,23.5,26.7,26.0,22.5,26.0,23.4,23.5,27.9,19.8,26.2,23.6,25.3,21.3,24.5,28.0,26.0,23.6],[17.0,16.1,14.9,16.6,18.4,17.6,18.3,18.0,19.7,19.6,17.1,16.8,18.8,17.1,19.0,17.1,20.0,19.2,17.8,17.7,18.2,19.0,18.2,18.5,17.3,20.9,18.5,18.1,21.5,19.4,19.9,15.7,18.3,20.8,18.1,17.4,16.2,19.4,17.9,16.6,20.7,18.9,15.0,18.2,18.8,17.6,18.1,19.5,20.7,19.5,19.8,20.4,17.9,17.5,19.7,19.6,17.9,19.9,20.4,20.0,18.7,18.7,18.7,19.1,18.6,19.1,18.8,17.6,19.6,19.5,21.8,22.0,22.3,20.2,20.7,20.2,22.4,22.0,23.0,21.5,20.0,21.1,22.4,25.2,23.7,19.8,22.5,20.8,23.5,22.6,22.6,24.4,28.1,23.3,24.0,31.4,29.1,27.8,26.5,30.2]],"clip":{"cell":"fpo-dppo-hopper","episode":1,"of":5,"return":15.0,"length":18,"success":false,"returns":[15.0,28.1,10.4,12.3,21.6],"seconds":3.0,"speed":0.053},"train":{"server":["fpo-policy default dppo hopper","--port 8000 --seed 0 --policy.device cpu","--policy.obs-dim 11 --policy.action-dim 3","--algo.buffer-size 4096 --algo.train-itrs 100"],"client":["mujoco-v1 --server-host 127.0.0.1 --server-port 8000","--num-envs 1 --num-episodes 100000","--env.name Hopper-v5 --runner.replan-steps 1 --runner.seed 0"],"env":"mujoco","source":"experiments/e28-dppo-learns/run.sh"}},{"id":"fpo-dppo-walker","row":"fpo-dppo","column":"walker","status":"flat","experiments":["E28"],"note":"no learning in 409,600 steps","note_zh":"409,600 步内没学会","seed":2,"curves":[[1.6,2.1,1.7,2.2,1.6,2.1,0.8,1.8,1.8,2.8,1.6,1.4,2.3,0.9,0.9,1.6,1.8,1.7,1.4,1.4,1.9,1.4,1.8,1.0,1.8,1.1,1.9,1.8,1.3,1.8,1.5,1.3,2.0,2.0,1.8,2.3,2.3,1.9,2.4,2.3,2.9,1.2,1.8,1.3,3.2,1.4,1.6,1.9,2.1,1.2,2.8,1.1,2.7,2.6,2.2,1.7,2.5,1.7,1.8,1.9,2.3,2.0,1.7,2.4,2.1,2.7,2.6,1.8,1.8,2.1,2.1,3.0,2.1,2.7,2.3,3.0,2.1,2.9,2.1,2.2,2.7,3.0,2.9,3.4,3.2,4.6,2.7,3.0,3.0,2.4,2.7,3.8,3.0,2.8,2.9,3.0,3.4,3.0,3.3,2.8],[-0.0,0.2,0.1,0.2,0.0,-0.3,0.3,-0.1,0.0,0.4,-0.6,-0.1,0.6,-0.4,0.2,-0.2,0.7,-0.1,0.3,0.9,-0.6,0.4,0.2,-0.5,-0.3,0.9,-0.2,0.4,0.4,0.5,0.5,-0.2,0.2,-0.5,0.4,0.1,0.1,0.4,0.6,0.7,0.2,1.1,-0.5,0.9,0.3,0.5,0.4,0.7,0.5,0.6,0.6,0.3,0.6,0.2,1.0,0.1,0.9,1.0,1.5,0.8,1.4,0.6,0.2,0.8,0.9,0.6,0.0,0.5,1.0,0.5,0.5,0.2,0.9,1.0,1.2,0.6,1.1,1.2,1.4,0.1,1.2,1.6,1.3,1.2,1.4,1.1,1.2,1.2,1.0,2.2,1.9,1.5,1.1,0.8,1.1,1.9,1.1,1.8,2.1,1.1],[0.5,0.5,0.7,0.8,0.5,0.5,1.3,0.9,1.2,2.0,1.2,0.9,1.3,0.7,0.8,0.9,1.7,1.2,0.9,1.8,1.6,0.8,0.3,1.1,1.0,1.3,1.6,0.6,1.5,1.0,1.8,1.5,0.9,1.0,1.4,0.2,1.3,1.3,1.1,1.3,1.5,1.5,2.2,0.5,1.3,0.8,0.7,1.9,1.3,2.3,0.7,1.5,0.9,1.7,1.1,1.8,1.5,1.2,1.7,1.6,0.9,1.4,1.3,1.9,2.0,2.5,1.5,2.1,2.6,2.2,2.5,1.3,3.0,2.3,1.9,1.1,2.1,2.4,2.4,1.9,0.8,1.7,1.4,2.1,1.7,2.1,2.5,2.0,1.2,3.0,1.9,1.3,2.2,2.7,2.3,1.7,2.3,3.0,2.3,2.3]],"clip":{"cell":"fpo-dppo-walker","episode":5,"of":5,"return":-2.1,"length":12,"success":false,"returns":[3.0,-3.5,16.8,-2.2,-2.1],"seconds":3.0,"speed":0.04},"train":{"server":["fpo-policy default dppo walker","--port 8000 --seed 0 --policy.device cpu","--policy.obs-dim 17 --policy.action-dim 6","--algo.buffer-size 4096 --algo.train-itrs 100"],"client":["mujoco-v1 --server-host 127.0.0.1 --server-port 8000","--num-envs 1 --num-episodes 100000","--env.name Walker2d-v5 --runner.replan-steps 1 --runner.seed 0"],"env":"mujoco","source":"experiments/e28-dppo-learns/run.sh"}},{"id":"fpo-dppo-square","row":"fpo-dppo","column":"square","status":"runs","experiments":["E27"],"note":"no success yet: sparse reward, random start","note_zh":"还没成功过：稀疏奖励、随机初始化","seed":0,"curves":[[0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0]],"clip":{"cell":"fpo-dppo-square","episode":3,"of":5,"return":0.0,"length":400,"success":false,"returns":[0.0,0.0,0.0,0.0,0.0],"seconds":8.0,"speed":1.0},"train":{"server":["fpo-policy default dppo default","--port 8000 --seed 0 --policy.device cpu","--policy.obs-dim 23 --policy.action-dim 7","--policy.state-keys robot0_eef_pos robot0_eef_quat robot0_gripper_qpos object","--algo.buffer-size 4096 --algo.batch-size 256 --algo.train-itrs 20"],"client":["robomimic-v1 --server-host 127.0.0.1 --server-port 8000","--num-envs 1 --num-episodes 100000","--env.name square-img --env.agentview-image-size 84 84","--runner.replan-steps 1"],"env":"robomimic","source":"experiments/e27-robomimic/run_cell.sh"}},{"id":"dppo-dppo-cheetah","row":"dppo-dppo","column":"cheetah","status":"learns","experiments":["E28"],"note":"+84 to +544; 2 of 3 seeds past the bar","note_zh":"+84 到 +544，3 个种子里 2 个过线","seed":0,"curves":[[-386.3,-436.7,-405.4,-406.3,-349.2,-419.9,-437.5,-429.6,-446.1,-443.9,-393.0,-369.2,-433.3,-349.4,-358.3,-384.0,-355.9,-440.2,-364.4,-373.5,-364.0,-378.6,-419.6,-381.4,-326.7,-425.5,-396.4,-431.5,-367.3,-377.0,-374.4,-332.7,-349.8,-282.9,-327.5,-299.5,-330.3,-282.7,-333.3,-305.2,-368.1,-426.3,-319.1,-381.3,-318.5,-279.7,-334.8,-335.3,-253.6,-302.6,-269.6,-356.5,-363.9,-385.3,-356.5,-331.1,-304.2,-274.2,-303.2,-241.1,-228.8,-281.7,-223.9,-232.8,-297.4,-287.3,-212.7,-306.3,-235.5,-277.3,-260.3,-272.4,-232.8,-221.3,-137.7,-236.2,-127.6,-189.2,-125.1,-95.3,-181.3,-92.6,-101.7,-101.0,-66.7,-51.8,-3.5,-29.1,-26.5,74.2,66.1,84.4,-2.0,59.5,163.5,-5.1,204.7,122.4,72.3,179.0],[-445.0,-379.3,-319.7,-376.3,-370.8,-360.5,-397.6,-435.5,-331.9,-408.6,-358.6,-406.6,-358.1,-348.4,-429.4,-426.3,-403.1,-413.8,-438.7,-355.2,-410.6,-462.3,-432.7,-395.6,-380.7,-399.9,-349.2,-389.7,-474.9,-420.3,-399.7,-416.8,-411.1,-414.9,-382.8,-367.8,-292.3,-357.4,-331.0,-364.7,-387.3,-416.7,-401.7,-351.5,-331.0,-417.6,-370.6,-376.6,-379.9,-359.3,-391.5,-346.0,-401.0,-393.6,-381.2,-534.5,-412.4,-425.4,-471.4,-374.2,-370.2,-496.7,-334.2,-310.9,-356.7,-383.5,-312.5,-333.8,-415.4,-369.1,-314.4,-402.9,-368.5,-349.2,-374.5,-349.2,-380.0,-406.9,-342.4,-369.6,-376.5,-351.9,-354.4,-435.9,-379.7,-363.3,-390.1,-283.9,-396.5,-370.1,-401.8,-389.1,-382.5,-346.0,-394.5,-342.4,-362.6,-334.1,-346.0,-312.7],[-382.1,-354.2,-412.8,-321.7,-353.0,-396.2,-394.0,-353.1,-344.1,-469.5,-398.2,-476.0,-360.8,-460.3,-413.5,-367.7,-348.7,-414.7,-402.9,-384.4,-348.5,-408.5,-371.9,-417.5,-391.8,-231.8,-351.8,-313.6,-359.3,-350.7,-376.5,-391.6,-355.7,-349.4,-399.5,-408.6,-311.5,-386.6,-355.5,-342.4,-344.3,-346.5,-322.9,-331.9,-323.6,-345.5,-378.4,-334.9,-306.5,-278.4,-334.6,-317.6,-298.8,-265.4,-292.7,-291.0,-252.2,-235.3,-207.0,-244.8,-190.6,-229.1,-292.9,-168.4,-289.9,-139.8,-216.9,-242.7,-204.9,-148.8,-245.9,-166.7,-102.7,-172.1,-155.1,-149.9,-98.8,-153.0,-164.8,-123.6,-38.9,-12.8,5.8,-20.0,-111.6,-85.9,-14.1,16.6,27.2,54.1,5.3,-26.9,45.1,80.1,197.8,162.5,172.9,193.5,307.7,480.3]],"clip":{"cell":"dppo-dppo-cheetah","episode":5,"of":5,"return":228.1,"length":1000,"success":false,"returns":[524.0,-49.9,344.8,129.9,228.1],"seconds":8.0,"speed":1.0},"train":{"server":["dppo-policy cheetah dppo cheetah","--port 8000 --seed 0 --policy.device cpu","--algo.buffer-size 1024 --algo.batch-size 512 --algo.train-itrs 100"],"client":["mujoco-v1 --server-host 127.0.0.1 --server-port 8000","--num-envs 1 --num-episodes 100000","--env.name HalfCheetah-v5 --runner.replan-steps 4 --runner.seed 0"],"env":"mujoco","source":"experiments/e28-dppo-learns/run.sh"}},{"id":"dppo-dppo-hopper","row":"dppo-dppo","column":"hopper","status":"rising","experiments":["E28"],"note":"11–16 → 276–430, still rising; the bar is 500","note_zh":"从 11–16 升到 276–430，还在涨；线是 500","seed":0,"curves":[[11.2,12.7,12.8,15.5,26.5,38.8,46.2,61.7,70.3,76.2,69.7,73.0,76.1,78.7,70.2,79.7,80.1,88.0,77.9,77.9,93.9,80.6,82.1,102.6,97.7,100.2,103.8,105.5,102.6,103.4,122.2,131.5,122.7,139.7,133.1,149.2,152.9,157.9,167.2,182.9,175.0,207.4,194.8,193.4,195.2,193.2,192.6,199.5,203.3,193.5,213.0,210.2,219.6,216.3,210.0,225.5,204.0,221.3,222.3,224.8,226.1,234.2,224.1,226.5,233.1,238.7,244.0,260.3,246.2,233.0,239.8,251.2,246.3,245.0,254.9,271.8,270.8,237.8,230.5,269.6,273.1,284.6,251.7,264.3,268.1,303.0,346.8,260.9,286.0,290.7,311.5,322.8,322.6,370.5,309.0,308.6,322.8,352.2,371.8,398.0],[12.4,14.4,17.4,25.1,32.9,40.0,51.6,62.5,65.0,64.6,56.2,69.6,69.9,65.0,70.6,75.1,78.5,84.0,92.2,78.1,86.1,97.8,91.1,112.5,110.8,108.4,131.5,121.2,130.8,132.5,159.0,154.0,174.6,159.0,167.1,166.8,189.2,199.8,186.7,189.9,197.9,191.8,213.6,211.6,194.4,218.4,227.9,231.9,229.7,223.9,250.4,235.1,239.9,244.7,240.5,244.0,227.6,242.5,249.3,265.0,287.5,304.9,253.7,285.0,269.5,276.7,292.5,277.3,278.3,274.9,286.9,253.5,315.4,305.5,305.8,355.2,341.4,416.1,337.9,377.9,385.3,370.3,364.2,355.5,335.7,404.0,327.5,349.9,385.8,493.0,490.6,426.8,368.0,465.4,479.3,409.9,389.2,492.4,405.7,367.7],[15.8,20.0,20.6,25.1,35.2,48.3,51.0,66.3,68.1,68.0,70.0,73.1,73.5,86.6,73.8,78.7,83.3,88.7,76.1,91.4,105.0,100.8,95.6,110.0,95.5,108.3,120.3,125.0,125.0,142.5,139.6,141.1,154.7,130.6,158.2,176.7,188.6,182.1,183.1,190.8,195.8,189.0,191.2,200.3,207.4,199.8,198.7,221.1,192.5,211.1,210.3,226.8,221.8,213.4,208.8,212.7,213.2,214.0,208.9,208.1,211.7,214.3,215.0,212.7,220.4,223.7,220.7,215.5,217.6,222.1,221.4,223.4,228.3,229.8,224.9,224.5,228.6,231.2,231.0,231.7,237.8,240.3,238.5,231.9,257.9,222.5,240.7,256.0,233.7,249.3,254.4,277.6,265.5,255.1,269.1,255.5,296.3,270.1,313.7,299.6]],"clip":{"cell":"dppo-dppo-hopper","episode":4,"of":5,"return":320.5,"length":174,"success":false,"returns":[287.9,356.9,242.4,320.5,377.5],"seconds":3.0,"speed":0.467},"train":{"server":["dppo-policy hopper dppo hopper","--port 8000 --seed 0 --policy.device cpu","--algo.buffer-size 1024 --algo.batch-size 512 --algo.train-itrs 100"],"client":["mujoco-v1 --server-host 127.0.0.1 --server-port 8000","--num-envs 1 --num-episodes 100000","--env.name Hopper-v5 --runner.replan-steps 4 --runner.seed 0"],"env":"mujoco","source":"experiments/e28-dppo-learns/run.sh"}},{"id":"dppo-dppo-walker","row":"dppo-dppo","column":"walker","status":"rising","experiments":["E28"],"note":"about −2 → 260–292, then flat; the bar is 500","note_zh":"从约 −2 升到 260–292 后走平；线是 500","seed":2,"curves":[[-2.2,1.2,3.4,8.8,16.0,25.7,46.9,74.8,75.2,162.9,137.0,150.3,128.1,146.4,207.9,246.8,222.6,192.1,201.7,230.1,245.4,215.8,198.5,247.4,225.1,212.2,242.2,259.0,182.3,167.7,216.5,223.4,237.7,249.4,219.5,225.9,241.3,262.3,234.6,295.6,283.2,247.8,214.2,293.6,244.2,253.8,197.1,241.9,270.6,260.6,261.6,280.4,264.6,294.7,299.8,290.2,263.9,251.1,234.9,282.8,218.8,257.7,265.8,241.8,253.8,258.9,282.1,241.0,317.2,253.7,281.4,273.1,271.9,285.7,331.5,247.4,269.2,261.3,228.5,289.6,255.8,305.3,266.8,278.9,212.9,261.3,227.3,296.7,254.2,248.2,223.9,268.5,302.2,263.1,250.0,301.5,291.1,304.0,183.6,210.2],[-1.6,1.2,4.6,8.4,14.2,28.3,26.7,33.1,28.9,157.3,50.8,120.8,156.5,141.8,139.5,178.8,206.9,235.2,238.6,247.7,223.7,200.4,262.3,227.4,239.6,212.9,279.2,254.1,229.5,263.7,231.6,218.6,219.2,226.7,209.1,237.4,213.1,232.0,327.0,210.4,174.2,212.1,232.5,172.9,198.8,238.1,222.9,263.8,228.4,295.6,231.0,270.5,218.5,205.8,252.9,233.5,180.4,160.0,204.6,197.1,203.7,219.6,239.6,346.4,292.8,290.5,254.1,207.0,269.8,252.6,196.1,240.9,218.1,230.1,220.0,217.1,227.8,248.0,185.1,267.8,223.6,233.2,283.5,272.7,279.5,227.5,230.0,284.7,283.2,241.0,297.9,248.2,279.8,320.6,283.3,334.9,253.0,305.1,278.1,323.4],[-2.6,-2.5,-2.0,-0.3,1.7,8.2,15.9,36.2,34.7,73.6,95.7,91.2,239.7,168.0,135.7,197.0,158.1,106.5,221.9,138.0,161.0,179.6,161.1,142.5,211.3,226.5,196.9,158.3,197.8,175.1,274.6,233.7,268.7,248.2,220.2,291.0,235.6,234.2,285.7,230.2,259.8,290.7,240.6,249.1,283.1,325.9,271.4,260.1,260.1,225.6,322.4,264.9,284.3,295.4,312.6,254.9,266.2,285.6,271.6,283.4,216.7,231.3,326.6,250.5,290.4,308.9,255.3,256.7,298.8,282.5,252.9,226.6,216.9,251.7,227.4,241.7,258.4,222.1,262.4,270.6,293.2,286.0,271.0,295.4,242.2,284.1,303.1,290.5,291.1,315.2,255.1,295.9,322.5,317.6,299.4,224.6,252.2,217.9,261.3,290.4]],"clip":{"cell":"dppo-dppo-walker","episode":5,"of":5,"return":339.7,"length":228,"success":false,"returns":[405.1,320.5,328.6,540.8,339.7],"seconds":3.0,"speed":0.613},"train":{"server":["dppo-policy walker dppo walker","--port 8000 --seed 0 --policy.device cpu","--algo.buffer-size 1024 --algo.batch-size 512 --algo.train-itrs 100"],"client":["mujoco-v1 --server-host 127.0.0.1 --server-port 8000","--num-envs 1 --num-episodes 100000","--env.name Walker2d-v5 --runner.replan-steps 4 --runner.seed 0"],"env":"mujoco","source":"experiments/e28-dppo-learns/run.sh"}},{"id":"dppo-dppo-square","row":"dppo-dppo","column":"square","status":"runs","experiments":["E27"],"note":"no success yet: sparse reward, random start","note_zh":"还没成功过：稀疏奖励、随机初始化","seed":0,"curves":[[0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0]],"clip":{"cell":"dppo-dppo-square","episode":3,"of":5,"return":0.0,"length":400,"success":false,"returns":[0.0,0.0,0.0,0.0,0.0],"seconds":8.0,"speed":1.0},"train":{"server":["dppo-policy default dppo default","--port 8000 --seed 0 --policy.device cpu","--policy.env-type robomimic --policy.env-name square","--algo.buffer-size 1024 --algo.batch-size 256 --algo.train-itrs 20"],"client":["robomimic-v1 --server-host 127.0.0.1 --server-port 8000","--num-envs 1 --num-episodes 100000","--env.name square-img --env.agentview-image-size 84 84","--runner.replan-steps 4"],"env":"robomimic","source":"experiments/e27-robomimic/run_cell.sh"}}],"vla":{"task":"LIBERO-10 task 8: put both moka pots on the stove","task_zh":"LIBERO-10 第 8 题：把两个摩卡壶都放到炉子上","cells":[{"id":"pi0-base","label":"pi0.5 as released","label_zh":"原版 pi0.5","status":"reference","experiments":["E26"],"score":[29,50],"note":"untrained, the reference","note_zh":"未训练，作参照","clip":{"cell":"pi0-base","episode":1,"of":1,"return":1.0,"length":410,"success":true,"returns":[1.0],"seconds":8.24,"speed":2.5},"train":{"server":["pi0-policy default eval default","--port 8000 --policy.device cuda","--policy.name pi05_libero --policy.checkpoint-path PI05_LIBERO_CHECKPOINT"],"client":["libero-v1 --server-host 127.0.0.1 --server-port 8000","--num-envs 1 --num-procs 1 --num-episodes 50","--env.task-suite-name libero_10 --env.task-id 8","--env.no-randomize-initial-state --runner.replan-steps 5 --runner.seed 7"],"env":"libero","source":"experiments/e26-frozen-mlp/eval.sh"}},{"id":"pi0-fpo","label":"pi0-policy · FPO","label_zh":"pi0-policy · FPO","status":"collapses","experiments":["E14","E26"],"score":[0,50],"note":"one iteration takes it to 0; our defect, under investigation","note_zh":"一轮后掉到 0；是我们平台的问题，正在排查","clip":{"cell":"pi0-fpo","episode":1,"of":1,"return":0.0,"length":520,"success":false,"returns":[0.0],"seconds":6.96,"speed":3.75},"train":{"server":["pi0-policy default fpo default","--port 8000 --seed 7 --policy.device cuda:0","--policy.name pi05_libero --policy.checkpoint-path PI05_LIBERO_CHECKPOINT","--algo.learning-rate 1e-5 --algo.clipping-epsilon 0.05","--algo.num-updates-per-batch 4 --algo.n-samples-per-action 4","--algo.buffer-size 4096 --algo.batch-size 8 --algo.global-steps 4096","--algo.master-weights-device cuda:1"],"client":["libero-v1 --server-host 127.0.0.1 --server-port 8000","--num-envs 1 --num-procs 10 --num-episodes 100000","--env.task-suite-name libero_10 --env.task-id 8","--env.randomize-initial-state --runner.replan-steps 5 --runner.seed 7"],"env":"libero","source":"experiments/e26-frozen-mlp/train.sh"}},{"id":"pi0-dppo","label":"pi0-policy · DPPO","label_zh":"pi0-policy · DPPO","status":"holds","experiments":["E25"],"score":[30,50],"note":"two iterations leave it intact, having barely moved it","note_zh":"两轮后没被毁掉，但几乎没动它","clip":{"cell":"pi0-dppo","episode":1,"of":1,"return":1.0,"length":415,"success":true,"returns":[1.0],"seconds":8.32,"speed":2.5},"train":{"server":["pi0-policy default dppo libero","--port 8000 --seed 7 --policy.device cuda:0","--policy.name pi05_libero --policy.checkpoint-path PI05_LIBERO_CHECKPOINT","--algo.buffer-size 4096 --algo.batch-size 8 --algo.train-itrs 2"],"client":["libero-v1 --server-host 127.0.0.1 --server-port 8000","--num-envs 1 --num-procs 10 --num-episodes 100000","--env.task-suite-name libero_10 --env.task-id 8","--env.randomize-initial-state --runner.replan-steps 5 --runner.seed 7"],"env":"libero","source":"experiments/e25-pi0-dppo/cell.sh"}}]},"experiments":{"E6":"e6-first-learning-curve","E14":"e14-ten-iterations","E16":"e16-critic-restart","E17":"e17-second-algorithm","E18":"e18-dppo-normalised","E23":"e23-hopper","E24":"e24-coverage","E25":"e25-pi0-dppo","E26":"e26-frozen-mlp","E27":"e27-robomimic","E28":"e28-dppo-learns","E29":"e29-clamp-or-noise"},"envs":{"mujoco":{"extra":"mujoco","packages":"gymnasium 1.x, mujoco 3.x (3.6 and 3.14 here)"},"robomimic":{"extra":"robomimic","packages":"robomimic 0.4, robosuite 1.4.1, mujoco 2.3.7"},"libero":{"extra":"libero","packages":"LIBERO, robosuite 1.4.1, mujoco 2.3.7"}},"server_packages":"torch; no MuJoCo, robosuite or gymnasium on any server that trained these cells"}
+{"rows":[{"id":"fpo-fpo","label":"fpo-policy · FPO"},{"id":"fpo-dppo","label":"fpo-policy · DPPO"},{"id":"dppo-dppo","label":"dppo-policy · DPPO"}],"columns":[{"id":"cheetah","label":"HalfCheetah-v5"},{"id":"hopper","label":"Hopper-v5"},{"id":"walker","label":"Walker2d-v5"},{"id":"square","label":"robomimic square"}],"ranges":{"cheetah":[-534.5,2154.1],"hopper":[11.2,2575.4],"walker":[-2.6,1570.6],"square":[0.0,148.9]},"cells":[{"id":"fpo-fpo-cheetah","row":"fpo-fpo","column":"cheetah","status":"learns","experiments":["E6","E16"],"note":"about −300 → 1,346–2,050","note_zh":"从约 −300 升到 1,346–2,050","seed":0,"curves":[[-340.4,-335.1,-377.7,-290.9,-265.6,-234.9,-246.0,-163.0,-259.4,-136.0,-135.2,-69.6,-60.2,-38.2,-51.8,-25.7,6.9,9.9,-25.6,2.0,-1.8,11.9,5.3,85.3,36.9,82.5,156.8,191.4,256.4,320.3,333.9,411.2,222.5,479.0,370.1,510.8,366.7,575.6,356.1,577.8,179.9,550.5,456.0,553.7,666.0,781.8,575.6,748.5,609.9,827.7,403.7,390.6,559.3,609.3,576.3,700.3,699.8,885.3,841.0,981.2,964.4,526.1,1008.3,1045.2,769.8,1031.7,766.6,1052.7,1090.7,838.4,1073.5,830.8,828.6,1156.7,1237.0,1190.5,1281.6,1265.4,1072.7,1361.7,1382.7,1385.1,1017.1,1412.4,1479.8,1472.5,1523.0,1530.3,1521.3,1563.3,1612.0,1641.7,1668.9,1262.2,1465.3,1412.7,1029.3,1304.5,1496.1,1643.1],[-358.6,-285.2,-262.2,-318.8,-357.6,-256.9,-199.5,-134.8,-216.0,-207.4,-210.1,-136.2,-64.2,-140.5,-169.7,-87.4,-28.8,-61.1,9.8,62.7,58.5,120.6,101.9,255.1,291.8,314.5,409.8,105.8,425.2,387.7,611.7,373.6,651.0,570.7,651.4,731.0,748.0,740.1,825.2,414.0,816.5,674.3,805.7,815.2,864.5,877.4,1022.2,904.5,926.0,1007.5,760.4,1056.0,1048.0,1203.5,1186.1,1111.5,1250.9,1307.5,1257.8,1242.5,1298.1,1327.0,1254.8,1435.7,1235.9,1511.2,1509.7,1469.5,1649.6,1417.7,1651.7,1001.0,1738.4,1757.2,1629.4,1718.8,1671.9,1728.0,1593.8,1832.3,1903.5,1556.2,1717.0,1666.3,1703.9,1803.4,1885.9,1829.2,1901.7,1926.3,1953.9,1951.7,2001.3,1935.2,2038.4,2154.1,2087.5,2112.3,2142.7,2117.7],[-285.4,-322.1,-281.0,-312.1,-282.8,-366.2,-209.1,-230.4,-226.3,-218.5,-186.8,-240.5,-188.6,-173.8,-149.1,-143.0,-67.5,-42.8,-29.8,-14.3,39.6,120.2,164.5,147.4,213.9,254.8,241.4,335.0,364.0,417.4,350.1,504.7,500.1,528.4,617.6,621.9,637.6,767.6,679.0,682.6,771.3,776.9,862.2,755.4,802.5,845.3,830.6,866.6,948.2,987.4,875.9,631.9,729.0,1026.7,960.3,987.3,951.3,1074.2,1061.3,1166.7,1234.0,902.6,1036.4,967.0,1175.8,1212.3,1253.0,1027.4,1173.7,1013.4,1068.9,1073.1,1068.0,1311.7,1503.5,998.7,1136.5,1213.3,1293.7,1163.1,1330.8,1183.8,1042.3,1134.6,1460.8,1223.6,1221.7,1402.3,1296.6,1255.1,1257.0,1188.4,1551.9,1299.1,1236.8,1303.3,1590.8,1281.4,1392.2,1356.2]],"clip":{"cell":"fpo-fpo-cheetah","episode":5,"of":5,"return":1609.1,"length":1000,"success":false,"returns":[1679.4,1734.1,1529.3,1255.2,1609.1],"seconds":8.0,"speed":1.0},"train":{"server":["fpo-policy default fpo default","--port 8000 --seed 0 --policy.device cpu","--algo.buffer-size 4096 --algo.global-steps 409600"],"client":["mujoco-v1 --server-host 127.0.0.1 --server-port 8000","--num-envs 1 --num-episodes 100000","--env.name HalfCheetah-v5 --runner.replan-steps 1 --runner.seed 0"],"env":"mujoco","source":"experiments/e16-critic-restart/phase_a.sh"}},{"id":"fpo-fpo-hopper","row":"fpo-fpo","column":"hopper","status":"learns","experiments":["E23"],"note":"15–19 → 1,587–2,006","note_zh":"从 15–19 升到 1,587–2,006","seed":2,"curves":[[16.3,21.1,31.3,61.3,79.8,122.0,144.4,176.3,202.4,218.7,235.0,237.1,253.5,279.0,299.1,318.8,365.7,387.2,395.0,424.1,405.6,458.4,488.4,594.9,629.7,618.5,713.7,761.4,837.1,992.3,916.2,737.8,987.1,877.4,809.6,1090.9,976.2,1146.0,861.4,1185.3,1139.3,958.8,845.2,1510.4,1285.9,1282.2,819.3,1019.5,1357.1,1153.2,1712.9,1572.2,1525.4,1176.6,986.4,929.7,1197.9,1510.9,1374.2,985.7,950.0,1026.2,1147.8,997.9,966.6,1476.1,1244.0,1337.1,1375.7,1216.6,1268.1,1431.9,1477.4,1247.6,1402.8,1990.0,1794.1,1640.2,1019.8,1538.6,1370.3,1004.0,1542.7,1438.4,1834.1,1791.8,1201.4,1446.0,1412.9,1275.7,1309.2,1672.3,1535.9,1615.4,1118.2,1283.4,1443.9,1684.7,1887.6,2320.3],[19.1,21.9,35.5,56.9,102.1,143.6,179.2,203.1,230.9,238.0,219.6,245.0,224.0,241.9,246.6,251.0,277.5,300.8,332.8,374.0,350.0,322.4,373.0,382.2,393.4,359.7,383.5,374.1,430.1,404.8,474.8,469.2,499.1,652.8,598.3,704.4,653.0,662.1,826.7,762.7,791.9,814.1,982.3,877.7,875.8,941.5,958.7,948.3,1171.5,1209.7,1300.9,1291.2,1241.1,1235.8,1464.6,1268.4,1512.1,1203.2,1126.3,1564.9,1363.8,1402.2,1227.4,1961.2,1837.7,1947.1,1776.6,1903.2,1636.3,2113.4,2164.5,1415.0,1638.8,2050.3,1437.3,2444.6,1880.1,2004.9,2482.8,1954.1,2112.4,1605.2,2089.8,1956.5,2575.4,1967.4,1940.4,1904.4,2377.3,1786.3,1962.7,2441.6,1851.2,1777.1,2307.6,2574.9,1838.0,1253.3,1840.8,2210.8],[14.5,18.5,35.6,53.8,92.8,121.4,163.1,182.8,228.8,218.6,220.6,235.1,234.7,245.9,263.1,293.0,327.1,324.1,373.7,363.5,376.5,369.8,400.2,450.0,451.8,571.1,628.2,644.8,798.6,855.9,797.8,886.9,1215.1,1571.2,1118.4,1325.9,1151.5,1258.1,1181.0,1339.7,1653.9,1443.2,1272.4,1170.1,1496.0,1105.7,1419.7,1108.2,1331.0,1495.4,1199.6,1558.2,1887.1,1229.5,2034.4,1517.2,1874.0,1567.6,1480.9,1612.7,2081.5,2017.8,2152.4,1691.2,1639.1,1439.9,1502.0,1232.2,1507.7,1476.2,1523.9,1233.4,1599.6,1672.5,1999.0,1821.7,2038.0,1733.4,2177.0,1677.7,1841.6,1858.1,1965.0,1929.9,2263.2,1629.4,1926.7,1449.4,2316.0,1768.6,2306.9,2057.3,1852.1,1950.5,1221.7,1498.2,1880.3,1569.4,1571.5,1852.7]],"clip":{"cell":"fpo-fpo-hopper","episode":2,"of":5,"return":1123.2,"length":360,"success":false,"returns":[2789.9,1123.2,2846.4,468.1,456.9],"seconds":3.0,"speed":0.973},"train":{"server":["fpo-policy default fpo default","--port 8000 --seed 0 --policy.device cpu","--policy.obs-dim 11 --policy.action-dim 3","--algo.buffer-size 4096 --algo.global-steps 409600"],"client":["mujoco-v1 --server-host 127.0.0.1 --server-port 8000","--num-envs 1 --num-episodes 100000","--env.name Hopper-v5 --runner.replan-steps 1 --runner.seed 0"],"env":"mujoco","source":"experiments/e23-hopper/run.sh"}},{"id":"fpo-fpo-walker","row":"fpo-fpo","column":"walker","status":"learns","experiments":["E24"],"note":"about 0 → 964–1,101","note_zh":"从约 0 升到 964–1,101","seed":1,"curves":[[0.7,1.9,10.7,34.4,82.6,129.7,199.9,237.7,205.4,263.3,367.4,337.5,348.6,333.0,295.4,340.1,331.0,312.3,325.1,366.6,315.0,318.5,341.0,325.9,270.0,317.1,328.2,338.2,522.6,551.8,423.1,330.4,297.0,512.2,375.0,340.4,333.9,321.6,309.4,300.0,375.0,322.8,341.0,371.4,352.0,374.5,391.5,436.9,426.6,449.7,553.6,635.4,727.9,704.6,546.9,621.1,722.3,741.0,682.8,604.1,614.4,854.6,727.9,676.9,765.7,1162.1,840.5,687.8,701.1,648.6,683.8,783.0,751.0,717.6,1030.8,944.4,738.7,674.4,902.5,1238.0,770.5,824.2,598.6,1122.9,1172.4,900.4,907.7,974.6,1107.7,886.2,901.8,1165.2,1024.7,1044.9,780.2,1066.5,909.6,892.1,987.0,868.3],[-0.3,0.8,7.9,31.4,47.2,107.5,224.2,155.5,208.4,282.9,298.4,245.3,277.6,335.8,303.3,303.4,296.0,337.3,330.8,329.4,334.9,294.6,319.8,287.9,321.7,292.6,312.1,337.3,336.4,351.1,333.5,397.0,322.3,380.4,404.4,321.6,362.7,348.6,332.0,330.9,337.2,316.9,333.5,331.5,327.1,334.2,383.5,347.4,362.1,359.4,377.7,359.7,393.2,392.0,416.8,434.5,410.1,375.1,406.9,413.7,433.7,397.2,440.9,495.9,458.8,455.9,504.1,537.1,496.4,599.0,751.8,691.0,784.7,840.0,913.3,762.6,882.0,875.6,864.6,995.1,1043.6,961.0,978.4,1012.3,1129.0,906.5,892.3,832.7,763.1,881.6,1058.2,1032.4,1076.8,991.3,846.8,1042.1,1051.7,868.9,918.7,1378.1],[0.6,1.5,7.7,28.2,64.7,145.2,200.0,201.2,256.2,217.2,246.8,279.8,316.7,257.1,311.0,303.2,232.2,304.3,314.1,336.8,327.1,321.9,348.0,353.3,430.8,356.0,442.6,327.7,387.8,368.5,467.1,354.3,404.5,337.4,329.7,329.7,328.2,311.0,387.0,337.4,488.8,419.6,477.3,385.7,377.9,428.6,571.4,447.4,433.3,479.6,517.5,520.1,555.3,592.9,702.3,669.5,593.1,733.4,678.6,768.3,599.3,728.6,988.6,1054.1,600.5,680.7,953.6,823.6,872.9,986.6,1030.2,1197.6,1056.5,1032.6,1009.6,949.7,1024.4,1061.3,1165.9,1150.1,996.1,1259.8,1298.4,1331.6,979.3,1257.1,1238.0,1370.2,1031.2,1570.6,810.7,1048.3,1088.8,1401.1,1227.8,1105.7,1192.6,932.1,1052.2,1150.4]],"clip":{"cell":"fpo-fpo-walker","episode":5,"of":5,"return":837.7,"length":310,"success":false,"returns":[821.9,1329.9,440.2,933.0,837.7],"seconds":3.0,"speed":0.84},"train":{"server":["fpo-policy default fpo default","--port 8000 --seed 0 --policy.device cpu","--policy.obs-dim 17 --policy.action-dim 6","--algo.buffer-size 4096 --algo.global-steps 409600"],"client":["mujoco-v1 --server-host 127.0.0.1 --server-port 8000","--num-envs 1 --num-episodes 100000","--env.name Walker2d-v5 --runner.replan-steps 1 --runner.seed 0"],"env":"mujoco","source":"experiments/e24-coverage/run_cell.sh"}},{"id":"fpo-fpo-square","row":"fpo-fpo","column":"square","status":"runs","experiments":["E27"],"note":"no success yet: sparse reward, random start","note_zh":"还没成功过：稀疏奖励、随机初始化","seed":0,"curves":[[0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0]],"clip":{"cell":"fpo-fpo-square","episode":3,"of":5,"return":0.0,"length":400,"success":false,"returns":[0.0,0.0,0.0,0.0,0.0],"seconds":8.0,"speed":1.0},"train":{"server":["fpo-policy default fpo default","--port 8000 --seed 0 --policy.device cpu","--policy.obs-dim 23 --policy.action-dim 7","--policy.state-keys robot0_eef_pos robot0_eef_quat robot0_gripper_qpos object","--algo.buffer-size 4096 --algo.global-steps 81920"],"client":["robomimic-v1 --server-host 127.0.0.1 --server-port 8000","--num-envs 1 --num-episodes 100000","--env.name square-img --env.agentview-image-size 84 84","--runner.replan-steps 1"],"env":"robomimic","source":"experiments/e27-robomimic/run_cell.sh"}},{"id":"fpo-dppo-cheetah","row":"fpo-dppo","column":"cheetah","status":"learns","experiments":["E17","E18","E30","E33"],"note":"+1,294 to +1,411 with dppo-policy's structure","note_zh":"换成 dppo-policy 的结构后 +1294 到 +1411","seed":0,"curves":[[-185.8,-335.4,-284.4,-244.1,-271.1,-269.5,-296.8,-266.4,-229.8,-158.9,-228.5,-305.1,-269.2,-258.3,-246.2,-237.8,-246.2,-289.3,-252.4,-286.3,-315.9,-283.8,-254.2,-281.6,-220.6,-271.2,-247.6,-287.4,-255.5,-201.0,-312.7,-215.8,-211.3,-258.6,-286.0,-225.9,-315.7,-235.0,-233.2,-259.2,-266.2,-242.7,-253.0,-264.1,-219.1,-243.9,-339.1,-221.6,-222.0,-343.1,-272.1,-211.4,-294.7,-273.5,-255.8,-262.8,-239.5,-225.7,-292.4,-315.5,-249.4,-264.7,-210.4,-221.8,-213.1,-220.0,-208.8,-247.6,-228.9,-206.5,-291.0,-205.8,-209.5,-210.3,-194.4,-243.6,-255.6,-220.9,-208.2,-243.9,-283.9,-262.3,-167.0,-207.6,-179.1,-180.7,-241.2,-183.7,-218.4,-213.4,-241.0,-215.6,-261.7,-250.0,-182.7,-148.8,-149.8,-159.2,-202.6,-183.5,-145.7,-148.0,-203.8,-127.4,-192.6,-148.8,-165.5,-216.4,-203.4,-152.5,-181.0,-158.6,-157.2,-191.9,-124.5,-187.6,-163.0,-163.9,-117.0,-158.0,-202.6,-167.9,-173.9,-168.4,-171.3,-160.4,-147.7,-145.6,-135.5,-131.7,-172.9,-171.3,-195.8,-141.7,-171.4,-181.1,-162.2,-174.1,-178.3,-180.1,-117.0,-146.4,-159.2,-166.9,-95.9,-137.8,-114.7,-177.2,-151.5,-131.1,-186.8,-176.9,-155.3,-111.3,-168.6,-195.5,-148.5,-139.2,-118.3,-127.4,-144.5,-174.0,-174.1,-142.7,-144.7,-193.4,-145.5,-132.4,-146.0,-144.9,-130.4,-90.5,-153.1,-120.0,-102.5,-94.5,-120.0,-146.4,-99.2,-140.1,-138.0,-190.2,-148.0,-195.3,-138.7,-160.9,-149.5,-147.3,-132.6,-107.2,-154.3,-138.3,-164.1,-136.8,-109.6,-116.6,-90.8,-51.7,-143.9,-85.6,-71.8,-80.9,-32.4,-54.8,-15.5,-109.7,-42.0,-84.5,-60.9,-3.0,-34.0,-11.5,56.4,48.3,-7.4,36.8,104.0,20.3,97.9,89.5,132.4,172.8,73.1,124.8,131.4,155.9,152.3,165.0,156.7,155.5,91.6,171.4,202.9,251.4,147.0,179.0,217.4,253.3,267.0,242.6,306.8,282.2,399.6,374.4,323.2,371.9,352.7,402.3,435.7,373.4,543.8,521.1,556.4,454.4,458.8,521.0,503.1,628.2,501.9,643.3,580.2,738.3,625.4,772.2,709.3,695.6,809.1,831.6,724.8,782.4,836.6,674.0,846.3,829.8,1071.9,1076.5,907.6,826.2,1170.0,904.3,1085.7,795.3,1008.9,816.0,1105.9,850.9,994.7,1145.4,987.4,920.4,1280.2,1087.6,1150.2,1258.6,1094.1,1112.0,1020.6,1186.6,1330.1,932.8],[-226.2,-289.1,-231.6,-254.8,-273.2,-273.3,-227.2,-237.6,-322.4,-247.1,-281.3,-335.0,-244.7,-221.1,-269.8,-271.2,-263.5,-273.0,-272.9,-323.7,-301.4,-286.8,-307.7,-283.4,-273.1,-251.5,-239.2,-243.0,-241.5,-237.9,-253.6,-266.4,-240.5,-279.2,-285.6,-233.8,-282.9,-268.1,-194.0,-234.6,-272.9,-294.4,-236.6,-285.0,-188.0,-231.0,-308.3,-261.9,-271.6,-330.0,-306.8,-241.3,-245.2,-321.8,-187.5,-240.0,-254.0,-260.4,-253.8,-271.1,-225.3,-305.5,-238.1,-284.4,-238.5,-263.3,-188.4,-209.4,-292.7,-250.0,-207.7,-179.2,-252.5,-210.0,-207.9,-241.6,-300.8,-169.1,-203.2,-237.7,-213.9,-236.4,-177.2,-213.9,-284.4,-233.9,-222.8,-205.5,-180.8,-179.8,-187.2,-183.1,-173.0,-264.6,-192.7,-212.7,-217.3,-141.9,-202.9,-213.1,-116.1,-179.9,-135.1,-230.6,-141.9,-147.4,-191.5,-217.4,-205.5,-165.4,-175.4,-197.3,-158.1,-216.5,-158.0,-154.1,-173.8,-176.9,-172.6,-217.0,-167.6,-123.0,-176.2,-124.9,-131.4,-148.2,-151.0,-149.5,-172.2,-121.3,-115.0,-96.1,-137.2,-144.6,-154.7,-110.2,-146.1,-161.7,-133.2,-125.6,-139.9,-107.3,-125.0,-154.2,-101.1,-139.6,-98.9,-110.9,-155.7,-119.4,-161.7,-115.7,-175.5,-167.2,-177.0,-100.1,-114.6,-152.3,-129.7,-125.9,-126.2,-108.6,-184.6,-135.8,-120.7,-127.0,-123.8,-75.4,-169.4,-115.7,-134.9,-124.1,-202.4,-109.3,-115.0,-83.3,-129.3,-125.5,-100.8,-81.6,-86.1,-123.3,-117.0,-84.6,-72.1,-89.7,-101.4,-92.8,-70.9,-131.7,-55.4,-72.4,-91.8,-58.9,-89.7,-87.8,-32.2,-58.8,-27.5,-75.8,-58.4,-47.6,-94.6,-71.9,-22.6,4.6,-54.1,15.1,24.0,18.4,97.5,88.0,178.7,99.2,-26.5,61.9,47.2,143.6,125.9,202.8,199.5,203.0,240.4,196.1,259.3,314.0,244.4,330.7,390.0,357.2,320.0,220.9,356.3,333.2,293.8,399.8,384.6,382.6,329.5,435.2,404.0,221.4,444.9,383.7,530.9,551.6,463.0,462.8,433.1,482.6,517.3,499.8,494.2,495.6,551.1,502.8,593.5,482.1,554.6,437.6,574.5,489.8,188.8,629.0,507.4,518.4,557.6,606.6,621.1,590.3,654.8,663.3,625.6,503.2,645.7,552.2,689.6,631.4,668.0,843.5,624.8,834.3,1025.1,1006.3,967.7,1044.3,652.4,1125.4,963.9,1049.2,1013.0,1046.6,1254.7,1171.5,1070.1,1245.3,1234.5,1297.5,1275.2,1242.2],[-271.0,-308.1,-264.4,-282.2,-200.2,-259.0,-286.7,-285.5,-239.0,-218.0,-307.1,-264.2,-280.3,-301.4,-259.1,-263.8,-279.4,-304.1,-338.3,-189.2,-243.0,-240.0,-295.0,-256.9,-272.3,-271.8,-279.5,-221.4,-214.0,-260.5,-278.7,-240.4,-240.0,-298.7,-310.2,-357.8,-278.7,-239.6,-304.6,-240.8,-200.9,-284.2,-207.6,-187.5,-293.8,-216.5,-293.1,-195.1,-201.0,-265.4,-215.6,-267.8,-248.5,-225.6,-261.3,-242.3,-305.4,-278.9,-176.3,-224.3,-212.0,-290.0,-287.5,-247.6,-281.5,-235.6,-289.6,-296.4,-226.9,-308.0,-197.0,-257.0,-184.1,-243.8,-162.9,-253.6,-226.4,-166.3,-242.5,-224.2,-237.3,-183.9,-137.2,-186.8,-149.2,-130.3,-225.5,-104.7,-187.2,-171.3,-229.6,-123.3,-205.2,-151.7,-187.6,-132.4,-168.7,-162.0,-147.2,-189.5,-174.9,-246.0,-159.5,-131.6,-159.2,-132.9,-83.0,-105.3,-137.7,-102.8,-118.8,-150.5,-141.2,-108.7,-157.2,-136.7,-150.1,-167.4,-100.4,-119.4,-129.0,-119.0,-129.2,-136.2,-112.7,-127.3,-112.9,-96.0,-114.6,-109.9,-61.9,-113.5,-46.0,-113.0,-142.7,-95.4,-99.7,-60.3,-124.3,-102.8,-117.4,-143.7,-130.9,-110.5,-96.3,-138.8,-187.7,-67.8,-139.6,-95.1,-91.7,-101.0,-98.4,-65.3,-51.4,-53.0,-107.2,-75.5,-79.2,-102.2,-52.5,-73.1,-51.1,-48.2,-92.2,-59.2,-46.9,-67.6,-49.0,-1.1,-18.1,-8.1,-40.4,-18.0,-17.5,-55.3,-0.4,-14.9,-45.2,32.3,16.1,15.9,89.9,40.2,139.2,97.1,76.1,150.0,139.0,228.8,225.7,305.6,288.6,273.4,332.4,380.1,355.0,402.3,319.5,300.8,252.5,392.3,331.0,451.3,341.0,247.0,445.4,495.7,522.0,537.0,556.2,435.9,506.4,476.7,508.3,591.1,636.1,593.5,650.0,646.9,625.8,504.3,571.9,698.9,558.4,486.2,580.6,627.2,671.1,748.3,791.8,827.2,860.4,698.9,810.0,717.8,775.3,553.4,753.2,755.7,729.6,801.9,841.1,894.0,745.1,879.9,882.4,964.0,898.3,909.6,851.9,932.3,999.4,998.9,913.7,1073.5,1023.9,982.5,969.7,1079.4,1069.5,960.0,1119.0,1111.0,1064.9,992.8,1056.9,1207.0,1069.6,1074.8,1025.3,1042.2,1083.2,1009.9,959.7,914.4,1016.5,902.4,980.0,1012.8,1070.6,1005.0,1028.7,991.7,1014.4,1012.8,1086.4,1088.7,1076.1,1114.1,1044.1,1037.2,968.7,1000.8,1125.1,1047.4,1000.1,872.8,1013.3,1115.3]],"clip":{"cell":"fpo-dppo-cheetah","episode":2,"of":5,"return":703.8,"length":1000,"success":false,"returns":[437.6,703.8,632.5,1132.3,854.4],"seconds":8.0,"speed":1.0},"train":{"server":["fpo-policy default dppo cheetah","--port 8000 --seed 0 --policy.device cpu","--policy.obs-dim 17 --policy.action-dim 6","--policy.action-horizon 4 --policy.flow-steps 20 --policy.hidden-dims 512 512 512","--algo.sampling-noise-level 1.0 --algo.logprob-noise-level 1.0","--algo.buffer-size 1024 --algo.batch-size 512 --algo.train-itrs 300"],"client":["mujoco-v1 --server-host 127.0.0.1 --server-port 8000","--num-envs 1 --num-episodes 100000","--env.name HalfCheetah-v5 --runner.replan-steps 4 --runner.seed 0"],"env":"mujoco","source":"experiments/e33-fpo-dppo-structure/run.sh"}},{"id":"fpo-dppo-hopper","row":"fpo-dppo","column":"hopper","status":"learns","experiments":["E28","E29","E30","E33"],"note":"998–1,037 with dppo-policy's structure, mostly by staying up","note_zh":"换成 dppo-policy 的结构后 998–1037，主要靠站住不倒","seed":3,"curves":[[19.2,17.9,18.0,19.7,21.0,21.3,26.1,23.2,29.4,31.6,34.9,39.8,46.0,49.2,62.5,62.5,81.7,79.6,85.7,89.8,106.0,110.5,105.4,106.5,113.3,117.2,142.9,144.8,150.8,163.1,152.2,180.4,171.2,202.0,195.2,227.9,229.9,229.0,234.1,241.4,218.3,234.6,227.5,244.7,247.7,248.9,250.6,255.7,242.5,258.7,263.7,255.3,275.9,266.4,255.2,273.1,275.4,294.5,284.6,287.1,300.4,324.7,327.4,365.4,433.5,349.4,451.6,423.2,479.8,424.2,430.8,490.3,441.3,518.5,491.2,558.3,542.2,600.0,481.6,503.3,615.7,480.7,652.0,740.0,695.6,756.1,930.0,758.2,850.5,940.5,1018.7,1009.7,1007.1,893.7,830.8,1015.3,833.5,1004.5,926.5,848.5,1014.0,1037.7,939.4,955.1,1016.2,1001.4,994.4,878.1,847.4,980.7,779.5,1015.5,1002.6,1004.8,1009.0,811.7,836.2,844.2,839.3,878.2,979.7,844.9,912.7,895.0,1034.1,1049.4,920.5,941.1,1015.9,1051.3,1024.4,1035.3,1036.5,943.6,970.6,1036.5,1017.8,1011.4,882.1,1021.3,1032.2,1017.2,1009.9,1016.9,1019.4,1009.3,952.9,1022.9,1018.8,1034.9,953.5,1023.8,1031.9,1028.8,1015.1,919.5,906.3,1018.1,1025.7,1013.4,1023.1,1019.2,1024.8,1009.9,1014.1,1019.4,1014.4,1015.4,1018.8,1015.8,1031.4,915.2,1055.7,942.9,1014.4,979.4,1009.8,945.5,822.0,906.3,742.1,1052.7,965.6,991.2,947.4,1022.2,926.5,1045.0,1006.3,862.2,1035.9,874.9,1035.3,999.6,1004.8,854.2,900.0,758.4,976.8,865.9,1071.1,1015.7,895.8,1003.3,1061.4,879.9,770.1,941.6,794.9,1096.0,882.5,882.1,1022.1,909.4,870.0,881.6,1040.1,1072.4,1079.7,920.1,1023.1,913.6,853.1,1071.4,904.6,781.0,1104.5,996.9,980.6,923.3,931.8,976.0,934.5,980.3,1055.5,1015.0,1068.7,1072.0,1037.3,1042.1,966.3,1014.3,1044.4,1037.7,1037.8,1036.0,1037.7,1036.0,1044.5,1035.6,1043.3,1026.0,1023.8,1015.2,1015.1,1021.0,1030.1,1033.2,1031.8,1032.1,1040.4,1028.6,1032.1,927.9,1035.6,1034.5,1027.1,1022.1,1025.7,1032.2,1029.5,1028.0,1034.6,1006.8,950.9,974.8,865.4,856.6,982.0,1060.5,918.0,1034.4,994.4,1021.8,1021.2,1027.2,1019.9,1031.1,1030.2,1021.4,1035.3,1026.1,1035.8,1054.7,1048.6,1059.6,1060.3,1067.0,1063.3,795.2],[16.4,18.8,17.3,21.8,20.2,23.7,21.4,23.7,24.6,24.2,33.7,40.0,44.0,56.1,60.3,69.0,72.2,80.3,79.6,97.6,104.5,107.4,115.9,107.5,125.2,128.9,163.4,153.4,180.8,166.4,185.9,185.1,200.7,213.9,216.5,228.3,238.2,244.7,240.7,254.9,240.3,243.7,249.7,238.5,257.5,262.4,248.9,240.7,246.7,247.5,263.9,246.4,264.2,286.0,259.6,282.2,278.4,263.5,264.5,286.9,276.7,283.0,256.4,274.0,251.3,261.2,262.1,262.7,290.0,284.8,278.7,303.7,341.3,301.4,404.1,339.2,424.8,372.7,366.9,367.5,379.8,372.2,381.9,373.8,377.5,427.0,472.7,435.0,506.1,454.7,496.8,469.8,483.8,567.7,599.9,656.5,868.1,726.4,922.6,887.5,836.5,847.7,934.7,778.2,883.0,1029.2,975.0,953.5,996.6,1008.2,854.6,1011.1,854.2,1003.8,732.3,865.6,1029.4,1025.7,1021.7,1021.0,1011.5,827.8,1011.2,1008.8,1015.7,847.3,999.7,887.6,993.8,1000.6,1003.0,1001.7,1002.9,1001.0,1007.2,1004.1,889.9,1005.8,1001.6,1000.4,1006.8,996.5,1003.2,1006.0,1004.2,996.5,1001.4,1010.4,1003.9,1003.9,1004.4,816.3,1008.3,987.7,1008.1,1007.4,1002.7,1002.3,1001.2,1002.8,1005.3,1006.8,1010.4,1002.5,1000.5,994.0,1003.1,1011.9,1009.4,1006.4,1016.3,1009.0,1017.3,1011.1,999.5,1008.8,1010.2,1006.5,1010.7,1009.9,1000.6,1011.5,1006.2,1010.2,984.1,1007.9,1009.4,1012.9,1007.7,1012.2,1012.3,1013.4,1005.2,1013.2,1009.9,999.7,1003.6,1005.1,1009.9,1007.7,1004.3,1009.7,1002.0,1011.6,1005.2,1011.9,1008.0,1005.3,1010.5,1010.3,1002.7,1008.5,1007.7,1009.9,1009.1,1005.4,1005.1,1006.9,1004.9,1011.2,1006.0,1005.8,1007.2,1000.1,1002.1,999.7,1002.7,1005.1,1004.1,1005.2,999.9,1004.8,1008.5,1002.2,1009.3,1002.4,996.9,1005.8,1008.5,1000.7,999.4,995.2,1000.9,1001.8,997.0,1005.4,918.0,996.4,1005.6,1001.6,1009.7,1006.3,1004.6,998.2,1001.0,1000.0,1004.1,1001.9,998.7,1003.0,1007.9,1003.3,1004.2,999.1,998.4,1000.5,1000.2,1003.1,996.2,997.2,1000.6,970.8,1002.0,1002.4,1004.6,1006.5,1000.7,1000.3,908.0,1001.8,998.8,1004.0,999.1,1008.8,998.1,971.9,995.2,995.2,995.5,1000.7,998.1,999.6,999.5,998.5,995.9,1000.9,999.2,997.8,996.9,993.7],[17.6,17.4,17.5,20.0,18.2,19.8,25.1,21.9,27.2,25.4,33.4,35.0,38.2,44.7,57.8,68.1,65.9,82.4,78.4,79.4,81.6,93.5,81.0,104.6,130.7,111.5,126.5,124.9,135.9,155.5,155.5,193.5,195.4,199.4,201.6,201.9,225.5,207.8,224.7,237.6,218.8,233.0,244.0,253.6,246.4,241.8,263.4,255.6,271.5,245.7,248.8,256.4,255.0,264.0,277.5,272.9,292.8,295.3,305.2,333.4,368.6,387.4,395.6,357.8,423.7,440.1,514.3,433.1,434.6,454.7,501.5,519.2,477.2,463.3,629.9,429.2,474.3,487.5,489.1,642.3,511.8,541.7,580.7,616.9,865.8,922.8,932.6,787.8,1058.7,929.2,934.4,1007.4,937.6,937.0,1019.1,906.1,876.7,867.5,1031.9,920.3,1105.6,1036.1,780.9,843.9,920.2,918.5,965.1,814.6,865.3,827.1,861.6,907.6,887.9,1028.3,1044.5,1047.5,903.9,963.1,1059.1,828.9,1067.0,1070.4,1066.9,969.1,992.6,855.9,953.3,914.8,1061.2,1005.3,918.3,1044.3,1009.1,1054.6,845.1,1067.5,908.6,1069.4,1052.8,1066.6,1078.7,1071.9,1095.8,1022.2,1079.3,946.4,1068.4,927.4,1082.3,1048.8,983.0,1058.5,1042.3,987.1,1049.7,1050.6,1077.9,896.4,704.1,905.3,1064.3,716.3,907.4,1013.4,983.0,752.1,885.4,1085.2,829.3,821.2,954.7,1075.7,914.6,1057.7,1021.3,1032.5,1052.6,999.8,1060.1,966.5,1078.4,925.5,1013.6,997.2,1047.7,1106.1,980.7,903.2,1082.4,914.5,1015.3,949.0,867.2,889.4,959.3,1022.8,949.5,1065.6,1057.9,1083.3,1003.1,1078.8,997.3,1007.3,1089.9,1008.2,1059.2,958.6,965.0,969.7,1033.6,925.8,1063.1,950.4,1104.3,1073.8,1000.4,859.2,912.8,1093.6,929.0,1054.2,902.9,1067.9,1058.0,950.7,1114.6,1011.4,1071.9,1011.6,1071.5,1049.4,1074.7,1065.6,787.5,1066.3,1056.9,1060.5,1057.8,818.4,861.8,1058.1,1048.0,1054.5,1054.5,1037.4,1060.1,1045.9,1023.4,1033.8,1063.6,1044.6,1045.4,1044.8,869.0,1059.8,813.5,1068.9,1005.0,930.1,1007.1,1038.2,1020.6,1024.5,1023.7,1028.5,1030.0,1033.6,1036.6,942.2,1037.8,1043.5,1058.0,1037.8,1044.1,1053.9,1046.7,1062.6,1046.2,950.7,1039.4,962.6,952.0,888.6,1053.7,1017.2,1059.5,1065.6,1050.9,1063.2,1032.0,1040.2,1042.0,1052.6,1039.7,1057.1,1066.1,1036.0,1040.2,961.2]],"clip":{"cell":"fpo-dppo-hopper","episode":5,"of":5,"return":850.5,"length":621,"success":false,"returns":[1050.4,326.3,1069.6,824.1,850.5],"seconds":5.0,"speed":1.0},"train":{"server":["fpo-policy default dppo hopper","--port 8000 --seed 0 --policy.device cpu","--policy.obs-dim 11 --policy.action-dim 3","--policy.action-horizon 4 --policy.flow-steps 20 --policy.hidden-dims 512 512 512","--algo.sampling-noise-level 1.0 --algo.logprob-noise-level 1.0","--algo.buffer-size 1024 --algo.batch-size 512 --algo.train-itrs 300"],"client":["mujoco-v1 --server-host 127.0.0.1 --server-port 8000","--num-envs 1 --num-episodes 100000","--env.name Hopper-v5 --runner.replan-steps 4 --runner.seed 0"],"env":"mujoco","source":"experiments/e33-fpo-dppo-structure/run.sh"}},{"id":"fpo-dppo-walker","row":"fpo-dppo","column":"walker","status":"learns","experiments":["E28","E33"],"note":"283–569 with dppo-policy's structure; 2 of 3 seeds past the bar","note_zh":"换成 dppo-policy 的结构后 283–569，3 个种子里 2 个过线","seed":0,"curves":[[2.5,3.0,2.7,3.3,3.0,3.5,4.2,3.8,4.4,4.8,6.9,7.4,10.1,12.1,16.9,23.7,45.8,75.9,80.3,80.4,154.6,124.6,126.4,238.5,205.4,244.5,292.9,307.1,241.1,234.0,280.9,235.9,225.4,215.4,249.1,292.9,253.9,250.5,266.7,246.7,292.9,251.5,251.0,274.1,255.3,242.8,263.3,279.7,259.7,303.8,263.1,296.4,258.4,322.3,255.2,284.7,314.0,315.6,294.9,287.0,285.4,285.7,277.0,295.3,281.8,241.6,287.1,256.6,273.4,277.0,263.5,293.1,287.9,259.1,297.9,285.4,312.2,283.3,262.2,251.1,274.8,260.7,253.3,278.7,262.2,273.3,247.7,274.9,260.9,288.9,280.1,245.3,254.4,279.1,233.8,262.8,301.5,243.5,296.7,308.6,293.1,284.7,260.4,277.7,296.0,284.9,261.5,304.1,283.6,265.4,293.3,289.9,289.8,296.5,262.3,296.4,313.9,296.0,286.8,250.2,265.5,285.8,303.9,266.8,253.8,267.4,305.1,327.2,322.8,312.8,275.3,280.2,290.9,257.3,296.7,314.2,294.2,283.0,302.9,251.8,296.0,299.3,311.0,262.4,266.2,326.2,296.2,307.7,283.1,268.8,270.2,286.3,292.6,296.3,292.0,271.1,275.6,274.8,290.7,287.4,287.2,280.5,309.4,294.9,291.4,304.9,286.6,286.3,311.5,291.9,295.6,308.3,278.3,316.1,315.9,312.4,289.7,317.1,275.2,323.6,300.2,306.1,308.4,257.5,300.3,301.3,283.2,295.0,311.2,298.5,357.8,301.3,297.2,322.1,295.8,332.9,419.1,289.1,310.4,288.8,299.1,325.4,315.3,332.4,300.8,309.3,301.5,349.4,295.3,293.5,279.6,313.9,312.4,328.6,291.6,348.5,286.1,315.3,341.5,345.2,358.4,360.4,365.9,316.5,328.2,388.1,473.9,430.2,378.6,404.7,525.1,542.3,477.2,354.0,543.0,553.9,643.3,499.6,687.0,505.0,550.6,422.1,477.1,411.6,378.9,403.3,388.0,471.2,507.2,372.1,449.4,361.9,349.7,401.3,355.4,362.5,428.9,378.6,371.9,412.1,449.6,412.6,411.8,674.8,446.4,442.2,457.0,603.7,430.2,473.2,698.3,508.1,383.6,376.3,617.1,399.7,502.9,313.3,428.3,374.4,337.3,398.0,469.5,379.1,451.7,501.8,378.4,501.6,392.9,515.2,484.5,386.6,602.6,862.6,461.2,858.0,474.6,482.3,550.4,456.8],[3.0,3.0,3.4,4.0,2.9,2.8,4.7,4.1,4.8,4.3,6.1,6.9,7.4,10.8,9.9,21.9,28.2,31.8,78.5,91.8,80.8,107.7,171.2,209.3,250.0,237.5,245.1,226.5,247.1,215.7,298.8,250.5,316.9,251.4,255.4,263.7,249.8,295.7,300.2,269.0,262.7,256.1,278.7,299.1,304.3,258.3,293.0,276.6,271.8,259.3,316.3,278.9,293.0,296.8,257.8,287.1,296.1,276.4,323.8,282.6,277.2,263.9,276.0,272.9,269.0,277.6,285.8,298.2,288.5,288.0,282.1,283.2,276.0,290.9,244.8,301.1,288.3,262.3,275.9,266.4,273.0,282.9,299.1,237.7,288.0,296.4,286.5,288.9,262.1,298.3,290.8,275.4,297.3,282.1,286.8,279.1,263.4,281.1,247.5,297.1,331.6,290.7,284.4,310.4,292.4,332.0,259.1,243.2,287.2,324.7,281.6,287.0,267.5,326.4,306.3,284.5,245.3,312.2,305.2,307.1,285.7,274.7,300.1,267.9,266.2,280.0,266.5,287.3,286.6,306.5,255.6,266.0,270.4,304.1,283.9,288.3,318.1,337.6,312.3,279.9,290.3,270.5,293.8,334.1,320.8,243.6,280.2,247.8,291.2,278.1,314.2,277.8,289.1,271.7,299.8,318.6,282.3,268.2,318.6,268.7,284.6,323.3,339.3,299.2,279.0,281.3,302.8,324.8,318.6,298.1,273.5,266.6,326.1,278.6,291.6,300.2,291.6,306.1,288.3,273.5,287.3,272.7,276.2,319.0,243.8,286.9,279.8,263.7,281.9,279.1,296.8,309.1,304.4,310.0,291.0,272.1,266.3,242.5,253.8,277.2,245.8,278.6,291.1,312.3,295.0,298.8,274.3,281.5,271.1,281.5,292.8,264.0,282.1,273.7,273.4,295.8,281.7,297.7,274.1,277.4,291.0,264.2,279.2,273.1,280.8,274.0,274.0,264.0,282.3,291.0,244.6,278.4,296.6,298.7,242.6,243.5,252.9,257.8,274.8,307.7,219.1,294.2,284.4,311.7,293.7,293.1,281.3,268.8,298.2,288.5,276.0,302.3,284.9,269.2,319.7,284.3,311.2,303.5,282.3,270.5,300.5,289.2,302.4,265.7,294.6,315.5,280.7,275.3,281.9,257.2,324.2,318.9,288.8,307.7,292.8,299.4,289.5,268.9,295.8,296.2,275.3,290.4,285.4,321.6,310.3,295.1,310.1,292.9,270.5,263.6,267.7,284.7,253.4,322.4,271.4,277.4,307.1,285.2,299.7,258.7],[2.5,1.6,4.0,2.3,2.7,3.1,3.2,3.7,4.7,4.9,4.8,6.0,6.6,10.1,12.3,22.1,28.8,45.8,52.5,72.1,130.9,158.5,147.7,215.2,253.6,239.5,268.8,209.1,274.2,226.4,233.0,275.4,295.2,239.8,238.3,280.5,255.7,243.0,288.8,285.6,294.3,259.9,252.0,309.6,291.3,273.9,265.8,265.8,290.3,275.1,298.5,300.7,275.0,312.5,279.9,276.8,272.9,286.4,279.0,242.0,267.2,309.4,282.8,289.4,277.6,265.8,295.2,268.0,298.8,294.7,297.5,264.3,293.1,277.1,265.5,280.9,314.4,326.9,277.0,282.4,282.7,309.9,284.4,308.8,290.7,279.0,301.6,346.1,343.1,304.3,255.6,292.0,255.7,276.0,261.6,302.4,263.9,283.5,321.4,312.1,313.3,313.4,293.5,276.9,282.1,301.5,285.3,313.7,272.6,297.1,280.7,291.7,281.1,293.1,262.1,326.0,295.4,320.4,320.0,334.4,278.4,285.6,276.5,300.5,277.3,289.2,271.8,291.3,267.0,293.7,289.2,312.0,295.9,303.6,301.2,301.8,262.9,302.7,284.8,296.1,335.5,268.0,286.5,345.8,313.3,322.7,312.0,315.6,315.0,345.9,330.6,369.6,342.1,254.4,280.3,325.3,328.9,252.7,314.2,294.7,287.6,309.9,292.8,302.7,307.5,300.0,312.9,305.6,308.7,327.1,303.7,298.5,319.5,292.2,369.0,358.6,297.2,350.2,298.8,303.4,313.1,309.0,322.3,323.4,309.4,308.8,298.4,311.5,306.5,318.7,378.7,325.5,318.9,273.2,289.2,290.2,306.9,338.4,318.1,314.4,312.7,311.6,314.9,288.0,272.8,281.4,270.7,325.6,327.6,315.6,403.1,319.8,327.3,315.0,300.7,291.8,339.5,321.3,348.3,355.6,295.5,425.5,401.9,417.7,310.4,330.4,350.0,366.3,372.2,403.2,280.6,429.3,511.6,415.8,284.0,512.3,357.1,371.1,455.3,327.2,353.0,405.9,371.1,301.6,400.1,412.3,315.8,432.4,413.1,626.6,431.3,429.1,609.0,522.8,443.3,692.9,660.4,441.3,523.6,469.8,479.6,603.9,433.8,495.5,598.9,447.4,748.1,688.3,605.7,571.5,656.3,502.6,537.0,484.2,642.8,589.1,559.2,624.1,817.3,555.0,749.5,704.3,624.1,783.2,461.2,584.2,783.0,827.1,769.7,542.1,550.7,746.9,503.4,505.5,690.1,666.9,597.1,387.2,347.6,689.9]],"clip":{"cell":"fpo-dppo-walker","episode":3,"of":5,"return":348.4,"length":368,"success":false,"returns":[52.2,1011.9,348.4,449.0,341.5],"seconds":3.0,"speed":0.987},"train":{"server":["fpo-policy default dppo walker","--port 8000 --seed 0 --policy.device cpu","--policy.obs-dim 17 --policy.action-dim 6","--policy.action-horizon 4 --policy.flow-steps 20 --policy.hidden-dims 512 512 512","--algo.sampling-noise-level 1.0 --algo.logprob-noise-level 1.0","--algo.buffer-size 1024 --algo.batch-size 512 --algo.train-itrs 300"],"client":["mujoco-v1 --server-host 127.0.0.1 --server-port 8000","--num-envs 1 --num-episodes 100000","--env.name Walker2d-v5 --runner.replan-steps 4 --runner.seed 0"],"env":"mujoco","source":"experiments/e33-fpo-dppo-structure/run.sh"}},{"id":"fpo-dppo-square","row":"fpo-dppo","column":"square","status":"runs","experiments":["E27"],"note":"no success yet: sparse reward, random start","note_zh":"还没成功过：稀疏奖励、随机初始化","seed":0,"curves":[[0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0]],"clip":{"cell":"fpo-dppo-square","episode":3,"of":5,"return":0.0,"length":400,"success":false,"returns":[0.0,0.0,0.0,0.0,0.0],"seconds":8.0,"speed":1.0},"train":{"server":["fpo-policy default dppo default","--port 8000 --seed 0 --policy.device cpu","--policy.obs-dim 23 --policy.action-dim 7","--policy.state-keys robot0_eef_pos robot0_eef_quat robot0_gripper_qpos object","--algo.buffer-size 4096 --algo.batch-size 256 --algo.train-itrs 20"],"client":["robomimic-v1 --server-host 127.0.0.1 --server-port 8000","--num-envs 1 --num-episodes 100000","--env.name square-img --env.agentview-image-size 84 84","--runner.replan-steps 1"],"env":"robomimic","source":"experiments/e27-robomimic/run_cell.sh"}},{"id":"dppo-dppo-cheetah","row":"dppo-dppo","column":"cheetah","status":"learns","experiments":["E28"],"note":"+84 to +544; 2 of 3 seeds past the bar","note_zh":"+84 到 +544，3 个种子里 2 个过线","seed":0,"curves":[[-386.3,-436.7,-405.4,-406.3,-349.2,-419.9,-437.5,-429.6,-446.1,-443.9,-393.0,-369.2,-433.3,-349.4,-358.3,-384.0,-355.9,-440.2,-364.4,-373.5,-364.0,-378.6,-419.6,-381.4,-326.7,-425.5,-396.4,-431.5,-367.3,-377.0,-374.4,-332.7,-349.8,-282.9,-327.5,-299.5,-330.3,-282.7,-333.3,-305.2,-368.1,-426.3,-319.1,-381.3,-318.5,-279.7,-334.8,-335.3,-253.6,-302.6,-269.6,-356.5,-363.9,-385.3,-356.5,-331.1,-304.2,-274.2,-303.2,-241.1,-228.8,-281.7,-223.9,-232.8,-297.4,-287.3,-212.7,-306.3,-235.5,-277.3,-260.3,-272.4,-232.8,-221.3,-137.7,-236.2,-127.6,-189.2,-125.1,-95.3,-181.3,-92.6,-101.7,-101.0,-66.7,-51.8,-3.5,-29.1,-26.5,74.2,66.1,84.4,-2.0,59.5,163.5,-5.1,204.7,122.4,72.3,179.0],[-445.0,-379.3,-319.7,-376.3,-370.8,-360.5,-397.6,-435.5,-331.9,-408.6,-358.6,-406.6,-358.1,-348.4,-429.4,-426.3,-403.1,-413.8,-438.7,-355.2,-410.6,-462.3,-432.7,-395.6,-380.7,-399.9,-349.2,-389.7,-474.9,-420.3,-399.7,-416.8,-411.1,-414.9,-382.8,-367.8,-292.3,-357.4,-331.0,-364.7,-387.3,-416.7,-401.7,-351.5,-331.0,-417.6,-370.6,-376.6,-379.9,-359.3,-391.5,-346.0,-401.0,-393.6,-381.2,-534.5,-412.4,-425.4,-471.4,-374.2,-370.2,-496.7,-334.2,-310.9,-356.7,-383.5,-312.5,-333.8,-415.4,-369.1,-314.4,-402.9,-368.5,-349.2,-374.5,-349.2,-380.0,-406.9,-342.4,-369.6,-376.5,-351.9,-354.4,-435.9,-379.7,-363.3,-390.1,-283.9,-396.5,-370.1,-401.8,-389.1,-382.5,-346.0,-394.5,-342.4,-362.6,-334.1,-346.0,-312.7],[-382.1,-354.2,-412.8,-321.7,-353.0,-396.2,-394.0,-353.1,-344.1,-469.5,-398.2,-476.0,-360.8,-460.3,-413.5,-367.7,-348.7,-414.7,-402.9,-384.4,-348.5,-408.5,-371.9,-417.5,-391.8,-231.8,-351.8,-313.6,-359.3,-350.7,-376.5,-391.6,-355.7,-349.4,-399.5,-408.6,-311.5,-386.6,-355.5,-342.4,-344.3,-346.5,-322.9,-331.9,-323.6,-345.5,-378.4,-334.9,-306.5,-278.4,-334.6,-317.6,-298.8,-265.4,-292.7,-291.0,-252.2,-235.3,-207.0,-244.8,-190.6,-229.1,-292.9,-168.4,-289.9,-139.8,-216.9,-242.7,-204.9,-148.8,-245.9,-166.7,-102.7,-172.1,-155.1,-149.9,-98.8,-153.0,-164.8,-123.6,-38.9,-12.8,5.8,-20.0,-111.6,-85.9,-14.1,16.6,27.2,54.1,5.3,-26.9,45.1,80.1,197.8,162.5,172.9,193.5,307.7,480.3]],"clip":{"cell":"dppo-dppo-cheetah","episode":5,"of":5,"return":228.1,"length":1000,"success":false,"returns":[524.0,-49.9,344.8,129.9,228.1],"seconds":8.0,"speed":1.0},"train":{"server":["dppo-policy cheetah dppo cheetah","--port 8000 --seed 0 --policy.device cpu","--algo.buffer-size 1024 --algo.batch-size 512 --algo.train-itrs 100"],"client":["mujoco-v1 --server-host 127.0.0.1 --server-port 8000","--num-envs 1 --num-episodes 100000","--env.name HalfCheetah-v5 --runner.replan-steps 4 --runner.seed 0"],"env":"mujoco","source":"experiments/e28-dppo-learns/run.sh"}},{"id":"dppo-dppo-hopper","row":"dppo-dppo","column":"hopper","status":"learns","experiments":["E28","E31"],"note":"812–961 at 300 iterations; 3 of 3 seeds past the bar","note_zh":"300 轮后 812–961，3 个种子全部过线","seed":0,"curves":[[11.2,12.7,12.8,15.5,26.5,37.5,49.3,54.2,66.1,74.9,74.0,77.4,71.0,73.2,73.6,77.9,80.3,68.5,82.6,77.3,88.2,76.4,74.6,89.2,98.8,96.6,113.0,106.8,119.8,110.6,123.3,122.7,135.1,134.5,149.3,159.4,163.8,155.2,161.2,173.4,172.2,175.0,180.7,184.8,195.3,188.7,198.0,199.0,197.9,196.5,210.8,196.8,210.5,209.0,219.7,225.4,214.7,221.7,227.5,228.3,231.6,233.8,237.3,233.2,236.8,224.8,230.7,234.1,245.8,244.3,233.0,250.2,268.1,250.5,276.1,250.2,242.6,248.7,261.2,270.8,268.2,274.9,264.1,274.4,271.8,298.8,298.8,294.1,296.8,297.7,303.4,318.0,343.5,327.4,344.9,341.6,324.3,349.9,368.8,339.7,425.7,331.9,376.7,390.1,342.9,335.4,377.2,442.4,462.1,427.9,413.4,394.7,422.6,442.3,468.1,427.2,414.8,444.6,374.8,406.1,365.0,420.4,445.2,395.9,389.0,424.2,397.6,404.5,379.2,370.5,398.5,397.6,474.1,421.3,380.0,366.8,383.8,365.0,451.2,370.9,415.7,395.8,391.1,507.6,477.0,558.3,487.1,485.1,498.5,686.2,452.2,554.9,420.7,481.4,487.9,490.4,422.5,444.8,474.3,422.5,499.8,452.3,545.5,517.5,513.0,535.0,665.9,603.1,677.7,667.7,638.3,529.9,479.3,570.3,495.6,677.6,508.9,559.4,598.4,549.8,553.8,537.4,782.7,836.6,665.8,943.6,930.7,759.8,860.4,612.1,749.1,792.3,609.6,807.8,651.5,716.2,566.9,666.3,691.9,601.3,676.1,724.3,577.4,825.3,611.4,710.2,800.5,564.6,593.4,600.8,728.2,635.8,753.6,601.4,521.4,625.0,524.4,631.4,815.1,816.0,609.7,841.3,630.8,705.3,615.5,762.2,762.3,642.5,637.2,605.8,713.5,922.0,719.8,833.6,717.2,694.4,817.5,797.1,802.8,745.8,647.4,633.8,597.2,555.1,722.5,623.7,624.0,564.7,681.9,638.8,584.9,645.0,648.9,611.1,606.9,635.8,630.2,722.7,436.8,561.2,562.6,650.9,581.0,615.2,672.1,556.3,563.4,701.1,651.4,562.8,698.0,721.1,632.6,674.8,785.0,776.0,776.9,766.7,926.7,795.8,632.1,975.0,718.1,695.0,721.4,775.3,946.8,779.7,692.3,619.4,892.4,800.4,636.5,927.1,887.2,967.3,761.5,1073.3,808.0,974.2],[12.4,14.4,17.4,25.1,32.9,43.2,47.7,61.4,66.2,68.0,64.5,68.3,70.5,64.7,71.1,74.4,79.3,77.0,80.8,83.1,87.0,88.0,89.1,109.8,106.5,110.4,121.6,124.4,117.1,114.8,132.6,141.4,150.7,141.2,167.2,156.6,156.0,159.4,163.6,174.8,192.4,176.2,177.6,184.1,193.2,186.9,187.0,198.8,191.2,195.1,205.0,193.4,200.1,203.7,210.3,206.9,203.6,214.1,201.4,203.3,204.9,216.1,208.5,206.4,216.0,200.9,215.8,221.1,212.3,223.0,225.3,243.0,239.6,241.9,268.4,267.2,260.1,287.6,287.2,303.4,357.3,291.7,326.4,304.9,326.7,327.0,321.1,403.5,391.2,401.4,412.4,317.5,473.3,433.5,459.0,411.6,407.9,377.4,384.1,378.0,455.3,362.2,444.4,400.3,408.9,357.1,488.2,512.5,370.0,581.1,482.7,514.7,520.3,439.1,743.2,456.5,577.3,594.1,537.6,590.9,430.6,686.5,555.4,712.1,576.0,723.2,676.9,710.0,727.4,737.4,587.9,687.8,571.9,609.6,662.5,876.2,614.7,887.8,848.7,680.4,602.0,813.6,681.8,832.8,579.7,802.6,688.4,701.1,587.0,785.3,700.1,861.8,824.7,909.6,846.9,840.2,590.4,591.2,1082.5,552.7,598.5,735.0,842.0,643.5,860.0,622.9,1014.3,779.9,886.6,803.4,792.2,886.9,824.9,693.3,692.1,718.1,722.1,665.5,709.6,753.3,878.7,813.6,954.3,815.4,1082.9,650.9,842.2,911.0,1004.1,951.1,800.7,853.2,681.5,749.9,1099.3,754.7,900.1,885.5,770.1,810.2,1124.2,1002.2,797.2,707.7,681.2,1036.4,1059.7,1051.4,794.2,1025.0,910.5,1001.3,610.5,767.0,770.6,788.4,648.1,761.8,758.2,643.0,786.9,635.5,562.5,653.9,703.2,561.3,686.8,688.9,688.3,636.4,693.9,671.6,804.8,809.2,857.1,964.4,818.9,864.8,668.9,1304.8,929.0,914.4,1121.1,1153.2,990.0,834.6,1123.7,919.9,1335.6,731.4,1035.0,941.7,1081.5,828.6,647.4,1003.1,923.5,763.1,1034.7,987.6,750.5,1248.3,932.3,1046.9,936.3,1035.5,754.3,801.1,1033.8,1048.4,799.8,1108.0,901.2,1078.5,898.9,727.2,897.7,1101.0,1285.0,902.4,685.4,832.7,795.7,802.1,1066.2,1083.0,1137.4,957.7,1030.0,1081.0,1104.8,822.7,954.7,1144.5,927.0,1149.8,1085.7,737.3,836.3,847.5],[15.8,20.0,20.6,25.1,35.2,48.3,51.0,66.3,68.1,68.0,70.0,73.1,73.5,86.6,73.8,78.7,82.6,87.5,84.7,94.0,93.3,93.1,103.6,109.5,106.6,107.0,113.8,122.4,135.1,129.3,145.8,152.6,157.4,158.6,169.7,171.4,188.9,171.3,179.2,187.9,192.1,193.8,202.8,213.5,197.7,203.7,215.5,212.3,219.2,215.8,216.1,220.0,214.2,212.0,206.1,211.1,210.4,222.0,219.9,215.7,229.3,227.8,232.5,225.5,238.3,237.4,226.8,257.1,236.7,242.9,240.4,235.0,237.6,244.0,254.5,239.8,269.6,267.2,269.9,284.8,250.9,272.6,266.8,297.4,305.0,343.7,308.9,306.4,296.3,337.1,365.7,315.3,287.9,330.6,334.5,345.9,380.8,332.6,412.4,395.6,371.0,349.6,381.6,335.3,366.5,389.1,388.3,359.1,432.8,372.9,336.4,348.2,372.6,382.3,459.9,499.2,340.2,406.8,374.2,411.2,446.9,388.8,457.5,464.9,551.2,493.9,422.4,520.3,520.2,429.8,521.3,471.5,464.5,472.3,415.0,514.0,449.9,666.8,469.9,438.9,583.3,610.4,514.2,481.0,612.9,836.4,495.6,564.2,674.1,720.6,657.1,518.5,496.8,682.1,823.3,654.1,556.9,645.0,537.0,680.4,524.7,505.3,568.1,498.1,515.4,649.3,796.7,701.9,693.4,659.5,547.3,537.4,670.0,586.0,490.5,577.0,722.5,649.8,642.4,680.9,715.7,581.1,1033.1,619.5,753.0,903.2,663.4,829.9,1122.1,742.3,620.9,793.6,653.9,881.5,891.1,738.5,705.3,789.7,779.7,671.3,911.3,567.9,784.8,736.5,859.3,825.8,813.5,808.0,666.1,799.6,817.6,870.8,738.4,696.7,666.5,569.8,702.3,727.5,530.6,812.9,551.0,719.5,652.1,809.6,946.9,862.3,947.5,881.4,766.4,642.2,744.1,911.5,993.4,791.0,925.2,838.0,995.1,817.8,705.4,788.7,798.6,739.2,801.4,698.7,746.9,828.4,838.4,534.5,684.8,634.4,880.0,572.5,592.1,506.9,555.2,833.2,597.5,589.5,845.9,695.1,636.0,811.0,643.3,677.1,1043.3,897.8,611.7,895.9,1025.8,1019.4,1049.7,873.7,812.1,748.4,1031.2,895.9,848.1,724.2,892.4,697.0,674.6,1011.5,1040.3,841.4,1049.2,986.2,1056.5,758.9,1073.9,799.8,959.0,1048.5,832.0,708.9,811.8,685.9,761.0,680.9,715.5,918.0]],"clip":{"cell":"dppo-dppo-hopper","episode":2,"of":5,"return":929.1,"length":618,"success":false,"returns":[466.5,929.1,1195.7,1361.0,531.1],"seconds":4.96,"speed":1.0},"train":{"server":["dppo-policy hopper dppo hopper","--port 8000 --seed 0 --policy.device cpu","--algo.buffer-size 1024 --algo.batch-size 512 --algo.train-itrs 300"],"client":["mujoco-v1 --server-host 127.0.0.1 --server-port 8000","--num-envs 1 --num-episodes 100000","--env.name Hopper-v5 --runner.replan-steps 4 --runner.seed 0"],"env":"mujoco","source":"experiments/e31-dppo-longer/run.sh"}},{"id":"dppo-dppo-walker","row":"dppo-dppo","column":"walker","status":"learns","experiments":["E28","E31"],"note":"528–622 at 300 iterations; 3 of 3 seeds past the bar","note_zh":"300 轮后 528–622，3 个种子全部过线","seed":2,"curves":[[-2.2,1.2,3.4,8.8,16.0,25.7,46.9,74.8,75.2,162.9,137.0,150.3,128.1,146.4,207.9,244.8,224.3,133.5,149.1,196.6,143.0,260.0,234.7,240.2,214.6,209.6,244.9,244.4,303.9,199.1,201.6,335.8,317.1,226.7,245.9,249.3,244.0,384.1,264.8,312.4,275.0,342.0,289.6,353.7,365.6,338.1,496.6,336.5,357.1,388.4,397.7,354.0,358.7,405.1,374.3,425.4,476.7,476.2,545.5,437.4,537.3,568.6,407.0,419.8,289.4,327.3,368.5,306.4,322.3,323.7,547.4,287.5,413.1,388.9,398.7,523.4,367.9,599.9,617.5,539.5,452.1,454.7,561.3,447.8,358.2,632.1,627.3,478.5,455.8,393.3,428.8,348.4,332.6,536.7,447.0,605.5,517.1,428.0,360.2,474.9,396.2,373.4,440.8,488.4,486.2,423.3,368.7,411.6,462.1,473.5,436.3,508.0,341.8,552.8,417.5,355.9,343.8,312.6,391.4,363.7,371.2,389.1,374.0,400.8,327.0,337.8,279.5,359.1,402.5,481.0,408.9,365.9,307.6,441.7,431.7,337.6,307.9,401.5,489.5,433.0,462.8,495.8,330.1,563.3,676.6,454.2,458.2,513.2,522.8,508.8,416.2,452.2,398.5,401.8,632.8,408.8,503.4,444.6,489.8,512.2,492.8,408.2,656.0,548.3,484.4,557.6,764.5,498.2,418.4,696.9,408.2,413.4,363.8,398.3,427.7,434.5,400.7,464.4,545.0,563.7,519.5,505.8,454.7,409.8,469.7,995.7,747.6,572.4,542.0,756.0,453.4,588.1,458.1,600.5,767.0,949.8,650.8,510.0,455.5,591.4,602.0,539.1,693.5,535.8,605.2,524.8,424.9,604.4,413.3,565.9,316.8,641.4,327.1,547.1,575.8,501.5,451.2,447.8,666.5,471.7,480.2,524.6,519.0,378.1,516.9,514.9,511.4,479.2,440.4,467.3,509.1,501.0,438.4,481.4,390.2,526.2,625.3,495.2,442.8,420.1,533.2,501.5,590.6,422.5,557.5,565.8,441.7,667.6,506.0,514.5,455.9,639.4,577.3,558.6,509.0,690.4,687.6,386.1,404.9,631.1,587.8,469.9,779.9,416.0,410.2,522.7,521.4,397.4,433.0,478.7,670.1,628.5,615.3,620.2,852.4,642.7,632.0,672.8,592.3,374.4,533.3,551.4,401.1,625.5,536.0,586.1,946.7,747.9,758.6,592.9,440.2,672.8,490.1,552.1,524.4,635.8,537.5,417.8,533.2,476.3],[-1.6,1.2,4.6,8.4,14.2,28.3,26.7,33.1,28.9,157.3,50.8,120.8,156.5,141.8,139.5,178.8,206.9,235.2,238.6,247.7,223.7,200.4,262.3,227.4,239.6,212.9,279.2,254.1,229.5,263.7,231.6,218.6,219.2,289.0,218.4,239.1,228.1,270.6,248.8,281.1,218.7,251.5,278.3,280.4,233.9,279.5,220.9,228.0,203.6,232.5,260.8,262.5,281.5,202.4,318.1,264.3,231.4,284.1,258.0,254.5,251.8,286.9,269.6,253.1,258.7,249.2,273.7,225.2,263.8,223.4,256.0,267.8,326.8,251.0,293.6,279.7,278.2,238.8,277.4,261.2,247.4,332.2,331.9,379.6,374.1,436.4,289.5,426.9,347.7,392.1,401.6,314.8,433.2,409.9,425.7,466.1,465.7,484.6,544.6,410.2,411.0,355.6,249.1,591.0,305.4,365.6,299.0,378.5,367.3,405.0,436.8,343.5,486.2,525.5,366.6,486.1,455.7,571.4,480.5,552.1,543.4,608.8,415.0,689.9,556.3,532.9,409.1,485.9,859.0,593.4,523.8,607.8,473.0,622.3,567.4,446.6,397.0,349.6,421.3,983.2,561.2,556.1,630.1,748.4,492.9,744.7,654.4,495.0,406.1,623.2,592.6,499.4,487.0,602.5,546.7,808.5,506.8,508.8,553.4,657.7,591.1,559.8,605.1,543.3,580.3,637.5,468.2,707.3,582.5,526.4,584.7,552.9,547.2,810.5,599.6,563.6,531.5,660.9,576.6,620.1,600.2,684.1,706.5,736.3,546.1,537.2,623.2,561.0,677.8,551.1,436.4,658.1,622.8,524.5,633.1,491.4,480.3,474.5,682.0,399.5,367.9,431.6,694.9,967.6,486.7,539.9,663.6,617.2,583.4,608.7,529.1,583.3,431.7,680.6,401.1,557.9,447.6,581.7,310.9,530.9,313.1,671.1,307.7,505.4,432.4,903.4,479.7,516.0,423.5,379.0,449.5,440.7,380.6,405.7,527.7,373.3,472.9,277.2,783.8,455.9,689.0,635.8,773.7,691.2,520.4,578.6,666.0,532.7,866.6,756.2,708.1,981.8,544.4,606.0,600.8,602.6,527.4,607.4,547.3,582.9,434.6,572.1,487.8,478.5,534.4,455.6,560.9,410.0,424.9,478.8,636.3,623.1,474.2,571.6,410.0,401.4,356.9,394.7,402.8,558.6,448.2,396.9,755.5,555.5,673.3,490.3,588.1,447.9,422.8,567.9,506.1,582.0,722.0,914.0,725.8,468.0,635.7,691.4,429.5,549.3],[-2.6,-2.5,-2.0,-0.3,1.7,8.2,15.9,36.2,34.7,58.8,90.9,148.4,131.9,146.5,165.2,131.8,149.9,130.7,205.3,217.6,239.6,258.3,261.6,242.4,229.9,215.1,193.3,297.2,229.6,249.3,274.3,246.0,221.0,158.6,191.5,265.2,256.0,223.1,303.2,287.6,226.5,171.7,165.3,250.0,262.9,277.8,231.1,280.6,210.1,221.4,271.7,298.2,381.3,254.8,224.6,270.4,230.4,239.6,230.4,289.4,283.3,288.0,269.9,304.3,327.8,242.4,249.2,230.5,290.1,236.5,244.7,273.9,301.5,299.5,256.6,343.5,474.1,251.3,274.5,356.2,381.9,307.9,313.0,376.0,383.6,353.7,264.2,342.5,356.0,350.4,399.7,407.5,348.0,320.7,355.7,427.3,553.2,338.8,428.2,346.9,444.7,548.6,422.3,588.4,418.0,369.9,632.6,444.4,464.4,368.9,485.4,428.2,476.3,516.5,525.6,428.1,604.9,529.8,375.4,396.8,604.7,389.8,475.2,496.4,448.2,514.0,850.5,545.1,483.3,409.1,518.0,428.8,655.0,644.8,566.6,473.6,552.9,695.2,852.8,486.3,462.2,500.0,489.2,547.5,593.2,573.0,554.7,476.5,614.0,527.5,511.9,703.2,724.9,742.4,537.9,536.2,480.3,628.0,837.1,604.2,634.4,714.8,702.1,695.3,606.7,530.7,564.8,815.6,515.3,476.2,382.5,560.1,466.4,439.2,749.7,518.4,515.5,457.8,511.0,548.7,430.9,476.8,538.3,640.0,466.4,609.7,504.5,409.7,425.4,425.6,432.4,422.6,429.4,422.1,483.4,421.6,523.3,586.1,424.4,620.8,748.8,655.3,537.8,415.5,804.0,679.8,926.5,756.8,715.2,693.3,625.6,771.2,602.5,477.7,583.4,430.1,533.6,741.0,640.3,679.2,569.2,703.8,866.3,399.8,425.8,497.0,437.0,642.5,417.0,506.7,478.7,563.5,401.6,808.7,506.7,841.6,699.5,819.3,462.7,946.2,558.6,408.9,316.5,521.6,454.6,505.9,811.9,600.8,727.2,562.2,645.7,600.6,667.8,454.1,372.5,455.7,564.2,568.5,523.7,448.6,710.2,884.6,726.9,605.0,737.1,574.0,562.1,443.2,491.6,476.4,518.7,578.8,755.8,545.2,719.0,436.3,341.2,426.6,499.2,511.7,620.4,464.1,674.3,669.9,513.8,433.1,404.5,501.4,584.6,512.2,462.8,610.7,439.4,472.4,514.2,733.5,530.8,846.2,643.2,595.9]],"clip":{"cell":"dppo-dppo-walker","episode":4,"of":5,"return":479.2,"length":289,"success":false,"returns":[946.2,203.2,374.2,479.2,496.9],"seconds":3.0,"speed":0.773},"train":{"server":["dppo-policy walker dppo walker","--port 8000 --seed 0 --policy.device cpu","--algo.buffer-size 1024 --algo.batch-size 512 --algo.train-itrs 300"],"client":["mujoco-v1 --server-host 127.0.0.1 --server-port 8000","--num-envs 1 --num-episodes 100000","--env.name Walker2d-v5 --runner.replan-steps 4 --runner.seed 0"],"env":"mujoco","source":"experiments/e31-dppo-longer/run.sh"}},{"id":"dppo-dppo-square","row":"dppo-dppo","column":"square","status":"learns","experiments":["E27","E34"],"note":"from DPPO's released policy, success 0.33–0.36 → 0.65–0.70","note_zh":"从 DPPO 官方预训练策略起步，成功率 0.33–0.36 → 0.65–0.70","seed":2,"curves":[[61.2,54.3,48.3,47.2,55.3,69.0,50.7,61.4,56.4,70.1,80.0,72.1,64.4,94.9,72.1,89.1,89.7,87.8,87.4,95.9,93.8,83.0,102.0,94.5,94.3,100.6,100.1,97.0,102.9,112.3,113.8,113.5,118.8,102.9,123.3,125.8,114.4,122.1,122.1,123.7],[56.8,52.2,56.8,52.3,51.8,53.9,53.9,71.8,61.4,78.7,71.3,88.8,71.9,84.1,77.3,74.1,93.8,87.3,94.3,111.0,90.3,122.7,102.0,108.7,110.1,113.1,121.2,118.4,119.6,132.3,109.2,133.6,116.8,116.9,130.8,140.9,133.1,148.2,143.8,142.6],[42.3,56.5,54.3,53.8,58.4,61.0,71.8,63.1,73.5,71.2,69.9,66.5,76.1,86.2,94.7,87.3,92.4,99.2,98.7,98.7,96.6,96.0,104.2,94.1,107.5,102.2,112.4,101.6,118.3,113.9,124.7,131.1,105.9,132.1,120.4,129.9,134.4,148.9,139.8,131.7]],"clip":{"cell":"dppo-dppo-square","episode":3,"of":5,"return":1.0,"length":360,"success":true,"returns":[1.0,1.0,1.0,1.0,1.0],"seconds":8.0,"speed":1.0},"train":{"server":["dppo-policy square dppo square","--port 8000 --seed 0 --policy.device cpu","--policy.checkpoint-path DPPO_SQUARE_CHECKPOINT","--algo.train-itrs 40"],"client":["robomimic-v1 --server-host 127.0.0.1 --server-port 8000","--num-envs 1 --num-procs 6 --num-episodes 100000","--env.name square-img --env.agentview-image-size 84 84","--env.no-terminate-on-success --runner.replan-steps 4"],"env":"robomimic","source":"experiments/e34-square-dppo/run_cell.sh"}}],"vla":{"task":"LIBERO-10 task 8: put both moka pots on the stove","task_zh":"LIBERO-10 第 8 题：把两个摩卡壶都放到炉子上","cells":[{"id":"pi0-base","label":"pi0.5 as released","label_zh":"原版 pi0.5","status":"reference","experiments":["E26"],"score":[29,50],"note":"untrained, the reference","note_zh":"未训练，作参照","clip":{"cell":"pi0-base","episode":1,"of":1,"return":1.0,"length":410,"success":true,"returns":[1.0],"seconds":8.24,"speed":2.5},"train":{"server":["pi0-policy default eval default","--port 8000 --policy.device cuda","--policy.name pi05_libero --policy.checkpoint-path PI05_LIBERO_CHECKPOINT"],"client":["libero-v1 --server-host 127.0.0.1 --server-port 8000","--num-envs 1 --num-procs 1 --num-episodes 50","--env.task-suite-name libero_10 --env.task-id 8","--env.no-randomize-initial-state --runner.replan-steps 5 --runner.seed 7"],"env":"libero","source":"experiments/e26-frozen-mlp/eval.sh"}},{"id":"pi0-fpo","label":"pi0-policy · FPO","label_zh":"pi0-policy · FPO","status":"holds","experiments":["E14","E26","E32"],"score":[33,50],"note":"one update with FPO++'s chunk loss leaves it intact; FPO's own took it to 0","note_zh":"换成 FPO++ 的块损失后一次更新没毁掉它；原版 FPO 会让它归零","clip":{"cell":"pi0-fpo","episode":1,"of":1,"return":1.0,"length":350,"success":true,"returns":[1.0],"seconds":7.04,"speed":2.5},"train":{"server":["pi0-policy default fpo default","--port 8000 --seed 7 --policy.device cuda:0","--policy.name pi05_libero --policy.checkpoint-path PI05_LIBERO_CHECKPOINT","--algo.learning-rate 1e-5 --algo.clipping-epsilon 0.05","--algo.num-updates-per-batch 4 --algo.n-samples-per-action 4","--algo.buffer-size 4096 --algo.batch-size 8 --algo.global-steps 8192","--algo.master-weights-device cuda:1","--algo.n-critic-warmup-itrs 1","--algo.output-mode u --algo.no-discretize-t-for-training","--algo.cfm-loss-steps 5 --algo.cfm-loss-dims 7 --algo.cfm-loss-sum-over-steps","--algo.ratio-per-sample"],"client":["libero-v1 --server-host 127.0.0.1 --server-port 8000","--num-envs 1 --num-procs 10 --num-episodes 100000","--env.task-suite-name libero_10 --env.task-id 8","--env.randomize-initial-state --runner.replan-steps 5 --runner.seed 7"],"env":"libero","source":"experiments/e32-pi0-fpo-plus-plus/train.sh"}},{"id":"pi0-dppo","label":"pi0-policy · DPPO","label_zh":"pi0-policy · DPPO","status":"holds","experiments":["E25"],"score":[30,50],"note":"two iterations leave it intact, having barely moved it","note_zh":"两轮后没被毁掉，但几乎没动它","clip":{"cell":"pi0-dppo","episode":1,"of":1,"return":1.0,"length":415,"success":true,"returns":[1.0],"seconds":8.32,"speed":2.5},"train":{"server":["pi0-policy default dppo libero","--port 8000 --seed 7 --policy.device cuda:0","--policy.name pi05_libero --policy.checkpoint-path PI05_LIBERO_CHECKPOINT","--algo.buffer-size 4096 --algo.batch-size 8 --algo.train-itrs 2"],"client":["libero-v1 --server-host 127.0.0.1 --server-port 8000","--num-envs 1 --num-procs 10 --num-episodes 100000","--env.task-suite-name libero_10 --env.task-id 8","--env.randomize-initial-state --runner.replan-steps 5 --runner.seed 7"],"env":"libero","source":"experiments/e25-pi0-dppo/cell.sh"}}]},"experiments":{"E6":"e6-first-learning-curve","E14":"e14-ten-iterations","E16":"e16-critic-restart","E17":"e17-second-algorithm","E18":"e18-dppo-normalised","E23":"e23-hopper","E24":"e24-coverage","E25":"e25-pi0-dppo","E26":"e26-frozen-mlp","E27":"e27-robomimic","E28":"e28-dppo-learns","E29":"e29-clamp-or-noise","E30":"e30-fpo-dppo-factors","E31":"e31-dppo-longer","E32":"e32-pi0-fpo-plus-plus","E33":"e33-fpo-dppo-structure","E34":"e34-square-dppo"},"envs":{"mujoco":{"extra":"mujoco","packages":"gymnasium 1.x, mujoco 3.x (3.6 and 3.14 here)"},"robomimic":{"extra":"robomimic","packages":"robomimic 0.4, robosuite 1.4.1, mujoco 2.3.7"},"libero":{"extra":"libero","packages":"LIBERO, robosuite 1.4.1, mujoco 2.3.7"}},"server_packages":"torch; no MuJoCo, robosuite or gymnasium on any server that trained these cells"}
diff --git a/docs/media/coverage/dppo-dppo-hopper.jpg b/docs/media/coverage/dppo-dppo-hopper.jpg
index 89fba31..3057b97 100644
Binary files a/docs/media/coverage/dppo-dppo-hopper.jpg and b/docs/media/coverage/dppo-dppo-hopper.jpg differ
diff --git a/docs/media/coverage/dppo-dppo-hopper.mp4 b/docs/media/coverage/dppo-dppo-hopper.mp4
index 9fa3190..1906f4d 100644
Binary files a/docs/media/coverage/dppo-dppo-hopper.mp4 and b/docs/media/coverage/dppo-dppo-hopper.mp4 differ
diff --git a/docs/media/coverage/dppo-dppo-square.jpg b/docs/media/coverage/dppo-dppo-square.jpg
index 3e2c7ce..37df851 100644
Binary files a/docs/media/coverage/dppo-dppo-square.jpg and b/docs/media/coverage/dppo-dppo-square.jpg differ
diff --git a/docs/media/coverage/dppo-dppo-square.mp4 b/docs/media/coverage/dppo-dppo-square.mp4
index 9e55beb..063ba37 100644
Binary files a/docs/media/coverage/dppo-dppo-square.mp4 and b/docs/media/coverage/dppo-dppo-square.mp4 differ
diff --git a/docs/media/coverage/dppo-dppo-walker.jpg b/docs/media/coverage/dppo-dppo-walker.jpg
index a7877ea..b7cf8e5 100644
Binary files a/docs/media/coverage/dppo-dppo-walker.jpg and b/docs/media/coverage/dppo-dppo-walker.jpg differ
diff --git a/docs/media/coverage/dppo-dppo-walker.mp4 b/docs/media/coverage/dppo-dppo-walker.mp4
index d66243c..3561961 100644
Binary files a/docs/media/coverage/dppo-dppo-walker.mp4 and b/docs/media/coverage/dppo-dppo-walker.mp4 differ
diff --git a/docs/media/coverage/fpo-dppo-cheetah.jpg b/docs/media/coverage/fpo-dppo-cheetah.jpg
index 2a74769..8b0a2c9 100644
Binary files a/docs/media/coverage/fpo-dppo-cheetah.jpg and b/docs/media/coverage/fpo-dppo-cheetah.jpg differ
diff --git a/docs/media/coverage/fpo-dppo-cheetah.mp4 b/docs/media/coverage/fpo-dppo-cheetah.mp4
index d0ee622..9bde4eb 100644
Binary files a/docs/media/coverage/fpo-dppo-cheetah.mp4 and b/docs/media/coverage/fpo-dppo-cheetah.mp4 differ
diff --git a/docs/media/coverage/fpo-dppo-hopper.jpg b/docs/media/coverage/fpo-dppo-hopper.jpg
index 975743c..15250bf 100644
Binary files a/docs/media/coverage/fpo-dppo-hopper.jpg and b/docs/media/coverage/fpo-dppo-hopper.jpg differ
diff --git a/docs/media/coverage/fpo-dppo-hopper.mp4 b/docs/media/coverage/fpo-dppo-hopper.mp4
index a2e1ba9..f797007 100644
Binary files a/docs/media/coverage/fpo-dppo-hopper.mp4 and b/docs/media/coverage/fpo-dppo-hopper.mp4 differ
diff --git a/docs/media/coverage/fpo-dppo-walker.jpg b/docs/media/coverage/fpo-dppo-walker.jpg
index 520691b..1d00224 100644
Binary files a/docs/media/coverage/fpo-dppo-walker.jpg and b/docs/media/coverage/fpo-dppo-walker.jpg differ
diff --git a/docs/media/coverage/fpo-dppo-walker.mp4 b/docs/media/coverage/fpo-dppo-walker.mp4
index c62ab6c..4eb752c 100644
Binary files a/docs/media/coverage/fpo-dppo-walker.mp4 and b/docs/media/coverage/fpo-dppo-walker.mp4 differ
diff --git a/docs/media/coverage/pi0-fpo.jpg b/docs/media/coverage/pi0-fpo.jpg
index c4153c1..42e2a15 100644
Binary files a/docs/media/coverage/pi0-fpo.jpg and b/docs/media/coverage/pi0-fpo.jpg differ
diff --git a/docs/media/coverage/pi0-fpo.mp4 b/docs/media/coverage/pi0-fpo.mp4
index 519f498..5964215 100644
Binary files a/docs/media/coverage/pi0-fpo.mp4 and b/docs/media/coverage/pi0-fpo.mp4 differ