coverage: the gaussian-policy · PPO row - #18
Merged
Merged
Conversation
plugrl-server E38 ran a Gaussian policy with PPO, every CleanRL default, on HalfCheetah, Hopper and Walker2d. It learns all three on 3 of 3 seeds and ends about where CleanRL's own runs do. The figure gains that row, with no square cell because it was not run there. Each clip comes from the median seed's final checkpoint, acting with the mean. coverage.json and the grid still are regenerated, and both home pages' paragraphs updated to match.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
The fourth row of "What runs on it":
gaussian-policy· PPO, from plugrl-server E38 (PlugRL/plugrl-server#87, figure #88). Merge after those, so that the E38 link in the text resolves.gaussian-ppo-{cheetah,hopper,walker}.coverage.jsonregenerated: 15 cells. The new row has no square cell, and the page already renders that slot empty.coverage-grid.jpgregenerated with the new row. Its label column is widened to fit "gaussian-policy".index.mdandindex.zh.md: the paragraph now names the baseline row. The note under the figure says why its square cell is empty and that it ends about where CleanRL's own runs do.No JavaScript or CSS changes: rows come from the data.