test(e2e): add CLI conformance baseline - #2871
Closed
elezar wants to merge 2 commits into
Closed
Conversation
|
Auto-sync is disabled for draft pull requests in this repository. Workflows must be run manually. Contributors can view more details about this message here. |
|
Label |
14 tasks
elezar
force-pushed
the
codex/2183-cli-conformance-minimal
branch
2 times, most recently
from
August 25, 2026 10:21
7b57176 to
3d802c2
Compare
elezar
marked this pull request as ready for review
August 25, 2026 10:27
elezar
requested review from
a team,
derekwaynecarr,
mrunalp and
sjenning
as code owners
August 25, 2026 10:27
elezar
force-pushed
the
codex/2183-cli-conformance-minimal
branch
2 times, most recently
from
August 25, 2026 13:06
184ffbc to
e794b2c
Compare
9 tasks
Signed-off-by: Evan Lezar <elezar@nvidia.com>
Signed-off-by: Evan Lezar <elezar@nvidia.com>
elezar
force-pushed
the
codex/2183-cli-conformance-minimal
branch
from
August 25, 2026 14:21
e794b2c to
a257f6a
Compare
Member
Author
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Establish a minimal, portable CLI conformance baseline that certifies the complete CLI -> gateway -> driver deployment path. The standalone conformance task consumes the gateway already selected in the CLI configuration and does not provision a gateway, choose an installation method, or select a compute driver.
Phase 1 contains one hardened smoke scenario. It establishes reusable command execution, polling, diagnostics, explicit resource tracking, and cleanup mechanics before additional lifecycle workflows are considered for conformance.
This is stack 1/2. PR #2873 adds the direct API conformance framework on top.
Related Issue
Changes
e2e-cli-conformanceprofile and focusedmise run e2e:cli-conformancetaskOPENSHELL_BINso the suite executes the explicitly selected CLI binary rather than assuming a repository build locationopenshell statuscommand as part of the scenario--from base, verify readiness throughsandbox get <name> --output json, verify list visibility, execute a run-specific marker, delete the sandbox, and verify its disappearancefinish()call; phase 1 does not require labelsvm_overlaytargetTesting
e2e-cli-conformanceenabledmise run pre-commitChecklist