Skip to content

Delete integration tests fully covered by acceptance - #6113

Merged
denik merged 1 commit into
mainfrom
denik/delete-redundant-integration-tests
Jul 31, 2026
Merged

Delete integration tests fully covered by acceptance#6113
denik merged 1 commit into
mainfrom
denik/delete-redundant-integration-tests

Conversation

@denik

@denik denik commented Jul 31, 2026

Copy link
Copy Markdown
Contributor

These tests (version, auth describe, api get/post, unknown-command) are CLI-driven, and every product-code block they execute is also covered by the acceptance suite.

Why

Acceptance tests run the same CLI and can run on cloud too (Cloud=true, real WorkspaceClient when CLOUD_ENV is set), so there's no reason to keep a duplicate in integration/. Verified by generating each test's in-process coverage (-coverpkg) and confirming its covered blocks are a subset of the union of per-test acceptance coverage (CLI_GOCOVERDIR); the only residual gaps were in the test harness itself (internal/testcli, internal/testutil) and cmdio tty/HasIO probing, not command logic.

@eng-dev-ecosystem-bot

eng-dev-ecosystem-bot commented Jul 31, 2026

Copy link
Copy Markdown
Collaborator

Integration test report

Commit: 4918ebc

Run: 30624319593

Env 🟨​KNOWN 💚​RECOVERED 🙈​SKIP ✅​pass 🙈​skip Time
🟨​ aws linux 3 1 4 313 1066 6:46
🟨​ aws windows 3 1 4 315 1064 5:49
💚​ azure linux 4 4 313 1065 4:31
🟨​ azure windows 3 1 4 315 1063 6:13
💚​ gcp linux 1 5 313 1066 3:58
💚​ gcp windows 1 5 315 1064 4:03
8 interesting tests: 4 SKIP, 3 KNOWN, 1 RECOVERED
Test Name aws linux aws windows azure linux azure windows gcp linux gcp windows
💚​ TestAccept 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R
🙈​ TestAccept/bundle/invariant/no_drift 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
🙈​ TestAccept/bundle/resources/vector_search_endpoints/drift/recreated_same_name 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
🙈​ TestAccept/bundle/resources/vector_search_indexes/recreate/embedding_dimension 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
🙈​ TestAccept/ssh/connection 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
🟨​ TestFetchRepositoryInfoAPI_FromRepo 🟨​K 🟨​K 💚​R 🟨​K 🙈​S 🙈​S
🟨​ TestFetchRepositoryInfoAPI_FromRepo/root 🟨​K 🟨​K 💚​R 🟨​K
🟨​ TestFetchRepositoryInfoAPI_FromRepo/subdir 🟨​K 🟨​K 💚​R 🟨​K
Top 3 slowest tests (at least 2 minutes):
duration env testname
3:05 azure windows TestAccept
3:03 gcp windows TestAccept
2:52 aws windows TestAccept

version, auth describe, api get/post, and the unknown-command test are all
CLI-driven, and every product-code block they execute is also covered by the
acceptance suite. Removing them.

Verified by generating each test's in-process coverage (-coverpkg) and checking
that its covered blocks are a subset of the union of per-test acceptance
coverage (CLI_GOCOVERDIR). Residual gaps were confined to the integration
harness (internal/testcli, internal/testutil) and cmdio tty/HasIO probing, none
of which is command logic.

Co-authored-by: Isaac
@denik
denik force-pushed the denik/delete-redundant-integration-tests branch from 0626b4f to 4918ebc Compare July 31, 2026 10:39
@denik
denik added this pull request to the merge queue Jul 31, 2026
Merged via the queue into main with commit 33a0e6a Jul 31, 2026
25 checks passed
@denik
denik deleted the denik/delete-redundant-integration-tests branch July 31, 2026 14:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants