Skip to content

cuda.core: add executable graph node updates - #2473

Draft
Andy-Jost wants to merge 3 commits into
NVIDIA:mainfrom
Andy-Jost:ajost/graph-exec-attachments
Draft

cuda.core: add executable graph node updates#2473
Andy-Jost wants to merge 3 commits into
NVIDIA:mainfrom
Andy-Jost:ajost/graph-exec-attachments

Conversation

@Andy-Jost

Copy link
Copy Markdown
Contributor

Summary

  • Add one append-only CUDA user-object accumulator per executable graph so individual node updates retain replacement resources through all affected launches.
  • Add ephemeral graph[node] views for complete kernel, memcpy, memset, host-callback, child-graph, and event updates, plus executable enable state where CUDA supports it.
  • Cover rollback, source reclamation, independent executables, whole-graph replacement, and in-flight cleanup without private mutation hooks.

Changes

  • Prepare and atomically install executable attachment accumulators during instantiation and whole-graph updates.
  • Route executable updates through cuGraphExecNodeSetParams while CUDA remains authoritative for node association.
  • Document complete-parameter semantics, owner retention, source lifetime, and CUDA 12.2+ requirements.

Notes

GPU tests were intentionally deferred to CI.

Related Work

Closes #2353.
Closes #2354.

@Andy-Jost Andy-Jost added this to the cuda.core 1.2.0 milestone Jul 31, 2026
@Andy-Jost Andy-Jost added P0 High priority - Must do! feature New feature or request cuda.core Everything related to the cuda.core module labels Jul 31, 2026
@Andy-Jost Andy-Jost self-assigned this Jul 31, 2026
@copy-pr-bot

copy-pr-bot Bot commented Jul 31, 2026

Copy link
Copy Markdown
Contributor

Auto-sync is disabled for draft pull requests in this repository. Workflows must be run manually.

Contributors can view more details about this message here.

@Andy-Jost

Copy link
Copy Markdown
Contributor Author

/ok to test

@github-actions github-actions Bot added the cuda.pathfinder Everything related to the cuda.pathfinder module label Jul 31, 2026
Install a private CUDA user object per graph executable so later node updates can retain replacement resources safely.
Expose ephemeral graph-node views that update complete executable parameters while retaining every replacement resource CUDA may still use.
Exercise public mutators, rollback, source reclamation, independent ownership, whole updates, and in-flight cleanup end to end.
@Andy-Jost
Andy-Jost force-pushed the ajost/graph-exec-attachments branch from 450d1d5 to dd97efa Compare July 31, 2026 19:43
@Andy-Jost

Copy link
Copy Markdown
Contributor Author

/ok to test

@Andy-Jost Andy-Jost removed the cuda.pathfinder Everything related to the cuda.pathfinder module label Jul 31, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

cuda.core Everything related to the cuda.core module feature New feature or request P0 High priority - Must do!

Projects

None yet

Development

Successfully merging this pull request may close these issues.

cuda.core: add atomic update methods for executable graph nodes cuda.core: add append-only attachment ownership for executable graphs

1 participant