Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 4 additions & 4 deletions docs/knowledge-base.md
Original file line number Diff line number Diff line change
Expand Up @@ -14,7 +14,7 @@ separate work, not an implemented capability of this knowledge base.
```text
src/inferrsi/data/skill_library/
README.md Library navigation
skill-index.json Stable IDs → categorized paths/backend (73 skills)
skill-index.json Stable IDs → categorized paths/backend (74 skills)
hardware/{ascend,cuda,host}/<id>/ Hardware/platform-specific complete skills
frameworks/<framework>/<id>/ Framework-owned complete skills
repositories/<repo>/ Engine entry, sub-skills and focused complete skills
Expand Down Expand Up @@ -171,18 +171,18 @@ Complete procedures, sidecars, references and cases are packaged, with 13 Ascend
repositories, methods or workflows. The 21 engine and research-router skills
use the same ownership layout under `repositories/<engine>/` and
`workflows/inference-engine-research/`, including their sub-skills and references.
The library contains 117 `SKILL.md` files, all in English.
The library contains 118 `SKILL.md` files, all in English.
The collection overview, import notes and source manifest belong to the research
workflow's references; Strata design-space analysis belongs to Strata. The library
root contains only navigation and the registry.

The [generated catalog](../src/inferrsi/data/repo_packs/inferrsi/knowledge/README.md)
projects the 73 registered skills into the contribution catalog. Its records
projects the 74 registered skills into the contribution catalog. Its records
use `inferrsi.<backend>.skills.<name_with_underscores>` IDs, with `ascend` and
`cuda` for scopes that depend on those backends and `common` for the remaining skills.
Each `skill_documents.original` points to the full packaged procedure. The
`skills` CLI retains the original hyphenated skill IDs and defaults to this
73-ID registry; engine procedures remain available through library navigation
74-ID registry; engine procedures remain available through library navigation
and catalog document pointers.

The registered [h3.c runtime audit](../src/inferrsi/data/skill_library/repositories/h3-c/audit-h3-runtime-residency/SKILL.md)
Expand Down
23 changes: 12 additions & 11 deletions docs/skill-coverage.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@ Generated from the registry, the skill sidecars and the two maintained
matrices. **Do not edit by hand**; regenerate after any registry, skill,
matrix or frozen-plan change.

- Input digest: `sha256:15f6aa9237afc144617167a4bdd44696f9ed141d88e2a63b93a8636d1f8f069d`
- Input digest: `sha256:898c813f2f033af7bf36fa2214e2294039740c759a3deceb2d6d8ff934e076e7`
- Regenerate: `python tools/build_skill_coverage.py`
- Verify without writing: `python tools/build_skill_coverage.py --check`

Expand All @@ -31,16 +31,16 @@ matrix: every field is copied from an owner that already maintains it.

| Measure | Value |
|---|---|
| Registered skill ids | 73 |
| By category | frameworks 3, hardware 22, methods 18, repositories 24, workflows 6 |
| By backend | ascend 14, common 54, cuda 5 |
| Registered skill ids | 74 |
| By category | frameworks 3, hardware 22, methods 19, repositories 24, workflows 6 |
| By backend | ascend 14, common 55, cuda 5 |
| Recorded on a numbered SearchSpace resource layer | 48 |
| Recorded only in a supplementary guidance table (†) | 12 |
| Recorded on two or more resource layers | 24 |
| Recorded in the Reference Matrix | 67 |
| With a `metadata.json` sidecar | 68 |
| With a `metadata.json` sidecar | 69 |
| Selected by a frozen evaluation plan | 2 |
| `SKILL.md` documents in the library | 117 |
| `SKILL.md` documents in the library | 118 |
| Unregistered documents (excluded from every count above) | 44 |

A complete inventory is not a coverage claim. Every registered row below
Expand Down Expand Up @@ -111,12 +111,13 @@ optimization is fully covered or that any procedure has measured benefit.
| [splash](../src/inferrsi/data/skill_library/repositories/splash/SKILL.md) | common | Investigate Splash model-format compatibility, automatic memory planning, Metal and ANE execution, DFlash2 ... | — | Splash portable AREX extraction (incoai/splash @ `39a97385f8560cf8a93972cec9b0a963c9195250`; AREX ...) | candidate · partial_cpu_only · 2 readset(s) | no-SearchSpace-layer, no-eval |
| [vllm-metal](../src/inferrsi/data/skill_library/repositories/vllm-metal/SKILL.md) | common | Investigate vllm-metal Apple inference through platform and native-ABI selection, paged KV/offload ownership ... | 1 Accelerator † guidance: vLLM Metal selected source contracts<br>2 RAM/Host † guidance: vLLM Metal selected source contracts<br>3 SSD † guidance: vLLM Metal selected source contracts | vLLM Metal portable AREX source and CPU extraction (vllm-project/vllm-metal @ `e7df7a6ff215f99c7842552d230fdbc709835934` ...) | candidate · partial_cpu_only · 2 readset(s) | no-eval |

## Registered: Methods (18)
## Registered: Methods (19)

| Skill | Backend | Declared task | SearchSpace layer / stage | Reference Matrix | State | Gaps |
|---|---|---|---|---|---|---|
| [assess-serving-preemption](../src/inferrsi/data/skill_library/methods/assess-serving-preemption/SKILL.md) | common | Assess whether LLM serving queue delays justify token-boundary priority preemption, accounting for suspended KV, host ... | 1 Accelerator · Diagnose / Configure / Optimize / Verify<br>2 RAM/Host · Diagnose / Configure / Optimize / Verify | 1 · Systems sources (Orca — OSDI 2022 proceedings) | candidate · not_run · 1 readset(s) | no-eval |
| [assess-split-backward-schedule](../src/inferrsi/data/skill_library/methods/assess-split-backward-schedule/SKILL.md) | common | Evaluate memory-capped split-backward and V-shaped pipeline scheduling proposals, preserving synchronous update ... | 1 Accelerator · Diagnose / Configure / Optimize / Verify | 1 · Systems sources (Zero Bubble — [2401.10241v1](https://arxiv.org/abs/2401.10241v1)) | candidate · not_run · 1 readset(s) | no-eval |
| [audit-fixed-workload-claim](../src/inferrsi/data/skill_library/methods/audit-fixed-workload-claim/SKILL.md) | common | Audit a performance claim from supplied fixed-workload reports and an explicit measurement contract. Check aggregation ... | — | — | candidate · not_run · 0 readset(s) | no-SearchSpace-layer, no-Reference-Matrix-row, no-eval |
| [calibrate-serving-simulation](../src/inferrsi/data/skill_library/methods/calibrate-serving-simulation/SKILL.md) | common | Build an evidence-gated serving-configuration shortlist from a profiled simulator while separating empirical ... | 1 Accelerator · Diagnose / Verify | 1 · Systems sources (Vidur — [2405.05465v2](https://arxiv.org/abs/2405.05465v2)) | candidate · not_run · 1 readset(s) | no-eval |
| [checkpoint-recovery-consistency](../src/inferrsi/data/skill_library/methods/checkpoint-recovery-consistency/SKILL.md) | common | Assess distributed checkpoint recovery using DLRover memory agreement, persistence completion and replica transport ... | 2 RAM/Host · Configure / Verify<br>3 SSD · Configure / Verify<br>4 Network · Diagnose / Configure / Verify<br>5 OS · Diagnose / Configure | 1 · Systems sources (C3 / DLRover FlashCheckpoint @ `e35b1ad90e2928ca6bacf5d22117f71356 ...)<br>1 · Systems sources (C4 / NVIDIA Resiliency Extension @ ...) | candidate · not_run · 1 readset(s) | no-eval |
| [choose-parallel-training-plan](../src/inferrsi/data/skill_library/methods/choose-parallel-training-plan/SKILL.md) | common | Compare stage, device-mesh and operator-sharding candidates for static distributed training while accounting for ... | 1 Accelerator · Diagnose / Configure / Optimize / Verify<br>4 Network · Diagnose / Configure / Optimize / Verify | 1 · Systems sources (Alpa — [2201.12023v3](https://arxiv.org/abs/2201.12023v3)) | candidate · not_run · 1 readset(s) | no-eval |
Expand Down Expand Up @@ -201,7 +202,7 @@ an entrypoint routes to procedures below it rather than adding one.

## Integrity checks

- Registered ids resolve to an existing `SKILL.md`: 73 of 73.
- Registered ids resolve to an existing `SKILL.md`: 74 of 74.
- Duplicate ids or paths: none; `skill_catalog` rejects them before this view is built.
- Skill links in the two matrices that do not resolve: 0.
- Registered skills without a `metadata.json` sidecar: 5.
Expand All @@ -210,10 +211,10 @@ an entrypoint routes to procedures below it rather than adding one.

| Gap | Skills |
|---|---|
| `no-SearchSpace-layer` | 13: ascend-video-diffusion-optimization, audit-recurrent-kv-finalization, cite-check-downstream-pr, competitor-scan, draft-acceptance-issue, dwarfstar, husky, inference-benchmark-design, lily, npu-skill-factory, repository-evolution-analysis, skill-evolution-playbook, splash |
| `no-Reference-Matrix-row` | 6: ascend-video-diffusion-optimization, cite-check-downstream-pr, claim-contract, competitor-scan, draft-acceptance-issue, rsi-evidence |
| `no-SearchSpace-layer` | 14: ascend-video-diffusion-optimization, audit-fixed-workload-claim, audit-recurrent-kv-finalization, cite-check-downstream-pr, competitor-scan, draft-acceptance-issue, dwarfstar, husky, inference-benchmark-design, lily, npu-skill-factory, repository-evolution-analysis, skill-evolution-playbook, splash |
| `no-Reference-Matrix-row` | 7: ascend-video-diffusion-optimization, audit-fixed-workload-claim, cite-check-downstream-pr, claim-contract, competitor-scan, draft-acceptance-issue, rsi-evidence |
| `no-sidecar` | 5: cite-check-downstream-pr, claim-contract, competitor-scan, draft-acceptance-issue, rsi-evidence |
| `no-eval` | 71: as listed in the Gaps column above |
| `no-eval` | 72: as listed in the Gaps column above |

These are inventory gaps, not defects. A workflow skill may legitimately
have no hardware resource layer; a candidate may legitimately be untested.
Expand Down
7 changes: 4 additions & 3 deletions src/inferrsi/data/repo_packs/inferrsi/knowledge/README.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# InferRSI skill discovery index

Generated abstracts for all 73 registered skills in `data/skill_library/`.
Generated abstracts for all 74 registered skills in `data/skill_library/`.
Their complete procedures, references and cases ship in the same package.
`skill-index.json` maps stable skill IDs to categorized directories. The
reference and searchspace matrices
Expand All @@ -15,7 +15,7 @@ These are knowledge abstracts (`--kind knowledge`), with namespaced package
IDs distinct from explicitly selected `checkout_ref` skills. Ascend/CUDA
procedures use their corresponding backend; shared methods use `common`.

Source snapshot: [ceb3509942bee863f24eee96e3598c4e007feb20](https://github.com/InferMatrixLab/InferRSI/tree/ceb3509942bee863f24eee96e3598c4e007feb20/src/inferrsi/data/skill_library).
Source snapshot: [d70fa5e4c5c2b1b70c6fbad1f020ab457c409c63](https://github.com/InferMatrixLab/InferRSI/tree/d70fa5e4c5c2b1b70c6fbad1f020ab457c409c63/src/inferrsi/data/skill_library).

```bash
inferrsi knowledge search 'profiling' --repo-type inferrsi --limit 50
Expand All @@ -29,7 +29,7 @@ contain the current input paths and bytes (Git checkout filters are respected).

```bash
python tools/build_skill_index.py --source-revision <committed-source-revision>
python tools/build_skill_index.py --source-revision ceb3509942bee863f24eee96e3598c4e007feb20 --check
python tools/build_skill_index.py --source-revision d70fa5e4c5c2b1b70c6fbad1f020ab457c409c63 --check
```

`--check` detects missing, stale and unexpected generated records without writing.
Expand All @@ -51,6 +51,7 @@ References and cases ship with their owning skill, not as duplicate knowledge ab
| [assess-serving-preemption](common/skills/assess-serving-preemption.json) | common | candidate |
| [assess-split-backward-schedule](common/skills/assess-split-backward-schedule.json) | common | candidate |
| [audit-afd-p2p-exchanges](cuda/skills/audit-afd-p2p-exchanges.json) | cuda | candidate |
| [audit-fixed-workload-claim](common/skills/audit-fixed-workload-claim.json) | common | candidate |
| [audit-flare-session-lifecycle](cuda/skills/audit-flare-session-lifecycle.json) | cuda | candidate |
| [audit-h3-metal-fasth3-semantics](common/skills/audit-h3-metal-fasth3-semantics.json) | common | candidate |
| [audit-h3-runtime-residency](common/skills/audit-h3-runtime-residency.json) | common | candidate |
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -21,8 +21,8 @@
"sources": [
{
"type": "git",
"url": "https://github.com/InferMatrixLab/InferRSI/blob/ceb3509942bee863f24eee96e3598c4e007feb20/src/inferrsi/data/skill_library/hardware/ascend/ascend-aclgraph-capture-replay/SKILL.md",
"commit": "ceb3509942bee863f24eee96e3598c4e007feb20",
"url": "https://github.com/InferMatrixLab/InferRSI/blob/d70fa5e4c5c2b1b70c6fbad1f020ab457c409c63/src/inferrsi/data/skill_library/hardware/ascend/ascend-aclgraph-capture-replay/SKILL.md",
"commit": "d70fa5e4c5c2b1b70c6fbad1f020ab457c409c63",
"paths": [
"src/inferrsi/data/skill_library/hardware/ascend/ascend-aclgraph-capture-replay/SKILL.md",
"src/inferrsi/data/skill_library/hardware/ascend/ascend-aclgraph-capture-replay/metadata.json",
Expand All @@ -41,7 +41,7 @@
"src/inferrsi/data/skill_library/hardware/ascend/ascend-aclgraph-capture-replay/SKILL.md": "d494fc7e539cbb7388189bd7b3f04bb5c4983fdd7a82484348aad1cee7f741f2",
"src/inferrsi/data/skill_library/hardware/ascend/ascend-aclgraph-capture-replay/metadata.json": "71c68431663ed2336cccc985a354adab6b13b4cfd6123a18a5d8d53c28268509",
"src/inferrsi/data/skill_library/hardware/ascend/ascend-aclgraph-capture-replay/references/source-notes.md": "6ffbfb68cc7e04923b4fbca2a73a7555b7c3b45a6f40819bb5f3213ef05cf88d",
"src/inferrsi/data/skill_library/skill-index.json": "efc23969e86e349abe8fd3c9d9b3aa1f23edebf3cb8344cb65e26a8ff680eeb4"
"src/inferrsi/data/skill_library/skill-index.json": "6d5784993dc8702b2c299c2354c39f765299a6734f7c24db994a97efd3fdbed6"
},
"skill_metadata": {
"name": "ascend-aclgraph-capture-replay",
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -23,8 +23,8 @@
"sources": [
{
"type": "git",
"url": "https://github.com/InferMatrixLab/InferRSI/blob/ceb3509942bee863f24eee96e3598c4e007feb20/src/inferrsi/data/skill_library/hardware/ascend/ascend-device-health/SKILL.md",
"commit": "ceb3509942bee863f24eee96e3598c4e007feb20",
"url": "https://github.com/InferMatrixLab/InferRSI/blob/d70fa5e4c5c2b1b70c6fbad1f020ab457c409c63/src/inferrsi/data/skill_library/hardware/ascend/ascend-device-health/SKILL.md",
"commit": "d70fa5e4c5c2b1b70c6fbad1f020ab457c409c63",
"paths": [
"src/inferrsi/data/skill_library/hardware/ascend/ascend-device-health/SKILL.md",
"src/inferrsi/data/skill_library/hardware/ascend/ascend-device-health/metadata.json",
Expand All @@ -41,7 +41,7 @@
"source_files": {
"src/inferrsi/data/skill_library/hardware/ascend/ascend-device-health/SKILL.md": "03829039860ece35519f2e4c339a48b5014ec25e07a2c150a3efb6a3a4e35b4a",
"src/inferrsi/data/skill_library/hardware/ascend/ascend-device-health/metadata.json": "80d80c15514919826fa72d6f6cf26b76db8accd85d21187fc239232ca454e7bf",
"src/inferrsi/data/skill_library/skill-index.json": "efc23969e86e349abe8fd3c9d9b3aa1f23edebf3cb8344cb65e26a8ff680eeb4"
"src/inferrsi/data/skill_library/skill-index.json": "6d5784993dc8702b2c299c2354c39f765299a6734f7c24db994a97efd3fdbed6"
},
"skill_metadata": {
"name": "ascend-device-health",
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -24,8 +24,8 @@
"sources": [
{
"type": "git",
"url": "https://github.com/InferMatrixLab/InferRSI/blob/ceb3509942bee863f24eee96e3598c4e007feb20/src/inferrsi/data/skill_library/hardware/ascend/ascend-distributed-parallel/SKILL.md",
"commit": "ceb3509942bee863f24eee96e3598c4e007feb20",
"url": "https://github.com/InferMatrixLab/InferRSI/blob/d70fa5e4c5c2b1b70c6fbad1f020ab457c409c63/src/inferrsi/data/skill_library/hardware/ascend/ascend-distributed-parallel/SKILL.md",
"commit": "d70fa5e4c5c2b1b70c6fbad1f020ab457c409c63",
"paths": [
"src/inferrsi/data/skill_library/hardware/ascend/ascend-distributed-parallel/SKILL.md",
"src/inferrsi/data/skill_library/hardware/ascend/ascend-distributed-parallel/metadata.json",
Expand All @@ -44,7 +44,7 @@
"src/inferrsi/data/skill_library/hardware/ascend/ascend-distributed-parallel/SKILL.md": "4ce9dcadd1ae3c7a8cc633336760d0a3c382f354f1b7028e3a10d28fa0d0c9fa",
"src/inferrsi/data/skill_library/hardware/ascend/ascend-distributed-parallel/metadata.json": "b6cb25879b1bca5f5af08b48776f2e664cf5dcd11a0efb1c4f56879e2afa9006",
"src/inferrsi/data/skill_library/hardware/ascend/ascend-distributed-parallel/references/awesome-ascend-communication-tests.md": "0cb27a3d24409171bb414d7ebf0c49ad62be5f46482f29624695496ba9eb3e63",
"src/inferrsi/data/skill_library/skill-index.json": "efc23969e86e349abe8fd3c9d9b3aa1f23edebf3cb8344cb65e26a8ff680eeb4"
"src/inferrsi/data/skill_library/skill-index.json": "6d5784993dc8702b2c299c2354c39f765299a6734f7c24db994a97efd3fdbed6"
},
"skill_metadata": {
"name": "ascend-distributed-parallel",
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -22,8 +22,8 @@
"sources": [
{
"type": "git",
"url": "https://github.com/InferMatrixLab/InferRSI/blob/ceb3509942bee863f24eee96e3598c4e007feb20/src/inferrsi/data/skill_library/hardware/ascend/ascend-graph-mode/SKILL.md",
"commit": "ceb3509942bee863f24eee96e3598c4e007feb20",
"url": "https://github.com/InferMatrixLab/InferRSI/blob/d70fa5e4c5c2b1b70c6fbad1f020ab457c409c63/src/inferrsi/data/skill_library/hardware/ascend/ascend-graph-mode/SKILL.md",
"commit": "d70fa5e4c5c2b1b70c6fbad1f020ab457c409c63",
"paths": [
"src/inferrsi/data/skill_library/hardware/ascend/ascend-graph-mode/SKILL.md",
"src/inferrsi/data/skill_library/hardware/ascend/ascend-graph-mode/metadata.json",
Expand All @@ -40,7 +40,7 @@
"source_files": {
"src/inferrsi/data/skill_library/hardware/ascend/ascend-graph-mode/SKILL.md": "9203cc5a14a1d65df5fbf275734b93be023e06527459b2f79864f28a338cb44a",
"src/inferrsi/data/skill_library/hardware/ascend/ascend-graph-mode/metadata.json": "72b41e7845915d34b09219624e82976386f3125816293540c2c38143fe6b477f",
"src/inferrsi/data/skill_library/skill-index.json": "efc23969e86e349abe8fd3c9d9b3aa1f23edebf3cb8344cb65e26a8ff680eeb4"
"src/inferrsi/data/skill_library/skill-index.json": "6d5784993dc8702b2c299c2354c39f765299a6734f7c24db994a97efd3fdbed6"
},
"skill_metadata": {
"name": "ascend-graph-mode",
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -22,8 +22,8 @@
"sources": [
{
"type": "git",
"url": "https://github.com/InferMatrixLab/InferRSI/blob/ceb3509942bee863f24eee96e3598c4e007feb20/src/inferrsi/data/skill_library/hardware/ascend/ascend-model-adaptation/SKILL.md",
"commit": "ceb3509942bee863f24eee96e3598c4e007feb20",
"url": "https://github.com/InferMatrixLab/InferRSI/blob/d70fa5e4c5c2b1b70c6fbad1f020ab457c409c63/src/inferrsi/data/skill_library/hardware/ascend/ascend-model-adaptation/SKILL.md",
"commit": "d70fa5e4c5c2b1b70c6fbad1f020ab457c409c63",
"paths": [
"src/inferrsi/data/skill_library/hardware/ascend/ascend-model-adaptation/SKILL.md",
"src/inferrsi/data/skill_library/hardware/ascend/ascend-model-adaptation/metadata.json",
Expand All @@ -40,7 +40,7 @@
"source_files": {
"src/inferrsi/data/skill_library/hardware/ascend/ascend-model-adaptation/SKILL.md": "8fdf46fb2743b67a66bc069d22a45305a222debfb606777bc451b4b8f31d9cc6",
"src/inferrsi/data/skill_library/hardware/ascend/ascend-model-adaptation/metadata.json": "be681a3206e5e183b4c9670c9d7784bcffce18c891449e5b15f94ca5f1324b9a",
"src/inferrsi/data/skill_library/skill-index.json": "efc23969e86e349abe8fd3c9d9b3aa1f23edebf3cb8344cb65e26a8ff680eeb4"
"src/inferrsi/data/skill_library/skill-index.json": "6d5784993dc8702b2c299c2354c39f765299a6734f7c24db994a97efd3fdbed6"
},
"skill_metadata": {
"name": "ascend-model-adaptation",
Expand Down
Loading
Loading