tree-attention

Here are 4 public repositories matching this topic...

vdev-ctrl / Adaptive-Learnable-Hierarchical-Routing-

This repo is a alternative solution for standard self-attention. It uses tree routing with learnable functions for cheaper self-attention while not compromising accuracy.

deep-learning pytorch transformer attention-mechanism efficient-inference efficient-transformers sparse-attention llm long-context sub-quadratic-attention tree-attention

Updated Oct 11, 2026
Python

senna-lang / bonsai-4b-system-one

Star

Lightweight System One model for edge devices: tree-masked multi-question inference on frozen Ternary-Bonsai-4B (MLX/PyTorch)

python pytorch classification decision-model ternary bonsai mlx huggingface apple-silicon tree-attention jev typed-decisions

Updated Oct 6, 2026
Python

JohnScheuer / tree-speculative-decoding

Star

Tree-based speculative decoding benchmarked against linear under equal verification budget — branch factor, depth, and draft quality sweep with fair node-level comparison.

python benchmarking pytorch transformer medusa llm-inference speculative-decoding draft-model autoregressive-decoding tree-attention specinfer

Updated Jul 17, 2026
Python

senna-lang / qwen3-4b-system-one

Star

Tree-masked multi-question inference for the Qwen3-4B System One LoRA (PyTorch / MLX)

python pytorch classification lora decision-model mlx distillation peft huggingface apple-silicon qwen3 tree-attention jev typed-decisions

Updated Oct 2, 2026
Python

Add this topic to your repo

To associate your repository with the tree-attention topic, visit your repo's landing page and select "manage topics."

Learn more