A collection of LogitsProcessors to customize and enhance LLM behavior for specific tasks.
-
Updated
Sep 16, 2026 - Python
A collection of LogitsProcessors to customize and enhance LLM behavior for specific tasks.
Research design for a Jev-native agent system:enable more options than jev provided with virtulization and paging, tool integration, external helper logits Top-k proposals with Jev-controlled fallback ,decision-aware hierarchical memory, and dependency-aware replanning.
Typed decisions (choice / score / yes-no) from local Qwen models on Apple Silicon. Probabilities come straight from the logits, no text generation. TypeSafe-compatible HTTP API, runs on MLX.
Plots how the logit values that are passed into the softmax function change over time as the model is trained.
Jev-style typed decisions from Qwen3.5-2B logits — one forward pass, zero decoding, zero fine-tuning.
Novel Hallucination detection method
Local frozen-backbone decision readout: evidence + criterion + options in, a probability per option out, in one forward pass. JevBench public set 0.805 / hard 0.604 with Qwen3.5-4B, no training.
Tell recoverable LLM failures from structural ones by reading the failed trace. Two models, one vLLM pass, no extra forward pass.
Convert any causal LM into a Jev-style typed decision model — no training, no new weights. Measured honestly against JevBench, negative results included.
Detecting prompt toxicity from a small LLM's internal logits and embeddings, no separate moderation model needed. 99.18% AUPRC with a 64-neuron MLP.
Typed decisions from a local LLM in one forward pass. Reads the logits of the allowed options instead of generating text. ~44 ms per extra decision on the same document with llama.cpp prefix caching.
Temporal analysis of LLM safety activation via logit-margin scores.
Fast, System One-inspired local AI decisions without text generation. One E4B Tetris snapshot game averaged 33.3 ms per request on an RTX 5090. Open source.
Ask a vision model a question, get the answer from its logits in one forward pass. No decoding, nothing trained. The confidence is the logit gap in nats.
Composable token sampling over f32 logits with caller-supplied randomness
Multi strategy logit fusion between Ouro-1.4B (Universal Transformer) and HRM-Text-1B (prefix-LM) for improved text generation
Convolutional Networks Training and Logits Saving
This project bridges the gap between human language and machine-executable code by translating prompts into structured function calls with typed arguments. Built strictly with Python 3.10+ and Pydantic , it demonstrates how constrained decoding can ensure near-perfect reliability and strict JSON compliance, even on small 0.5B parameter models.
To associate your repository with the logits topic, visit your repo's landing page and select "manage topics."