🐼 Steer your LLMs and agents at the token level: A web app for token visualization & control, model inspection, data annotation, and more.
Explore how Hugging Face tokenizers work across models like LLaMA, PHI-3, and StarCoder2. Includes examples for encoding, decoding, chat formatting, and token visualization. Ideal for understanding text preprocessing in LLMs.
Native Windows app for chatting with local GGUF models and visualizing token-driven neural activity through a live connectome.
Token Pie runs locally on each developer's machine, reads telemetry Copilot already writes, Nothing leaves the machine. No server, no account, no telemetry of our own.
To associate your repository with the token-visualization topic, visit your repo's landing page and select "manage topics."