Popular repositories Loading

1. TokenFlow-Gateway TokenFlow-Gateway Public

   TokenFlow is an enterprise-grade, token-aware load balancer and AI gateway for vLLM. It prevents GPU OOM crashes using Redis-backed admission control, semantic caching, and dynamic token routing. B…

   TypeScript 12

2. prompt-guard-2-frozen-head prompt-guard-2-frozen-head Public

   Phase-5 injection-classifier pipeline: A calibrated linear head trained on Prompt Guard 2 frozen embeddings achieving 99.9% OOD recall.

   TeX 10 1

3. accelerate accelerate Public

   Forked from huggingface/accelerate

   🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support

   Python 5

4. sglang sglang Public

   Forked from sgl-project/sglang

   SGLang is a high-performance serving framework for large language models and multimodal models.

   Python 5

5. PlcSentinel PlcSentinel Public

   Industrial Control Systems (ICS/OT) security testbed: Modbus, S7comm, OPC UA, inline L7 DPI gateways

   Python 1

6. AI-Powered-Itinerary-Generator AI-Powered-Itinerary-Generator Public

   A serverless application built with Cloudflare Workers that generates personalized travel itineraries using AI and stores them in Firestore. The API responds instantly with a tracking ID while gene…

   JavaScript