FreeCite: A Judge-Free Benchmark for Granular Citation Evaluation in Large Language Models
-
Updated
Feb 22, 2026 - Python
#
deterministic-evaluation
Here are 9 public repositories matching this topic...
Research benchmark for evidence-grounded OS-agent collaboration, continuous state diagnosis, scoped memory reuse, and stale-state rejection.
multi-agent-systems system-administration research-only agent-collaboration os-agent stateful-agents agent-benchmark tool-using-agents deterministic-evaluation linux-operations evidence-grounding memory-evaluation continuous-tasks
-
Updated
Jul 29, 2026 - JavaScript
Canonical specification and sealed execution traces for VERITAS Ω-CODE v2.0 — deterministic software verification protocol.
-
Updated
Apr 23, 2026 - HTML
As of 07/09/2026 the only open-source PT-PT benchmark that avoids LLM judges and targets email-style structured generation. Deterministic CPU-friendly benchmark for European Portuguese (PT-PT) email LLMs. No LLM judges.
nlp open-source benchmark reproducible email text-generation portuguese dialect pt-pt business-email portuguese-portugal portuguese-european llm-evaluation structured-generation portuguese-nlp llm-benchmark deterministic-evaluation european-portuguese no-llm-judge
-
Updated
Sep 10, 2026 - Python
A realistic RL environment for training LLM agents on enterprise email triage—featuring multi-step decision making, ambiguity handling, tool usage, and deterministic evaluation.
docker reinforcement-learning simulation hackathon triage ai-agents email-classifier scaler rl-environment pydantic fastapi multi-step-reasoning huggingface-spaces llm-agents tool-usage agentic-workflows openenv email-triage deterministic-evaluation pytorch-openenv
-
Updated
Jul 2, 2026 - Python
HCAC is a completion contract for agents and tools. It defines when something is truly “done” — not just structurally, but behaviorally.
backpressure ai-agents quality-gates policy-as-code acceptance-criteria hard-constraints release-readiness deterministic-evaluation agent-contract completion-contract behavioral-contract behavioral-spec
-
Updated
Feb 28, 2026
Public, fully local PoCs for counterfactually auditable lifecycle certification: exact paired replay, drift monitoring, post-drift replanning, and bridge-aware ledger control on synthetic tasks.
ai poc autonomous-agents synthetic-data drift-monitoring llm scientific-reproducibility deterministic-evaluation counterfactual-auditing paired-replay
-
Updated
Mar 19, 2026 - Python
Deterministic offline ComtradeBench judge for evaluating agent robustness under pagination, retries, duplicates, page drift, and totals traps.
-
Updated
Aug 17, 2026 - Python
AI-assisted policy formalization and governance platform for source-traceable rule extraction, human review, immutable versioning, deterministic evaluation, quality analysis, and regression testing.
react rule-engine compliance governance policy-engine policy-as-code fastapi azure-openai azure-ai-search deterministic-evaluation
-
Updated
Sep 2, 2026 - Python
Add this topic to your repo
To associate your repository with the deterministic-evaluation topic, visit your repo's landing page and select "manage topics."