Repository navigation
feat(llma): support composite offline scorers - #1235
Merged
Merged
Conversation
PR overviewNo security issues were found in this pull request. Reviews
|
7 tasks done
marandaneto
approved these changes
Nov 12, 2026
marandaneto
left a comment
marandaneto
left a comment
Member
There was a problem hiding this comment.
The code looks good; no qualifying findings. Verdict: correct.
Radu-Raicea
enabled auto-merge (squash)
November 12, 2026 15:45
auto-merge was automatically disabled
November 12, 2026 15:50
Pull request was closed
Contributor
posthog-python Compliance ReportDate: 2026-11-12T15:55:01.980605+00:00 ✅ All Tests Passed!270/270 tests passed Capture_V1 Tests✅ 95/95 tests passed View Details
Capture_Ai Tests✅ 5/5 tests passed View Details
Feature_Flags Tests✅ 17/17 tests passed View Details
Feature_Flags_V4 Tests✅ 149/149 tests passed View Details
Feature_Flags_Local_Evaluation Tests✅ 4/4 tests passed View Details
|
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
💡 Motivation and Context
Offline evaluation callers can create and version composite scorers, validate formulas, and request per-item calculations through the existing sync and async clients. Public types expose pinned inputs and dependency metadata; upload receipts expose stored outcomes, including calculation errors.
Bulk uploads keep composite items and their supplied inputs together while preserving order and exact retry recovery. Ordinary uploads retain their existing wire format. Includes documentation, a replayable example, and a minor release changeset.
Requires the backend rollout from PostHog/posthog#132949. The accompanying SDK contract update defines the new behavior; no intentional contract divergence.
💚 How did you test it?
📝 Checklist
🤖 Agent context
Autonomy: Human-driven (agent-assisted)
Codex assisted implementation and validation using Git, GitHub, uv, pytest, Ruff, mypy, and Pyright. Composite grouping is conservative because ingestion-only credentials cannot discover dependencies; oversized groups fail before any upload. Validation includes mocked API contracts, inspected backend source, and live integration checks against local PostHog with the composite backend.