Skip to content

Validate release identity and packaged SDK examples - #76

Merged
bigboateng merged 1 commit into
mainfrom
codex/release-sdk-artifacts
Oct 13, 2026
Merged

bigboateng merged 1 commit into
mainfrom
codex/release-sdk-artifacts

Conversation

@bigboateng

@bigboateng bigboateng commented Oct 13, 2026 •

Copy link
Copy Markdown
Contributor

Change contract

When: A maintainer releases Pitot, or a developer generates an SDK project with the released CLI.
Before: SDK versions were rewritten after the binary build while generated dependencies stayed at 0.1.0. The Rust consumer referenced a nonexistent field, and obsolete test paths skipped its build. Publication could start before all packages built.
After: Release admission requires a clean checkout at a matching stable tag and matching SDK source versions. Generated dependencies pin the CLI release. Python, npm and Rust artifacts are checked before upload; npm/Python publish those checked files. Rust projects use the repository's release tag and all three generated templates are built and exercised.

Boundaries preserved

  • Existing npm/Python and binary destinations remain; Rust uses a Git dependency without introducing a registry.
  • No release tag, registry upload or real model call is performed by this PR's tests.
  • Development builds use the documented source fallback. Prereleases and Go-incompatible major versions are rejected before publication.

Evidence

Scenario or check Expected result Observed result
Go suite and maintenance suite Pass Passed; 227 maintenance tests, 3 platform skips
Stable tag admission; malformed/branch/prerelease/mismatched refs Accept matching source; reject others Passed in owned Git fixtures
Rust tagged nested crate and missing tag Resolve intended crate; reject absent tag Passed
Packaged Python wheel/sdist, npm and Rust; generated Rust programs Matching identities and working stdio; failed TS build rejected Passed locally
Formatting, static checks and workflow syntax Pass Passed
Native Linux, macOS and Windows CI Pass at this PR head All 49 checks passed; current report has 33 agent and 3 runtime passes

Failure and recovery

One Pi Windows installation attempt hit the existing five-minute timeout before its test ran; one retry at the unchanged commit passed.

Build or identity failures stop before authentication and upload. Cross-registry publication remains non-atomic: inspect any already-published version before retrying a failed upload. Future release tags require an explicit version bump in all SDK manifests and the development fallback.

Remaining limits

Production registry authentication and delivery are not exercised. Windows runtime readiness, obsolete integration cleanup, and the final documentation cleanup remain separate follow-ups.

@github-actions

github-actions Bot commented Oct 13, 2026 •

Copy link
Copy Markdown

Pitot coding-agent E2E

Intelligence Flow is the verification source; Pitot's public README carries the latest main status.

Agent Ubuntu macOS Windows Result Evidence
Claude ✅ Pass · real CLI 2.1.296 · native · binary-observed anthropic messages ✅ Pass · real CLI 2.1.296 · native · binary-observed anthropic messages ✅ Pass · real CLI 2.1.296 · native · binary-observed anthropic messages ✅ Passing All platforms are required
Cursor ✅ Pass · real CLI 2026.10.01-e373342 · native · binary-observed cursor connect proto ✅ Pass · real CLI 2026.10.01-e373342 · native · binary-observed cursor connect proto ✅ Pass · real CLI 2026.10.01-e373342 · native · binary-observed cursor connect proto ✅ Passing All platforms are required
Codex ✅ Pass · real CLI 0.162.1 · native · binary-observed openai responses ✅ Pass · real CLI 0.162.1 · native · binary-observed openai responses ✅ Pass · real CLI 0.162.1 · native · binary-observed openai responses ✅ Passing All platforms are required
Devin ✅ Pass · real CLI 3000.11.3 · native · binary-observed devin connect proto ✅ Pass · real CLI 3000.11.3 · native · binary-observed devin connect proto ✅ Pass · real CLI 3000.11.3 · native · binary-observed devin connect proto ✅ Passing All platforms are required
DeepSeek Harness ✅ Pass · real CLI 0.2.0-rc.2 · native · binary-observed openai chat ✅ Pass · real CLI 0.2.0-rc.2 · native · binary-observed openai chat ✅ Pass · real CLI 0.2.0-rc.2 · native · binary-observed openai chat ✅ Passing All platforms are required
GitHub Copilot CLI ✅ Pass · real CLI 1.0.95 · native · binary-observed openai chat ✅ Pass · real CLI 1.0.95 · native · binary-observed openai chat ✅ Pass · real CLI 1.0.95 · native · binary-observed openai chat ✅ Passing All platforms are required
Gemini ✅ Pass · real CLI 0.63.0 · native · binary-observed gemini generate content ✅ Pass · real CLI 0.63.0 · native · binary-observed gemini generate content ✅ Pass · real CLI 0.63.0 · native · binary-observed gemini generate content ✅ Passing All platforms are required
Kimi Code ✅ Pass · real CLI 2.1.1 · native · binary-observed openai chat ✅ Pass · real CLI 2.1.1 · native · binary-observed openai chat ✅ Pass · real CLI 2.1.1 · native · binary-observed openai chat ✅ Passing All platforms are required
OpenCode ✅ Pass · real CLI 2.0.27 · native · binary-observed openai responses ✅ Pass · real CLI 2.0.27 · native · binary-observed openai responses ✅ Pass · real CLI 2.0.27 · native · binary-observed openai responses ✅ Passing All platforms are required
Pi ✅ Pass · real CLI 1.1.0 · native · binary-observed openai chat ✅ Pass · real CLI 1.1.0 · native · binary-observed openai chat ✅ Pass · real CLI 1.1.0 · native · binary-observed openai chat ✅ Passing All platforms are required
Qwen Code ✅ Pass · real CLI 0.25.1 · native · binary-observed openai chat ✅ Pass · real CLI 0.25.1 · native · binary-observed openai chat ✅ Pass · real CLI 0.25.1 · native · binary-observed openai chat ✅ Passing All platforms are required

Runtime capabilities

Capability Ubuntu macOS Windows Result
pitot request ✅ Pass · real runtime allow/deny ✅ Pass · real runtime allow/deny ✅ Pass · real runtime allow/deny ✅ Passing

Source commit: 0343af873e98

@bigboateng
bigboateng merged commit c26e315 into main Oct 13, 2026
85 of 87 checks passed
@bigboateng
bigboateng deleted the codex/release-sdk-artifacts branch October 13, 2026 14:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant