Skip to content

feat(proxy): add discovery-driven application TLS passthrough - #4957

Open
TaylorMutch wants to merge 3 commits into
feat/4668-discovery-readers/TaylorMutchfrom
feat/4954-sandbox-proxy/TaylorMutch
Open

TaylorMutch wants to merge 3 commits into
feat/4668-discovery-readers/TaylorMutchfrom
feat/4954-sandbox-proxy/TaylorMutch

Conversation

@TaylorMutch

@TaylorMutch TaylorMutch commented Oct 27, 2026 •

Copy link
Copy Markdown
Collaborator

Summary

Add the optional openshell-sandbox-proxy discovery consumer. It uses exact TLS SNI and unexpired discovered routes to relay application TLS directly to owning supervisors, keeping payloads off the gateway.

Based on main at df6a799eb. Stacked on feat/4668-discovery-readers/TaylorMutch.

Related Issue

Closes #4954. Part of RFC 0017.

Changes

  • Consume snapshots and watches through the Rust SDK client for the separate openshell.v1.ServiceDiscovery service.

  • Support one workspace, selected workspaces, or all active workspaces with discovery-only credentials.

  • Bound route caches, connections, ClientHello parsing, retries, and setup deadlines; atomically replace validated snapshots.

  • Close affected streams on withdrawal, installation replacement, expiry, or authorization loss; reload credentials/trust on reconnect.

  • Add health/readiness/metrics, container and release wiring, and a standalone Helm chart with deployment and workspace-scope regression cases.

Release Notes

Testing

  • Canonical Helm service-auth configuration passed the full chart/runtime-parser suite and final combined-chart tests, generated Helm docs, and Markdown lint. Tests cover the runtime default plus explicit true/false in gatewayConfig."openshell.gateway".enable_gateway_service_auth.

  • Renamed the auth setting consistently across TOML, CLI, environment, Helm, tests, man page, and docs. Standalone auth-stage server tests (2,822 passed; 51 PostgreSQL-dependent tests skipped), combined-stack server/proxy tests, strict Clippy, full Helm runtime validation, generated docs, Markdown lint, and formatting passed. Default remains false; no live E2E was rerun for this configuration-only rename.

  • Rebased all five branches onto main df6a799eb, preserving the SPIFFE provider-token limiter and application-auth peer metadata. Branch ancestry, patch scope, and frozen Python/Go SDK checks passed.

  • Standalone URL PR: 2,801 server tests (50 PostgreSQL-dependent tests skipped), 650 core tests, 336 Kubernetes-driver tests, 300 supervisor tests, and 409 CLI library tests passed.

  • Combined auth/discovery-reader/proxy stack: 2,831 server tests (51 PostgreSQL-dependent tests skipped) and all nine proxy tests passed. Strict all-target Clippy passed for server, core, Kubernetes driver, supervisor, CLI, and proxy.

  • Full Helm suites passed for the URL/Helm follow-up, including rendered TOML, resource coherence, ownership, and scaling. The combined stack passed all 500 gateway-chart unit tests. Generated Helm docs, Markdown/MDX lint, Rust formatting, and whitespace checks passed.

  • Fresh live k3d shared/push/graceful E2E passed on the rebased URL/Helm stage with matching locally built images: Pod-IP ingress without app Services, HTTP/WebSockets, Host/SNI, NetworkPolicy, withdrawal/re-exposure, takeover preserving workload identity/process/memory, and listener-disabled gateway fallback using enable_gateway_service_routing: true. The isolated release and namespace were removed.

Dedicated, poll, abrupt-loss, and external-ingress scenarios were not rerun for these review fixes. Current-head GitHub CI is pending.

Qualification limits

Live Kubernetes qualification covers dedicated/shared supervisors, graceful shared-owner replacement, gateway outage, and policy isolation. Hashed URL/public-port behavior is covered by unit tests. Whole-node failure, real network partitions, metric-driven HPA, sustained production load, external ingress/DNS automation, and published release artifacts remain unqualified. Installation-status presentation (#4670) remains separate work. The example Kubernetes HTTPRoute controller remains a separate compatibility POC.

Checklist

  • Follows Conventional Commits
  • Commits are signed off (DCO)
  • Relevant implementation, configuration, and API documentation updated

PR dependency order: #4956 → #4963 → #4964 → #4957.

@copy-pr-bot

copy-pr-bot Bot commented Oct 27, 2026

Copy link
Copy Markdown

Auto-sync is disabled for draft pull requests in this repository. Workflows must be run manually.

Contributors can view more details about this message here.

@github-actions

Copy link
Copy Markdown

@TaylorMutch
TaylorMutch added this pull request to stack #4942 October 27, 2026 02:54
@TaylorMutch
TaylorMutch force-pushed the feat/4953-authoritative-app-urls/TaylorMutch branch from a6d0833 to e6e1927 Compare October 27, 2026 03:15
@TaylorMutch
TaylorMutch force-pushed the feat/4954-sandbox-proxy/TaylorMutch branch from d51549f to 6d0cb1e Compare October 27, 2026 03:15
@TaylorMutch
TaylorMutch force-pushed the feat/4953-authoritative-app-urls/TaylorMutch branch from e6e1927 to 2574b9a Compare October 27, 2026 05:42
@TaylorMutch
TaylorMutch force-pushed the feat/4954-sandbox-proxy/TaylorMutch branch from 6d0cb1e to 151ee71 Compare October 27, 2026 05:42
@TaylorMutch
TaylorMutch removed this pull request from stack #4942 October 27, 2026 05:45
@TaylorMutch
TaylorMutch changed the base branch from feat/4953-authoritative-app-urls/TaylorMutch to feat/4668-discovery-readers/TaylorMutch October 27, 2026 05:45
@TaylorMutch
TaylorMutch added this pull request to stack #4965 October 27, 2026 05:46
@TaylorMutch
TaylorMutch removed this pull request from stack #4965 October 27, 2026 05:47
@TaylorMutch
TaylorMutch force-pushed the feat/4668-discovery-readers/TaylorMutch branch from 6d1fb23 to 9b730e6 Compare October 27, 2026 06:24
@TaylorMutch
TaylorMutch force-pushed the feat/4954-sandbox-proxy/TaylorMutch branch from 151ee71 to 7624c50 Compare October 27, 2026 06:24
@TaylorMutch
TaylorMutch force-pushed the feat/4668-discovery-readers/TaylorMutch branch from 9b730e6 to 8fef4ac Compare October 27, 2026 06:25
@TaylorMutch
TaylorMutch force-pushed the feat/4954-sandbox-proxy/TaylorMutch branch from 7624c50 to 5415439 Compare October 27, 2026 06:25
@TaylorMutch
TaylorMutch force-pushed the feat/4668-discovery-readers/TaylorMutch branch from 8fef4ac to 8d568c1 Compare October 27, 2026 06:46
@TaylorMutch
TaylorMutch force-pushed the feat/4954-sandbox-proxy/TaylorMutch branch from 5415439 to 8b71a26 Compare October 27, 2026 06:46
@TaylorMutch
TaylorMutch force-pushed the feat/4668-discovery-readers/TaylorMutch branch from 8d568c1 to de13e31 Compare October 27, 2026 21:06
@TaylorMutch
TaylorMutch force-pushed the feat/4954-sandbox-proxy/TaylorMutch branch 2 times, most recently from 7cae154 to 299e56b Compare October 28, 2026 17:05
@TaylorMutch
TaylorMutch force-pushed the feat/4668-discovery-readers/TaylorMutch branch from de13e31 to 05974d6 Compare October 28, 2026 17:05
@TaylorMutch
TaylorMutch force-pushed the feat/4954-sandbox-proxy/TaylorMutch branch from 299e56b to 2fa7511 Compare October 28, 2026 22:52
@TaylorMutch
TaylorMutch force-pushed the feat/4668-discovery-readers/TaylorMutch branch from 159961a to fe417d2 Compare November 4, 2026 21:56
@TaylorMutch
TaylorMutch force-pushed the feat/4954-sandbox-proxy/TaylorMutch branch 2 times, most recently from 3726423 to f7625e7 Compare November 4, 2026 22:22
@TaylorMutch
TaylorMutch force-pushed the feat/4668-discovery-readers/TaylorMutch branch from fe417d2 to 6f7d700 Compare November 4, 2026 22:22
@TaylorMutch
TaylorMutch force-pushed the feat/4954-sandbox-proxy/TaylorMutch branch from f7625e7 to 93c7f1e Compare November 6, 2026 17:27
@TaylorMutch
TaylorMutch force-pushed the feat/4668-discovery-readers/TaylorMutch branch from 6f7d700 to f337bf1 Compare November 6, 2026 17:27
@TaylorMutch
TaylorMutch force-pushed the feat/4954-sandbox-proxy/TaylorMutch branch from 93c7f1e to be3684a Compare November 6, 2026 18:48
@TaylorMutch
TaylorMutch force-pushed the feat/4668-discovery-readers/TaylorMutch branch from f337bf1 to bc80c84 Compare November 6, 2026 18:48
@TaylorMutch
TaylorMutch force-pushed the feat/4954-sandbox-proxy/TaylorMutch branch from be3684a to 4c5a56d Compare November 6, 2026 22:02
@TaylorMutch
TaylorMutch force-pushed the feat/4668-discovery-readers/TaylorMutch branch 2 times, most recently from 052c76c to e8603a5 Compare November 9, 2026 19:08
@TaylorMutch
TaylorMutch force-pushed the feat/4954-sandbox-proxy/TaylorMutch branch 2 times, most recently from 90ed107 to 00048e2 Compare November 10, 2026 08:41
@TaylorMutch
TaylorMutch force-pushed the feat/4668-discovery-readers/TaylorMutch branch from e8603a5 to 89ea75b Compare November 10, 2026 08:41
@TaylorMutch
TaylorMutch force-pushed the feat/4954-sandbox-proxy/TaylorMutch branch from 00048e2 to c1f9745 Compare November 12, 2026 20:17
@TaylorMutch
TaylorMutch force-pushed the feat/4668-discovery-readers/TaylorMutch branch from 89ea75b to 8df72ee Compare November 12, 2026 20:17
@TaylorMutch
TaylorMutch force-pushed the feat/4954-sandbox-proxy/TaylorMutch branch from c1f9745 to af29413 Compare November 13, 2026 21:15
@TaylorMutch
TaylorMutch force-pushed the feat/4668-discovery-readers/TaylorMutch branch from 8df72ee to a18cc74 Compare November 13, 2026 21:15
@purp purp added area:runtime Sandbox execution, isolation, supervision, policy enforcement, networking, and provider lifecycle. topic:authnz Authentication, authorization, identity, sessions, credential protection, and policy integrity. topic:documentation Architecture docs, READMEs, project website updates, and automated documentation generation. topic:kubernetes Kubernetes operators, CRDs, deployment controllers, and native Kubernetes API integration. topic:networking General network transport, connectivity, and proxy behavior. labels Nov 15, 2026
@TaylorMutch

Copy link
Copy Markdown
Collaborator Author

/ok to test 38af543

@TaylorMutch

Copy link
Copy Markdown
Collaborator Author

/ok to test 679c1f4

@TaylorMutch

Copy link
Copy Markdown
Collaborator Author

/ok to test e0ec25d

Route application TLS directly to discovered supervisor listeners, with
bounded caches and connections, expiry and withdrawal, health endpoints,
container/release packaging, and a standalone Helm chart.

Support one workspace, a finite selected set, or all active workspaces
through exclusive CLI and Helm settings. Validate complete snapshot scope
before atomic cache replacement and retain credential reload on reconnect.

Closes #4954
Refs #4668, #4669

Signed-off-by: Taylor Mutch <taylormutch@gmail.com>
Signed-off-by: Taylor Mutch <taylormutch@gmail.com>
Signed-off-by: Taylor Mutch <taylormutch@gmail.com>
@TaylorMutch

Copy link
Copy Markdown
Collaborator Author

/ok to test 692bd92

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:runtime Sandbox execution, isolation, supervision, policy enforcement, networking, and provider lifecycle. topic:authnz Authentication, authorization, identity, sessions, credential protection, and policy integrity. topic:documentation Architecture docs, READMEs, project website updates, and automated documentation generation. topic:kubernetes Kubernetes operators, CRDs, deployment controllers, and native Kubernetes API integration. topic:networking General network transport, connectivity, and proxy behavior. topic:operability Installing/configuring deployments, upgrades, backup/restore, diagnostics, and maintenance. topic:reliability High availability, recovery, retries, graceful degradation, and correctness across restarts.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants