Skip to content
Draft
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
25 commits
Select commit Hold shift + click to select a range
9959030
docs(testkit): add the tests/support environment contract table
matthewgrossman Nov 19, 2026
174cf49
test(tmachine): add a gateway_overrides role for environment gateway …
matthewgrossman Nov 19, 2026
2eb7ee9
test(testkit): serve TLS from host servers with a test or environment CA
matthewgrossman Nov 20, 2026
c71a628
test(testkit): let a host HTTP server listen on a chosen port
matthewgrossman Nov 20, 2026
e1d2187
test(testkit): add provider refresh commands to the test context
matthewgrossman Nov 20, 2026
9fd7b01
test(features): use the testkit profile, provider and refresh helpers…
matthewgrossman Nov 20, 2026
4688963
test(features): port the provider refresh handle test
matthewgrossman Nov 20, 2026
3b16558
test(tmachine): add an OTLP feature environment that points the gatew…
matthewgrossman Nov 20, 2026
b6b8485
test(support): add an OTLP collector fixture on the environment's add…
matthewgrossman Nov 20, 2026
30adc45
test(features): port the OTLP agent trace relay tests
matthewgrossman Nov 20, 2026
b06e4f0
ci(e2e): select tests per row with a filter and run otlp-relay
matthewgrossman Nov 20, 2026
5d756df
test(tmachine): add SPIFFE Workload API environments
matthewgrossman Nov 20, 2026
5a9a7c4
test(support): add SPIFFE Workload API fixture
matthewgrossman Nov 20, 2026
31e91c0
test(features): port provider token exchange tests to testkit
matthewgrossman Nov 20, 2026
b1fa517
test(tmachine): add an additional destination CA environment
matthewgrossman Nov 20, 2026
09bc608
ci(e2e): run provider refresh and token exchange suites
matthewgrossman Nov 20, 2026
0af47c5
test(features): keep OTLP exit-span sandbox names within the limit
matthewgrossman Nov 20, 2026
c0cc105
test(features): port provider readiness and stable placeholder tests
matthewgrossman Nov 20, 2026
777c53f
ci(e2e): run provider rotation suite on additional-CA environments
matthewgrossman Nov 20, 2026
3a6cf21
test(e2e): remove gateway configuration tests ported to testkit suites
matthewgrossman Nov 20, 2026
aac5553
Merge remote-tracking branch 'origin/test/5728-share-environment-help…
matthewgrossman Nov 20, 2026
44ab147
Merge remote-tracking branch 'origin/test/5728-share-environment-help…
matthewgrossman Nov 20, 2026
4b82ab0
test(support): name the OTLP and SPIFFE environment ports _PORT
matthewgrossman Nov 20, 2026
702e06f
test(tmachine): drop the removed provider_token_exchange binary from …
matthewgrossman Nov 20, 2026
ad0f0cd
Merge remote-tracking branch 'origin/test/5728-share-environment-help…
matthewgrossman Nov 20, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
17 changes: 15 additions & 2 deletions .github/workflows/e2e-suites.yml
Original file line number Diff line number Diff line change
Expand Up @@ -4,8 +4,9 @@
# Runs testkit suites in tmachine environments on CI. Each row of `ROWS` below
# names a tmachine environment and installer, the family (the path of a
# workspace under tests/suites/, such as conformance or drivers/podman) and,
# optionally, the package in it, the gateway name the installer registers, and
# the runner label for the environment's architecture. `openshell-test-runner`
# optionally, the package in it, a nextest filterset (`filter`) for a package
# whose tests need different environments, the gateway name the installer
# registers, and the runner label for the environment's architecture. `openshell-test-runner`
# builds the tests, boots the environment, runs them inside it and checks the
# results. With `prebuilt`, the rows run what the caller built once for the
# run instead: conformance rows the static `openshell-conformance`, the other
Expand Down Expand Up @@ -116,6 +117,13 @@ jobs:
{"environment":"ubuntu-k3s","installer":"k3s","family":"features","package":"routable-host-ip","gateway":"tmachine","runner":"ubuntu-24.04"},
{"environment":"ubuntu-k3s","installer":"k3s-ha","family":"features","package":"routable-host-ip","gateway":"tmachine","runner":"ubuntu-24.04"},
{"environment":"ubuntu-docker-rootful","installer":"deb","family":"features","package":"connect-ssh-supervision","gateway":"openshell","runner":"ubuntu-24.04"},
{"environment":"fedora-podman-rootless-otlp","installer":"rpm","family":"features","package":"otlp-relay","filter":"not test(relay_is_inert_without_collector)","gateway":"openshell","runner":"ubuntu-24.04"},
{"environment":"ubuntu-docker-rootful","installer":"deb","family":"features","package":"otlp-relay","filter":"test(relay_is_inert_without_collector)","gateway":"openshell","runner":"ubuntu-24.04"},
{"environment":"fedora-podman-rootless-spiffe","installer":"rpm","family":"features","package":"provider-token-exchange","gateway":"openshell","runner":"ubuntu-24.04"},
{"environment":"ubuntu-docker-rootful","installer":"deb","family":"features","package":"provider-refresh","gateway":"openshell","runner":"ubuntu-24.04"},
{"environment":"fedora-podman-rootful","installer":"rpm","family":"features","package":"provider-refresh","gateway":"openshell","runner":"ubuntu-24.04"},
{"environment":"ubuntu-docker-rootful-additional-ca","installer":"deb","family":"features","package":"provider-rotation","gateway":"openshell","runner":"ubuntu-24.04"},
{"environment":"fedora-podman-rootful-additional-ca","installer":"rpm","family":"features","package":"provider-rotation","gateway":"openshell","runner":"ubuntu-24.04"},
{"environment":"fedora-podman-rootful-keycloak","installer":"rpm","family":"features","package":"keycloak-provider-refresh","gateway":"openshell","runner":"ubuntu-24.04"},
{"environment":"fedora-podman-rootless-keycloak","installer":"rpm","family":"features","package":"keycloak-provider-refresh","gateway":"openshell","runner":"ubuntu-24.04"},
{"environment":"fedora-podman-rootful-userns-default","installer":"rpm","family":"drivers/podman","gateway":"openshell","runner":"ubuntu-24.04"},
Expand All @@ -135,6 +143,7 @@ jobs:
| select((.external_driver // false) == false or $external == "true")
| select((.upgrade_source // false) == false or $upgrade == "true")
| .package //= ""
| .filter //= ""
| .disruption //= ""
| .suite = ([.family, .package, .disruption] | map(select(. != "")) | join("/"))
| .artifact = ([.suite, .environment, .installer] | join("-") | gsub("/"; "-"))
Expand Down Expand Up @@ -254,6 +263,7 @@ jobs:
INSTALLER: ${{ matrix.installer }}
FAMILY: ${{ matrix.family }}
PACKAGE: ${{ matrix.package }}
FILTER: ${{ matrix.filter }}
GATEWAY: ${{ matrix.gateway }}
DISRUPTION: ${{ matrix.disruption }}
run: |
Expand Down Expand Up @@ -281,6 +291,9 @@ jobs:
if [ -n "${PACKAGE}" ]; then
selection+=(--package "${PACKAGE}")
fi
if [ -n "${FILTER}" ]; then
selection+=(--filter "${FILTER}")
fi
fi
# A continuity row seeds state, applies the disruption, and verifies.
if [ -n "${DISRUPTION}" ]; then
Expand Down
4 changes: 3 additions & 1 deletion TESTING.md
Original file line number Diff line number Diff line change
Expand Up @@ -278,7 +278,9 @@ out of every environment until it's fixed.
an explicit matrix and runs the runner once per row. Branch E2E calls it once
per family when the `test:e2e` label is set, and a failure fails the Core E2E
result. Release Dev and Release Qualification run the conformance and feature
families. To run a suite in another environment on CI, add a row.
families. To run a suite in another environment on CI, add a row. A row's
`filter`, a nextest filterset, runs only some of the package's tests, for a
package whose tests need different environments.

### Adding a feature suite

Expand Down
Loading
Loading