Repository navigation
test(e2e): port Docker and Podman driver feature tests from e2e/rust - #5695
Draft
matthewgrossman wants to merge 16 commits into
Draft
matthewgrossman wants to merge 16 commits into
matthewgrossman wants to merge 16 commits into
Conversation
|
Auto-sync is disabled for draft pull requests in this repository. Workflows must be run manually. Contributors can view more details about this message here. |
This was referenced Nov 18, 2026
matthewgrossman
force-pushed
the
test/5655-port-network-l7-policy/matthewgrossman
branch
from
November 18, 2026 18:34
251835b to
3214f39
Compare
6 of 7 tasks
matthewgrossman
force-pushed
the
test/5676-port-docker-podman-features/matthewgrossman
branch
from
November 18, 2026 18:42
4c8dfc9 to
4579361
Compare
Member
Author
|
/ok to test 4579361 |
matthewgrossman
force-pushed
the
test/5676-port-docker-podman-features/matthewgrossman
branch
from
November 18, 2026 18:51
4579361 to
cd9c8f2
Compare
Member
Author
|
/ok to test cd9c8f2 |
matthewgrossman
force-pushed
the
test/5655-port-network-l7-policy/matthewgrossman
branch
from
November 18, 2026 19:08
3214f39 to
f99bacb
Compare
Member
Author
|
/ok to test 0a29574 |
matthewgrossman
force-pushed
the
test/5676-port-docker-podman-features/matthewgrossman
branch
from
November 18, 2026 19:11
cd9c8f2 to
0a29574
Compare
matthewgrossman
force-pushed
the
test/5655-port-network-l7-policy/matthewgrossman
branch
from
November 18, 2026 23:27
f99bacb to
afcf2f4
Compare
Member
Author
|
/ok to test f188601 |
matthewgrossman
force-pushed
the
test/5676-port-docker-podman-features/matthewgrossman
branch
from
November 18, 2026 23:33
0a29574 to
f188601
Compare
This was referenced Nov 18, 2026
matthewgrossman
force-pushed
the
test/5655-port-network-l7-policy/matthewgrossman
branch
from
November 19, 2026 00:46
054ed4f to
31e7182
Compare
matthewgrossman
force-pushed
the
test/5676-port-docker-podman-features/matthewgrossman
branch
from
November 19, 2026 00:50
f188601 to
f054e20
Compare
Member
Author
|
/ok to test f054e20 |
matthewgrossman
force-pushed
the
test/5655-port-network-l7-policy/matthewgrossman
branch
from
November 19, 2026 19:38
bfcbcc7 to
86a2569
Compare
7 of 8 tasks
Member
Author
|
/ok to test 0211cf1 |
matthewgrossman
force-pushed
the
test/5676-port-docker-podman-features/matthewgrossman
branch
from
November 20, 2026 00:34
f054e20 to
0211cf1
Compare
Member
Author
|
/ok to test 1d05357 |
This was referenced Nov 20, 2026
|
Label |
…container-engine Signed-off-by: Matthew Grossman <mgrossman@nvidia.com>
…leanup Signed-off-by: Matthew Grossman <mgrossman@nvidia.com>
… and ephemeral cleanup Signed-off-by: Matthew Grossman <mgrossman@nvidia.com>
Signed-off-by: Matthew Grossman <mgrossman@nvidia.com>
…ker and Podman Signed-off-by: Matthew Grossman <mgrossman@nvidia.com>
Signed-off-by: Matthew Grossman <mgrossman@nvidia.com>
…onfig on Docker and Podman Signed-off-by: Matthew Grossman <mgrossman@nvidia.com>
… host-gateway The EOF check runs its three responses in one sandbox and reads the close through the shared http_raw client. The stop/start check is the restart half of podman_host_gateway, which stays in e2e/rust until its DNS relay check is decided. Signed-off-by: Matthew Grossman <mgrossman@nvidia.com>
…ocsf Merges the class, attribution and schema checks of ocsf_jsonl_conformance into the stderr test. The sandbox denies a TCP connect and an L7 POST to an in-process host server, and the exec sessions add SSH Activity. ocsf_jsonl_conformance stays in e2e/rust for its /var/log file-sink check until that drop is decided. Signed-off-by: Matthew Grossman <mgrossman@nvidia.com>
…hosen Python to sandbox-clients Signed-off-by: Matthew Grossman <mgrossman@nvidia.com>
…ontainers on it Signed-off-by: Matthew Grossman <mgrossman@nvidia.com>
…transparent-tcp Signed-off-by: Matthew Grossman <mgrossman@nvidia.com>
Signed-off-by: Matthew Grossman <mgrossman@nvidia.com>
…en_restart Signed-off-by: Matthew Grossman <mgrossman@nvidia.com>
Signed-off-by: Matthew Grossman <mgrossman@nvidia.com>
…rites the shorthand Signed-off-by: Matthew Grossman <mgrossman@nvidia.com>
Member
Author
|
/ok to test 47c28fb |
matthewgrossman
force-pushed
the
test/5676-port-docker-podman-features/matthewgrossman
branch
from
November 20, 2026 07:11
1d05357 to
47c28fb
Compare
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Ports the
e2e/rusttests that need a container engine to testkit suites, so they run on the Docker and Podman rows instead of being gated to one engine. Draft: some legacy tests stay until the drops in #5297 are decided.Related Issue
Closes #5676
Part of #5281
Stack: main <- #5665 <- #5695 (#5691 has merged) (base
test/5655-port-network-l7-policy/matthewgrossman). The PR holds only its own 14 commits.Helpers from #5691 (now on main) used:
sandbox_clients_support::{connect, http, http_raw}withRequest,ReadEnd::ClosedandHttp::status();host_server_support::{TEST_HOST, HttpRecorder, TcpServer};testkit::python_image()with.command(["sleep", "infinity"]);policy::allowandpolicy::base_withwithpolicy::binaries_yaml(PYTHON_BINARIES). Left inline: the driver-config main commands, which must run as the main process (the OCI test checks workspace preparation beforeexec sleep infinity), and the bind test's filesystem-only policy YAML, which has nobinaries:list.Changes
tests/suites/drivers/{docker,podman}: stop is terminal and ephemeral cleanup leaves no containers, one test per driver. Podman also checks the supervisor JWTexp.drivers/dockeris a new suite with its CI rows.features/resource-limits: checks that gateway info reports CPU and memorylimit_supported, then readscpu.maxandmemory.max.features/ocsf: supervisor stderr OCSF JSON records. Covers opt-in, clean stdout, gateway logs keeping only the shorthand, Network/HTTP/SSH Activity classes (denied connect, L7-denied POST to an in-process host server, exec sessions), container and image attribution, version, and OCSF schema validation.features/driver-config: existing volume, OCI workspace with a nested volume, and bind mount, on a new<base>-driver-configtmachine environment.features/host-gateway:response_eof.rsruns the three closing responses in one sandbox and checks the read ends withReadEnd::Closed.host_server_reachable_after_stop_startchecks the host server again after stop and start.features/transparent-tcp: native TCP resolves through policy DNS to a synthetic address and reaches an echo fixture, also by the numeric synthetic address after its mapping expires, as an IPv4-mapped IPv6 address, and on TCP port 53. A wrong port, the fixture's real address, the transparent listener port and an unlisted host are denied, nothing denied reaches the fixture, and exec still works afterwards. Rows: Docker rootful, Podman rootful and rootless. On Docker the fixture runs on the host; on Podman it is a container on the gateway network.drivers/podman:private_dns_pins_do_not_cross_binary_rules. A copy ofpython3that a rule names exactly reaches a private fixture; a copy that only a*.openshell.testrule allows resolves the name but can't use the exact rule's pin. It lives in the Podman driver suite, notfeatures/transparent-tcp, because it needs a fixture at a private address reached by name. On Docker the fixture would sit behindhost.openshell.internal, which the supervisor trusts as the host gateway for any matching rule (HOST_GATEWAY_ALIASES), so the wildcard binary reaches it (verified locally).Context::gateway_infoandSandboxBuilder::log_level.Engine::copy_fromreadscp <id>:<path> -as a tar stream, because under rootful Podman (sudo -n podman cp) a copy to a host path is owned by root and the test can't read it.features/ocsfsets the sandbox log level toinfo. The shorthand layer logs atinfo; the Podman driver leaves the supervisor at itswarndefault, while the Docker driver passes the gateway's level, so without it Podman's supervisor stderr has noOCSF NET:OPENline.sandbox_clients_support::resolvereturns whatgetaddrinfoanswered (Resolve::{Addresses, Failed}).sandbox_clients_support::Pythonrunsconnect,http,http_rawandresolveunder a chosen interpreter with extra environment, such as a copiedpython3withPYTHONHOME. The free functions use the image'spython3.container_engine_support::{Engine::network_from_env, Engine::run_test_container, Engine::container_ip, EchoContainer}start a fixture container on the gateway network, removed at test cleanup.OPENSHELL_TEST_CONTAINER_NETWORK: each Podman installer publishes the network its gateway attaches sandboxes to:tmachinefor the binaries installer (itsgateway-podman.toml.j2),openshellfor the rpm installer (the packaged config sets nonetwork_name, so the driver default applies).e2e/with-podman-gateway.shexports it. Docker doesn't publish it. It belongs in thetests/support/README.mdcontract table from test(testkit): share TLS host servers, a gateway settings role and the environment contract table #5728, which isn't on this branch yet; I'll add the row once it is.driver_config_volume.rs,ocsf_console.rsandpodman_resource_limits.rs, and the EOF test fromhost_gateway_alias.rs, plus the now-unusedbollarddependency. Removes the two ported tests fromtransparent_tcp.rs.local_driver_token_restart.rskeeps only its VM gateway restart test until PR6, and leaves the Podman CI list.Defaults applied
allow_driver_config = trueandenable_bind_mounts = true, and disables resource admission. Only this environment disables it: admission rejects host bind mounts, so the bind-mount test can't run with it on. Test volumes still carry theopenshell.ai/sandbox-attachableand workspace labels.testkit::python_image(), because the default image has nosandboxuser. The bind source is a temp directory under$HOME.features/resource-limitshas no k3s row yet. The VM driver reportslimit_supported=false, so no VM issue was filed.Coverage that is new on a driver
transparent_tcpwas excluded from the tmachine archive.Pending drops (Decision D in #5297)
These stay in
e2e/rustuntil approved:ocsf_jsonl_conformance.rs, for its/var/logfile-sink check. Its other checks now live infeatures/ocsf.host_gateway_alias::sandbox_reaches_host_openshell_internal_via_host_gateway_alias.podman_host_gateway.rs, for its reachability half and thenameserver 127.0.0.53check. Its stop/start half now lives infeatures/host-gateway.transparent_tcp::rootless_podman_musl_getaddrinfo_uses_udp_policy_dns.Testing
cargo fmt --checkon testkit, support, drivers/docker, drivers/podman, features, conformance ande2e/rust.cargo clippy --locked --all-targets -- -D warningson the same workspaces.Unit tests in
tests/support(including the newPythoncommand andresolveparser) and thefeatures/ocsfrecord parser.uv run tasks/scripts/check_cargo_lockfile_alignment.pyandtasks/scripts/check-cargo-lockfiles.sh. Every commit resolves withcargo metadata --locked.Run end to end locally against Docker Desktop with
e2e/with-docker-gateway.sh:features/host-gateway(3 tests),features/ocsf,features/resource-limits,features/transparent-tcpanddrivers/dockerpass.features/driver-configand the Podman rows rely on CI.Podman rows may flake on
ContainerExiteduntil fix(server): keep the reconcile sweep from failing a sandbox mid-start #5265 merges.Checks appropriate to the affected code and behavior pass
Unit tests added/updated (if applicable)
E2E tests added/updated (if applicable)
Checklist