sample-product-chart:0.1.01.30.0unknownWorst status across all scenarios that exercise each mechanism. Covers: addons (cert-manager, istio, gatekeeper, …), subchart variants, customer profiles.
addon:cert-manager
UNTESTED
certificates-cert-manager-jks-pkcs12 · certificates-cert-manager-jks-pkcs12 · certificates-cert-manager-jks-pkcs12 · certificates-cert-manager-jks-pkcs12 · certificates-cert-manager-jks-pkcs12 · certificates-cert-manager-jks-pkcs12 · certificates-cert-manager-jks-pkcs12 · certificates-cert-manager-jks-pkcs12 · certificates-cert-manager-jks-pkcs12 · certificates-cert-manager-jks-pkcs12 · certificates-cert-manager-lets-encrypt-staging · certificates-cert-manager-lets-encrypt-staging · certificates-cert-manager-lets-encrypt-staging · certificates-cert-manager-lets-encrypt-staging · certificates-cert-manager-lets-encrypt-staging · certificates-cert-manager-lets-encrypt-staging · certificates-cert-manager-self-signed-ca · certificates-cert-manager-self-signed-ca · certificates-cert-manager-self-signed-ca · certificates-cert-manager-self-signed-ca · certificates-cert-manager-self-signed-ca · certificates-cert-manager-self-signed-ca · certificates-cert-manager-self-signed-ca · certificates-cert-manager-self-signed-ca · certificates-cert-manager-self-signed-ca · certificates-cert-manager-wildcard · certificates-cert-manager-wildcard · certificates-cert-manager-wildcard · certificates-cert-manager-wildcard · certificates-cert-manager-wildcard · customer-a-istio · customer-a-istio · customer-a-istio · gateway-api-envoy-gateway-cert-manager-tls · gateway-api-envoy-gateway-cert-manager-tls · ingress-controllers-nginx-ingress-tls-cert-manager · ingress-controllers-nginx-ingress-tls-cert-manager · ingress-controllers-nginx-ingress-tls-cert-manager · service-mesh-istio-service-mesh-cert-manager-tls · service-mesh-istio-service-mesh-cert-manager-tls · with-cert-manager · with-cert-manager · with-cert-manager · with-cert-manager
addon:contour
FAIL
gateway-api-contour-gateway-api-basic · gateway-api-contour-gateway-api-basic · gateway-api-contour-gateway-api-basic · gateway-api-contour-gateway-api-response-header-modifier · gateway-api-contour-gateway-api-response-header-modifier · gateway-api-contour-gateway-api-route-precedence · gateway-api-contour-gateway-api-route-precedence · gateway-api-contour-gateway-api-route-precedence · ingress-controllers-contour-basic-httpproxy · ingress-controllers-contour-basic-httpproxy · ingress-controllers-contour-basic-httpproxy · ingress-controllers-contour-basic-httpproxy · ingress-controllers-contour-rate-limit · ingress-controllers-contour-tls-delegation · ingress-controllers-contour-tls-delegation · ingress-controllers-contour-tls-delegation · ingress-controllers-contour-tls-delegation · ingress-controllers-contour-tls-delegation
addon:envoy-gateway
UNTESTED
envoy-gateway · envoy-gateway · envoy-gateway · envoy-gateway · envoy-gateway · gateway-api-envoy-gateway-cert-manager-tls · gateway-api-envoy-gateway-cert-manager-tls · gateway-api-envoy-gateway-grpcroute · gateway-api-envoy-gateway-grpcroute · gateway-api-envoy-gateway-grpcroute · gateway-api-envoy-gateway-grpcroute · gateway-api-envoy-gateway-grpcroute · gateway-api-envoy-gateway-httproute · gateway-api-envoy-gateway-httproute · gateway-api-envoy-gateway-httproute · gateway-api-envoy-gateway-httproute · gateway-api-envoy-gateway-httproute · gateway-api-envoy-gateway-httproute · gateway-api-envoy-gateway-httproute · gateway-api-envoy-gateway-httproute · gateway-api-envoy-gateway-httproute · gateway-api-envoy-gateway-security-policy-attach · gateway-api-envoy-gateway-security-policy-attach · gateway-api-envoy-gateway-security-policy-attach · gateway-api-envoy-gateway-security-policy-attach
addon:gatekeeper
PASS
customer-b-gatekeeper
addon:istio
FAIL
customer-a-istio · customer-a-istio · customer-a-istio · gateway-api-istio-gateway-api-backend-tls-policy · gateway-api-istio-gateway-api-backend-tls-policy · gateway-api-istio-gateway-api-backend-tls-policy · gateway-api-istio-gateway-api-backend-tls-policy · gateway-api-istio-gateway-api-backend-tls-policy · gateway-api-istio-gateway-api-backend-tls-policy · gateway-api-istio-gateway-api-backend-tls-policy · gateway-api-istio-gateway-api-backend-tls-policy · gateway-api-istio-gateway-api-backend-tls-policy · gateway-api-istio-gateway-api-backend-tls-policy · gateway-api-istio-gateway-api-backend-tls-policy · gateway-api-istio-gateway-api-basic · gateway-api-istio-gateway-api-basic · gateway-api-istio-gateway-api-basic · gateway-api-istio-gateway-api-basic · gateway-api-istio-gateway-api-multi-listener · gateway-api-istio-gateway-api-multi-listener · gateway-api-istio-gateway-api-multi-listener · gateway-api-istio-gateway-api-multi-listener · service-mesh-istio-ingress-gateway-basic · service-mesh-istio-ingress-gateway-basic · service-mesh-istio-ingress-gateway-basic · service-mesh-istio-ingress-gateway-jwt · service-mesh-istio-ingress-gateway-jwt · service-mesh-istio-ingress-gateway-jwt · service-mesh-istio-ingress-gateway-multi-host · service-mesh-istio-ingress-gateway-multi-host · service-mesh-istio-ingress-gateway-request-authentication · service-mesh-istio-ingress-gateway-request-authentication · service-mesh-istio-service-mesh-cert-manager-tls · service-mesh-istio-service-mesh-cert-manager-tls · service-mesh-istio-service-mesh-peer-authentication · service-mesh-istio-service-mesh-sidecar-injection · service-mesh-istio-service-mesh-sidecar-injection · service-mesh-istio-service-mesh-sidecar-injection · service-mesh-istio-service-mesh-strict-mtls · service-mesh-istio-service-mesh-strict-mtls · service-mesh-istio-service-mesh-telemetry-v2
addon:linkerd
UNTESTED
service-mesh-linkerd-basic-mesh · service-mesh-linkerd-basic-mesh · service-mesh-linkerd-basic-mesh · service-mesh-linkerd-basic-mesh · service-mesh-linkerd-basic-mesh · service-mesh-linkerd-basic-mesh · service-mesh-linkerd-basic-mesh · service-mesh-linkerd-basic-mesh · service-mesh-linkerd-basic-mesh
addon:manual-tls-secret
UNTESTED
certificates-manual-tls-secret-basic · certificates-manual-tls-secret-basic · certificates-manual-tls-secret-basic · certificates-manual-tls-secret-basic · certificates-manual-tls-secret-ecdsa · certificates-manual-tls-secret-ecdsa · certificates-manual-tls-secret-ecdsa · certificates-manual-tls-secret-ecdsa · certificates-manual-tls-secret-multiple-sans · certificates-manual-tls-secret-multiple-sans · certificates-manual-tls-secret-multiple-sans
addon:mounted-tls-certs
UNTESTED
certificates-mounted-tls-certs-csi-secret-store · certificates-mounted-tls-certs-csi-secret-store · certificates-mounted-tls-certs-csi-secret-store · certificates-mounted-tls-certs-csi-secret-store · certificates-mounted-tls-certs-csi-secret-store · certificates-mounted-tls-certs-csi-secret-store · certificates-mounted-tls-certs-csi-secret-store · certificates-mounted-tls-certs-csi-secret-store · certificates-mounted-tls-certs-projected-volume · certificates-mounted-tls-certs-projected-volume · certificates-mounted-tls-certs-projected-volume · certificates-mounted-tls-certs-projected-volume · certificates-mounted-tls-certs-pvc-mount · certificates-mounted-tls-certs-pvc-mount · certificates-mounted-tls-certs-pvc-mount · certificates-mounted-tls-certs-pvc-mount · certificates-mounted-tls-certs-pvc-mount · certificates-mounted-tls-certs-pvc-mount
addon:nginx-ingress
UNTESTED
ingress-controllers-nginx-ingress-basic · ingress-controllers-nginx-ingress-basic · ingress-controllers-nginx-ingress-canary · ingress-controllers-nginx-ingress-canary · ingress-controllers-nginx-ingress-default-backend · ingress-controllers-nginx-ingress-default-backend · ingress-controllers-nginx-ingress-default-backend · ingress-controllers-nginx-ingress-default-backend · ingress-controllers-nginx-ingress-default-backend · ingress-controllers-nginx-ingress-default-backend · ingress-controllers-nginx-ingress-default-backend · ingress-controllers-nginx-ingress-snippet-annotations · ingress-controllers-nginx-ingress-snippet-annotations · ingress-controllers-nginx-ingress-tls-cert-manager · ingress-controllers-nginx-ingress-tls-cert-manager · ingress-controllers-nginx-ingress-tls-cert-manager
addon:none
FAIL
c3bad-path · c3fail-deliberate · c3sig-slow · c3sig-slow2 · c3sig-slow2 · minimal · minimal · minimal · minimal · minimal · minimal · minimal · minimal · minimal · minimal
addon:traefik
UNTESTED
ingress-controllers-traefik-basic · ingress-controllers-traefik-basic · ingress-controllers-traefik-basic · ingress-controllers-traefik-basic · ingress-controllers-traefik-basic · ingress-controllers-traefik-basic · ingress-controllers-traefik-basic · ingress-controllers-traefik-basic · ingress-controllers-traefik-basic · ingress-controllers-traefik-ingressroute-crd · ingress-controllers-traefik-ingressroute-crd · ingress-controllers-traefik-middleware-chain · ingress-controllers-traefik-middleware-chain · ingress-controllers-traefik-middleware-chain · ingress-controllers-traefik-tls-passthrough · ingress-controllers-traefik-tls-passthrough · ingress-controllers-traefik-tls-passthrough · ingress-controllers-traefik-tls-passthrough · ingress-controllers-traefik-tls-passthrough · ingress-controllers-traefik-tls-passthrough
subchart:postgres-internal
PASS
subchart-postgres-internal
mesh:istio
UNTESTED
customer-a-istio · customer-a-istio · customer-a-istio
mesh:istio-ingress-gateway
UNTESTED
service-mesh-istio-ingress-gateway-basic · service-mesh-istio-ingress-gateway-basic · service-mesh-istio-ingress-gateway-basic · service-mesh-istio-ingress-gateway-jwt · service-mesh-istio-ingress-gateway-jwt · service-mesh-istio-ingress-gateway-jwt · service-mesh-istio-ingress-gateway-multi-host · service-mesh-istio-ingress-gateway-multi-host · service-mesh-istio-ingress-gateway-request-authentication · service-mesh-istio-ingress-gateway-request-authentication
mesh:istio-service-mesh
FAIL
service-mesh-istio-service-mesh-cert-manager-tls · service-mesh-istio-service-mesh-cert-manager-tls · service-mesh-istio-service-mesh-peer-authentication · service-mesh-istio-service-mesh-sidecar-injection · service-mesh-istio-service-mesh-sidecar-injection · service-mesh-istio-service-mesh-sidecar-injection · service-mesh-istio-service-mesh-strict-mtls · service-mesh-istio-service-mesh-strict-mtls · service-mesh-istio-service-mesh-telemetry-v2
mesh:linkerd
UNTESTED
service-mesh-linkerd-basic-mesh · service-mesh-linkerd-basic-mesh · service-mesh-linkerd-basic-mesh · service-mesh-linkerd-basic-mesh · service-mesh-linkerd-basic-mesh · service-mesh-linkerd-basic-mesh · service-mesh-linkerd-basic-mesh · service-mesh-linkerd-basic-mesh · service-mesh-linkerd-basic-mesh
customer:A
UNTESTED
customer-a-istio · customer-a-istio · customer-a-istio
customer:B
PASS
customer-b-gatekeeper
gateway-api:contour
UNTESTED
gateway-api-contour-gateway-api-basic · gateway-api-contour-gateway-api-basic · gateway-api-contour-gateway-api-basic · gateway-api-contour-gateway-api-response-header-modifier · gateway-api-contour-gateway-api-response-header-modifier · gateway-api-contour-gateway-api-route-precedence · gateway-api-contour-gateway-api-route-precedence · gateway-api-contour-gateway-api-route-precedence
gateway-api:envoy
UNTESTED
envoy-gateway · envoy-gateway · envoy-gateway · envoy-gateway · envoy-gateway · gateway-api-envoy-gateway-cert-manager-tls · gateway-api-envoy-gateway-cert-manager-tls · gateway-api-envoy-gateway-grpcroute · gateway-api-envoy-gateway-grpcroute · gateway-api-envoy-gateway-grpcroute · gateway-api-envoy-gateway-grpcroute · gateway-api-envoy-gateway-grpcroute · gateway-api-envoy-gateway-httproute · gateway-api-envoy-gateway-httproute · gateway-api-envoy-gateway-httproute · gateway-api-envoy-gateway-httproute · gateway-api-envoy-gateway-httproute · gateway-api-envoy-gateway-httproute · gateway-api-envoy-gateway-httproute · gateway-api-envoy-gateway-httproute · gateway-api-envoy-gateway-httproute · gateway-api-envoy-gateway-security-policy-attach · gateway-api-envoy-gateway-security-policy-attach · gateway-api-envoy-gateway-security-policy-attach · gateway-api-envoy-gateway-security-policy-attach
gateway-api:istio
UNTESTED
gateway-api-istio-gateway-api-backend-tls-policy · gateway-api-istio-gateway-api-backend-tls-policy · gateway-api-istio-gateway-api-backend-tls-policy · gateway-api-istio-gateway-api-backend-tls-policy · gateway-api-istio-gateway-api-backend-tls-policy · gateway-api-istio-gateway-api-backend-tls-policy · gateway-api-istio-gateway-api-backend-tls-policy · gateway-api-istio-gateway-api-backend-tls-policy · gateway-api-istio-gateway-api-backend-tls-policy · gateway-api-istio-gateway-api-backend-tls-policy · gateway-api-istio-gateway-api-backend-tls-policy · gateway-api-istio-gateway-api-basic · gateway-api-istio-gateway-api-basic · gateway-api-istio-gateway-api-basic · gateway-api-istio-gateway-api-basic · gateway-api-istio-gateway-api-multi-listener · gateway-api-istio-gateway-api-multi-listener · gateway-api-istio-gateway-api-multi-listener · gateway-api-istio-gateway-api-multi-listener
One row per scenario. Cell value: passed / total asserts.
Groups with 3+ variants per integration are collapsed — click the header to expand.
| Scenario | Cluster shape | Tags | Asserts | Status | Agent |
|---|---|---|---|---|---|
customer-b-gatekeeper
customer-b-gatekeeper |
kind
|
nightlycustomer-replica |
2/2 | PASS | 0 |
subchart-postgres-internal
subchart-postgres-internal |
kind
|
pr-subsetnightly |
2/2 | PASS | 0 |
addon/cert-manager
| Scenario | Cluster shape | Tags | Asserts | Status | Agent |
|---|---|---|---|---|---|
certificates-cert-manager-jks-pkcs12
certificates-cert-manager-jks-pkcs12 |
kind
|
nightly |
0/0 | UNTESTED | — |
certificates-cert-manager-jks-pkcs12
certificates-cert-manager-jks-pkcs12 |
kind
|
nightly |
0/0 | UNTESTED | — |
certificates-cert-manager-jks-pkcs12
certificates-cert-manager-jks-pkcs12 |
kind
|
nightly |
0/0 | UNTESTED | — |
certificates-cert-manager-jks-pkcs12
certificates-cert-manager-jks-pkcs12 |
kind
|
nightly |
0/0 | UNTESTED | — |
certificates-cert-manager-jks-pkcs12
certificates-cert-manager-jks-pkcs12 |
kind
|
nightly |
0/0 | UNTESTED | — |
certificates-cert-manager-jks-pkcs12
certificates-cert-manager-jks-pkcs12 |
kind
|
nightly |
0/0 | UNTESTED | — |
certificates-cert-manager-jks-pkcs12
certificates-cert-manager-jks-pkcs12 |
kind
|
nightly |
0/0 | UNTESTED | — |
certificates-cert-manager-jks-pkcs12
certificates-cert-manager-jks-pkcs12 |
kind
|
nightly |
0/0 | UNTESTED | — |
certificates-cert-manager-jks-pkcs12
certificates-cert-manager-jks-pkcs12 |
kind
|
nightly |
0/0 | UNTESTED | — |
certificates-cert-manager-jks-pkcs12
certificates-cert-manager-jks-pkcs12 |
kind
|
nightly |
0/0 | INTERRUPTED | 0 |
certificates-cert-manager-lets-encrypt-staging
certificates-cert-manager-lets-encrypt-staging |
kind
|
nightly |
0/0 | UNTESTED | — |
certificates-cert-manager-lets-encrypt-staging
certificates-cert-manager-lets-encrypt-staging |
kind
|
nightly |
0/0 | UNTESTED | — |
certificates-cert-manager-lets-encrypt-staging
certificates-cert-manager-lets-encrypt-staging |
kind
|
nightly |
0/0 | UNTESTED | — |
certificates-cert-manager-lets-encrypt-staging
certificates-cert-manager-lets-encrypt-staging |
kind
|
nightly |
0/0 | UNTESTED | — |
certificates-cert-manager-lets-encrypt-staging
certificates-cert-manager-lets-encrypt-staging |
kind
|
nightly |
0/0 | UNTESTED | — |
certificates-cert-manager-lets-encrypt-staging
certificates-cert-manager-lets-encrypt-staging |
kind
|
nightly |
3/3 | PASS | 0 |
certificates-cert-manager-self-signed-ca
certificates-cert-manager-self-signed-ca |
kind
|
nightly |
0/0 | UNTESTED | — |
certificates-cert-manager-self-signed-ca
certificates-cert-manager-self-signed-ca |
kind
|
nightly |
0/0 | UNTESTED | — |
certificates-cert-manager-self-signed-ca
certificates-cert-manager-self-signed-ca |
kind
|
nightly |
0/0 | UNTESTED | — |
certificates-cert-manager-self-signed-ca
certificates-cert-manager-self-signed-ca |
kind
|
nightly |
0/0 | UNTESTED | — |
certificates-cert-manager-self-signed-ca
certificates-cert-manager-self-signed-ca |
kind
|
nightly |
0/0 | UNTESTED | — |
certificates-cert-manager-self-signed-ca
certificates-cert-manager-self-signed-ca |
kind
|
nightly |
0/0 | UNTESTED | — |
certificates-cert-manager-self-signed-ca
certificates-cert-manager-self-signed-ca |
kind
|
nightly |
0/0 | UNTESTED | — |
certificates-cert-manager-self-signed-ca
certificates-cert-manager-self-signed-ca |
kind
|
nightly |
0/0 | UNTESTED | — |
certificates-cert-manager-self-signed-ca
certificates-cert-manager-self-signed-ca |
kind
|
nightly |
3/3 | PASS | 0 |
certificates-cert-manager-wildcard
certificates-cert-manager-wildcard |
kind
|
nightly |
0/0 | UNTESTED | — |
certificates-cert-manager-wildcard
certificates-cert-manager-wildcard |
kind
|
nightly |
0/0 | UNTESTED | — |
certificates-cert-manager-wildcard
certificates-cert-manager-wildcard |
kind
|
nightly |
0/0 | UNTESTED | — |
certificates-cert-manager-wildcard
certificates-cert-manager-wildcard |
kind
|
nightly |
0/0 | UNTESTED | — |
certificates-cert-manager-wildcard
certificates-cert-manager-wildcard |
kind
|
nightly |
3/3 | PASS | 0 |
ingress-controllers-nginx-ingress-tls-cert-manager
ingress-controllers-nginx-ingress-tls-cert-manager |
kind
|
nightly |
0/0 | UNTESTED | — |
ingress-controllers-nginx-ingress-tls-cert-manager
ingress-controllers-nginx-ingress-tls-cert-manager |
kind
|
nightly |
0/0 | UNTESTED | — |
ingress-controllers-nginx-ingress-tls-cert-manager
ingress-controllers-nginx-ingress-tls-cert-manager |
kind
|
nightly |
5/5 | PASS | 0 |
with-cert-manager
with-cert-manager |
kind
|
pr-subsetnightly |
0/0 | UNTESTED | — |
with-cert-manager
with-cert-manager |
kind
|
pr-subsetnightly |
0/0 | UNTESTED | — |
with-cert-manager
with-cert-manager |
kind
|
pr-subsetnightly |
0/0 | UNTESTED | — |
with-cert-manager
with-cert-manager |
kind
|
pr-subsetnightly |
2/2 | PASS | 0 |
addon/contour
| Scenario | Cluster shape | Tags | Asserts | Status | Agent |
|---|---|---|---|---|---|
gateway-api-contour-gateway-api-basic
gateway-api-contour-gateway-api-basic |
kind
|
nightly |
0/0 | UNTESTED | — |
gateway-api-contour-gateway-api-basic
gateway-api-contour-gateway-api-basic |
kind
|
nightly |
0/0 | UNTESTED | — |
gateway-api-contour-gateway-api-basic
gateway-api-contour-gateway-api-basic |
kind
|
nightly |
4/4 | PASS | 0 |
gateway-api-contour-gateway-api-response-header-modifier
gateway-api-contour-gateway-api-response-header-modifier |
kind
|
nightly |
0/0 | UNTESTED | — |
gateway-api-contour-gateway-api-response-header-modifier
gateway-api-contour-gateway-api-response-header-modifier |
kind
|
nightly |
4/4 | PASS | 0 |
gateway-api-contour-gateway-api-route-precedence
gateway-api-contour-gateway-api-route-precedence |
kind
|
nightly |
0/0 | UNTESTED | — |
gateway-api-contour-gateway-api-route-precedence
gateway-api-contour-gateway-api-route-precedence |
kind
|
nightly |
0/0 | UNTESTED | — |
gateway-api-contour-gateway-api-route-precedence
gateway-api-contour-gateway-api-route-precedence |
kind
|
nightly |
4/4 | PASS | 0 |
ingress-controllers-contour-basic-httpproxy
ingress-controllers-contour-basic-httpproxy |
kind
|
nightly |
0/0 | UNTESTED | — |
ingress-controllers-contour-basic-httpproxy
ingress-controllers-contour-basic-httpproxy |
kind
|
nightly |
0/0 | UNTESTED | — |
ingress-controllers-contour-basic-httpproxy
ingress-controllers-contour-basic-httpproxy |
kind
|
nightly |
0/0 | UNTESTED | — |
ingress-controllers-contour-basic-httpproxy
ingress-controllers-contour-basic-httpproxy |
kind
|
nightly |
4/4 | PASS | 0 |
ingress-controllers-contour-rate-limit
ingress-controllers-contour-rate-limit |
kind
|
nightly |
3/4 | FAIL | 0 |
ingress-controllers-contour-tls-delegation
ingress-controllers-contour-tls-delegation |
kind
|
nightly |
0/0 | UNTESTED | — |
ingress-controllers-contour-tls-delegation
ingress-controllers-contour-tls-delegation |
kind
|
nightly |
0/0 | UNTESTED | — |
ingress-controllers-contour-tls-delegation
ingress-controllers-contour-tls-delegation |
kind
|
nightly |
0/0 | UNTESTED | — |
ingress-controllers-contour-tls-delegation
ingress-controllers-contour-tls-delegation |
kind
|
nightly |
0/0 | UNTESTED | — |
ingress-controllers-contour-tls-delegation
ingress-controllers-contour-tls-delegation |
kind
|
nightly |
4/4 | PASS | 0 |
addon/envoy-gateway
| Scenario | Cluster shape | Tags | Asserts | Status | Agent |
|---|---|---|---|---|---|
envoy-gateway
envoy-gateway |
kind
|
nightly |
0/0 | UNTESTED | — |
envoy-gateway
envoy-gateway |
kind
|
nightly |
0/0 | UNTESTED | — |
envoy-gateway
envoy-gateway |
kind
|
nightly |
0/0 | UNTESTED | — |
envoy-gateway
envoy-gateway |
kind
|
nightly |
0/0 | UNTESTED | — |
envoy-gateway
envoy-gateway |
kind
|
nightly |
4/4 | PASS | 0 |
gateway-api-envoy-gateway-cert-manager-tls
gateway-api-envoy-gateway-cert-manager-tls |
kind
|
nightly |
0/0 | UNTESTED | — |
gateway-api-envoy-gateway-cert-manager-tls
gateway-api-envoy-gateway-cert-manager-tls |
kind
|
nightly |
7/7 | PASS | 0 |
gateway-api-envoy-gateway-grpcroute
gateway-api-envoy-gateway-grpcroute |
kind
|
nightly |
0/0 | UNTESTED | — |
gateway-api-envoy-gateway-grpcroute
gateway-api-envoy-gateway-grpcroute |
kind
|
nightly |
0/0 | UNTESTED | — |
gateway-api-envoy-gateway-grpcroute
gateway-api-envoy-gateway-grpcroute |
kind
|
nightly |
0/0 | UNTESTED | — |
gateway-api-envoy-gateway-grpcroute
gateway-api-envoy-gateway-grpcroute |
kind
|
nightly |
0/0 | UNTESTED | — |
gateway-api-envoy-gateway-grpcroute
gateway-api-envoy-gateway-grpcroute |
kind
|
nightly |
5/5 | PASS | 0 |
gateway-api-envoy-gateway-httproute
gateway-api-envoy-gateway-httproute |
kind
|
nightly |
0/0 | UNTESTED | — |
gateway-api-envoy-gateway-httproute
gateway-api-envoy-gateway-httproute |
kind
|
nightly |
0/0 | UNTESTED | — |
gateway-api-envoy-gateway-httproute
gateway-api-envoy-gateway-httproute |
kind
|
nightly |
0/0 | UNTESTED | — |
gateway-api-envoy-gateway-httproute
gateway-api-envoy-gateway-httproute |
kind
|
nightly |
0/0 | UNTESTED | — |
gateway-api-envoy-gateway-httproute
gateway-api-envoy-gateway-httproute |
kind
|
nightly |
0/0 | UNTESTED | — |
gateway-api-envoy-gateway-httproute
gateway-api-envoy-gateway-httproute |
kind
|
nightly |
0/0 | UNTESTED | — |
gateway-api-envoy-gateway-httproute
gateway-api-envoy-gateway-httproute |
kind
|
nightly |
0/0 | UNTESTED | — |
gateway-api-envoy-gateway-httproute
gateway-api-envoy-gateway-httproute |
kind
|
nightly |
0/0 | UNTESTED | — |
gateway-api-envoy-gateway-httproute
gateway-api-envoy-gateway-httproute |
kind
|
nightly |
5/5 | PASS | 0 |
gateway-api-envoy-gateway-security-policy-attach
gateway-api-envoy-gateway-security-policy-attach |
kind
|
nightly |
0/0 | UNTESTED | — |
gateway-api-envoy-gateway-security-policy-attach
gateway-api-envoy-gateway-security-policy-attach |
kind
|
nightly |
0/0 | UNTESTED | — |
gateway-api-envoy-gateway-security-policy-attach
gateway-api-envoy-gateway-security-policy-attach |
kind
|
nightly |
0/0 | UNTESTED | — |
gateway-api-envoy-gateway-security-policy-attach
gateway-api-envoy-gateway-security-policy-attach |
kind
|
nightly |
5/5 | PASS | 0 |
addon/istio
| Scenario | Cluster shape | Tags | Asserts | Status | Agent |
|---|---|---|---|---|---|
customer-a-istio
customer-a-istio |
kind
|
nightlycustomer-replica |
0/0 | UNTESTED | — |
customer-a-istio
customer-a-istio |
kind
|
nightlycustomer-replica |
0/0 | UNTESTED | — |
customer-a-istio
customer-a-istio |
kind
|
nightlycustomer-replica |
2/2 | PASS | 0 |
gateway-api-istio-gateway-api-backend-tls-policy
gateway-api-istio-gateway-api-backend-tls-policy |
kind
|
nightly |
0/0 | UNTESTED | — |
gateway-api-istio-gateway-api-backend-tls-policy
gateway-api-istio-gateway-api-backend-tls-policy |
kind
|
nightly |
0/0 | UNTESTED | — |
gateway-api-istio-gateway-api-backend-tls-policy
gateway-api-istio-gateway-api-backend-tls-policy |
kind
|
nightly |
0/0 | UNTESTED | — |
gateway-api-istio-gateway-api-backend-tls-policy
gateway-api-istio-gateway-api-backend-tls-policy |
kind
|
nightly |
0/0 | UNTESTED | — |
gateway-api-istio-gateway-api-backend-tls-policy
gateway-api-istio-gateway-api-backend-tls-policy |
kind
|
nightly |
0/0 | UNTESTED | — |
gateway-api-istio-gateway-api-backend-tls-policy
gateway-api-istio-gateway-api-backend-tls-policy |
kind
|
nightly |
0/0 | UNTESTED | — |
gateway-api-istio-gateway-api-backend-tls-policy
gateway-api-istio-gateway-api-backend-tls-policy |
kind
|
nightly |
0/0 | UNTESTED | — |
gateway-api-istio-gateway-api-backend-tls-policy
gateway-api-istio-gateway-api-backend-tls-policy |
kind
|
nightly |
0/0 | UNTESTED | — |
gateway-api-istio-gateway-api-backend-tls-policy
gateway-api-istio-gateway-api-backend-tls-policy |
kind
|
nightly |
0/0 | UNTESTED | — |
gateway-api-istio-gateway-api-backend-tls-policy
gateway-api-istio-gateway-api-backend-tls-policy |
kind
|
nightly |
0/0 | UNTESTED | — |
gateway-api-istio-gateway-api-backend-tls-policy
gateway-api-istio-gateway-api-backend-tls-policy |
kind
|
nightly |
7/7 | PASS | 0 |
gateway-api-istio-gateway-api-basic
gateway-api-istio-gateway-api-basic |
kind
|
nightly |
0/0 | UNTESTED | — |
gateway-api-istio-gateway-api-basic
gateway-api-istio-gateway-api-basic |
kind
|
nightly |
0/0 | UNTESTED | — |
gateway-api-istio-gateway-api-basic
gateway-api-istio-gateway-api-basic |
kind
|
nightly |
0/0 | UNTESTED | — |
gateway-api-istio-gateway-api-basic
gateway-api-istio-gateway-api-basic |
kind
|
nightly |
6/6 | PASS | 0 |
gateway-api-istio-gateway-api-multi-listener
gateway-api-istio-gateway-api-multi-listener |
kind
|
nightly |
0/0 | UNTESTED | — |
gateway-api-istio-gateway-api-multi-listener
gateway-api-istio-gateway-api-multi-listener |
kind
|
nightly |
0/0 | UNTESTED | — |
gateway-api-istio-gateway-api-multi-listener
gateway-api-istio-gateway-api-multi-listener |
kind
|
nightly |
0/0 | UNTESTED | — |
gateway-api-istio-gateway-api-multi-listener
gateway-api-istio-gateway-api-multi-listener |
kind
|
nightly |
6/6 | PASS | 0 |
service-mesh-istio-ingress-gateway-basic
service-mesh-istio-ingress-gateway-basic |
kind
|
nightly |
0/0 | UNTESTED | — |
service-mesh-istio-ingress-gateway-basic
service-mesh-istio-ingress-gateway-basic |
kind
|
nightly |
0/0 | UNTESTED | — |
service-mesh-istio-ingress-gateway-basic
service-mesh-istio-ingress-gateway-basic |
kind
|
nightly |
8/8 | PASS | 0 |
service-mesh-istio-ingress-gateway-jwt
service-mesh-istio-ingress-gateway-jwt |
kind
|
nightly |
0/0 | UNTESTED | — |
service-mesh-istio-ingress-gateway-jwt
service-mesh-istio-ingress-gateway-jwt |
kind
|
nightly |
0/0 | UNTESTED | — |
service-mesh-istio-ingress-gateway-jwt
service-mesh-istio-ingress-gateway-jwt |
kind
|
nightly |
8/8 | PASS | 0 |
service-mesh-istio-ingress-gateway-multi-host
service-mesh-istio-ingress-gateway-multi-host |
kind
|
nightly |
0/0 | UNTESTED | — |
service-mesh-istio-ingress-gateway-multi-host
service-mesh-istio-ingress-gateway-multi-host |
kind
|
nightly |
8/8 | PASS | 0 |
service-mesh-istio-ingress-gateway-request-authentication
service-mesh-istio-ingress-gateway-request-authentication |
kind
|
nightly |
0/0 | UNTESTED | — |
service-mesh-istio-ingress-gateway-request-authentication
service-mesh-istio-ingress-gateway-request-authentication |
kind
|
nightly |
8/8 | PASS | 0 |
service-mesh-istio-service-mesh-cert-manager-tls
service-mesh-istio-service-mesh-cert-manager-tls |
kind
|
nightly |
0/0 | UNTESTED | — |
service-mesh-istio-service-mesh-cert-manager-tls
service-mesh-istio-service-mesh-cert-manager-tls |
kind
|
nightly |
9/9 | PASS | 0 |
service-mesh-istio-service-mesh-peer-authentication
service-mesh-istio-service-mesh-peer-authentication |
kind
|
nightly |
6/6 | PASS | 0 |
service-mesh-istio-service-mesh-sidecar-injection
service-mesh-istio-service-mesh-sidecar-injection |
kind
|
nightly |
0/0 | UNTESTED | — |
service-mesh-istio-service-mesh-sidecar-injection
service-mesh-istio-service-mesh-sidecar-injection |
kind
|
nightly |
0/0 | UNTESTED | — |
service-mesh-istio-service-mesh-sidecar-injection
service-mesh-istio-service-mesh-sidecar-injection |
kind
|
nightly |
5/6 | FAIL | 0 |
service-mesh-istio-service-mesh-strict-mtls
service-mesh-istio-service-mesh-strict-mtls |
kind
|
nightly |
0/0 | UNTESTED | — |
service-mesh-istio-service-mesh-strict-mtls
service-mesh-istio-service-mesh-strict-mtls |
kind
|
nightly |
6/6 | PASS | 0 |
service-mesh-istio-service-mesh-telemetry-v2
service-mesh-istio-service-mesh-telemetry-v2 |
kind
|
nightly |
6/6 | PASS | 0 |
addon/linkerd
| Scenario | Cluster shape | Tags | Asserts | Status | Agent |
|---|---|---|---|---|---|
service-mesh-linkerd-basic-mesh
service-mesh-linkerd-basic-mesh |
kind
|
nightly |
0/0 | UNTESTED | — |
service-mesh-linkerd-basic-mesh
service-mesh-linkerd-basic-mesh |
kind
|
nightly |
0/0 | UNTESTED | — |
service-mesh-linkerd-basic-mesh
service-mesh-linkerd-basic-mesh |
kind
|
nightly |
0/0 | UNTESTED | — |
service-mesh-linkerd-basic-mesh
service-mesh-linkerd-basic-mesh |
kind
|
nightly |
0/0 | UNTESTED | — |
service-mesh-linkerd-basic-mesh
service-mesh-linkerd-basic-mesh |
kind
|
nightly |
0/0 | UNTESTED | — |
service-mesh-linkerd-basic-mesh
service-mesh-linkerd-basic-mesh |
kind
|
nightly |
0/0 | UNTESTED | — |
service-mesh-linkerd-basic-mesh
service-mesh-linkerd-basic-mesh |
kind
|
nightly |
0/0 | UNTESTED | — |
service-mesh-linkerd-basic-mesh
service-mesh-linkerd-basic-mesh |
kind
|
nightly |
0/0 | UNTESTED | — |
service-mesh-linkerd-basic-mesh
service-mesh-linkerd-basic-mesh |
kind
|
nightly |
6/6 | PASS | 0 |
addon/manual-tls-secret
| Scenario | Cluster shape | Tags | Asserts | Status | Agent |
|---|---|---|---|---|---|
certificates-manual-tls-secret-basic
certificates-manual-tls-secret-basic |
kind
|
nightly |
0/0 | UNTESTED | — |
certificates-manual-tls-secret-basic
certificates-manual-tls-secret-basic |
kind
|
nightly |
0/0 | UNTESTED | — |
certificates-manual-tls-secret-basic
certificates-manual-tls-secret-basic |
kind
|
nightly |
0/0 | UNTESTED | — |
certificates-manual-tls-secret-basic
certificates-manual-tls-secret-basic |
kind
|
nightly |
3/3 | PASS | 0 |
certificates-manual-tls-secret-ecdsa
certificates-manual-tls-secret-ecdsa |
kind
|
nightly |
0/0 | UNTESTED | — |
certificates-manual-tls-secret-ecdsa
certificates-manual-tls-secret-ecdsa |
kind
|
nightly |
0/0 | UNTESTED | — |
certificates-manual-tls-secret-ecdsa
certificates-manual-tls-secret-ecdsa |
kind
|
nightly |
0/0 | UNTESTED | — |
certificates-manual-tls-secret-ecdsa
certificates-manual-tls-secret-ecdsa |
kind
|
nightly |
3/3 | PASS | 0 |
certificates-manual-tls-secret-multiple-sans
certificates-manual-tls-secret-multiple-sans |
kind
|
nightly |
0/0 | UNTESTED | — |
certificates-manual-tls-secret-multiple-sans
certificates-manual-tls-secret-multiple-sans |
kind
|
nightly |
0/0 | UNTESTED | — |
certificates-manual-tls-secret-multiple-sans
certificates-manual-tls-secret-multiple-sans |
kind
|
nightly |
3/3 | PASS | 0 |
addon/mounted-tls-certs
| Scenario | Cluster shape | Tags | Asserts | Status | Agent |
|---|---|---|---|---|---|
certificates-mounted-tls-certs-csi-secret-store
certificates-mounted-tls-certs-csi-secret-store |
kind
|
nightly |
0/0 | UNTESTED | — |
certificates-mounted-tls-certs-csi-secret-store
certificates-mounted-tls-certs-csi-secret-store |
kind
|
nightly |
0/0 | UNTESTED | — |
certificates-mounted-tls-certs-csi-secret-store
certificates-mounted-tls-certs-csi-secret-store |
kind
|
nightly |
0/0 | UNTESTED | — |
certificates-mounted-tls-certs-csi-secret-store
certificates-mounted-tls-certs-csi-secret-store |
kind
|
nightly |
0/0 | UNTESTED | — |
certificates-mounted-tls-certs-csi-secret-store
certificates-mounted-tls-certs-csi-secret-store |
kind
|
nightly |
0/0 | UNTESTED | — |
certificates-mounted-tls-certs-csi-secret-store
certificates-mounted-tls-certs-csi-secret-store |
kind
|
nightly |
0/0 | UNTESTED | — |
certificates-mounted-tls-certs-csi-secret-store
certificates-mounted-tls-certs-csi-secret-store |
kind
|
nightly |
0/0 | UNTESTED | — |
certificates-mounted-tls-certs-csi-secret-store
certificates-mounted-tls-certs-csi-secret-store |
kind
|
nightly |
3/3 | PASS | 0 |
certificates-mounted-tls-certs-projected-volume
certificates-mounted-tls-certs-projected-volume |
kind
|
nightly |
0/0 | UNTESTED | — |
certificates-mounted-tls-certs-projected-volume
certificates-mounted-tls-certs-projected-volume |
kind
|
nightly |
0/0 | UNTESTED | — |
certificates-mounted-tls-certs-projected-volume
certificates-mounted-tls-certs-projected-volume |
kind
|
nightly |
0/0 | UNTESTED | — |
certificates-mounted-tls-certs-projected-volume
certificates-mounted-tls-certs-projected-volume |
kind
|
nightly |
3/3 | PASS | 0 |
certificates-mounted-tls-certs-pvc-mount
certificates-mounted-tls-certs-pvc-mount |
kind
|
nightly |
0/0 | UNTESTED | — |
certificates-mounted-tls-certs-pvc-mount
certificates-mounted-tls-certs-pvc-mount |
kind
|
nightly |
0/0 | UNTESTED | — |
certificates-mounted-tls-certs-pvc-mount
certificates-mounted-tls-certs-pvc-mount |
kind
|
nightly |
0/0 | UNTESTED | — |
certificates-mounted-tls-certs-pvc-mount
certificates-mounted-tls-certs-pvc-mount |
kind
|
nightly |
0/0 | UNTESTED | — |
certificates-mounted-tls-certs-pvc-mount
certificates-mounted-tls-certs-pvc-mount |
kind
|
nightly |
0/0 | UNTESTED | — |
certificates-mounted-tls-certs-pvc-mount
certificates-mounted-tls-certs-pvc-mount |
kind
|
nightly |
3/3 | PASS | 0 |
addon/nginx-ingress
| Scenario | Cluster shape | Tags | Asserts | Status | Agent |
|---|---|---|---|---|---|
ingress-controllers-nginx-ingress-basic
ingress-controllers-nginx-ingress-basic |
kind
|
nightly |
0/0 | UNTESTED | — |
ingress-controllers-nginx-ingress-basic
ingress-controllers-nginx-ingress-basic |
kind
|
nightly |
4/4 | PASS | 0 |
ingress-controllers-nginx-ingress-canary
ingress-controllers-nginx-ingress-canary |
kind
|
nightly |
0/0 | UNTESTED | — |
ingress-controllers-nginx-ingress-canary
ingress-controllers-nginx-ingress-canary |
kind
|
nightly |
4/4 | PASS | 0 |
ingress-controllers-nginx-ingress-default-backend
ingress-controllers-nginx-ingress-default-backend |
kind
|
nightly |
0/0 | UNTESTED | — |
ingress-controllers-nginx-ingress-default-backend
ingress-controllers-nginx-ingress-default-backend |
kind
|
nightly |
0/0 | UNTESTED | — |
ingress-controllers-nginx-ingress-default-backend
ingress-controllers-nginx-ingress-default-backend |
kind
|
nightly |
0/0 | UNTESTED | — |
ingress-controllers-nginx-ingress-default-backend
ingress-controllers-nginx-ingress-default-backend |
kind
|
nightly |
0/0 | UNTESTED | — |
ingress-controllers-nginx-ingress-default-backend
ingress-controllers-nginx-ingress-default-backend |
kind
|
nightly |
0/0 | UNTESTED | — |
ingress-controllers-nginx-ingress-default-backend
ingress-controllers-nginx-ingress-default-backend |
kind
|
nightly |
0/0 | UNTESTED | — |
ingress-controllers-nginx-ingress-default-backend
ingress-controllers-nginx-ingress-default-backend |
kind
|
nightly |
4/4 | PASS | 0 |
ingress-controllers-nginx-ingress-snippet-annotations
ingress-controllers-nginx-ingress-snippet-annotations |
kind
|
nightly |
0/0 | UNTESTED | — |
ingress-controllers-nginx-ingress-snippet-annotations
ingress-controllers-nginx-ingress-snippet-annotations |
kind
|
nightly |
4/4 | PASS | 0 |
addon/none
| Scenario | Cluster shape | Tags | Asserts | Status | Agent |
|---|---|---|---|---|---|
c3bad-path
c3bad-path |
kind
|
test |
0/0 | UNTESTED | 0 |
c3fail-deliberate
c3fail-deliberate |
kind
|
test |
0/1 | FAIL | 0 |
c3sig-slow
c3sig-slow |
kind
|
test |
0/0 | FAIL | 0 |
c3sig-slow2
c3sig-slow2 |
kind
|
test |
0/0 | UNTESTED | — |
c3sig-slow2
c3sig-slow2 |
kind
|
test |
0/0 | INTERRUPTED | 0 |
minimal
minimal |
kind
|
pr-subsetnightly |
0/0 | UNTESTED | — |
minimal
minimal |
kind
|
pr-subsetnightly |
0/0 | UNTESTED | — |
minimal
minimal |
kind
|
pr-subsetnightly |
0/0 | UNTESTED | — |
minimal
minimal |
kind
|
pr-subsetnightly |
0/0 | UNTESTED | — |
minimal
minimal |
kind
|
pr-subsetnightly |
0/0 | UNTESTED | — |
minimal
minimal |
kind
|
pr-subsetnightly |
0/0 | UNTESTED | — |
minimal
minimal |
kind
|
pr-subsetnightly |
0/0 | UNTESTED | — |
minimal
minimal |
kind
|
pr-subsetnightly |
0/0 | UNTESTED | — |
minimal
minimal |
kind
|
pr-subsetnightly |
0/0 | UNTESTED | — |
minimal
minimal |
kind
|
pr-subsetnightly |
0/0 | INTERRUPTED | 0 |
addon/traefik
| Scenario | Cluster shape | Tags | Asserts | Status | Agent |
|---|---|---|---|---|---|
ingress-controllers-traefik-basic
ingress-controllers-traefik-basic |
kind
|
nightly |
0/0 | UNTESTED | — |
ingress-controllers-traefik-basic
ingress-controllers-traefik-basic |
kind
|
nightly |
0/0 | UNTESTED | — |
ingress-controllers-traefik-basic
ingress-controllers-traefik-basic |
kind
|
nightly |
0/0 | UNTESTED | — |
ingress-controllers-traefik-basic
ingress-controllers-traefik-basic |
kind
|
nightly |
0/0 | UNTESTED | — |
ingress-controllers-traefik-basic
ingress-controllers-traefik-basic |
kind
|
nightly |
0/0 | UNTESTED | — |
ingress-controllers-traefik-basic
ingress-controllers-traefik-basic |
kind
|
nightly |
0/0 | UNTESTED | — |
ingress-controllers-traefik-basic
ingress-controllers-traefik-basic |
kind
|
nightly |
0/0 | UNTESTED | — |
ingress-controllers-traefik-basic
ingress-controllers-traefik-basic |
kind
|
nightly |
0/0 | UNTESTED | — |
ingress-controllers-traefik-basic
ingress-controllers-traefik-basic |
kind
|
nightly |
4/4 | PASS | 0 |
ingress-controllers-traefik-ingressroute-crd
ingress-controllers-traefik-ingressroute-crd |
kind
|
nightly |
0/0 | UNTESTED | — |
ingress-controllers-traefik-ingressroute-crd
ingress-controllers-traefik-ingressroute-crd |
kind
|
nightly |
4/4 | PASS | 0 |
ingress-controllers-traefik-middleware-chain
ingress-controllers-traefik-middleware-chain |
kind
|
nightly |
0/0 | UNTESTED | — |
ingress-controllers-traefik-middleware-chain
ingress-controllers-traefik-middleware-chain |
kind
|
nightly |
0/0 | UNTESTED | — |
ingress-controllers-traefik-middleware-chain
ingress-controllers-traefik-middleware-chain |
kind
|
nightly |
4/4 | PASS | 0 |
ingress-controllers-traefik-tls-passthrough
ingress-controllers-traefik-tls-passthrough |
kind
|
nightly |
0/0 | UNTESTED | — |
ingress-controllers-traefik-tls-passthrough
ingress-controllers-traefik-tls-passthrough |
kind
|
nightly |
0/0 | UNTESTED | — |
ingress-controllers-traefik-tls-passthrough
ingress-controllers-traefik-tls-passthrough |
kind
|
nightly |
0/0 | UNTESTED | — |
ingress-controllers-traefik-tls-passthrough
ingress-controllers-traefik-tls-passthrough |
kind
|
nightly |
0/0 | UNTESTED | — |
ingress-controllers-traefik-tls-passthrough
ingress-controllers-traefik-tls-passthrough |
kind
|
nightly |
0/0 | UNTESTED | — |
ingress-controllers-traefik-tls-passthrough
ingress-controllers-traefik-tls-passthrough |
kind
|
nightly |
4/4 | PASS | 0 |
c3bad-path
c3bad-path
UNTESTED
kind
addon:nonetest---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
c3fail-deliberate
c3fail-deliberate
FAIL
kind
addon:nonetesthelm-status-deployed:
jq: parse error: Invalid numeric literal at line 1, column 6
examples/sample-product-chart/chart-test/reports/scenario-c3fail-deliberate-20260529-145822/artifacts/logs---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
helm-status-deployed
jq: parse error: Invalid numeric literal at line 1, column 6
Logs: examples/sample-product-chart/chart-test/reports/scenario-c3fail-deliberate-20260529-145822/artifacts/logs
c3sig-slow
c3sig-slow
FAIL
kind
addon:nonetestsee examples/sample-product-chart/chart-test/reports/scenario-c3sig-slow-20260529-150454/artifacts/logs/cluster-up.log
---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
c3sig-slow2
c3sig-slow2
UNTESTED
kind
addon:nonetest---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
c3sig-slow2
c3sig-slow2
INTERRUPTED
kind
addon:nonetest---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
certificates-cert-manager-jks-pkcs12
certificates-cert-manager-jks-pkcs12
UNTESTED
kind
addon:cert-managernightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
certificates-cert-manager-jks-pkcs12
certificates-cert-manager-jks-pkcs12
UNTESTED
kind
addon:cert-managernightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
certificates-cert-manager-jks-pkcs12
certificates-cert-manager-jks-pkcs12
UNTESTED
kind
addon:cert-managernightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
certificates-cert-manager-jks-pkcs12
certificates-cert-manager-jks-pkcs12
UNTESTED
kind
addon:cert-managernightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
certificates-cert-manager-jks-pkcs12
certificates-cert-manager-jks-pkcs12
UNTESTED
kind
addon:cert-managernightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
certificates-cert-manager-jks-pkcs12
certificates-cert-manager-jks-pkcs12
UNTESTED
kind
addon:cert-managernightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
certificates-cert-manager-jks-pkcs12
certificates-cert-manager-jks-pkcs12
UNTESTED
kind
addon:cert-managernightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
certificates-cert-manager-jks-pkcs12
certificates-cert-manager-jks-pkcs12
UNTESTED
kind
addon:cert-managernightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
certificates-cert-manager-jks-pkcs12
certificates-cert-manager-jks-pkcs12
UNTESTED
kind
addon:cert-managernightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
certificates-cert-manager-jks-pkcs12
certificates-cert-manager-jks-pkcs12
INTERRUPTED
kind
addon:cert-managernightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
certificates-cert-manager-lets-encrypt-staging
certificates-cert-manager-lets-encrypt-staging
UNTESTED
kind
addon:cert-managernightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
certificates-cert-manager-lets-encrypt-staging
certificates-cert-manager-lets-encrypt-staging
UNTESTED
kind
addon:cert-managernightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
certificates-cert-manager-lets-encrypt-staging
certificates-cert-manager-lets-encrypt-staging
UNTESTED
kind
addon:cert-managernightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
certificates-cert-manager-lets-encrypt-staging
certificates-cert-manager-lets-encrypt-staging
UNTESTED
kind
addon:cert-managernightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
certificates-cert-manager-lets-encrypt-staging
certificates-cert-manager-lets-encrypt-staging
UNTESTED
kind
addon:cert-managernightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
certificates-cert-manager-lets-encrypt-staging
certificates-cert-manager-lets-encrypt-staging
PASS
kind
addon:cert-managernightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
helm-status-deployed
helm status: deployed PASS: release sample in ns/sample is deployed
pods-ready
kubectl --context kind-chart-test-swarm-bench-2 -n sample wait --for=condition=Ready pods --timeout=5m --all pod/sample-5db589c76f-7qn6m condition met PASS: pods Ready in ns/sample NAME READY STATUS RESTARTS AGE sample-5db589c76f-7qn6m 1/1 Running 0 4s
smoke-script
exec: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/assertions/cert-manager-letsencrypt-staging.sh (RELEASE=sample NAMESPACE=sample) ==> Verifying Let's Encrypt staging ClusterIssuer status INFO: LE staging ClusterIssuer not Ready (reason: ErrRegisterACMEAccount) INFO: ACME registration may require network access to Let's Encrypt staging endpoint PASS: LE staging ClusterIssuer exists (ACME challenge stubbed for offline compatibility) ==> Verifying self-signed ClusterIssuer is Ready clusterissuer.cert-manager.io/chart-test-swarm-selfsigned condition met PASS: self-signed ClusterIssuer Ready=True ==> Waiting for Certificate 'sample-tls' Ready (3m max) certificate.cert-manager.io/sample-tls condition met PASS: Certificate Ready=True ==> Verifying TLS Secret 'sample-tls' keys Secret keys: ca.crt tls.crt tls.key OK: tls.crt + tls.key present ==> Waiting for pod Ready (3m max) pod/sample-5db589c76f-7qn6m condition met PASS: chart pods Ready PASS: cert-manager Let's Encrypt staging integration verified
Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-certificates-cert-manager-lets-encrypt-staging-20260530-104019-6/artifacts/logs
certificates-cert-manager-self-signed-ca
certificates-cert-manager-self-signed-ca
UNTESTED
kind
addon:cert-managernightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
certificates-cert-manager-self-signed-ca
certificates-cert-manager-self-signed-ca
UNTESTED
kind
addon:cert-managernightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
certificates-cert-manager-self-signed-ca
certificates-cert-manager-self-signed-ca
UNTESTED
kind
addon:cert-managernightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
certificates-cert-manager-self-signed-ca
certificates-cert-manager-self-signed-ca
UNTESTED
kind
addon:cert-managernightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
certificates-cert-manager-self-signed-ca
certificates-cert-manager-self-signed-ca
UNTESTED
kind
addon:cert-managernightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
certificates-cert-manager-self-signed-ca
certificates-cert-manager-self-signed-ca
UNTESTED
kind
addon:cert-managernightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
certificates-cert-manager-self-signed-ca
certificates-cert-manager-self-signed-ca
UNTESTED
kind
addon:cert-managernightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
certificates-cert-manager-self-signed-ca
certificates-cert-manager-self-signed-ca
UNTESTED
kind
addon:cert-managernightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
certificates-cert-manager-self-signed-ca
certificates-cert-manager-self-signed-ca
PASS
kind
addon:cert-managernightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
helm-status-deployed
helm status: deployed PASS: release sample in ns/sample is deployed
pods-ready
kubectl --context kind-chart-test-swarm-bench-3 -n sample wait --for=condition=Ready pods --timeout=5m --all pod/sample-5db589c76f-5bnlw condition met PASS: pods Ready in ns/sample NAME READY STATUS RESTARTS AGE sample-5db589c76f-5bnlw 1/1 Running 0 4s
smoke-script
exec: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/assertions/cert-manager-self-signed.sh (RELEASE=sample NAMESPACE=sample)
==> Waiting for Certificate 'sample-tls' Ready (3m max)
certificate.cert-manager.io/sample-tls condition met
PASS: Certificate Ready=True
==> Verifying TLS Secret 'sample-tls' keys
Secret keys: ca.crt
tls.crt
tls.key
OK: tls.crt, tls.key, ca.crt all present
==> Waiting for pod Ready (3m max)
pod/sample-5db589c76f-5bnlw condition met
PASS: chart pods Ready
==> Verifying HTTPS reachable from in-cluster curl
HTTPS response: 200
PASS: HTTPS 200 with --cacert verification
==> Verifying peer certificate SAN
SAN: X509v3 Subject Alternative Name:
DNS:sample.sample.svc, DNS:sample.sample.svc.cluster.local
PASS: cert SAN includes configured host
PASS: cert-manager self-signed CA integration verifiedLogs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-certificates-cert-manager-self-signed-ca-20260530-104109-9/artifacts/logs
certificates-cert-manager-wildcard
certificates-cert-manager-wildcard
UNTESTED
kind
addon:cert-managernightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
certificates-cert-manager-wildcard
certificates-cert-manager-wildcard
UNTESTED
kind
addon:cert-managernightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
certificates-cert-manager-wildcard
certificates-cert-manager-wildcard
UNTESTED
kind
addon:cert-managernightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
certificates-cert-manager-wildcard
certificates-cert-manager-wildcard
UNTESTED
kind
addon:cert-managernightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
certificates-cert-manager-wildcard
certificates-cert-manager-wildcard
PASS
kind
addon:cert-managernightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
helm-status-deployed
helm status: deployed PASS: release sample in ns/sample is deployed
pods-ready
kubectl --context kind-chart-test-swarm-bench-4 -n sample wait --for=condition=Ready pods --timeout=3m --all pod/sample-5967fcc884-lmbfh condition met PASS: pods Ready in ns/sample NAME READY STATUS RESTARTS AGE sample-5967fcc884-lmbfh 1/1 Running 0 3s
smoke-script
exec: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/assertions/cert-manager-wildcard.sh (RELEASE=sample NAMESPACE=sample)
==> Waiting for Certificate 'sample-wildcard-tls' Ready (3m max)
certificate.cert-manager.io/sample-wildcard-tls condition met
PASS: Certificate Ready=True
==> Verifying TLS Secret 'sample-wildcard-tls' keys
Secret keys: ca.crt
tls.crt
tls.key
OK: tls.crt, tls.key, ca.crt all present
==> Verifying wildcard certificate SANs
SAN: X509v3 Subject Alternative Name:
DNS:*.test.local, DNS:test.local
PASS: cert SAN includes DNS:*.test.local and DNS:test.local
PASS: cert-manager wildcard certificate integration verifiedLogs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-certificates-cert-manager-wildcard-20260530-104202-5/artifacts/logs
certificates-manual-tls-secret-basic
certificates-manual-tls-secret-basic
UNTESTED
kind
addon:manual-tls-secretnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
certificates-manual-tls-secret-basic
certificates-manual-tls-secret-basic
UNTESTED
kind
addon:manual-tls-secretnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
certificates-manual-tls-secret-basic
certificates-manual-tls-secret-basic
UNTESTED
kind
addon:manual-tls-secretnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
certificates-manual-tls-secret-basic
certificates-manual-tls-secret-basic
PASS
kind
addon:manual-tls-secretnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
helm-status-deployed
helm status: deployed PASS: release sample in ns/sample is deployed
pods-ready
kubectl --context kind-chart-test-swarm-bench-5 -n sample wait --for=condition=Ready pods --timeout=5m --all pod/sample-676fb884d-fh6jm condition met PASS: pods Ready in ns/sample NAME READY STATUS RESTARTS AGE sample-676fb884d-fh6jm 1/1 Running 0 5s
smoke-script
==> Verifying TLS Secret 'manual-tls-basic' type Secret type: kubernetes.io/tls PASS: Secret type is kubernetes.io/tls ==> Verifying TLS Secret 'manual-tls-basic' data keys Secret keys: tls.crt tls.key OK: tls.crt, tls.key both present ==> Verifying tls.crt is valid PEM subject=C=US, ST=CA, O=Chart Test Swarm, CN=sample.sample.svc PASS: tls.crt is a valid certificate ==> Verifying tls.key is valid PEM RSA key ok PASS: tls.key is a valid private key ==> Waiting for pod Ready (3m max) pod/sample-676fb884d-fh6jm condition met PASS: chart pods Ready ==> Verifying HTTPS reachable from in-cluster curl HTTPS response: 200 PASS: HTTPS 200 PASS: manual-tls-secret basic scenario verified
Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-certificates-manual-tls-secret-basic-20260530-104250-4/artifacts/logs
certificates-manual-tls-secret-ecdsa
certificates-manual-tls-secret-ecdsa
UNTESTED
kind
addon:manual-tls-secretnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
certificates-manual-tls-secret-ecdsa
certificates-manual-tls-secret-ecdsa
UNTESTED
kind
addon:manual-tls-secretnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
certificates-manual-tls-secret-ecdsa
certificates-manual-tls-secret-ecdsa
UNTESTED
kind
addon:manual-tls-secretnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
certificates-manual-tls-secret-ecdsa
certificates-manual-tls-secret-ecdsa
PASS
kind
addon:manual-tls-secretnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
helm-status-deployed
helm status: deployed PASS: release sample in ns/sample is deployed
pods-ready
kubectl --context kind-chart-test-swarm-bench-6 -n sample wait --for=condition=Ready pods --timeout=5m --all pod/sample-5b447d9b74-zbmfr condition met PASS: pods Ready in ns/sample NAME READY STATUS RESTARTS AGE sample-5b447d9b74-zbmfr 1/1 Running 0 4s
smoke-script
exec: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/assertions/manual-tls-ecdsa.sh (RELEASE=sample NAMESPACE=sample)
==> Verifying TLS Secret 'manual-tls-ecdsa' exists
PASS: Secret exists
==> Verifying certificate public-key algorithm is ECDSA
Public Key Algorithm: Public Key Algorithm: id-ecPublicKey
PASS: certificate uses ECDSA public key
==> Verifying ECDSA curve (P-256 or P-384)
Curve info: ASN1 OID: prime256v1
PASS: ECDSA curve is in {P-256, P-384}
==> Waiting for pod Ready (3m max)
pod/sample-5b447d9b74-zbmfr condition met
PASS: chart pods Ready
==> Verifying HTTPS reachable from in-cluster curl
HTTPS response: 200
PASS: HTTPS 200
PASS: manual-tls-secret ECDSA scenario verifiedLogs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-certificates-manual-tls-secret-ecdsa-20260530-104326-4/artifacts/logs
certificates-manual-tls-secret-multiple-sans
certificates-manual-tls-secret-multiple-sans
UNTESTED
kind
addon:manual-tls-secretnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
certificates-manual-tls-secret-multiple-sans
certificates-manual-tls-secret-multiple-sans
UNTESTED
kind
addon:manual-tls-secretnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
certificates-manual-tls-secret-multiple-sans
certificates-manual-tls-secret-multiple-sans
PASS
kind
addon:manual-tls-secretnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
helm-status-deployed
helm status: deployed PASS: release sample in ns/sample is deployed
pods-ready
kubectl --context kind-chart-test-swarm-bench-7 -n sample wait --for=condition=Ready pods --timeout=5m --all pod/sample-6b84d7ddb4-v6xb4 condition met PASS: pods Ready in ns/sample NAME READY STATUS RESTARTS AGE sample-6b84d7ddb4-v6xb4 1/1 Running 0 4s
smoke-script
exec: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/assertions/manual-tls-multiple-sans.sh (RELEASE=sample NAMESPACE=sample)
==> Verifying TLS Secret 'manual-tls-multisite' exists
PASS: Secret exists
==> Verifying certificate SANs (>=2 DNS entries)
SANs: X509v3 Subject Alternative Name:
DNS:sample.sample.svc, DNS:api.sample.sample.svc, DNS:admin.sample.sample.svc
SAN count: 3
PASS: certificate has 3 SANs (>=2 required)
==> Waiting for pod Ready (3m max)
pod/sample-6b84d7ddb4-v6xb4 condition met
PASS: chart pods Ready
==> Verifying HTTPS reachable from in-cluster curl
HTTPS response: 200
PASS: HTTPS 200
PASS: manual-tls-secret multiple-sans scenario verifiedLogs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-certificates-manual-tls-secret-multiple-sans-20260530-104401-4/artifacts/logs
certificates-mounted-tls-certs-csi-secret-store
certificates-mounted-tls-certs-csi-secret-store
UNTESTED
kind
addon:mounted-tls-certsnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
certificates-mounted-tls-certs-csi-secret-store
certificates-mounted-tls-certs-csi-secret-store
UNTESTED
kind
addon:mounted-tls-certsnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
certificates-mounted-tls-certs-csi-secret-store
certificates-mounted-tls-certs-csi-secret-store
UNTESTED
kind
addon:mounted-tls-certsnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
certificates-mounted-tls-certs-csi-secret-store
certificates-mounted-tls-certs-csi-secret-store
UNTESTED
kind
addon:mounted-tls-certsnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
certificates-mounted-tls-certs-csi-secret-store
certificates-mounted-tls-certs-csi-secret-store
UNTESTED
kind
addon:mounted-tls-certsnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
certificates-mounted-tls-certs-csi-secret-store
certificates-mounted-tls-certs-csi-secret-store
UNTESTED
kind
addon:mounted-tls-certsnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
certificates-mounted-tls-certs-csi-secret-store
certificates-mounted-tls-certs-csi-secret-store
UNTESTED
kind
addon:mounted-tls-certsnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
certificates-mounted-tls-certs-csi-secret-store
certificates-mounted-tls-certs-csi-secret-store
PASS
kind
addon:mounted-tls-certsnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
helm-status-deployed
helm status: deployed PASS: release sample in ns/sample is deployed
pods-ready
kubectl --context kind-chart-test-swarm-bench-8 -n sample wait --for=condition=Ready pods --timeout=5m --all pod/sample-675b745dbc-nq6z8 condition met PASS: pods Ready in ns/sample NAME READY STATUS RESTARTS AGE sample-675b745dbc-nq6z8 1/1 Running 0 4s
smoke-script
Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2026-05-30 14:45:31.815106009 +0000 Modify: 2026-05-30 14:45:30.499106008 +0000 Change: 2026-05-30 14:45:30.499106008 +0000 PASS: tls.key present at /etc/tls/tls.key ==> [5/5] Verifying HTTPS endpoint WARN: HTTPS probe failed (may be non-critical on kind) === CSI full-volume-mount verification: SKIP === REASON: Full CSI volume mount verification (csi.driver=secrets-store.csi.k8s.io in pod spec, cert files populated via CSI provider) requires a real CSI provider plugin (AWS Secrets Manager, GCP Secret Manager, Azure Key Vault, HashiCorp Vault, etc.) which is not available on kind clusters. The scenario verifies: 1. CSI driver helm chart installs successfully 2. SecretProviderClass resource is created 3. Product pod runs and serves HTTPS with TLS certs mounted from a regular Secret For full CSI volume-mount testing, run this scenario on a cluster with a supported secrets-store CSI provider plugin installed. PASS: mounted-tls-certs csi-secret-store scenario verified (CSI infra validated)
Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-certificates-mounted-tls-certs-csi-secret-store-20260530-104437-8/artifacts/logs
certificates-mounted-tls-certs-projected-volume
certificates-mounted-tls-certs-projected-volume
UNTESTED
kind
addon:mounted-tls-certsnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
certificates-mounted-tls-certs-projected-volume
certificates-mounted-tls-certs-projected-volume
UNTESTED
kind
addon:mounted-tls-certsnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
certificates-mounted-tls-certs-projected-volume
certificates-mounted-tls-certs-projected-volume
UNTESTED
kind
addon:mounted-tls-certsnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
certificates-mounted-tls-certs-projected-volume
certificates-mounted-tls-certs-projected-volume
PASS
kind
addon:mounted-tls-certsnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
helm-status-deployed
helm status: deployed PASS: release sample in ns/sample is deployed
pods-ready
kubectl --context kind-chart-test-swarm-bench-9 -n sample wait --for=condition=Ready pods --timeout=5m --all pod/sample-67c556c9cb-jz9r4 condition met PASS: pods Ready in ns/sample NAME READY STATUS RESTARTS AGE sample-67c556c9cb-jz9r4 1/1 Running 0 4s
smoke-script
PASS: projected volume sources include secret 'mounted-tls-projected' ==> Verifying mountPath matches tls.mountPath PASS: mountPath=/etc/tls ==> Waiting for pod Ready (3m max) pod/sample-67c556c9cb-jz9r4 condition met PASS: chart pods Ready ==> Exec stat /etc/tls/tls.crt in pod Defaulted container "app" out of: app, wait-for-tls (init) File: '/etc/tls/tls.crt' -> '..data/tls.crt' Size: 14 Blocks: 0 IO Block: 4096 symbolic link Device: 1000e6h/1048806dInode: 6 Links: 1 Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2026-05-30 14:46:05.700367011 +0000 Modify: 2026-05-30 14:46:03.961367010 +0000 Change: 2026-05-30 14:46:03.961367010 +0000 PASS: tls.crt accessible at /etc/tls ==> Verifying HTTPS reachable from in-cluster curl HTTPS response: 200 PASS: HTTPS 200 PASS: mounted-tls-certs projected-volume scenario verified
Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-certificates-mounted-tls-certs-projected-volume-20260530-104535-4/artifacts/logs
certificates-mounted-tls-certs-pvc-mount
certificates-mounted-tls-certs-pvc-mount
UNTESTED
kind
addon:mounted-tls-certsnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
certificates-mounted-tls-certs-pvc-mount
certificates-mounted-tls-certs-pvc-mount
UNTESTED
kind
addon:mounted-tls-certsnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
certificates-mounted-tls-certs-pvc-mount
certificates-mounted-tls-certs-pvc-mount
UNTESTED
kind
addon:mounted-tls-certsnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
certificates-mounted-tls-certs-pvc-mount
certificates-mounted-tls-certs-pvc-mount
UNTESTED
kind
addon:mounted-tls-certsnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
certificates-mounted-tls-certs-pvc-mount
certificates-mounted-tls-certs-pvc-mount
UNTESTED
kind
addon:mounted-tls-certsnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
certificates-mounted-tls-certs-pvc-mount
certificates-mounted-tls-certs-pvc-mount
PASS
kind
addon:mounted-tls-certsnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
helm-status-deployed
helm status: deployed PASS: release sample in ns/sample is deployed
pods-ready
kubectl --context kind-chart-test-swarm-bench-10 -n sample wait --for=condition=Ready pods --timeout=10m -l app=sample pod/sample-6c94f9dbc-f2brv condition met PASS: pods Ready in ns/sample (selector=app=sample) NAME READY STATUS RESTARTS AGE sample-6c94f9dbc-f2brv 1/1 Running 0 9s
smoke-script
PASS: mountPath=/etc/tls ==> Verifying volume source is persistentVolumeClaim PASS: volume source is persistentVolumeClaim (claim=mounted-tls-pvc) ==> Waiting for pod Ready (3m max) pod/sample-6c94f9dbc-f2brv condition met PASS: chart pods Ready ==> Exec stat /etc/tls/tls.crt in pod Defaulted container "app" out of: app, wait-for-tls (init) File: /etc/tls/tls.crt Size: 1176 Blocks: 8 IO Block: 4096 regular file Device: fe01h/65025dInode: 47011 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2026-05-30 14:46:43.440502000 +0000 Modify: 2026-05-30 14:46:43.440502000 +0000 Change: 2026-05-30 14:46:43.441502000 +0000 PASS: tls.crt accessible at /etc/tls ==> Verifying HTTPS reachable from in-cluster curl HTTPS response: 200 PASS: HTTPS 200 PASS: mounted-tls-certs pvc-mount scenario verified
Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-certificates-mounted-tls-certs-pvc-mount-20260530-104612-8/artifacts/logs
customer-a-istio
customer-a-istio
UNTESTED
kind
addon:istioaddon:cert-managermesh:istiocustomer:Anightlycustomer-replica---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
customer-a-istio
customer-a-istio
UNTESTED
kind
addon:istioaddon:cert-managermesh:istiocustomer:Anightlycustomer-replica---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
customer-a-istio
customer-a-istio
PASS
kind
addon:istioaddon:cert-managermesh:istiocustomer:Anightlycustomer-replica---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
helm-status-deployed
helm status: deployed PASS: release sample in ns/sample is deployed
pods-ready
kubectl --context kind-chart-test-swarm-bench-11 -n sample wait --for=condition=Ready pods --timeout=5m --all pod/sample-5967fcc884-h8rqk condition met PASS: pods Ready in ns/sample NAME READY STATUS RESTARTS AGE sample-5967fcc884-h8rqk 1/1 Running 0 3s
Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-customer-a-istio-20260530-104653-3/artifacts/logs
customer-b-gatekeeper
customer-b-gatekeeper
PASS
kind
addon:gatekeepercustomer:Bnightlycustomer-replica---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
helm-status-deployed
helm status: deployed PASS: release sample in ns/sample is deployed
pods-ready
kubectl --context kind-chart-test-swarm-bench-12 -n sample wait --for=condition=Ready pods --timeout=5m --all pod/sample-5967fcc884-v622j condition met PASS: pods Ready in ns/sample NAME READY STATUS RESTARTS AGE sample-5967fcc884-v622j 1/1 Running 0 2s
Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-customer-b-gatekeeper-20260530-104745/artifacts/logs
envoy-gateway
envoy-gateway
UNTESTED
kind
addon:envoy-gatewaygateway-api:envoynightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
envoy-gateway
envoy-gateway
UNTESTED
kind
addon:envoy-gatewaygateway-api:envoynightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
envoy-gateway
envoy-gateway
UNTESTED
kind
addon:envoy-gatewaygateway-api:envoynightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
envoy-gateway
envoy-gateway
UNTESTED
kind
addon:envoy-gatewaygateway-api:envoynightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
envoy-gateway
envoy-gateway
PASS
kind
addon:envoy-gatewaygateway-api:envoynightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
helm-status-deployed
helm status: deployed PASS: release envoy-gateway in ns/envoy-gateway-system is deployed
helm-status-deployed
helm status: deployed PASS: release sample in ns/sample is deployed
pods-ready
kubectl --context kind-chart-test-swarm-bench-13 -n envoy-gateway-system wait --for=condition=Ready pods --timeout=5m -l app.kubernetes.io/name=gateway-helm pod/envoy-gateway-56b969757f-tv5hw condition met PASS: pods Ready in ns/envoy-gateway-system (selector=app.kubernetes.io/name=gateway-helm) NAME READY STATUS RESTARTS AGE envoy-gateway-56b969757f-tv5hw 1/1 Running 0 13s
pods-ready
kubectl --context kind-chart-test-swarm-bench-13 -n sample wait --for=condition=Ready pods --timeout=5m --all pod/sample-5967fcc884-pcsm9 condition met PASS: pods Ready in ns/sample NAME READY STATUS RESTARTS AGE sample-5967fcc884-pcsm9 1/1 Running 0 3s
Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-envoy-gateway-20260530-104832-6/artifacts/logs
gateway-api-contour-gateway-api-basic
gateway-api-contour-gateway-api-basic
UNTESTED
kind
addon:contourgateway-api:contournightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
gateway-api-contour-gateway-api-basic
gateway-api-contour-gateway-api-basic
UNTESTED
kind
addon:contourgateway-api:contournightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
gateway-api-contour-gateway-api-basic
gateway-api-contour-gateway-api-basic
PASS
kind
addon:contourgateway-api:contournightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
helm-status-deployed
helm status: deployed PASS: release sample in ns/sample is deployed
pods-ready
kubectl --context kind-chart-test-swarm-utest-contour-basic -n projectcontour wait --for=condition=Ready pods --timeout=5m -l control-plane=contour-gateway-provisioner pod/contour-gateway-provisioner-555bf78b46-2bstv condition met PASS: pods Ready in ns/projectcontour (selector=control-plane=contour-gateway-provisioner) NAME READY STATUS RESTARTS AGE contour-gateway-provisioner-555bf78b46-2bstv 1/1 Running 0 4s
pods-ready
kubectl --context kind-chart-test-swarm-utest-contour-basic -n sample wait --for=condition=Ready pods --timeout=5m --all pod/sample-7dcd986bd4-74qh7 condition met PASS: pods Ready in ns/sample NAME READY STATUS RESTARTS AGE sample-7dcd986bd4-74qh7 1/1 Running 0 4s
smoke-script
==> Waiting for GatewayClass contour Accepted=True (3m max) PASS: GatewayClass contour Accepted=True ==> Waiting for Gateway listener http Programmed=True (5m max) PASS: Gateway listener http Programmed=True ==> Verifying auto-provisioned Envoy Deployment in sample namespace PASS: auto-provisioned Envoy Deployment found (1) ==> Waiting for Envoy pods Ready (3m max) pod/contour-sample-gw-7c77855479-574rf condition met pod/contour-sample-gw-7c77855479-j4g8q condition met pod/envoy-sample-gw-qjbpc condition met PASS: Envoy pods Ready ==> Verifying HTTPRoute sample-route Accepted=True PASS: HTTPRoute sample-route Accepted=True ==> Getting Envoy Service ClusterIP in sample Envoy Service: envoy-sample-gw IP: 10.96.107.37 ==> Probing backend via gateway (retry up to 2m for data-plane ready) HTTP response: 200 (attempt 1) HTTP response: 200 PASS: HTTP 200 through Contour Gateway API PASS: contour-gateway-api basic integration verified
Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-gateway-api-contour-gateway-api-basic-20260531-192028-4/artifacts/logs
gateway-api-contour-gateway-api-response-header-modifier
gateway-api-contour-gateway-api-response-header-modifier
UNTESTED
kind
addon:contourgateway-api:contournightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
gateway-api-contour-gateway-api-response-header-modifier
gateway-api-contour-gateway-api-response-header-modifier
PASS
kind
addon:contourgateway-api:contournightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
helm-status-deployed
helm status: deployed PASS: release sample in ns/sample is deployed
pods-ready
kubectl --context kind-chart-test-swarm-utest-contour-hdr -n projectcontour wait --for=condition=Ready pods --timeout=5m -l control-plane=contour-gateway-provisioner pod/contour-gateway-provisioner-555bf78b46-kpn4g condition met PASS: pods Ready in ns/projectcontour (selector=control-plane=contour-gateway-provisioner) NAME READY STATUS RESTARTS AGE contour-gateway-provisioner-555bf78b46-kpn4g 1/1 Running 0 5s
pods-ready
kubectl --context kind-chart-test-swarm-utest-contour-hdr -n sample wait --for=condition=Ready pods --timeout=5m --all pod/sample-7dcd986bd4-pd8tj condition met PASS: pods Ready in ns/sample NAME READY STATUS RESTARTS AGE sample-7dcd986bd4-pd8tj 1/1 Running 0 4s
smoke-script
==> Verifying auto-provisioned Envoy Deployment in sample namespace PASS: auto-provisioned Envoy Deployment found (1) ==> Waiting for Envoy pods Ready (3m max) pod/contour-sample-gw-7c77855479-2w7s5 condition met pod/contour-sample-gw-7c77855479-zmdsf condition met pod/envoy-sample-gw-gggnb condition met PASS: Envoy pods Ready ==> Verifying HTTPRoute sample-route Accepted=True PASS: HTTPRoute sample-route Accepted=True ==> Verifying ResponseHeaderModifier filter is configured on HTTPRoute Filter type: ResponseHeaderModifier PASS: ResponseHeaderModifier filter configured on HTTPRoute ==> Getting Envoy Service ClusterIP in sample Envoy Service IP: 10.96.189.89 ==> Probing backend via gateway (retry up to 2m for data-plane ready) HTTP response: 200 (attempt 1) HTTP response: 200 X-Powered-By header: x-powered-by: chart-test-swarm PASS: X-Powered-By header includes chart-test-swarm as configured PASS: contour-gateway-api response-header-modifier integration verified
Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-gateway-api-contour-gateway-api-response-header-modifier-20260531-192122-3/artifacts/logs
gateway-api-contour-gateway-api-route-precedence
gateway-api-contour-gateway-api-route-precedence
UNTESTED
kind
addon:contourgateway-api:contournightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
gateway-api-contour-gateway-api-route-precedence
gateway-api-contour-gateway-api-route-precedence
UNTESTED
kind
addon:contourgateway-api:contournightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
gateway-api-contour-gateway-api-route-precedence
gateway-api-contour-gateway-api-route-precedence
PASS
kind
addon:contourgateway-api:contournightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
helm-status-deployed
helm status: deployed PASS: release sample in ns/sample is deployed
pods-ready
kubectl --context kind-chart-test-swarm-utest-contour-precedence -n projectcontour wait --for=condition=Ready pods --timeout=5m -l control-plane=contour-gateway-provisioner pod/contour-gateway-provisioner-555bf78b46-59r2b condition met PASS: pods Ready in ns/projectcontour (selector=control-plane=contour-gateway-provisioner) NAME READY STATUS RESTARTS AGE contour-gateway-provisioner-555bf78b46-59r2b 1/1 Running 0 4s
pods-ready
kubectl --context kind-chart-test-swarm-utest-contour-precedence -n sample wait --for=condition=Ready pods --timeout=5m --all pod/sample-7dcd986bd4-qxd2d condition met PASS: pods Ready in ns/sample NAME READY STATUS RESTARTS AGE sample-7dcd986bd4-qxd2d 1/1 Running 0 4s
smoke-script
==> Verifying auto-provisioned Envoy Deployment in sample namespace PASS: auto-provisioned Envoy Deployment found (1) ==> Waiting for Envoy pods Ready (3m max) pod/contour-sample-gw-7c77855479-gjqf7 condition met pod/contour-sample-gw-7c77855479-hrgs4 condition met pod/envoy-sample-gw-sxdft condition met PASS: Envoy pods Ready ==> Verifying HTTPRoute sample-route-api Accepted=True PASS: HTTPRoute sample-route-api Accepted=True ==> Verifying HTTPRoute sample-route-api-v2 Accepted=True PASS: HTTPRoute sample-route-api-v2 Accepted=True ==> Getting Envoy Service ClusterIP in sample Envoy Service IP: 10.96.6.230 ==> Test 1: /api/v2/foo → expect X-Route: v2 (more specific prefix wins) Test /api/v2/foo → X-Route header: x-route: v2 PASS: /api/v2/foo routed to v2 (more specific prefix wins) ==> Test 2: /api/foo → expect X-Route: v1 (less specific prefix wins for non-overlapping paths) Test /api/foo → X-Route header: x-route: v1 PASS: /api/foo routed to v1 (less specific prefix wins for non-overlapping) PASS: contour-gateway-api route-precedence integration verified
Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-gateway-api-contour-gateway-api-route-precedence-20260531-192210-3/artifacts/logs
gateway-api-envoy-gateway-cert-manager-tls
gateway-api-envoy-gateway-cert-manager-tls
UNTESTED
kind
addon:envoy-gatewayaddon:cert-managergateway-api:envoynightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
gateway-api-envoy-gateway-cert-manager-tls
gateway-api-envoy-gateway-cert-manager-tls
PASS
kind
addon:envoy-gatewayaddon:cert-managergateway-api:envoynightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
helm-status-deployed
helm status: deployed PASS: release cert-manager in ns/cert-manager is deployed
helm-status-deployed
helm status: deployed PASS: release envoy-gateway in ns/envoy-gateway-system is deployed
helm-status-deployed
helm status: deployed PASS: release sample in ns/sample is deployed
pods-ready
kubectl --context kind-chart-test-swarm-eg-cm-tls -n cert-manager wait --for=condition=Ready pods --timeout=5m --all pod/cert-manager-c69c859c4-25xwl condition met pod/cert-manager-cainjector-d6d64f75f-xpcx7 condition met pod/cert-manager-webhook-566849c7fc-2pt9m condition met PASS: pods Ready in ns/cert-manager NAME READY STATUS RESTARTS AGE cert-manager-c69c859c4-25xwl 1/1 Running 0 21s cert-manager-cainjector-d6d64f75f-xpcx7 1/1 Running 0 21s cert-manager-webhook-566849c7fc-2pt9m 1/1 Running 0 21s
pods-ready
kubectl --context kind-chart-test-swarm-eg-cm-tls -n envoy-gateway-system wait --for=condition=Ready pods --timeout=5m -l app.kubernetes.io/name=gateway-helm pod/envoy-gateway-56b969757f-drw4h condition met PASS: pods Ready in ns/envoy-gateway-system (selector=app.kubernetes.io/name=gateway-helm) NAME READY STATUS RESTARTS AGE envoy-gateway-56b969757f-drw4h 1/1 Running 0 33s
pods-ready
kubectl --context kind-chart-test-swarm-eg-cm-tls -n sample wait --for=condition=Ready pods --timeout=5m --all pod/sample-7dcd986bd4-gjc74 condition met PASS: pods Ready in ns/sample NAME READY STATUS RESTARTS AGE sample-7dcd986bd4-gjc74 1/1 Running 0 4s
smoke-script
httproute.gateway.networking.k8s.io/sample-route created
==> Waiting for GatewayClass envoy Accepted=True (3m max)
PASS: GatewayClass envoy Accepted=True
==> Waiting for Gateway listener https Programmed=True (5m max)
PASS: Gateway listener https Programmed=True
==> Verifying gateway listener https is Programmed
PASS: Listener https Programmed=True
==> Verifying HTTPRoute sample-route Accepted=True
PASS: HTTPRoute sample-route Accepted=True
==> Getting envoy data-plane Service ClusterIP
Gateway Service IP: 10.96.168.123
==> Probing HTTPS backend via gateway (retry up to 2m)
HTTPS response: 200 (attempt 2)
HTTPS response: 200
PASS: HTTPS 200 through Envoy Gateway with cert-manager TLS
==> Verifying peer certificate matches cert-manager issued cert
SAN: X509v3 Subject Alternative Name:
DNS:sample.sample.svc.cluster.local
PASS: cert SAN includes sample.sample.svc.cluster.local
PASS: envoy-gateway + cert-manager TLS compose verifiedLogs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-gateway-api-envoy-gateway-cert-manager-tls-20260531-184029-2/artifacts/logs
gateway-api-envoy-gateway-grpcroute
gateway-api-envoy-gateway-grpcroute
UNTESTED
kind
addon:envoy-gatewaygateway-api:envoynightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
gateway-api-envoy-gateway-grpcroute
gateway-api-envoy-gateway-grpcroute
UNTESTED
kind
addon:envoy-gatewaygateway-api:envoynightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
gateway-api-envoy-gateway-grpcroute
gateway-api-envoy-gateway-grpcroute
UNTESTED
kind
addon:envoy-gatewaygateway-api:envoynightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
gateway-api-envoy-gateway-grpcroute
gateway-api-envoy-gateway-grpcroute
UNTESTED
kind
addon:envoy-gatewaygateway-api:envoynightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
gateway-api-envoy-gateway-grpcroute
gateway-api-envoy-gateway-grpcroute
PASS
kind
addon:envoy-gatewaygateway-api:envoynightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
helm-status-deployed
helm status: deployed PASS: release envoy-gateway in ns/envoy-gateway-system is deployed
helm-status-deployed
helm status: deployed PASS: release sample in ns/sample is deployed
pods-ready
kubectl --context kind-chart-test-swarm-eg-grpc -n envoy-gateway-system wait --for=condition=Ready pods --timeout=5m -l app.kubernetes.io/name=gateway-helm pod/envoy-gateway-56b969757f-v4xl4 condition met PASS: pods Ready in ns/envoy-gateway-system (selector=app.kubernetes.io/name=gateway-helm) NAME READY STATUS RESTARTS AGE envoy-gateway-56b969757f-v4xl4 1/1 Running 0 16s
pods-ready
kubectl --context kind-chart-test-swarm-eg-grpc -n sample wait --for=condition=Ready pods --timeout=5m --all pod/grpc-backend-775f8dc876-b8mq7 condition met pod/sample-7dcd986bd4-lhclh condition met PASS: pods Ready in ns/sample NAME READY STATUS RESTARTS AGE grpc-backend-775f8dc876-b8mq7 1/1 Running 0 5s sample-7dcd986bd4-lhclh 1/1 Running 0 5s
smoke-script
PASS: GatewayClass envoy Accepted=True ==> Waiting for Gateway listener http Programmed=True (5m max) PASS: Gateway listener http Programmed=True ==> Verifying GRPCRoute sample-grpc-route Accepted=True PASS: GRPCRoute sample-grpc-route Accepted=True ==> Getting envoy data-plane Service ClusterIP Gateway Service IP: 10.96.8.129 ==> Probing gRPC backend via gateway (grpcurl reflection) grpcurl output: addsvc.Add grpc.gateway.examples.examplepb.ABitOfEverythingService grpc.reflection.v1alpha.ServerReflection grpcbin.GRPCBin hello.HelloService (attempt 2) grpcurl output: addsvc.Add grpc.gateway.examples.examplepb.ABitOfEverythingService grpc.reflection.v1alpha.ServerReflection grpcbin.GRPCBin hello.HelloService PASS: grpcurl reflection listed 5 service(s) PASS: envoy-gateway GRPCRoute integration verified
Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-gateway-api-envoy-gateway-grpcroute-20260531-183758-5/artifacts/logs
gateway-api-envoy-gateway-httproute
gateway-api-envoy-gateway-httproute
UNTESTED
kind
addon:envoy-gatewaygateway-api:envoynightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
gateway-api-envoy-gateway-httproute
gateway-api-envoy-gateway-httproute
UNTESTED
kind
addon:envoy-gatewaygateway-api:envoynightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
gateway-api-envoy-gateway-httproute
gateway-api-envoy-gateway-httproute
UNTESTED
kind
addon:envoy-gatewaygateway-api:envoynightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
gateway-api-envoy-gateway-httproute
gateway-api-envoy-gateway-httproute
UNTESTED
kind
addon:envoy-gatewaygateway-api:envoynightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
gateway-api-envoy-gateway-httproute
gateway-api-envoy-gateway-httproute
UNTESTED
kind
addon:envoy-gatewaygateway-api:envoynightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
gateway-api-envoy-gateway-httproute
gateway-api-envoy-gateway-httproute
UNTESTED
kind
addon:envoy-gatewaygateway-api:envoynightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
gateway-api-envoy-gateway-httproute
gateway-api-envoy-gateway-httproute
UNTESTED
kind
addon:envoy-gatewaygateway-api:envoynightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
gateway-api-envoy-gateway-httproute
gateway-api-envoy-gateway-httproute
UNTESTED
kind
addon:envoy-gatewaygateway-api:envoynightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
gateway-api-envoy-gateway-httproute
gateway-api-envoy-gateway-httproute
PASS
kind
addon:envoy-gatewaygateway-api:envoynightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
helm-status-deployed
helm status: deployed PASS: release envoy-gateway in ns/envoy-gateway-system is deployed
helm-status-deployed
helm status: deployed PASS: release sample in ns/sample is deployed
pods-ready
kubectl --context kind-chart-test-swarm-eg-httproute -n envoy-gateway-system wait --for=condition=Ready pods --timeout=5m -l app.kubernetes.io/name=gateway-helm pod/envoy-gateway-56b969757f-lglzx condition met PASS: pods Ready in ns/envoy-gateway-system (selector=app.kubernetes.io/name=gateway-helm) NAME READY STATUS RESTARTS AGE envoy-gateway-56b969757f-lglzx 1/1 Running 0 15s
pods-ready
kubectl --context kind-chart-test-swarm-eg-httproute -n sample wait --for=condition=Ready pods --timeout=5m --all pod/sample-7dcd986bd4-tp8pr condition met PASS: pods Ready in ns/sample NAME READY STATUS RESTARTS AGE sample-7dcd986bd4-tp8pr 1/1 Running 0 3s
smoke-script
exec: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/assertions/envoy-gateway-httproute.sh (RELEASE=sample NAMESPACE=sample) ==> Applying GatewayClass + Gateway + HTTPRoute gatewayclass.gateway.networking.k8s.io/envoy created gateway.gateway.networking.k8s.io/sample-gw created httproute.gateway.networking.k8s.io/sample-route created ==> Waiting for GatewayClass envoy Accepted=True (3m max) PASS: GatewayClass envoy Accepted=True ==> Waiting for Gateway listener http Programmed=True (5m max) PASS: Gateway listener http Programmed=True ==> Verifying HTTPRoute sample-route Accepted=True PASS: HTTPRoute sample-route Accepted=True ==> Getting envoy data-plane Service ClusterIP Gateway Service: envoy-sample-sample-gw-038a7a21 IP: 10.96.158.114 ==> Probing backend via gateway (retry up to 2m for data-plane ready) HTTP response: 200 (attempt 2) HTTP response: 200 PASS: HTTP 200 through Envoy Gateway PASS: envoy-gateway HTTPRoute integration verified
Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-gateway-api-envoy-gateway-httproute-20260531-183512-10/artifacts/logs
gateway-api-envoy-gateway-security-policy-attach
gateway-api-envoy-gateway-security-policy-attach
UNTESTED
kind
addon:envoy-gatewaygateway-api:envoynightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
gateway-api-envoy-gateway-security-policy-attach
gateway-api-envoy-gateway-security-policy-attach
UNTESTED
kind
addon:envoy-gatewaygateway-api:envoynightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
gateway-api-envoy-gateway-security-policy-attach
gateway-api-envoy-gateway-security-policy-attach
UNTESTED
kind
addon:envoy-gatewaygateway-api:envoynightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
gateway-api-envoy-gateway-security-policy-attach
gateway-api-envoy-gateway-security-policy-attach
PASS
kind
addon:envoy-gatewaygateway-api:envoynightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
helm-status-deployed
helm status: deployed PASS: release envoy-gateway in ns/envoy-gateway-system is deployed
helm-status-deployed
helm status: deployed PASS: release sample in ns/sample is deployed
pods-ready
kubectl --context kind-chart-test-swarm-eg-secpol -n envoy-gateway-system wait --for=condition=Ready pods --timeout=5m -l app.kubernetes.io/name=gateway-helm pod/envoy-gateway-56b969757f-wzfp2 condition met PASS: pods Ready in ns/envoy-gateway-system (selector=app.kubernetes.io/name=gateway-helm) NAME READY STATUS RESTARTS AGE envoy-gateway-56b969757f-wzfp2 1/1 Running 0 14s
pods-ready
kubectl --context kind-chart-test-swarm-eg-secpol -n sample wait --for=condition=Ready pods --timeout=5m --all pod/sample-7dcd986bd4-t6x9c condition met PASS: pods Ready in ns/sample NAME READY STATUS RESTARTS AGE sample-7dcd986bd4-t6x9c 1/1 Running 0 3s
smoke-script
gatewayclass.gateway.networking.k8s.io/envoy created gateway.gateway.networking.k8s.io/sample-gw created ==> Waiting for Gateway listener http Programmed=True (5m max) PASS: Gateway listener http Programmed=True ==> Applying HTTPRoute + SecurityPolicy httproute.gateway.networking.k8s.io/sample-route created securitypolicy.gateway.envoyproxy.io/sample-cors-policy created ==> Waiting for GatewayClass envoy Accepted=True (3m max) PASS: GatewayClass envoy Accepted=True ==> Verifying HTTPRoute sample-route Accepted=True PASS: HTTPRoute sample-route Accepted=True ==> Verifying SecurityPolicy Accepted=True PASS: SecurityPolicy sample-cors-policy Accepted=True ==> Getting envoy data-plane Service ClusterIP Gateway Service IP: 10.96.20.208 ==> Probing CORS preflight (OPTIONS request) CORS response: access-control-allow-origin: http://example.com (attempt 2) CORS response: access-control-allow-origin: http://example.com PASS: CORS header present on preflight response PASS: envoy-gateway SecurityPolicy CORS integration verified
Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-gateway-api-envoy-gateway-security-policy-attach-20260531-183914-4/artifacts/logs
gateway-api-istio-gateway-api-backend-tls-policy
gateway-api-istio-gateway-api-backend-tls-policy
UNTESTED
kind
addon:istiogateway-api:istionightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
gateway-api-istio-gateway-api-backend-tls-policy
gateway-api-istio-gateway-api-backend-tls-policy
UNTESTED
kind
addon:istiogateway-api:istionightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
gateway-api-istio-gateway-api-backend-tls-policy
gateway-api-istio-gateway-api-backend-tls-policy
UNTESTED
kind
addon:istiogateway-api:istionightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
gateway-api-istio-gateway-api-backend-tls-policy
gateway-api-istio-gateway-api-backend-tls-policy
UNTESTED
kind
addon:istiogateway-api:istionightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
gateway-api-istio-gateway-api-backend-tls-policy
gateway-api-istio-gateway-api-backend-tls-policy
UNTESTED
kind
addon:istiogateway-api:istionightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
gateway-api-istio-gateway-api-backend-tls-policy
gateway-api-istio-gateway-api-backend-tls-policy
UNTESTED
kind
addon:istiogateway-api:istionightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
gateway-api-istio-gateway-api-backend-tls-policy
gateway-api-istio-gateway-api-backend-tls-policy
UNTESTED
kind
addon:istiogateway-api:istionightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
gateway-api-istio-gateway-api-backend-tls-policy
gateway-api-istio-gateway-api-backend-tls-policy
UNTESTED
kind
addon:istiogateway-api:istionightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
gateway-api-istio-gateway-api-backend-tls-policy
gateway-api-istio-gateway-api-backend-tls-policy
UNTESTED
kind
addon:istiogateway-api:istionightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
gateway-api-istio-gateway-api-backend-tls-policy
gateway-api-istio-gateway-api-backend-tls-policy
UNTESTED
kind
addon:istiogateway-api:istionightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
gateway-api-istio-gateway-api-backend-tls-policy
gateway-api-istio-gateway-api-backend-tls-policy
PASS
kind
addon:istiogateway-api:istionightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
helm-status-deployed
helm status: deployed PASS: release istio-base in ns/istio-system is deployed
helm-status-deployed
helm status: deployed PASS: release istiod in ns/istio-system is deployed
helm-status-deployed
helm status: deployed PASS: release sample in ns/sample is deployed
pods-ready
kubectl --context kind-chart-test-swarm-istio-btls -n istio-system wait --for=condition=Ready pods --timeout=5m -l app=istiod pod/istiod-68c4759fc-585tl condition met PASS: pods Ready in ns/istio-system (selector=app=istiod) NAME READY STATUS RESTARTS AGE istiod-68c4759fc-585tl 1/1 Running 0 9s
smoke-script
exec: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/assertions/istio-gateway-api-gen-backend-tls-certs.sh (RELEASE=sample NAMESPACE=sample) ==> Generating self-signed CA and TLS cert for backend ==> Creating/updating TLS Secret backend-tls-cert secret/backend-tls-cert created PASS: TLS Secret backend-tls-cert created ==> Creating/updating CA ConfigMap backend-ca-cert configmap/backend-ca-cert created PASS: CA ConfigMap backend-ca-cert created PASS: Backend TLS certs generated and applied
pods-ready
kubectl --context kind-chart-test-swarm-istio-btls -n sample wait --for=condition=Ready pods --timeout=5m --all pod/sample-7dcd986bd4-pwxft condition met PASS: pods Ready in ns/sample NAME READY STATUS RESTARTS AGE sample-7dcd986bd4-pwxft 1/1 Running 0 3s
smoke-script
gatewayclass.gateway.networking.k8s.io/istio configured gateway.gateway.networking.k8s.io/sample-gw created httproute.gateway.networking.k8s.io/sample-route created ==> Waiting for GatewayClass istio Accepted=True (3m max) PASS: GatewayClass istio Accepted=True ==> Waiting for Gateway listener http Programmed=True (5m max) PASS: Gateway listener http Programmed=True ==> Verifying HTTPRoute sample-route Accepted=True PASS: HTTPRoute sample-route Accepted=True ==> Getting Istio data-plane Service ClusterIP Gateway Service IP: 10.96.27.33 ==> Probing backend via gateway (before BackendTLSPolicy, retry up to 2m) HTTP response: 200 (attempt 2) HTTP response: 200 PASS: HTTP 200 through Istio Gateway API ==> Applying BackendTLSPolicy backendtlspolicy.gateway.networking.k8s.io/sample-backend-tls created ==> Waiting for BackendTLSPolicy Accepted=True (2m max) PASS: BackendTLSPolicy sample-backend-tls Accepted=True PASS: istio-gateway-api BackendTLSPolicy integration verified
Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-gateway-api-istio-gateway-api-backend-tls-policy-20260531-184029-11/artifacts/logs
gateway-api-istio-gateway-api-basic
gateway-api-istio-gateway-api-basic
UNTESTED
kind
addon:istiogateway-api:istionightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
gateway-api-istio-gateway-api-basic
gateway-api-istio-gateway-api-basic
UNTESTED
kind
addon:istiogateway-api:istionightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
gateway-api-istio-gateway-api-basic
gateway-api-istio-gateway-api-basic
UNTESTED
kind
addon:istiogateway-api:istionightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
gateway-api-istio-gateway-api-basic
gateway-api-istio-gateway-api-basic
PASS
kind
addon:istiogateway-api:istionightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
helm-status-deployed
helm status: deployed PASS: release istio-base in ns/istio-system is deployed
helm-status-deployed
helm status: deployed PASS: release istiod in ns/istio-system is deployed
helm-status-deployed
helm status: deployed PASS: release sample in ns/sample is deployed
pods-ready
kubectl --context kind-chart-test-swarm-istio-basic -n istio-system wait --for=condition=Ready pods --timeout=5m -l app=istiod pod/istiod-54b585df85-ssk4l condition met PASS: pods Ready in ns/istio-system (selector=app=istiod) NAME READY STATUS RESTARTS AGE istiod-54b585df85-ssk4l 1/1 Running 0 8s
pods-ready
kubectl --context kind-chart-test-swarm-istio-basic -n sample wait --for=condition=Ready pods --timeout=5m --all pod/sample-7dcd986bd4-pl7dz condition met PASS: pods Ready in ns/sample NAME READY STATUS RESTARTS AGE sample-7dcd986bd4-pl7dz 1/1 Running 0 4s
smoke-script
==> Applying GatewayClass + Gateway + HTTPRoute Warning: resource gatewayclasses/istio is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by kubectl apply. kubectl apply should only be used on resources created declaratively by either kubectl create --save-config or kubectl apply. The missing annotation will be patched automatically. gatewayclass.gateway.networking.k8s.io/istio configured gateway.gateway.networking.k8s.io/sample-gw created httproute.gateway.networking.k8s.io/sample-route created ==> Waiting for GatewayClass istio Accepted=True (3m max) PASS: GatewayClass istio Accepted=True ==> Waiting for Gateway listener http Programmed=True (5m max) PASS: Gateway listener http Programmed=True ==> Verifying auto-provisioned Deployment in sample namespace PASS: auto-provisioned Deployment found (1) ==> Verifying HTTPRoute sample-route Accepted=True PASS: HTTPRoute sample-route Accepted=True ==> Getting Istio data-plane Service ClusterIP Gateway Service: sample-gw-istio IP: 10.96.130.172 ==> Probing backend via gateway (retry up to 2m for data-plane ready) HTTP response: 200 (attempt 2) HTTP response: 200 PASS: HTTP 200 through Istio Gateway API PASS: istio-gateway-api basic integration verified
Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-gateway-api-istio-gateway-api-basic-20260531-183758-4/artifacts/logs
gateway-api-istio-gateway-api-multi-listener
gateway-api-istio-gateway-api-multi-listener
UNTESTED
kind
addon:istiogateway-api:istionightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
gateway-api-istio-gateway-api-multi-listener
gateway-api-istio-gateway-api-multi-listener
UNTESTED
kind
addon:istiogateway-api:istionightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
gateway-api-istio-gateway-api-multi-listener
gateway-api-istio-gateway-api-multi-listener
UNTESTED
kind
addon:istiogateway-api:istionightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
gateway-api-istio-gateway-api-multi-listener
gateway-api-istio-gateway-api-multi-listener
PASS
kind
addon:istiogateway-api:istionightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
helm-status-deployed
helm status: deployed PASS: release istio-base in ns/istio-system is deployed
helm-status-deployed
helm status: deployed PASS: release istiod in ns/istio-system is deployed
helm-status-deployed
helm status: deployed PASS: release sample in ns/sample is deployed
pods-ready
kubectl --context kind-chart-test-swarm-istio-multi -n istio-system wait --for=condition=Ready pods --timeout=5m -l app=istiod pod/istiod-54b585df85-tp7wb condition met PASS: pods Ready in ns/istio-system (selector=app=istiod) NAME READY STATUS RESTARTS AGE istiod-54b585df85-tp7wb 1/1 Running 0 8s
pods-ready
kubectl --context kind-chart-test-swarm-istio-multi -n sample wait --for=condition=Ready pods --timeout=5m --all pod/sample-7dcd986bd4-9sxwz condition met PASS: pods Ready in ns/sample NAME READY STATUS RESTARTS AGE sample-7dcd986bd4-9sxwz 1/1 Running 0 3s
smoke-script
PASS: GatewayClass istio Accepted=True ==> Verifying Gateway has >= 2 listeners PASS: Gateway has 2 listeners: http https ==> Waiting for Gateway listener http Programmed=True (5m max) PASS: Gateway listener http Programmed=True ==> Waiting for Gateway listener https Programmed=True (5m max) PASS: Gateway listener https Programmed=True ==> Verifying HTTPRoute sample-route Accepted=True PASS: HTTPRoute sample-route Accepted=True ==> Getting Istio data-plane Service ClusterIP Gateway Service IP: 10.96.193.110 ==> Probing HTTP backend via gateway (retry up to 2m) HTTP response: 200 (attempt 2) HTTP response: 200 PASS: HTTP 200 on port 80 ==> Probing HTTPS backend via gateway (retry up to 2m) HTTPS response: 200 (attempt 1) HTTPS response: 200 PASS: HTTPS 200 on port 443 PASS: istio-gateway-api multi-listener integration verified
Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-gateway-api-istio-gateway-api-multi-listener-20260531-183914-5/artifacts/logs
ingress-controllers-contour-basic-httpproxy
ingress-controllers-contour-basic-httpproxy
UNTESTED
kind
addon:contournightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
ingress-controllers-contour-basic-httpproxy
ingress-controllers-contour-basic-httpproxy
UNTESTED
kind
addon:contournightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
ingress-controllers-contour-basic-httpproxy
ingress-controllers-contour-basic-httpproxy
UNTESTED
kind
addon:contournightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
ingress-controllers-contour-basic-httpproxy
ingress-controllers-contour-basic-httpproxy
PASS
kind
addon:contournightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
helm-status-deployed
helm status: deployed PASS: release sample in ns/sample is deployed
pods-ready
kubectl --context kind-chart-test-swarm-default -n sample wait --for=condition=Ready pods --timeout=5m --all pod/sample-69469cb4c6-prm2m condition met PASS: pods Ready in ns/sample NAME READY STATUS RESTARTS AGE sample-69469cb4c6-prm2m 1/1 Running 0 3s
pods-ready
kubectl --context kind-chart-test-swarm-default -n projectcontour wait --for=condition=Ready pods --timeout=3m --all pod/contour-contour-5847f7c7f9-lmw56 condition met pod/contour-envoy-vqpc9 condition met PASS: pods Ready in ns/projectcontour NAME READY STATUS RESTARTS AGE contour-contour-5847f7c7f9-lmw56 1/1 Running 0 28s contour-envoy-vqpc9 2/2 Running 0 28s
smoke-script
pod/contour-envoy-vqpc9 condition met PASS: envoy pod Ready ==> Waiting for contour controller pod Ready (3m max) pod/contour-contour-5847f7c7f9-lmw56 condition met PASS: contour controller pod Ready ==> Waiting for product pod Ready (3m max) pod/sample-69469cb4c6-prm2m condition met PASS: product pods Ready ==> Getting envoy pod IP (probe via pod IP) envoy pod IP: 10.244.0.6 ==> Verifying HTTPProxy exists and status is valid HTTPProxy status: valid PASS: HTTPProxy status is valid ==> Probing HTTP with Host header (expect 200) on envoy container port 8080 HTTP response (with Host): 200 PASS: HTTP 200 with Host header ==> Probing HTTP without Host header (expect 404) on envoy container port 8080 HTTP response (without Host): 404 PASS: HTTP 404 without Host header (envoy default) PASS: Contour basic HTTPProxy integration verified
Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-ingress-controllers-contour-basic-httpproxy-20260530-213232-4/artifacts/logs
ingress-controllers-contour-rate-limit
ingress-controllers-contour-rate-limit
FAIL
kind
addon:contournightlysmoke-script:
exec: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/assertions/contour-rate-limit.sh (RELEASE=sample NAMESPACE=sample)
==> Waiting for envoy pod Ready (3m max)
error: no matching resources found
/Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-ingress-controllers-contour-rate-limit-20260530-145216/artifacts/logs---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
helm-status-deployed
helm status: deployed PASS: release sample in ns/sample is deployed
pods-ready
kubectl --context kind-chart-test-swarm-default -n sample wait --for=condition=Ready pods --timeout=5m --all pod/sample-69469cb4c6-lhtgf condition met PASS: pods Ready in ns/sample NAME READY STATUS RESTARTS AGE sample-69469cb4c6-lhtgf 1/1 Running 0 3s
pods-ready
kubectl --context kind-chart-test-swarm-default -n projectcontour wait --for=condition=Ready pods --timeout=3m --all pod/contour-contour-5847f7c7f9-npc58 condition met pod/contour-envoy-6ss8t condition met PASS: pods Ready in ns/projectcontour NAME READY STATUS RESTARTS AGE contour-contour-5847f7c7f9-npc58 1/1 Running 0 28s contour-envoy-6ss8t 2/2 Running 0 28s
smoke-script
exec: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/assertions/contour-rate-limit.sh (RELEASE=sample NAMESPACE=sample) ==> Waiting for envoy pod Ready (3m max) error: no matching resources found
Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-ingress-controllers-contour-rate-limit-20260530-145216/artifacts/logs
ingress-controllers-contour-tls-delegation
ingress-controllers-contour-tls-delegation
UNTESTED
kind
addon:contournightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
ingress-controllers-contour-tls-delegation
ingress-controllers-contour-tls-delegation
UNTESTED
kind
addon:contournightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
ingress-controllers-contour-tls-delegation
ingress-controllers-contour-tls-delegation
UNTESTED
kind
addon:contournightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
ingress-controllers-contour-tls-delegation
ingress-controllers-contour-tls-delegation
UNTESTED
kind
addon:contournightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
ingress-controllers-contour-tls-delegation
ingress-controllers-contour-tls-delegation
PASS
kind
addon:contournightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
helm-status-deployed
helm status: deployed PASS: release sample in ns/sample is deployed
pods-ready
kubectl --context kind-chart-test-swarm-default -n sample wait --for=condition=Ready pods --timeout=5m --all pod/sample-69469cb4c6-95llp condition met PASS: pods Ready in ns/sample NAME READY STATUS RESTARTS AGE sample-69469cb4c6-95llp 1/1 Running 0 2s
pods-ready
kubectl --context kind-chart-test-swarm-default -n projectcontour wait --for=condition=Ready pods --timeout=3m --all pod/contour-contour-5847f7c7f9-cf76m condition met pod/contour-envoy-srmjb condition met PASS: pods Ready in ns/projectcontour NAME READY STATUS RESTARTS AGE contour-contour-5847f7c7f9-cf76m 1/1 Running 0 28s contour-envoy-srmjb 2/2 Running 0 28s
smoke-script
pod/sample-69469cb4c6-95llp condition met PASS: product pods Ready ==> Verifying TLSCertificateDelegation exists tlscertificatedelegation.projectcontour.io/sample-tls-delegation PASS: TLSCertificateDelegation sample-tls-delegation exists ==> Verifying TLS secret exists in tls-secrets namespace secret/sample-tls PASS: TLS secret sample-tls exists ==> Verifying HTTPProxy status is valid HTTPProxy status: valid PASS: HTTPProxy status is valid ==> Getting envoy pod IP envoy pod IP: 10.244.0.6 ==> Probing HTTPS (expect 200) on envoy container port 8443 HTTPS response: 200 PASS: HTTPS 200 with delegated TLS cert ==> Verifying cert subject (expect CN=sample.test.local) Certificate subject: subject=CN=sample.test.local PASS: certificate CN matches sample.test.local PASS: Contour TLS delegation integration verified
Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-ingress-controllers-contour-tls-delegation-20260530-214220-5/artifacts/logs
ingress-controllers-nginx-ingress-basic
ingress-controllers-nginx-ingress-basic
UNTESTED
kind
addon:nginx-ingressnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
ingress-controllers-nginx-ingress-basic
ingress-controllers-nginx-ingress-basic
PASS
kind
addon:nginx-ingressnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
helm-status-deployed
helm status: deployed PASS: release sample in ns/sample is deployed
pods-ready
kubectl --context kind-chart-test-swarm-default -n sample wait --for=condition=Ready pods --timeout=5m --all pod/sample-69469cb4c6-kfwbt condition met PASS: pods Ready in ns/sample NAME READY STATUS RESTARTS AGE sample-69469cb4c6-kfwbt 1/1 Running 0 4s
pods-ready
kubectl --context kind-chart-test-swarm-default -n ingress-nginx wait --for=condition=Ready pods --timeout=3m --all pod/ingress-nginx-controller-d74c658c5-zh5x9 condition met PASS: pods Ready in ns/ingress-nginx NAME READY STATUS RESTARTS AGE ingress-nginx-controller-d74c658c5-zh5x9 1/1 Running 0 29s
smoke-script
exec: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/assertions/nginx-basic.sh (RELEASE=sample NAMESPACE=sample) ==> Waiting for nginx controller pod Ready (3m max) pod/ingress-nginx-controller-d74c658c5-zh5x9 condition met PASS: nginx controller pod Ready ==> Waiting for product pod Ready (3m max) pod/sample-69469cb4c6-kfwbt condition met PASS: product pods Ready ==> Verifying Ingress exists with ingressClassName: nginx Ingress class: nginx PASS: Ingress carries ingressClassName: nginx ==> Getting nginx controller pod IP NGINX pod IP: 10.244.0.6 ==> Probing HTTP with Host header (expect 200) HTTP response (with Host): 200 PASS: HTTP 200 with Host header ==> Verifying nginx controller logs show request matched product Service PASS: controller logs reference product Service 'sample' PASS: NGINX Ingress basic integration verified
Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-ingress-controllers-nginx-ingress-basic-20260530-213120-2/artifacts/logs
ingress-controllers-nginx-ingress-canary
ingress-controllers-nginx-ingress-canary
UNTESTED
kind
addon:nginx-ingressnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
ingress-controllers-nginx-ingress-canary
ingress-controllers-nginx-ingress-canary
PASS
kind
addon:nginx-ingressnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
helm-status-deployed
helm status: deployed PASS: release sample in ns/sample is deployed
pods-ready
kubectl --context kind-chart-test-swarm-default -n sample wait --for=condition=Ready pods --timeout=5m --all pod/sample-69469cb4c6-24fnm condition met pod/sample-canary-575699b698-86scv condition met PASS: pods Ready in ns/sample NAME READY STATUS RESTARTS AGE sample-69469cb4c6-24fnm 1/1 Running 0 3s sample-canary-575699b698-86scv 1/1 Running 0 3s
pods-ready
kubectl --context kind-chart-test-swarm-default -n ingress-nginx wait --for=condition=Ready pods --timeout=3m --all pod/ingress-nginx-controller-d74c658c5-c2npd condition met PASS: pods Ready in ns/ingress-nginx NAME READY STATUS RESTARTS AGE ingress-nginx-controller-d74c658c5-c2npd 1/1 Running 0 29s
smoke-script
PASS: canary pod Ready ==> Verifying stable Ingress exists ingress.networking.k8s.io/sample-stable PASS: stable Ingress exists ==> Verifying canary Ingress exists with canary annotations Canary flag: 'true', canary-weight: '20' PASS: canary Ingress has correct annotations ==> Getting nginx controller pod IP NGINX pod IP: 10.244.0.6 ==> Running 100 canary probes (expect 10-30 canary hits) ... probe 20/100: canary=5 stable=15 ... probe 40/100: canary=11 stable=29 ... probe 60/100: canary=17 stable=43 ... probe 80/100: canary=22 stable=58 ... probe 100/100: canary=26 stable=74 Canary hits: 26/100 (20% target) Stable hits: 74/100 PASS: canary traffic in range [10, 30] — 26 hits PASS: NGINX Ingress canary integration verified
Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-ingress-controllers-nginx-ingress-canary-20260530-213615-2/artifacts/logs
ingress-controllers-nginx-ingress-default-backend
ingress-controllers-nginx-ingress-default-backend
UNTESTED
kind
addon:nginx-ingressnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
ingress-controllers-nginx-ingress-default-backend
ingress-controllers-nginx-ingress-default-backend
UNTESTED
kind
addon:nginx-ingressnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
ingress-controllers-nginx-ingress-default-backend
ingress-controllers-nginx-ingress-default-backend
UNTESTED
kind
addon:nginx-ingressnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
ingress-controllers-nginx-ingress-default-backend
ingress-controllers-nginx-ingress-default-backend
UNTESTED
kind
addon:nginx-ingressnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
ingress-controllers-nginx-ingress-default-backend
ingress-controllers-nginx-ingress-default-backend
UNTESTED
kind
addon:nginx-ingressnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
ingress-controllers-nginx-ingress-default-backend
ingress-controllers-nginx-ingress-default-backend
UNTESTED
kind
addon:nginx-ingressnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
ingress-controllers-nginx-ingress-default-backend
ingress-controllers-nginx-ingress-default-backend
PASS
kind
addon:nginx-ingressnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
helm-status-deployed
helm status: deployed PASS: release sample in ns/sample is deployed
pods-ready
kubectl --context kind-chart-test-swarm-default -n sample wait --for=condition=Ready pods --timeout=5m --all pod/sample-69469cb4c6-k62qx condition met PASS: pods Ready in ns/sample NAME READY STATUS RESTARTS AGE sample-69469cb4c6-k62qx 1/1 Running 0 2s
pods-ready
kubectl --context kind-chart-test-swarm-default -n ingress-nginx wait --for=condition=Ready pods --timeout=3m --all pod/custom-default-backend-6f9895b6b7-hn5r9 condition met pod/ingress-nginx-controller-765bc57f9-q9v87 condition met PASS: pods Ready in ns/ingress-nginx NAME READY STATUS RESTARTS AGE custom-default-backend-6f9895b6b7-hn5r9 1/1 Running 0 36s ingress-nginx-controller-765bc57f9-q9v87 1/1 Running 0 28s
smoke-script
exec: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/assertions/nginx-default-backend.sh (RELEASE=sample NAMESPACE=sample) ==> Waiting for nginx controller pod Ready (3m max) pod/ingress-nginx-controller-765bc57f9-q9v87 condition met PASS: nginx controller pod Ready ==> Waiting for product pod Ready (3m max) pod/sample-69469cb4c6-k62qx condition met PASS: product pods Ready ==> Waiting for custom default backend pod Ready (2m max) pod/custom-default-backend-6f9895b6b7-hn5r9 condition met PASS: custom default backend pod Ready ==> Getting nginx controller pod IP NGINX pod IP: 10.244.0.7 ==> Probing HTTP without Host header (should hit custom default backend) Response body: 'chart-test-swarm-default-backend' PASS: custom default backend served distinctive body 'chart-test-swarm-default-backend' ==> Verifying Host-matched request still reaches product Service HTTP response (with Host): 200 PASS: HTTP 200 with matching Host header PASS: NGINX Ingress default backend integration verified
Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-ingress-controllers-nginx-ingress-default-backend-20260530-213502-7/artifacts/logs
ingress-controllers-nginx-ingress-snippet-annotations
ingress-controllers-nginx-ingress-snippet-annotations
UNTESTED
kind
addon:nginx-ingressnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
ingress-controllers-nginx-ingress-snippet-annotations
ingress-controllers-nginx-ingress-snippet-annotations
PASS
kind
addon:nginx-ingressnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
helm-status-deployed
helm status: deployed PASS: release sample in ns/sample is deployed
pods-ready
kubectl --context kind-chart-test-swarm-default -n sample wait --for=condition=Ready pods --timeout=5m --all pod/sample-69469cb4c6-t89sh condition met PASS: pods Ready in ns/sample NAME READY STATUS RESTARTS AGE sample-69469cb4c6-t89sh 1/1 Running 0 4s
pods-ready
kubectl --context kind-chart-test-swarm-default -n ingress-nginx wait --for=condition=Ready pods --timeout=3m --all pod/ingress-nginx-controller-d74c658c5-856ch condition met PASS: pods Ready in ns/ingress-nginx NAME READY STATUS RESTARTS AGE ingress-nginx-controller-d74c658c5-856ch 1/1 Running 0 29s
smoke-script
exec: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/assertions/nginx-snippet-annotations.sh (RELEASE=sample NAMESPACE=sample) ==> Waiting for nginx controller pod Ready (3m max) pod/ingress-nginx-controller-d74c658c5-856ch condition met PASS: nginx controller pod Ready ==> Waiting for product pod Ready (3m max) pod/sample-69469cb4c6-t89sh condition met PASS: product pods Ready ==> Verifying Ingress has configuration-snippet annotation PASS: Ingress has nginx.ingress.kubernetes.io/configuration-snippet annotation Snippet content: add_header X-Test "chart-test-swarm"; ==> Getting nginx controller pod IP NGINX pod IP: 10.244.0.6 ==> Probing HTTP with Host header (expect 200 with X-Test header) HTTP response code: 200 PASS: HTTP 200 with Host header ==> Verifying snippet-injected header 'X-Test: chart-test-swarm' Response header X-Test: 'chart-test-swarm' PASS: snippet-injected header 'X-Test: chart-test-swarm' present PASS: NGINX Ingress snippet annotations integration verified
Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-ingress-controllers-nginx-ingress-snippet-annotations-20260530-213350-2/artifacts/logs
ingress-controllers-nginx-ingress-tls-cert-manager
ingress-controllers-nginx-ingress-tls-cert-manager
UNTESTED
kind
addon:cert-manageraddon:nginx-ingressnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
ingress-controllers-nginx-ingress-tls-cert-manager
ingress-controllers-nginx-ingress-tls-cert-manager
UNTESTED
kind
addon:cert-manageraddon:nginx-ingressnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
ingress-controllers-nginx-ingress-tls-cert-manager
ingress-controllers-nginx-ingress-tls-cert-manager
PASS
kind
addon:cert-manageraddon:nginx-ingressnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
helm-status-deployed
helm status: deployed PASS: release sample in ns/sample is deployed
pods-ready
kubectl --context kind-chart-test-swarm-default -n sample wait --for=condition=Ready pods --timeout=5m --all pod/sample-69469cb4c6-swdpn condition met PASS: pods Ready in ns/sample NAME READY STATUS RESTARTS AGE sample-69469cb4c6-swdpn 1/1 Running 0 3s
pods-ready
kubectl --context kind-chart-test-swarm-default -n cert-manager wait --for=condition=Ready pods --timeout=3m --all pod/cert-manager-c69c859c4-6f2qv condition met pod/cert-manager-cainjector-d6d64f75f-wnxt7 condition met pod/cert-manager-webhook-566849c7fc-2xck7 condition met PASS: pods Ready in ns/cert-manager NAME READY STATUS RESTARTS AGE cert-manager-c69c859c4-6f2qv 1/1 Running 0 57s cert-manager-cainjector-d6d64f75f-wnxt7 1/1 Running 0 57s cert-manager-webhook-566849c7fc-2xck7 1/1 Running 0 57s
pods-ready
kubectl --context kind-chart-test-swarm-default -n ingress-nginx wait --for=condition=Ready pods --timeout=3m --all pod/ingress-nginx-controller-d74c658c5-9bvlx condition met PASS: pods Ready in ns/ingress-nginx NAME READY STATUS RESTARTS AGE ingress-nginx-controller-d74c658c5-9bvlx 1/1 Running 0 29s
smoke-script
tls.key OK: tls.crt, tls.key, ca.crt all present ==> Waiting for nginx controller pod Ready (3m max) pod/ingress-nginx-controller-d74c658c5-9bvlx condition met PASS: nginx controller pod Ready ==> Waiting for product pod Ready (3m max) pod/sample-69469cb4c6-swdpn condition met PASS: product pods Ready ==> Verifying Ingress exists with TLS TLS host: sample.test.local, TLS secret: sample-tls PASS: Ingress TLS references cert-manager Secret 'sample-tls' ==> Getting nginx controller pod IP NGINX pod IP: 10.244.0.10 ==> Probing HTTPS with --cacert (expect 200 with cert chain rooted at ClusterIssuer CA) HTTPS response: 200 PASS: HTTPS 200 with --cacert verification ==> Verifying peer certificate issuer matches ClusterIssuer CA Cert issuer: issuer=CN=sample.test.local NOTE: cert issuer 'issuer=CN=sample.test.local' — ClusterIssuer CA may use different DN (informational) PASS: Cross-feature cert-manager + nginx-ingress TLS integration verified
Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-ingress-controllers-nginx-ingress-tls-cert-manager-20260530-214046-3/artifacts/logs
ingress-controllers-traefik-basic
ingress-controllers-traefik-basic
UNTESTED
kind
addon:traefiknightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
ingress-controllers-traefik-basic
ingress-controllers-traefik-basic
UNTESTED
kind
addon:traefiknightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
ingress-controllers-traefik-basic
ingress-controllers-traefik-basic
UNTESTED
kind
addon:traefiknightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
ingress-controllers-traefik-basic
ingress-controllers-traefik-basic
UNTESTED
kind
addon:traefiknightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
ingress-controllers-traefik-basic
ingress-controllers-traefik-basic
UNTESTED
kind
addon:traefiknightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
ingress-controllers-traefik-basic
ingress-controllers-traefik-basic
UNTESTED
kind
addon:traefiknightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
ingress-controllers-traefik-basic
ingress-controllers-traefik-basic
UNTESTED
kind
addon:traefiknightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
ingress-controllers-traefik-basic
ingress-controllers-traefik-basic
UNTESTED
kind
addon:traefiknightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
ingress-controllers-traefik-basic
ingress-controllers-traefik-basic
PASS
kind
addon:traefiknightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
helm-status-deployed
helm status: deployed PASS: release sample in ns/sample is deployed
pods-ready
kubectl --context kind-chart-test-swarm-default -n sample wait --for=condition=Ready pods --timeout=5m --all pod/sample-69469cb4c6-xj4l4 condition met PASS: pods Ready in ns/sample NAME READY STATUS RESTARTS AGE sample-69469cb4c6-xj4l4 1/1 Running 0 3s
pods-ready
kubectl --context kind-chart-test-swarm-default -n traefik wait --for=condition=Ready pods --timeout=3m --all pod/traefik-77657478fd-7tkhn condition met PASS: pods Ready in ns/traefik NAME READY STATUS RESTARTS AGE traefik-77657478fd-7tkhn 1/1 Running 0 7s
smoke-script
exec: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/assertions/traefik-basic.sh (RELEASE=sample NAMESPACE=sample) ==> Waiting for Traefik pod Ready (3m max) pod/traefik-77657478fd-7tkhn condition met PASS: Traefik pod Ready ==> Waiting for product pod Ready (3m max) pod/sample-69469cb4c6-xj4l4 condition met PASS: product pods Ready ==> Getting Traefik pod IP (probe via pod IP) Traefik pod IP: 10.244.0.5 ==> Verifying IngressRoute exists ingressroute.traefik.io/sample-basic PASS: IngressRoute sample-basic exists ==> Probing HTTP with Host header (expect 200) on container port 8000 HTTP response (with Host): 200 PASS: HTTP 200 with Host header ==> Probing HTTP without Host header (expect 404) on container port 8000 HTTP response (without Host): 404 PASS: HTTP 404 without Host header (Traefik default) PASS: Traefik basic IngressRoute integration verified
Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-ingress-controllers-traefik-basic-20260530-212546-9/artifacts/logs
ingress-controllers-traefik-ingressroute-crd
ingress-controllers-traefik-ingressroute-crd
UNTESTED
kind
addon:traefiknightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
ingress-controllers-traefik-ingressroute-crd
ingress-controllers-traefik-ingressroute-crd
PASS
kind
addon:traefiknightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
helm-status-deployed
helm status: deployed PASS: release sample in ns/sample is deployed
pods-ready
kubectl --context kind-chart-test-swarm-default -n sample wait --for=condition=Ready pods --timeout=5m --all pod/sample-69469cb4c6-shksp condition met PASS: pods Ready in ns/sample NAME READY STATUS RESTARTS AGE sample-69469cb4c6-shksp 1/1 Running 0 3s
pods-ready
kubectl --context kind-chart-test-swarm-default -n traefik wait --for=condition=Ready pods --timeout=3m --all pod/traefik-77657478fd-97lhs condition met PASS: pods Ready in ns/traefik NAME READY STATUS RESTARTS AGE traefik-77657478fd-97lhs 1/1 Running 0 8s
smoke-script
exec: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/assertions/traefik-ingressroute-crd.sh (RELEASE=sample NAMESPACE=sample) ==> Waiting for Traefik pod Ready (3m max) pod/traefik-77657478fd-97lhs condition met PASS: Traefik pod Ready ==> Waiting for product pod Ready (3m max) pod/sample-69469cb4c6-shksp condition met PASS: product pods Ready ==> Verifying IngressRoute CRD is used (not classic Ingress) IngressRoute count: 1 PASS: IngressRoute.traefik.io/v1alpha1 resources present ==> Verifying no classic Ingress resources exist Classic Ingress count: 0 PASS: no classic Ingress resources (CRD-only routing) ==> Getting Traefik pod IP Traefik pod IP: 10.244.0.5 ==> Probing HTTP with Host header (expect 200) HTTP response: 200 PASS: HTTP 200 through IngressRoute CRD PASS: Traefik IngressRoute CRD integration verified
Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-ingress-controllers-traefik-ingressroute-crd-20260530-212932-2/artifacts/logs
ingress-controllers-traefik-middleware-chain
ingress-controllers-traefik-middleware-chain
UNTESTED
kind
addon:traefiknightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
ingress-controllers-traefik-middleware-chain
ingress-controllers-traefik-middleware-chain
UNTESTED
kind
addon:traefiknightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
ingress-controllers-traefik-middleware-chain
ingress-controllers-traefik-middleware-chain
PASS
kind
addon:traefiknightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
helm-status-deployed
helm status: deployed PASS: release sample in ns/sample is deployed
pods-ready
kubectl --context kind-chart-test-swarm-default -n sample wait --for=condition=Ready pods --timeout=5m --all pod/sample-69469cb4c6-mv9n7 condition met PASS: pods Ready in ns/sample NAME READY STATUS RESTARTS AGE sample-69469cb4c6-mv9n7 1/1 Running 0 3s
pods-ready
kubectl --context kind-chart-test-swarm-default -n traefik wait --for=condition=Ready pods --timeout=3m --all pod/traefik-77657478fd-wjgpc condition met PASS: pods Ready in ns/traefik NAME READY STATUS RESTARTS AGE traefik-77657478fd-wjgpc 1/1 Running 0 9s
smoke-script
==> Waiting for Traefik pod Ready (3m max) pod/traefik-77657478fd-wjgpc condition met PASS: Traefik pod Ready ==> Waiting for product pod Ready (3m max) pod/sample-69469cb4c6-mv9n7 condition met PASS: product pods Ready ==> Verifying Middleware CR exists middleware.traefik.io/add-test-header PASS: Middleware add-test-header exists ==> Verifying IngressRoute references the Middleware PASS: IngressRoute references Middleware 'add-test-header' ==> Getting Traefik pod IP Traefik pod IP: 10.244.0.5 ==> Probing HTTP with Host header (expect 200 with X-Test header) HTTP response code: 200 PASS: HTTP 200 with Host header ==> Verifying middleware-injected header 'X-Test: chart-test-swarm' Response header X-Test: 'chart-test-swarm' PASS: middleware injected header 'X-Test: chart-test-swarm' PASS: Traefik middleware chain integration verified
Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-ingress-controllers-traefik-middleware-chain-20260530-213039-3/artifacts/logs
ingress-controllers-traefik-tls-passthrough
ingress-controllers-traefik-tls-passthrough
UNTESTED
kind
addon:traefiknightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
ingress-controllers-traefik-tls-passthrough
ingress-controllers-traefik-tls-passthrough
UNTESTED
kind
addon:traefiknightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
ingress-controllers-traefik-tls-passthrough
ingress-controllers-traefik-tls-passthrough
UNTESTED
kind
addon:traefiknightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
ingress-controllers-traefik-tls-passthrough
ingress-controllers-traefik-tls-passthrough
UNTESTED
kind
addon:traefiknightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
ingress-controllers-traefik-tls-passthrough
ingress-controllers-traefik-tls-passthrough
UNTESTED
kind
addon:traefiknightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
ingress-controllers-traefik-tls-passthrough
ingress-controllers-traefik-tls-passthrough
PASS
kind
addon:traefiknightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
helm-status-deployed
helm status: deployed PASS: release sample in ns/sample is deployed
pods-ready
kubectl --context kind-chart-test-swarm-default -n sample wait --for=condition=Ready pods --timeout=5m --all pod/sample-697b9f98fb-8rdzm condition met PASS: pods Ready in ns/sample NAME READY STATUS RESTARTS AGE sample-697b9f98fb-8rdzm 1/1 Running 0 5s
pods-ready
kubectl --context kind-chart-test-swarm-default -n traefik wait --for=condition=Ready pods --timeout=3m --all pod/traefik-77657478fd-c8nwp condition met PASS: pods Ready in ns/traefik NAME READY STATUS RESTARTS AGE traefik-77657478fd-c8nwp 1/1 Running 0 16s
smoke-script
exec: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/assertions/traefik-tls-passthrough.sh (RELEASE=sample NAMESPACE=sample) ==> Waiting for Traefik pod Ready (3m max) pod/traefik-77657478fd-c8nwp condition met PASS: Traefik pod Ready ==> Waiting for product pod Ready (3m max) pod/sample-697b9f98fb-8rdzm condition met PASS: product pods Ready ==> Getting Traefik pod IP Traefik pod IP: 10.244.0.5 ==> Verifying IngressRouteTCP exists with tls.passthrough=true PASS: IngressRouteTCP tls.passthrough=true ==> Extracting backend certificate subject Backend cert subject: subject=C=US, ST=CA, O=Chart Test Swarm, CN=sample.sample.svc ==> Probing HTTPS through Traefik (expect 200, backend cert) HTTPS response: 200 PASS: HTTPS 200 through Traefik ==> Verifying served cert matches backend cert (not Traefik default) Served cert subject: * subject: C=US; ST=CA; O=Chart Test Swarm; CN=sample.sample.svc PASS: served cert subject matches backend cert (CN=sample.sample.svc) PASS: Traefik TLS passthrough integration verified
Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-ingress-controllers-traefik-tls-passthrough-20260530-212802-6/artifacts/logs
minimal
minimal
UNTESTED
kind
addon:nonepr-subsetnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
minimal
minimal
UNTESTED
kind
addon:nonepr-subsetnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
minimal
minimal
UNTESTED
kind
addon:nonepr-subsetnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
minimal
minimal
UNTESTED
kind
addon:nonepr-subsetnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
minimal
minimal
UNTESTED
kind
addon:nonepr-subsetnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
minimal
minimal
UNTESTED
kind
addon:nonepr-subsetnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
minimal
minimal
UNTESTED
kind
addon:nonepr-subsetnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
minimal
minimal
UNTESTED
kind
addon:nonepr-subsetnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
minimal
minimal
UNTESTED
kind
addon:nonepr-subsetnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
minimal
minimal
INTERRUPTED
kind
addon:nonepr-subsetnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
service-mesh-istio-ingress-gateway-basic
service-mesh-istio-ingress-gateway-basic
UNTESTED
kind
addon:istiomesh:istio-ingress-gatewaynightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
service-mesh-istio-ingress-gateway-basic
service-mesh-istio-ingress-gateway-basic
UNTESTED
kind
addon:istiomesh:istio-ingress-gatewaynightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
service-mesh-istio-ingress-gateway-basic
service-mesh-istio-ingress-gateway-basic
PASS
kind
addon:istiomesh:istio-ingress-gatewaynightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
helm-status-deployed
helm status: deployed PASS: release istio-base in ns/istio-system is deployed
helm-status-deployed
helm status: deployed PASS: release istiod in ns/istio-system is deployed
helm-status-deployed
helm status: deployed PASS: release istio-ingressgateway in ns/istio-system is deployed
helm-status-deployed
helm status: deployed PASS: release sample in ns/sample is deployed
pods-ready
kubectl --context kind-chart-test-swarm-default -n istio-system wait --for=condition=Ready pods --timeout=5m -l app=istiod pod/istiod-54b585df85-bt7bq condition met PASS: pods Ready in ns/istio-system (selector=app=istiod) NAME READY STATUS RESTARTS AGE istiod-54b585df85-bt7bq 1/1 Running 0 13s
pods-ready
kubectl --context kind-chart-test-swarm-default -n istio-system wait --for=condition=Ready pods --timeout=3m -l app=istio-ingressgateway pod/istio-ingressgateway-8584b67974-ph6t8 condition met PASS: pods Ready in ns/istio-system (selector=app=istio-ingressgateway) NAME READY STATUS RESTARTS AGE istio-ingressgateway-8584b67974-ph6t8 1/1 Running 0 8s
pods-ready
kubectl --context kind-chart-test-swarm-default -n sample wait --for=condition=Ready pods --timeout=3m --all pod/sample-7dcd986bd4-cf9gd condition met PASS: pods Ready in ns/sample NAME READY STATUS RESTARTS AGE sample-7dcd986bd4-cf9gd 1/1 Running 0 3s
smoke-script
exec: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/assertions/istio-ingress-gateway-basic.sh (RELEASE=sample NAMESPACE=sample) ==> Creating Istio Gateway + VirtualService gateway.networking.istio.io/sample-igw created virtualservice.networking.istio.io/sample-vs created ==> Waiting for istiod to reconcile Gateway (15s) ==> Verifying Gateway resource is admitted ✓ Gateway sample-igw exists ==> Verifying VirtualService resource exists ✓ VirtualService sample-vs exists ==> Getting istio-ingressgateway pod IP Gateway pod IP: 10.244.0.6 ==> Probing product through istio ingress gateway HTTP response through gateway: 200 PASS: traffic routed through istio ingress gateway PASS: istio ingress gateway basic integration verified
Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-service-mesh-istio-ingress-gateway-basic-20260531-204053-3/artifacts/logs
service-mesh-istio-ingress-gateway-jwt
service-mesh-istio-ingress-gateway-jwt
UNTESTED
kind
addon:istiomesh:istio-ingress-gatewaynightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
service-mesh-istio-ingress-gateway-jwt
service-mesh-istio-ingress-gateway-jwt
UNTESTED
kind
addon:istiomesh:istio-ingress-gatewaynightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
service-mesh-istio-ingress-gateway-jwt
service-mesh-istio-ingress-gateway-jwt
PASS
kind
addon:istiomesh:istio-ingress-gatewaynightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
helm-status-deployed
helm status: deployed PASS: release istio-base in ns/istio-system is deployed
helm-status-deployed
helm status: deployed PASS: release istiod in ns/istio-system is deployed
helm-status-deployed
helm status: deployed PASS: release istio-ingressgateway in ns/istio-system is deployed
helm-status-deployed
helm status: deployed PASS: release sample in ns/sample is deployed
pods-ready
kubectl --context kind-chart-test-swarm-default -n istio-system wait --for=condition=Ready pods --timeout=5m -l app=istiod pod/istiod-54b585df85-dtws8 condition met PASS: pods Ready in ns/istio-system (selector=app=istiod) NAME READY STATUS RESTARTS AGE istiod-54b585df85-dtws8 1/1 Running 0 12s
pods-ready
kubectl --context kind-chart-test-swarm-default -n istio-system wait --for=condition=Ready pods --timeout=3m -l app=istio-ingressgateway pod/istio-ingressgateway-8584b67974-gccjm condition met PASS: pods Ready in ns/istio-system (selector=app=istio-ingressgateway) NAME READY STATUS RESTARTS AGE istio-ingressgateway-8584b67974-gccjm 1/1 Running 0 7s
pods-ready
kubectl --context kind-chart-test-swarm-default -n sample wait --for=condition=Ready pods --timeout=3m --all pod/sample-7dcd986bd4-tqwz9 condition met PASS: pods Ready in ns/sample NAME READY STATUS RESTARTS AGE sample-7dcd986bd4-tqwz9 1/1 Running 0 3s
smoke-script
==> Creating Istio Gateway + VirtualService gateway.networking.istio.io/sample-igw created virtualservice.networking.istio.io/sample-vs created ==> Creating RequestAuthentication (JWT validation) configmap/jwt-jwks created requestauthentication.security.istio.io/sample-jwt-auth created ==> Creating AuthorizationPolicy (require JWT via ALLOW) authorizationpolicy.security.istio.io/sample-require-jwt created ==> Waiting for istiod to reconcile policies (15s) ==> Getting istio-ingressgateway pod IP Gateway pod IP: 10.244.0.6 ==> Signing JWT with test issuer key JWT generated (expires in 1h) ==> Test 1: Request WITHOUT Bearer token → expect 401 or 403 HTTP code (no auth): 403 ✓ Request without token correctly rejected ==> Test 2: Request WITH valid Bearer token → expect 200 HTTP code (with valid JWT): 200 ✓ Request with valid JWT succeeds PASS: istio ingress gateway JWT authentication verified
Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-service-mesh-istio-ingress-gateway-jwt-20260531-205541-3/artifacts/logs
service-mesh-istio-ingress-gateway-multi-host
service-mesh-istio-ingress-gateway-multi-host
UNTESTED
kind
addon:istiomesh:istio-ingress-gatewaynightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
service-mesh-istio-ingress-gateway-multi-host
service-mesh-istio-ingress-gateway-multi-host
PASS
kind
addon:istiomesh:istio-ingress-gatewaynightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
helm-status-deployed
helm status: deployed PASS: release istio-base in ns/istio-system is deployed
helm-status-deployed
helm status: deployed PASS: release istiod in ns/istio-system is deployed
helm-status-deployed
helm status: deployed PASS: release istio-ingressgateway in ns/istio-system is deployed
helm-status-deployed
helm status: deployed PASS: release sample in ns/sample is deployed
pods-ready
kubectl --context kind-chart-test-swarm-default -n istio-system wait --for=condition=Ready pods --timeout=5m -l app=istiod pod/istiod-54b585df85-r6fcx condition met PASS: pods Ready in ns/istio-system (selector=app=istiod) NAME READY STATUS RESTARTS AGE istiod-54b585df85-r6fcx 1/1 Running 0 11s
pods-ready
kubectl --context kind-chart-test-swarm-default -n istio-system wait --for=condition=Ready pods --timeout=3m -l app=istio-ingressgateway pod/istio-ingressgateway-8584b67974-v9thg condition met PASS: pods Ready in ns/istio-system (selector=app=istio-ingressgateway) NAME READY STATUS RESTARTS AGE istio-ingressgateway-8584b67974-v9thg 1/1 Running 0 7s
pods-ready
kubectl --context kind-chart-test-swarm-default -n sample wait --for=condition=Ready pods --timeout=3m --all pod/sample-7dcd986bd4-2c9wj condition met PASS: pods Ready in ns/sample NAME READY STATUS RESTARTS AGE sample-7dcd986bd4-2c9wj 1/1 Running 0 3s
smoke-script
exec: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/assertions/istio-ingress-gateway-multi-host.sh (RELEASE=sample NAMESPACE=sample) ==> Creating multi-host Istio Gateway + VirtualService gateway.networking.istio.io/sample-igw-multi created Warning: virtualService rule #1 match #0 is not used (duplicate/overlapping match in rule #0) Warning: virtualService rule #1 not used (all matches used by prior rules) virtualservice.networking.istio.io/sample-vs-multi created ==> Waiting for istiod to reconcile Gateway + VirtualService (15s) ==> Verifying Gateway resource is admitted ✓ Gateway sample-igw-multi exists ==> Getting istio-ingressgateway pod IP Gateway pod IP: 10.244.0.6 ==> Probing skywatcher host through gateway Skywatcher HTTP code: 200 ==> Probing api host through gateway API HTTP code: 200 PASS: multi-host routing through istio ingress gateway verified
Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-service-mesh-istio-ingress-gateway-multi-host-20260531-204940-2/artifacts/logs
service-mesh-istio-ingress-gateway-request-authentication
service-mesh-istio-ingress-gateway-request-authentication
UNTESTED
kind
addon:istiomesh:istio-ingress-gatewaynightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
service-mesh-istio-ingress-gateway-request-authentication
service-mesh-istio-ingress-gateway-request-authentication
PASS
kind
addon:istiomesh:istio-ingress-gatewaynightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
helm-status-deployed
helm status: deployed PASS: release istio-base in ns/istio-system is deployed
helm-status-deployed
helm status: deployed PASS: release istiod in ns/istio-system is deployed
helm-status-deployed
helm status: deployed PASS: release istio-ingressgateway in ns/istio-system is deployed
helm-status-deployed
helm status: deployed PASS: release sample in ns/sample is deployed
pods-ready
kubectl --context kind-chart-test-swarm-default -n istio-system wait --for=condition=Ready pods --timeout=5m -l app=istiod pod/istiod-54b585df85-bwxw4 condition met PASS: pods Ready in ns/istio-system (selector=app=istiod) NAME READY STATUS RESTARTS AGE istiod-54b585df85-bwxw4 1/1 Running 0 12s
pods-ready
kubectl --context kind-chart-test-swarm-default -n istio-system wait --for=condition=Ready pods --timeout=3m -l app=istio-ingressgateway pod/istio-ingressgateway-8584b67974-flc49 condition met PASS: pods Ready in ns/istio-system (selector=app=istio-ingressgateway) NAME READY STATUS RESTARTS AGE istio-ingressgateway-8584b67974-flc49 1/1 Running 0 7s
pods-ready
kubectl --context kind-chart-test-swarm-default -n sample wait --for=condition=Ready pods --timeout=3m --all pod/sample-7dcd986bd4-gk7dz condition met PASS: pods Ready in ns/sample NAME READY STATUS RESTARTS AGE sample-7dcd986bd4-gk7dz 1/1 Running 0 3s
smoke-script
==> JWT key: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/fixtures/service-mesh/jwt/jwt-key.pem ==> JWKS: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/fixtures/service-mesh/jwt/jwks.json ==> Creating Istio Gateway + VirtualService gateway.networking.istio.io/sample-igw created virtualservice.networking.istio.io/sample-vs created ==> Creating RequestAuthentication (JWT validation ONLY, no deny) requestauthentication.security.istio.io/sample-jwt-validate created ==> Waiting for istiod to reconcile policies (15s) ==> Getting istio-ingressgateway pod IP Gateway pod IP: 10.244.0.6 ==> Test 1: Request WITHOUT Bearer token → should pass (no deny rule) HTTP code (no auth): 200 ✓ Request without token passes through (no enforcement) ==> Test 2: Request WITH valid JWT → should succeed HTTP code (valid JWT): 200 ✓ Request with valid JWT succeeds ==> Test 3: Request WITH invalid JWT (wrong issuer) → should be rejected HTTP code (invalid JWT): 401 ✓ Invalid JWT correctly rejected (RequestAuthentication validates) PASS: istio ingress gateway RequestAuthentication (validate-only, no deny) verified
Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-service-mesh-istio-ingress-gateway-request-authentication-20260531-205915-2/artifacts/logs
service-mesh-istio-service-mesh-cert-manager-tls
service-mesh-istio-service-mesh-cert-manager-tls
UNTESTED
kind
addon:istioaddon:cert-managermesh:istio-service-meshnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
service-mesh-istio-service-mesh-cert-manager-tls
service-mesh-istio-service-mesh-cert-manager-tls
PASS
kind
addon:istioaddon:cert-managermesh:istio-service-meshnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
helm-status-deployed
helm status: deployed PASS: release cert-manager in ns/cert-manager is deployed
helm-status-deployed
helm status: deployed PASS: release istio-base in ns/istio-system is deployed
helm-status-deployed
helm status: deployed PASS: release istiod in ns/istio-system is deployed
helm-status-deployed
helm status: deployed PASS: release istio-ingressgateway in ns/istio-system is deployed
helm-status-deployed
helm status: deployed PASS: release sample in ns/sample is deployed
pods-ready
kubectl --context kind-chart-test-swarm-default -n cert-manager wait --for=condition=Ready pods --timeout=5m --all pod/cert-manager-c69c859c4-dw6t2 condition met pod/cert-manager-cainjector-d6d64f75f-wmg4t condition met pod/cert-manager-webhook-566849c7fc-zxg54 condition met PASS: pods Ready in ns/cert-manager NAME READY STATUS RESTARTS AGE cert-manager-c69c859c4-dw6t2 1/1 Running 0 39s cert-manager-cainjector-d6d64f75f-wmg4t 1/1 Running 0 39s cert-manager-webhook-566849c7fc-zxg54 1/1 Running 0 39s
pods-ready
kubectl --context kind-chart-test-swarm-default -n istio-system wait --for=condition=Ready pods --timeout=5m --all pod/istio-ingressgateway-8584b67974-xphfm condition met pod/istiod-54b585df85-287x8 condition met PASS: pods Ready in ns/istio-system NAME READY STATUS RESTARTS AGE istio-ingressgateway-8584b67974-xphfm 1/1 Running 0 8s istiod-54b585df85-287x8 1/1 Running 0 15s
pods-ready
kubectl --context kind-chart-test-swarm-default -n sample wait --for=condition=Ready pods --timeout=5m --all pod/sample-6f8587999b-dkq2f condition met PASS: pods Ready in ns/sample NAME READY STATUS RESTARTS AGE sample-6f8587999b-dkq2f 1/1 Running 0 4s
smoke-script
2026-06-01T00:19:26.545770Zinfocachereturned workload certificate from cachettl=23h59m59.454230079s 2026-06-01T00:19:26.545915Zinfocachereturned workload trust anchor from cachettl=23h59m59.454085371s 2026-06-01T00:19:26.545994Zinfocachereturned workload trust anchor from cachettl=23h59m59.454005996s 2026-06-01T00:19:26.915710ZinfoReadiness succeeded in 646.41675ms 2026-06-01T00:19:26.915967ZinfoEnvoy proxy is ready ==> Running istioctl analyze (downloading if needed) Downloading istioctl 1.27.9... SKIP: istioctl not available; skipping analyze step ==> Testing HTTPS through Istio Gateway with TLS pod/ct-gw-tls-probe created pod/ct-gw-tls-probe condition met PASS: test pod ct-gw-tls-probe ready Gateway service IP: 10.96.144.5 HTTPS response through Gateway: 200 PASS: HTTPS 200 through Istio Gateway with cert-manager-issued cert ==> Verifying peer certificate issuer matches cert-manager Peer cert issuer: pod "ct-gw-tls-probe" force deleted from sample namespace NOTE: peer certificate issuer not matching expected pattern: PASS: Istio Gateway + cert-manager TLS cross-feature compose verified
Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-service-mesh-istio-service-mesh-cert-manager-tls-20260531-201823-2/artifacts/logs
service-mesh-istio-service-mesh-peer-authentication
service-mesh-istio-service-mesh-peer-authentication
PASS
kind
addon:istiomesh:istio-service-meshnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
helm-status-deployed
helm status: deployed PASS: release istio-base in ns/istio-system is deployed
helm-status-deployed
helm status: deployed PASS: release istiod in ns/istio-system is deployed
helm-status-deployed
helm status: deployed PASS: release sample in ns/sample is deployed
pods-ready
kubectl --context kind-chart-test-swarm-default -n istio-system wait --for=condition=Ready pods --timeout=5m -l app=istiod pod/istiod-54b585df85-vg2rp condition met PASS: pods Ready in ns/istio-system (selector=app=istiod) NAME READY STATUS RESTARTS AGE istiod-54b585df85-vg2rp 1/1 Running 0 7s
pods-ready
kubectl --context kind-chart-test-swarm-default -n sample wait --for=condition=Ready pods --timeout=5m --all pod/sample-6f8587999b-cmc6x condition met PASS: pods Ready in ns/sample NAME READY STATUS RESTARTS AGE sample-6f8587999b-cmc6x 1/1 Running 0 4s
smoke-script
PASS: in-mesh traffic allowed under PERMISSIVE ==> Phase 2: Updating PeerAuthentication to STRICT peerauthentication.security.istio.io/sample-perm configured ==> Verifying PeerAuthentication STRICT PeerAuthentication mode: STRICT PASS: PeerAuthentication updated to STRICT ==> Waiting 10s for mTLS policy propagation ==> Phase 2a: Non-mesh probe under STRICT (expect rejection) Non-mesh HTTP under STRICT: 000 PASS: non-mesh traffic rejected under STRICT (code=000) ==> Phase 2b: In-mesh probe under STRICT (expect 200) In-mesh HTTP under STRICT: 200 PASS: in-mesh traffic still works under STRICT via auto-upgraded mTLS ==> Cleaning up pods and control namespace pod "ct-nonmesh" deleted from sample-plain namespace error: timed out waiting for the condition on pods/ct-nonmesh pod "ct-mesh-probe" deleted from sample namespace error: timed out waiting for the condition on pods/ct-mesh-probe namespace "sample-plain" deleted PASS: istio PeerAuthentication lifecycle verified
Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-service-mesh-istio-service-mesh-peer-authentication-20260531-200357/artifacts/logs
service-mesh-istio-service-mesh-sidecar-injection
service-mesh-istio-service-mesh-sidecar-injection
UNTESTED
kind
addon:istiomesh:istio-service-meshnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
service-mesh-istio-service-mesh-sidecar-injection
service-mesh-istio-service-mesh-sidecar-injection
UNTESTED
kind
addon:istiomesh:istio-service-meshnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
service-mesh-istio-service-mesh-sidecar-injection
service-mesh-istio-service-mesh-sidecar-injection
FAIL
kind
addon:istiomesh:istio-service-meshnightlysmoke-script:
exec: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/assertions/istio-sidecar-injection.sh (RELEASE=sample NAMESPACE=sample)
==> Labeling namespace sample for istio injection
namespace/sample labeled
==> Restarting deployments to pick up sidecar injection
Restarting deployment/sample
deployment.apps/sample restarted
Waiting for rollout of deployment/sample to complete (3m max)
Waiting for deployment "sample" rollout to finish: 1 old replicas are pending termination...
Waiting for deployment "sample" rollout to finish: 1 old replicas are pending termination...
deployment "sample" successfully rolled out
PASS: all deployments rolled out
==> Waiting 5s for old pods to terminate
==> Verifying istio-proxy sidecar injected into every product pod
Pod sample-cff994cb6-tjl8j (deploy/sample) containers (2): app istio-proxy
✓ istio-proxy sidecar present
PASS: every Running product pod has exactly 2 containers including istio-proxy
==> Probing product Service over the mesh from an in-mesh pod
HTTP response from in-mesh probe: 000
FAIL: expected HTTP 200 from in-mesh probe, got 000
/Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-service-mesh-istio-service-mesh-sidecar-injection-20260531-195326-3/artifacts/logs---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
helm-status-deployed
helm status: deployed PASS: release istio-base in ns/istio-system is deployed
helm-status-deployed
helm status: deployed PASS: release istiod in ns/istio-system is deployed
helm-status-deployed
helm status: deployed PASS: release sample in ns/sample is deployed
pods-ready
kubectl --context kind-chart-test-swarm-default -n istio-system wait --for=condition=Ready pods --timeout=5m -l app=istiod pod/istiod-54b585df85-8gw77 condition met PASS: pods Ready in ns/istio-system (selector=app=istiod) NAME READY STATUS RESTARTS AGE istiod-54b585df85-8gw77 1/1 Running 0 8s
pods-ready
kubectl --context kind-chart-test-swarm-default -n sample wait --for=condition=Ready pods --timeout=5m --all pod/sample-6f8587999b-9tmfl condition met PASS: pods Ready in ns/sample NAME READY STATUS RESTARTS AGE sample-6f8587999b-9tmfl 1/1 Running 0 4s
smoke-script
exec: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/assertions/istio-sidecar-injection.sh (RELEASE=sample NAMESPACE=sample)
==> Labeling namespace sample for istio injection
namespace/sample labeled
==> Restarting deployments to pick up sidecar injection
Restarting deployment/sample
deployment.apps/sample restarted
Waiting for rollout of deployment/sample to complete (3m max)
Waiting for deployment "sample" rollout to finish: 1 old replicas are pending termination...
Waiting for deployment "sample" rollout to finish: 1 old replicas are pending termination...
deployment "sample" successfully rolled out
PASS: all deployments rolled out
==> Waiting 5s for old pods to terminate
==> Verifying istio-proxy sidecar injected into every product pod
Pod sample-cff994cb6-tjl8j (deploy/sample) containers (2): app istio-proxy
✓ istio-proxy sidecar present
PASS: every Running product pod has exactly 2 containers including istio-proxy
==> Probing product Service over the mesh from an in-mesh pod
HTTP response from in-mesh probe: 000
FAIL: expected HTTP 200 from in-mesh probe, got 000Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-service-mesh-istio-service-mesh-sidecar-injection-20260531-195326-3/artifacts/logs
service-mesh-istio-service-mesh-strict-mtls
service-mesh-istio-service-mesh-strict-mtls
UNTESTED
kind
addon:istiomesh:istio-service-meshnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
service-mesh-istio-service-mesh-strict-mtls
service-mesh-istio-service-mesh-strict-mtls
PASS
kind
addon:istiomesh:istio-service-meshnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
helm-status-deployed
helm status: deployed PASS: release istio-base in ns/istio-system is deployed
helm-status-deployed
helm status: deployed PASS: release istiod in ns/istio-system is deployed
helm-status-deployed
helm status: deployed PASS: release sample in ns/sample is deployed
pods-ready
kubectl --context kind-chart-test-swarm-default -n istio-system wait --for=condition=Ready pods --timeout=5m -l app=istiod pod/istiod-54b585df85-rqjwh condition met PASS: pods Ready in ns/istio-system (selector=app=istiod) NAME READY STATUS RESTARTS AGE istiod-54b585df85-rqjwh 1/1 Running 0 7s
pods-ready
kubectl --context kind-chart-test-swarm-default -n sample wait --for=condition=Ready pods --timeout=5m --all pod/sample-6f8587999b-fs8zw condition met PASS: pods Ready in ns/sample NAME READY STATUS RESTARTS AGE sample-6f8587999b-fs8zw 1/1 Running 0 3s
smoke-script
==> Creating non-mesh namespace sample-plain (no injection label) namespace/sample-plain created ==> Non-mesh probe: plain HTTP from pod without sidecar (expect failure) pod/ct-nonmesh created pod/ct-nonmesh condition met HTTP response from non-mesh probe: 000 PASS: plain HTTP from non-mesh pod rejected (code=000) ==> In-mesh probe: HTTP from pod with sidecar (expect 200) pod/ct-mesh-probe created Waiting for in-mesh probe pod to be ready (2m max) pod/ct-mesh-probe condition met HTTP response from in-mesh probe: 200 PASS: in-mesh pod reached product Service with HTTP 200 via auto-upgraded mTLS pod "ct-nonmesh" deleted from sample-plain namespace error: timed out waiting for the condition on pods/ct-nonmesh pod "ct-mesh-probe" deleted from sample namespace error: timed out waiting for the condition on pods/ct-mesh-probe ==> Cleaning up control namespace namespace "sample-plain" deleted PASS: istio strict mTLS integration verified
Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-service-mesh-istio-service-mesh-strict-mtls-20260531-200148-2/artifacts/logs
service-mesh-istio-service-mesh-telemetry-v2
service-mesh-istio-service-mesh-telemetry-v2
PASS
kind
addon:istiomesh:istio-service-meshnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
helm-status-deployed
helm status: deployed PASS: release istio-base in ns/istio-system is deployed
helm-status-deployed
helm status: deployed PASS: release istiod in ns/istio-system is deployed
helm-status-deployed
helm status: deployed PASS: release sample in ns/sample is deployed
pods-ready
kubectl --context kind-chart-test-swarm-default -n istio-system wait --for=condition=Ready pods --timeout=5m -l app=istiod pod/istiod-54b585df85-fcqgz condition met PASS: pods Ready in ns/istio-system (selector=app=istiod) NAME READY STATUS RESTARTS AGE istiod-54b585df85-fcqgz 1/1 Running 0 8s
pods-ready
kubectl --context kind-chart-test-swarm-default -n sample wait --for=condition=Ready pods --timeout=5m --all pod/sample-6f8587999b-bc9pp condition met PASS: pods Ready in ns/sample NAME READY STATUS RESTARTS AGE sample-6f8587999b-bc9pp 1/1 Running 0 3s
smoke-script
Waiting for deployment "sample" rollout to finish: 1 old replicas are pending termination... Waiting for deployment "sample" rollout to finish: 1 old replicas are pending termination... deployment "sample" successfully rolled out PASS: all deployments rolled out with sidecars ==> Applying Telemetry resource in namespace sample telemetry.telemetry.istio.io/sample-telemetry created PASS: Telemetry resource sample-telemetry created ==> Verifying Telemetry resource exists PASS: Telemetry resource confimed ==> Verifying Telemetry spec has accessLogging Access log provider: envoy PASS: access logging configured with envoy provider ==> Querying istio-proxy stats endpoint for metrics Probing proxy stats on pod sample-6f8587999b-bc9pp sidecar istio-proxy NOTE: istio-proxy stats returned but no upstream_cx_active metrics found (may be initial) NOTE: istio_requests_total not yet present (no traffic generated) ==> Verifying istio-proxy can generate access logs NOTE: local request returned empty (may be normal for nginx default page) NOTE: prometheus metrics path may not be directly visible in stats endpoint PASS: istio Telemetry v2 integration verified
Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-service-mesh-istio-service-mesh-telemetry-v2-20260531-200615/artifacts/logs
service-mesh-linkerd-basic-mesh
service-mesh-linkerd-basic-mesh
UNTESTED
kind
addon:linkerdmesh:linkerdnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
service-mesh-linkerd-basic-mesh
service-mesh-linkerd-basic-mesh
UNTESTED
kind
addon:linkerdmesh:linkerdnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
service-mesh-linkerd-basic-mesh
service-mesh-linkerd-basic-mesh
UNTESTED
kind
addon:linkerdmesh:linkerdnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
service-mesh-linkerd-basic-mesh
service-mesh-linkerd-basic-mesh
UNTESTED
kind
addon:linkerdmesh:linkerdnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
service-mesh-linkerd-basic-mesh
service-mesh-linkerd-basic-mesh
UNTESTED
kind
addon:linkerdmesh:linkerdnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
service-mesh-linkerd-basic-mesh
service-mesh-linkerd-basic-mesh
UNTESTED
kind
addon:linkerdmesh:linkerdnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
service-mesh-linkerd-basic-mesh
service-mesh-linkerd-basic-mesh
UNTESTED
kind
addon:linkerdmesh:linkerdnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
service-mesh-linkerd-basic-mesh
service-mesh-linkerd-basic-mesh
UNTESTED
kind
addon:linkerdmesh:linkerdnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
service-mesh-linkerd-basic-mesh
service-mesh-linkerd-basic-mesh
PASS
kind
addon:linkerdmesh:linkerdnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
helm-status-deployed
helm status: deployed PASS: release linkerd-crds in ns/linkerd is deployed
helm-status-deployed
helm status: deployed PASS: release linkerd-control-plane in ns/linkerd is deployed
helm-status-deployed
helm status: deployed PASS: release sample in ns/sample is deployed
pods-ready
kubectl --context kind-chart-test-swarm-default -n linkerd wait --for=condition=Ready pods --timeout=10m --all pod/linkerd-destination-649b766779-zsh7h condition met pod/linkerd-identity-68fb644f96-8267h condition met pod/linkerd-proxy-injector-57f9597568-s6cks condition met PASS: pods Ready in ns/linkerd NAME READY STATUS RESTARTS AGE linkerd-destination-649b766779-zsh7h 4/4 Running 0 41s linkerd-identity-68fb644f96-8267h 2/2 Running 0 41s linkerd-proxy-injector-57f9597568-s6cks 2/2 Running 0 41s
pods-ready
kubectl --context kind-chart-test-swarm-default -n sample wait --for=condition=Ready pods --timeout=5m --all pod/sample-7dcd986bd4-nmc67 condition met pod/sample-scope-c689dc867-xb476 condition met PASS: pods Ready in ns/sample NAME READY STATUS RESTARTS AGE sample-7dcd986bd4-nmc67 1/1 Running 0 40s sample-scope-c689dc867-xb476 1/1 Running 0 40s
smoke-script
× 'linkerd-config' config map exists
configmaps "linkerd-config" is forbidden: User "system:serviceaccount:sample:default" cannot get resource "configmaps" in API group "" in the namespace "linkerd"
see https://linkerd.io/2.14/checks/#l5d-existence-linkerd-config for hints
Failed to run extensions checks: namespaces is forbidden: User "system:serviceaccount:sample:default" cannot list resource "namespaces" in API group "" at the cluster scope
==> Check exit code: 1
WARN: linkerd check did not produce expected 'Status check results' message
This may be due to the probe pod not having cluster-wide RBAC.
The sidecar injection verification above is the primary gate.
pod "ct-linkerd-check" deleted from sample namespace
==> Probing product Service from an in-mesh test pod
pod/ct-mesh-probe created
Waiting for probe pod to be ready (2m max)
pod/ct-mesh-probe condition met
Probe pod containers: linkerd-proxy ct-mesh-probe
HTTP response from in-mesh probe: 200
PASS: in-mesh pod reached product Service with HTTP 200
pod "ct-mesh-probe" deleted from sample namespace
error: timed out waiting for the condition on pods/ct-mesh-probe
PASS: linkerd basic mesh integration verifiedLogs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-service-mesh-linkerd-basic-mesh-20260531-225454-10/artifacts/logs
subchart-postgres-internal
subchart-postgres-internal
PASS
kind
subchart:postgres-internalpr-subsetnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
helm-status-deployed
helm status: deployed PASS: release sample in ns/sample is deployed
pods-ready
kubectl --context kind-chart-test-swarm-bench-15 -n sample wait --for=condition=Ready pods --timeout=4m --all pod/sample-5967fcc884-v2mm7 condition met PASS: pods Ready in ns/sample NAME READY STATUS RESTARTS AGE sample-5967fcc884-v2mm7 1/1 Running 0 2s
Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-subchart-postgres-internal-20260530-104951/artifacts/logs
with-cert-manager
with-cert-manager
UNTESTED
kind
addon:cert-managerpr-subsetnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
with-cert-manager
with-cert-manager
UNTESTED
kind
addon:cert-managerpr-subsetnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
with-cert-manager
with-cert-manager
UNTESTED
kind
addon:cert-managerpr-subsetnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
⚠ no agent reported on this scenario — UNTESTED
with-cert-manager
with-cert-manager
PASS
kind
addon:cert-managerpr-subsetnightly---
id: c3bad-path
name: "Bad path scenario"
description: "Validates pre-boot error on missing fixture path"
labels: {test: bad-path}
cluster:
provider: kind
k8s_version: v1.30.0
preinstall:
- kind: raw_manifest
path: ./fixtures/does-not-exist.yaml
product:
chart: ./chart
release: sample
namespace: sample
asserts:
- {type: pods-ready, namespace: sample}
tags: [test]
mechanisms: ['addon:none']
helm_values:
{replicaCount: 1, image: {repository: nginx, tag: "1.27-alpine"}, service: {type: ClusterIP, port: 80}}
raw_manifest_refs:
[]
helm-status-deployed
helm status: deployed PASS: release sample in ns/sample is deployed
pods-ready
kubectl --context kind-chart-test-swarm-bench-16 -n sample wait --for=condition=Ready pods --timeout=5m --all pod/sample-5967fcc884-jg4pc condition met PASS: pods Ready in ns/sample NAME READY STATUS RESTARTS AGE sample-5967fcc884-jg4pc 1/1 Running 0 3s
Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-with-cert-manager-20260530-105022-4/artifacts/logs