chart-test-swarm — run-20260531-230537

Time (UTC)
2026-05-31T23:05:38Z
Project
—
Chart
sample-product-chart:0.1.0
Suite
all
Cluster
kind · k8s 1.30.0
K8s Server
unknown
Agents
1
UNTESTED · 158 FAIL · 4 INTERRUPTED · 3 PASS · 44

Mechanism coverage

Worst status across all scenarios that exercise each mechanism. Covers: addons (cert-manager, istio, gatekeeper, …), subchart variants, customer profiles.

addon

subchart

mesh

customer

other

Scenarios

One row per scenario. Cell value: passed / total asserts. Groups with 3+ variants per integration are collapsed — click the header to expand.

Scenario Cluster shape Tags Asserts Status Agent
customer-b-gatekeeper
customer-b-gatekeeper
kind nightlycustomer-replica 2/2 PASS 0
subchart-postgres-internal
subchart-postgres-internal
kind pr-subsetnightly 2/2 PASS 0
UNTESTED 37 variants: 31 UNTESTED / 1 INTERRUPTED / 5 PASS addon/cert-manager
Scenario Cluster shape Tags Asserts Status Agent
certificates-cert-manager-jks-pkcs12
certificates-cert-manager-jks-pkcs12
kind nightly 0/0 UNTESTED —
certificates-cert-manager-jks-pkcs12
certificates-cert-manager-jks-pkcs12
kind nightly 0/0 UNTESTED —
certificates-cert-manager-jks-pkcs12
certificates-cert-manager-jks-pkcs12
kind nightly 0/0 UNTESTED —
certificates-cert-manager-jks-pkcs12
certificates-cert-manager-jks-pkcs12
kind nightly 0/0 UNTESTED —
certificates-cert-manager-jks-pkcs12
certificates-cert-manager-jks-pkcs12
kind nightly 0/0 UNTESTED —
certificates-cert-manager-jks-pkcs12
certificates-cert-manager-jks-pkcs12
kind nightly 0/0 UNTESTED —
certificates-cert-manager-jks-pkcs12
certificates-cert-manager-jks-pkcs12
kind nightly 0/0 UNTESTED —
certificates-cert-manager-jks-pkcs12
certificates-cert-manager-jks-pkcs12
kind nightly 0/0 UNTESTED —
certificates-cert-manager-jks-pkcs12
certificates-cert-manager-jks-pkcs12
kind nightly 0/0 UNTESTED —
certificates-cert-manager-jks-pkcs12
certificates-cert-manager-jks-pkcs12
kind nightly 0/0 INTERRUPTED 0
certificates-cert-manager-lets-encrypt-staging
certificates-cert-manager-lets-encrypt-staging
kind nightly 0/0 UNTESTED —
certificates-cert-manager-lets-encrypt-staging
certificates-cert-manager-lets-encrypt-staging
kind nightly 0/0 UNTESTED —
certificates-cert-manager-lets-encrypt-staging
certificates-cert-manager-lets-encrypt-staging
kind nightly 0/0 UNTESTED —
certificates-cert-manager-lets-encrypt-staging
certificates-cert-manager-lets-encrypt-staging
kind nightly 0/0 UNTESTED —
certificates-cert-manager-lets-encrypt-staging
certificates-cert-manager-lets-encrypt-staging
kind nightly 0/0 UNTESTED —
certificates-cert-manager-lets-encrypt-staging
certificates-cert-manager-lets-encrypt-staging
kind nightly 3/3 PASS 0
certificates-cert-manager-self-signed-ca
certificates-cert-manager-self-signed-ca
kind nightly 0/0 UNTESTED —
certificates-cert-manager-self-signed-ca
certificates-cert-manager-self-signed-ca
kind nightly 0/0 UNTESTED —
certificates-cert-manager-self-signed-ca
certificates-cert-manager-self-signed-ca
kind nightly 0/0 UNTESTED —
certificates-cert-manager-self-signed-ca
certificates-cert-manager-self-signed-ca
kind nightly 0/0 UNTESTED —
certificates-cert-manager-self-signed-ca
certificates-cert-manager-self-signed-ca
kind nightly 0/0 UNTESTED —
certificates-cert-manager-self-signed-ca
certificates-cert-manager-self-signed-ca
kind nightly 0/0 UNTESTED —
certificates-cert-manager-self-signed-ca
certificates-cert-manager-self-signed-ca
kind nightly 0/0 UNTESTED —
certificates-cert-manager-self-signed-ca
certificates-cert-manager-self-signed-ca
kind nightly 0/0 UNTESTED —
certificates-cert-manager-self-signed-ca
certificates-cert-manager-self-signed-ca
kind nightly 3/3 PASS 0
certificates-cert-manager-wildcard
certificates-cert-manager-wildcard
kind nightly 0/0 UNTESTED —
certificates-cert-manager-wildcard
certificates-cert-manager-wildcard
kind nightly 0/0 UNTESTED —
certificates-cert-manager-wildcard
certificates-cert-manager-wildcard
kind nightly 0/0 UNTESTED —
certificates-cert-manager-wildcard
certificates-cert-manager-wildcard
kind nightly 0/0 UNTESTED —
certificates-cert-manager-wildcard
certificates-cert-manager-wildcard
kind nightly 3/3 PASS 0
ingress-controllers-nginx-ingress-tls-cert-manager
ingress-controllers-nginx-ingress-tls-cert-manager
kind nightly 0/0 UNTESTED —
ingress-controllers-nginx-ingress-tls-cert-manager
ingress-controllers-nginx-ingress-tls-cert-manager
kind nightly 0/0 UNTESTED —
ingress-controllers-nginx-ingress-tls-cert-manager
ingress-controllers-nginx-ingress-tls-cert-manager
kind nightly 5/5 PASS 0
with-cert-manager
with-cert-manager
kind pr-subsetnightly 0/0 UNTESTED —
with-cert-manager
with-cert-manager
kind pr-subsetnightly 0/0 UNTESTED —
with-cert-manager
with-cert-manager
kind pr-subsetnightly 0/0 UNTESTED —
with-cert-manager
with-cert-manager
kind pr-subsetnightly 2/2 PASS 0
FAIL 18 variants: 1 FAIL / 12 UNTESTED / 5 PASS addon/contour
Scenario Cluster shape Tags Asserts Status Agent
gateway-api-contour-gateway-api-basic
gateway-api-contour-gateway-api-basic
kind nightly 0/0 UNTESTED —
gateway-api-contour-gateway-api-basic
gateway-api-contour-gateway-api-basic
kind nightly 0/0 UNTESTED —
gateway-api-contour-gateway-api-basic
gateway-api-contour-gateway-api-basic
kind nightly 4/4 PASS 0
gateway-api-contour-gateway-api-response-header-modifier
gateway-api-contour-gateway-api-response-header-modifier
kind nightly 0/0 UNTESTED —
gateway-api-contour-gateway-api-response-header-modifier
gateway-api-contour-gateway-api-response-header-modifier
kind nightly 4/4 PASS 0
gateway-api-contour-gateway-api-route-precedence
gateway-api-contour-gateway-api-route-precedence
kind nightly 0/0 UNTESTED —
gateway-api-contour-gateway-api-route-precedence
gateway-api-contour-gateway-api-route-precedence
kind nightly 0/0 UNTESTED —
gateway-api-contour-gateway-api-route-precedence
gateway-api-contour-gateway-api-route-precedence
kind nightly 4/4 PASS 0
ingress-controllers-contour-basic-httpproxy
ingress-controllers-contour-basic-httpproxy
kind nightly 0/0 UNTESTED —
ingress-controllers-contour-basic-httpproxy
ingress-controllers-contour-basic-httpproxy
kind nightly 0/0 UNTESTED —
ingress-controllers-contour-basic-httpproxy
ingress-controllers-contour-basic-httpproxy
kind nightly 0/0 UNTESTED —
ingress-controllers-contour-basic-httpproxy
ingress-controllers-contour-basic-httpproxy
kind nightly 4/4 PASS 0
ingress-controllers-contour-rate-limit
ingress-controllers-contour-rate-limit
kind nightly 3/4 FAIL 0
ingress-controllers-contour-tls-delegation
ingress-controllers-contour-tls-delegation
kind nightly 0/0 UNTESTED —
ingress-controllers-contour-tls-delegation
ingress-controllers-contour-tls-delegation
kind nightly 0/0 UNTESTED —
ingress-controllers-contour-tls-delegation
ingress-controllers-contour-tls-delegation
kind nightly 0/0 UNTESTED —
ingress-controllers-contour-tls-delegation
ingress-controllers-contour-tls-delegation
kind nightly 0/0 UNTESTED —
ingress-controllers-contour-tls-delegation
ingress-controllers-contour-tls-delegation
kind nightly 4/4 PASS 0
UNTESTED 25 variants: 20 UNTESTED / 5 PASS addon/envoy-gateway
Scenario Cluster shape Tags Asserts Status Agent
envoy-gateway
envoy-gateway
kind nightly 0/0 UNTESTED —
envoy-gateway
envoy-gateway
kind nightly 0/0 UNTESTED —
envoy-gateway
envoy-gateway
kind nightly 0/0 UNTESTED —
envoy-gateway
envoy-gateway
kind nightly 0/0 UNTESTED —
envoy-gateway
envoy-gateway
kind nightly 4/4 PASS 0
gateway-api-envoy-gateway-cert-manager-tls
gateway-api-envoy-gateway-cert-manager-tls
kind nightly 0/0 UNTESTED —
gateway-api-envoy-gateway-cert-manager-tls
gateway-api-envoy-gateway-cert-manager-tls
kind nightly 7/7 PASS 0
gateway-api-envoy-gateway-grpcroute
gateway-api-envoy-gateway-grpcroute
kind nightly 0/0 UNTESTED —
gateway-api-envoy-gateway-grpcroute
gateway-api-envoy-gateway-grpcroute
kind nightly 0/0 UNTESTED —
gateway-api-envoy-gateway-grpcroute
gateway-api-envoy-gateway-grpcroute
kind nightly 0/0 UNTESTED —
gateway-api-envoy-gateway-grpcroute
gateway-api-envoy-gateway-grpcroute
kind nightly 0/0 UNTESTED —
gateway-api-envoy-gateway-grpcroute
gateway-api-envoy-gateway-grpcroute
kind nightly 5/5 PASS 0
gateway-api-envoy-gateway-httproute
gateway-api-envoy-gateway-httproute
kind nightly 0/0 UNTESTED —
gateway-api-envoy-gateway-httproute
gateway-api-envoy-gateway-httproute
kind nightly 0/0 UNTESTED —
gateway-api-envoy-gateway-httproute
gateway-api-envoy-gateway-httproute
kind nightly 0/0 UNTESTED —
gateway-api-envoy-gateway-httproute
gateway-api-envoy-gateway-httproute
kind nightly 0/0 UNTESTED —
gateway-api-envoy-gateway-httproute
gateway-api-envoy-gateway-httproute
kind nightly 0/0 UNTESTED —
gateway-api-envoy-gateway-httproute
gateway-api-envoy-gateway-httproute
kind nightly 0/0 UNTESTED —
gateway-api-envoy-gateway-httproute
gateway-api-envoy-gateway-httproute
kind nightly 0/0 UNTESTED —
gateway-api-envoy-gateway-httproute
gateway-api-envoy-gateway-httproute
kind nightly 0/0 UNTESTED —
gateway-api-envoy-gateway-httproute
gateway-api-envoy-gateway-httproute
kind nightly 5/5 PASS 0
gateway-api-envoy-gateway-security-policy-attach
gateway-api-envoy-gateway-security-policy-attach
kind nightly 0/0 UNTESTED —
gateway-api-envoy-gateway-security-policy-attach
gateway-api-envoy-gateway-security-policy-attach
kind nightly 0/0 UNTESTED —
gateway-api-envoy-gateway-security-policy-attach
gateway-api-envoy-gateway-security-policy-attach
kind nightly 0/0 UNTESTED —
gateway-api-envoy-gateway-security-policy-attach
gateway-api-envoy-gateway-security-policy-attach
kind nightly 5/5 PASS 0
FAIL 41 variants: 1 FAIL / 28 UNTESTED / 12 PASS addon/istio
Scenario Cluster shape Tags Asserts Status Agent
customer-a-istio
customer-a-istio
kind nightlycustomer-replica 0/0 UNTESTED —
customer-a-istio
customer-a-istio
kind nightlycustomer-replica 0/0 UNTESTED —
customer-a-istio
customer-a-istio
kind nightlycustomer-replica 2/2 PASS 0
gateway-api-istio-gateway-api-backend-tls-policy
gateway-api-istio-gateway-api-backend-tls-policy
kind nightly 0/0 UNTESTED —
gateway-api-istio-gateway-api-backend-tls-policy
gateway-api-istio-gateway-api-backend-tls-policy
kind nightly 0/0 UNTESTED —
gateway-api-istio-gateway-api-backend-tls-policy
gateway-api-istio-gateway-api-backend-tls-policy
kind nightly 0/0 UNTESTED —
gateway-api-istio-gateway-api-backend-tls-policy
gateway-api-istio-gateway-api-backend-tls-policy
kind nightly 0/0 UNTESTED —
gateway-api-istio-gateway-api-backend-tls-policy
gateway-api-istio-gateway-api-backend-tls-policy
kind nightly 0/0 UNTESTED —
gateway-api-istio-gateway-api-backend-tls-policy
gateway-api-istio-gateway-api-backend-tls-policy
kind nightly 0/0 UNTESTED —
gateway-api-istio-gateway-api-backend-tls-policy
gateway-api-istio-gateway-api-backend-tls-policy
kind nightly 0/0 UNTESTED —
gateway-api-istio-gateway-api-backend-tls-policy
gateway-api-istio-gateway-api-backend-tls-policy
kind nightly 0/0 UNTESTED —
gateway-api-istio-gateway-api-backend-tls-policy
gateway-api-istio-gateway-api-backend-tls-policy
kind nightly 0/0 UNTESTED —
gateway-api-istio-gateway-api-backend-tls-policy
gateway-api-istio-gateway-api-backend-tls-policy
kind nightly 0/0 UNTESTED —
gateway-api-istio-gateway-api-backend-tls-policy
gateway-api-istio-gateway-api-backend-tls-policy
kind nightly 7/7 PASS 0
gateway-api-istio-gateway-api-basic
gateway-api-istio-gateway-api-basic
kind nightly 0/0 UNTESTED —
gateway-api-istio-gateway-api-basic
gateway-api-istio-gateway-api-basic
kind nightly 0/0 UNTESTED —
gateway-api-istio-gateway-api-basic
gateway-api-istio-gateway-api-basic
kind nightly 0/0 UNTESTED —
gateway-api-istio-gateway-api-basic
gateway-api-istio-gateway-api-basic
kind nightly 6/6 PASS 0
gateway-api-istio-gateway-api-multi-listener
gateway-api-istio-gateway-api-multi-listener
kind nightly 0/0 UNTESTED —
gateway-api-istio-gateway-api-multi-listener
gateway-api-istio-gateway-api-multi-listener
kind nightly 0/0 UNTESTED —
gateway-api-istio-gateway-api-multi-listener
gateway-api-istio-gateway-api-multi-listener
kind nightly 0/0 UNTESTED —
gateway-api-istio-gateway-api-multi-listener
gateway-api-istio-gateway-api-multi-listener
kind nightly 6/6 PASS 0
service-mesh-istio-ingress-gateway-basic
service-mesh-istio-ingress-gateway-basic
kind nightly 0/0 UNTESTED —
service-mesh-istio-ingress-gateway-basic
service-mesh-istio-ingress-gateway-basic
kind nightly 0/0 UNTESTED —
service-mesh-istio-ingress-gateway-basic
service-mesh-istio-ingress-gateway-basic
kind nightly 8/8 PASS 0
service-mesh-istio-ingress-gateway-jwt
service-mesh-istio-ingress-gateway-jwt
kind nightly 0/0 UNTESTED —
service-mesh-istio-ingress-gateway-jwt
service-mesh-istio-ingress-gateway-jwt
kind nightly 0/0 UNTESTED —
service-mesh-istio-ingress-gateway-jwt
service-mesh-istio-ingress-gateway-jwt
kind nightly 8/8 PASS 0
service-mesh-istio-ingress-gateway-multi-host
service-mesh-istio-ingress-gateway-multi-host
kind nightly 0/0 UNTESTED —
service-mesh-istio-ingress-gateway-multi-host
service-mesh-istio-ingress-gateway-multi-host
kind nightly 8/8 PASS 0
service-mesh-istio-ingress-gateway-request-authentication
service-mesh-istio-ingress-gateway-request-authentication
kind nightly 0/0 UNTESTED —
service-mesh-istio-ingress-gateway-request-authentication
service-mesh-istio-ingress-gateway-request-authentication
kind nightly 8/8 PASS 0
service-mesh-istio-service-mesh-cert-manager-tls
service-mesh-istio-service-mesh-cert-manager-tls
kind nightly 0/0 UNTESTED —
service-mesh-istio-service-mesh-cert-manager-tls
service-mesh-istio-service-mesh-cert-manager-tls
kind nightly 9/9 PASS 0
service-mesh-istio-service-mesh-peer-authentication
service-mesh-istio-service-mesh-peer-authentication
kind nightly 6/6 PASS 0
service-mesh-istio-service-mesh-sidecar-injection
service-mesh-istio-service-mesh-sidecar-injection
kind nightly 0/0 UNTESTED —
service-mesh-istio-service-mesh-sidecar-injection
service-mesh-istio-service-mesh-sidecar-injection
kind nightly 0/0 UNTESTED —
service-mesh-istio-service-mesh-sidecar-injection
service-mesh-istio-service-mesh-sidecar-injection
kind nightly 5/6 FAIL 0
service-mesh-istio-service-mesh-strict-mtls
service-mesh-istio-service-mesh-strict-mtls
kind nightly 0/0 UNTESTED —
service-mesh-istio-service-mesh-strict-mtls
service-mesh-istio-service-mesh-strict-mtls
kind nightly 6/6 PASS 0
service-mesh-istio-service-mesh-telemetry-v2
service-mesh-istio-service-mesh-telemetry-v2
kind nightly 6/6 PASS 0
UNTESTED 9 variants: 8 UNTESTED / 1 PASS addon/linkerd
Scenario Cluster shape Tags Asserts Status Agent
service-mesh-linkerd-basic-mesh
service-mesh-linkerd-basic-mesh
kind nightly 0/0 UNTESTED —
service-mesh-linkerd-basic-mesh
service-mesh-linkerd-basic-mesh
kind nightly 0/0 UNTESTED —
service-mesh-linkerd-basic-mesh
service-mesh-linkerd-basic-mesh
kind nightly 0/0 UNTESTED —
service-mesh-linkerd-basic-mesh
service-mesh-linkerd-basic-mesh
kind nightly 0/0 UNTESTED —
service-mesh-linkerd-basic-mesh
service-mesh-linkerd-basic-mesh
kind nightly 0/0 UNTESTED —
service-mesh-linkerd-basic-mesh
service-mesh-linkerd-basic-mesh
kind nightly 0/0 UNTESTED —
service-mesh-linkerd-basic-mesh
service-mesh-linkerd-basic-mesh
kind nightly 0/0 UNTESTED —
service-mesh-linkerd-basic-mesh
service-mesh-linkerd-basic-mesh
kind nightly 0/0 UNTESTED —
service-mesh-linkerd-basic-mesh
service-mesh-linkerd-basic-mesh
kind nightly 6/6 PASS 0
UNTESTED 11 variants: 8 UNTESTED / 3 PASS addon/manual-tls-secret
Scenario Cluster shape Tags Asserts Status Agent
certificates-manual-tls-secret-basic
certificates-manual-tls-secret-basic
kind nightly 0/0 UNTESTED —
certificates-manual-tls-secret-basic
certificates-manual-tls-secret-basic
kind nightly 0/0 UNTESTED —
certificates-manual-tls-secret-basic
certificates-manual-tls-secret-basic
kind nightly 0/0 UNTESTED —
certificates-manual-tls-secret-basic
certificates-manual-tls-secret-basic
kind nightly 3/3 PASS 0
certificates-manual-tls-secret-ecdsa
certificates-manual-tls-secret-ecdsa
kind nightly 0/0 UNTESTED —
certificates-manual-tls-secret-ecdsa
certificates-manual-tls-secret-ecdsa
kind nightly 0/0 UNTESTED —
certificates-manual-tls-secret-ecdsa
certificates-manual-tls-secret-ecdsa
kind nightly 0/0 UNTESTED —
certificates-manual-tls-secret-ecdsa
certificates-manual-tls-secret-ecdsa
kind nightly 3/3 PASS 0
certificates-manual-tls-secret-multiple-sans
certificates-manual-tls-secret-multiple-sans
kind nightly 0/0 UNTESTED —
certificates-manual-tls-secret-multiple-sans
certificates-manual-tls-secret-multiple-sans
kind nightly 0/0 UNTESTED —
certificates-manual-tls-secret-multiple-sans
certificates-manual-tls-secret-multiple-sans
kind nightly 3/3 PASS 0
UNTESTED 18 variants: 15 UNTESTED / 3 PASS addon/mounted-tls-certs
Scenario Cluster shape Tags Asserts Status Agent
certificates-mounted-tls-certs-csi-secret-store
certificates-mounted-tls-certs-csi-secret-store
kind nightly 0/0 UNTESTED —
certificates-mounted-tls-certs-csi-secret-store
certificates-mounted-tls-certs-csi-secret-store
kind nightly 0/0 UNTESTED —
certificates-mounted-tls-certs-csi-secret-store
certificates-mounted-tls-certs-csi-secret-store
kind nightly 0/0 UNTESTED —
certificates-mounted-tls-certs-csi-secret-store
certificates-mounted-tls-certs-csi-secret-store
kind nightly 0/0 UNTESTED —
certificates-mounted-tls-certs-csi-secret-store
certificates-mounted-tls-certs-csi-secret-store
kind nightly 0/0 UNTESTED —
certificates-mounted-tls-certs-csi-secret-store
certificates-mounted-tls-certs-csi-secret-store
kind nightly 0/0 UNTESTED —
certificates-mounted-tls-certs-csi-secret-store
certificates-mounted-tls-certs-csi-secret-store
kind nightly 0/0 UNTESTED —
certificates-mounted-tls-certs-csi-secret-store
certificates-mounted-tls-certs-csi-secret-store
kind nightly 3/3 PASS 0
certificates-mounted-tls-certs-projected-volume
certificates-mounted-tls-certs-projected-volume
kind nightly 0/0 UNTESTED —
certificates-mounted-tls-certs-projected-volume
certificates-mounted-tls-certs-projected-volume
kind nightly 0/0 UNTESTED —
certificates-mounted-tls-certs-projected-volume
certificates-mounted-tls-certs-projected-volume
kind nightly 0/0 UNTESTED —
certificates-mounted-tls-certs-projected-volume
certificates-mounted-tls-certs-projected-volume
kind nightly 3/3 PASS 0
certificates-mounted-tls-certs-pvc-mount
certificates-mounted-tls-certs-pvc-mount
kind nightly 0/0 UNTESTED —
certificates-mounted-tls-certs-pvc-mount
certificates-mounted-tls-certs-pvc-mount
kind nightly 0/0 UNTESTED —
certificates-mounted-tls-certs-pvc-mount
certificates-mounted-tls-certs-pvc-mount
kind nightly 0/0 UNTESTED —
certificates-mounted-tls-certs-pvc-mount
certificates-mounted-tls-certs-pvc-mount
kind nightly 0/0 UNTESTED —
certificates-mounted-tls-certs-pvc-mount
certificates-mounted-tls-certs-pvc-mount
kind nightly 0/0 UNTESTED —
certificates-mounted-tls-certs-pvc-mount
certificates-mounted-tls-certs-pvc-mount
kind nightly 3/3 PASS 0
UNTESTED 13 variants: 9 UNTESTED / 4 PASS addon/nginx-ingress
Scenario Cluster shape Tags Asserts Status Agent
ingress-controllers-nginx-ingress-basic
ingress-controllers-nginx-ingress-basic
kind nightly 0/0 UNTESTED —
ingress-controllers-nginx-ingress-basic
ingress-controllers-nginx-ingress-basic
kind nightly 4/4 PASS 0
ingress-controllers-nginx-ingress-canary
ingress-controllers-nginx-ingress-canary
kind nightly 0/0 UNTESTED —
ingress-controllers-nginx-ingress-canary
ingress-controllers-nginx-ingress-canary
kind nightly 4/4 PASS 0
ingress-controllers-nginx-ingress-default-backend
ingress-controllers-nginx-ingress-default-backend
kind nightly 0/0 UNTESTED —
ingress-controllers-nginx-ingress-default-backend
ingress-controllers-nginx-ingress-default-backend
kind nightly 0/0 UNTESTED —
ingress-controllers-nginx-ingress-default-backend
ingress-controllers-nginx-ingress-default-backend
kind nightly 0/0 UNTESTED —
ingress-controllers-nginx-ingress-default-backend
ingress-controllers-nginx-ingress-default-backend
kind nightly 0/0 UNTESTED —
ingress-controllers-nginx-ingress-default-backend
ingress-controllers-nginx-ingress-default-backend
kind nightly 0/0 UNTESTED —
ingress-controllers-nginx-ingress-default-backend
ingress-controllers-nginx-ingress-default-backend
kind nightly 0/0 UNTESTED —
ingress-controllers-nginx-ingress-default-backend
ingress-controllers-nginx-ingress-default-backend
kind nightly 4/4 PASS 0
ingress-controllers-nginx-ingress-snippet-annotations
ingress-controllers-nginx-ingress-snippet-annotations
kind nightly 0/0 UNTESTED —
ingress-controllers-nginx-ingress-snippet-annotations
ingress-controllers-nginx-ingress-snippet-annotations
kind nightly 4/4 PASS 0
FAIL 15 variants: 2 FAIL / 11 UNTESTED / 2 INTERRUPTED addon/none
Scenario Cluster shape Tags Asserts Status Agent
c3bad-path
c3bad-path
kind test 0/0 UNTESTED 0
c3fail-deliberate
c3fail-deliberate
kind test 0/1 FAIL 0
c3sig-slow
c3sig-slow
kind test 0/0 FAIL 0
c3sig-slow2
c3sig-slow2
kind test 0/0 UNTESTED —
c3sig-slow2
c3sig-slow2
kind test 0/0 INTERRUPTED 0
minimal
minimal
kind pr-subsetnightly 0/0 UNTESTED —
minimal
minimal
kind pr-subsetnightly 0/0 UNTESTED —
minimal
minimal
kind pr-subsetnightly 0/0 UNTESTED —
minimal
minimal
kind pr-subsetnightly 0/0 UNTESTED —
minimal
minimal
kind pr-subsetnightly 0/0 UNTESTED —
minimal
minimal
kind pr-subsetnightly 0/0 UNTESTED —
minimal
minimal
kind pr-subsetnightly 0/0 UNTESTED —
minimal
minimal
kind pr-subsetnightly 0/0 UNTESTED —
minimal
minimal
kind pr-subsetnightly 0/0 UNTESTED —
minimal
minimal
kind pr-subsetnightly 0/0 INTERRUPTED 0
UNTESTED 20 variants: 16 UNTESTED / 4 PASS addon/traefik
Scenario Cluster shape Tags Asserts Status Agent
ingress-controllers-traefik-basic
ingress-controllers-traefik-basic
kind nightly 0/0 UNTESTED —
ingress-controllers-traefik-basic
ingress-controllers-traefik-basic
kind nightly 0/0 UNTESTED —
ingress-controllers-traefik-basic
ingress-controllers-traefik-basic
kind nightly 0/0 UNTESTED —
ingress-controllers-traefik-basic
ingress-controllers-traefik-basic
kind nightly 0/0 UNTESTED —
ingress-controllers-traefik-basic
ingress-controllers-traefik-basic
kind nightly 0/0 UNTESTED —
ingress-controllers-traefik-basic
ingress-controllers-traefik-basic
kind nightly 0/0 UNTESTED —
ingress-controllers-traefik-basic
ingress-controllers-traefik-basic
kind nightly 0/0 UNTESTED —
ingress-controllers-traefik-basic
ingress-controllers-traefik-basic
kind nightly 0/0 UNTESTED —
ingress-controllers-traefik-basic
ingress-controllers-traefik-basic
kind nightly 4/4 PASS 0
ingress-controllers-traefik-ingressroute-crd
ingress-controllers-traefik-ingressroute-crd
kind nightly 0/0 UNTESTED —
ingress-controllers-traefik-ingressroute-crd
ingress-controllers-traefik-ingressroute-crd
kind nightly 4/4 PASS 0
ingress-controllers-traefik-middleware-chain
ingress-controllers-traefik-middleware-chain
kind nightly 0/0 UNTESTED —
ingress-controllers-traefik-middleware-chain
ingress-controllers-traefik-middleware-chain
kind nightly 0/0 UNTESTED —
ingress-controllers-traefik-middleware-chain
ingress-controllers-traefik-middleware-chain
kind nightly 4/4 PASS 0
ingress-controllers-traefik-tls-passthrough
ingress-controllers-traefik-tls-passthrough
kind nightly 0/0 UNTESTED —
ingress-controllers-traefik-tls-passthrough
ingress-controllers-traefik-tls-passthrough
kind nightly 0/0 UNTESTED —
ingress-controllers-traefik-tls-passthrough
ingress-controllers-traefik-tls-passthrough
kind nightly 0/0 UNTESTED —
ingress-controllers-traefik-tls-passthrough
ingress-controllers-traefik-tls-passthrough
kind nightly 0/0 UNTESTED —
ingress-controllers-traefik-tls-passthrough
ingress-controllers-traefik-tls-passthrough
kind nightly 0/0 UNTESTED —
ingress-controllers-traefik-tls-passthrough
ingress-controllers-traefik-tls-passthrough
kind nightly 4/4 PASS 0

Scenarios — details

c3bad-path c3bad-path UNTESTED
Cluster
kind
Mechanisms
addon:none
Tags
test

⚠ no agent reported on this scenario — UNTESTED

c3fail-deliberate c3fail-deliberate FAIL
Cluster
kind
Mechanisms
addon:none
Tags
test
Error
error 82 B · 2 ln
helm-status-deployed:
jq: parse error: Invalid numeric literal at line 1, column 6
Log
examples/sample-product-chart/chart-test/reports/scenario-c3fail-deliberate-20260529-145822/artifacts/logs
Assertions · agent 0
  • FAIL helm-status-deployed
    notes
    jq: parse error: Invalid numeric literal at line 1, column 6

Logs: examples/sample-product-chart/chart-test/reports/scenario-c3fail-deliberate-20260529-145822/artifacts/logs

c3sig-slow c3sig-slow FAIL
Cluster
kind
Mechanisms
addon:none
Tags
test
Error
error 118 B · 1 ln
see examples/sample-product-chart/chart-test/reports/scenario-c3sig-slow-20260529-150454/artifacts/logs/cluster-up.log

⚠ no agent reported on this scenario — UNTESTED

c3sig-slow2 c3sig-slow2 UNTESTED
Cluster
kind
Mechanisms
addon:none
Tags
test

⚠ no agent reported on this scenario — UNTESTED

c3sig-slow2 c3sig-slow2 INTERRUPTED
Cluster
kind
Mechanisms
addon:none
Tags
test

⚠ no agent reported on this scenario — UNTESTED

certificates-cert-manager-jks-pkcs12 certificates-cert-manager-jks-pkcs12 UNTESTED
Cluster
kind
Mechanisms
addon:cert-manager
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

certificates-cert-manager-jks-pkcs12 certificates-cert-manager-jks-pkcs12 UNTESTED
Cluster
kind
Mechanisms
addon:cert-manager
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

certificates-cert-manager-jks-pkcs12 certificates-cert-manager-jks-pkcs12 UNTESTED
Cluster
kind
Mechanisms
addon:cert-manager
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

certificates-cert-manager-jks-pkcs12 certificates-cert-manager-jks-pkcs12 UNTESTED
Cluster
kind
Mechanisms
addon:cert-manager
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

certificates-cert-manager-jks-pkcs12 certificates-cert-manager-jks-pkcs12 UNTESTED
Cluster
kind
Mechanisms
addon:cert-manager
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

certificates-cert-manager-jks-pkcs12 certificates-cert-manager-jks-pkcs12 UNTESTED
Cluster
kind
Mechanisms
addon:cert-manager
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

certificates-cert-manager-jks-pkcs12 certificates-cert-manager-jks-pkcs12 UNTESTED
Cluster
kind
Mechanisms
addon:cert-manager
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

certificates-cert-manager-jks-pkcs12 certificates-cert-manager-jks-pkcs12 UNTESTED
Cluster
kind
Mechanisms
addon:cert-manager
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

certificates-cert-manager-jks-pkcs12 certificates-cert-manager-jks-pkcs12 UNTESTED
Cluster
kind
Mechanisms
addon:cert-manager
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

certificates-cert-manager-jks-pkcs12 certificates-cert-manager-jks-pkcs12 INTERRUPTED
Cluster
kind
Mechanisms
addon:cert-manager
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

certificates-cert-manager-lets-encrypt-staging certificates-cert-manager-lets-encrypt-staging UNTESTED
Cluster
kind
Mechanisms
addon:cert-manager
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

certificates-cert-manager-lets-encrypt-staging certificates-cert-manager-lets-encrypt-staging UNTESTED
Cluster
kind
Mechanisms
addon:cert-manager
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

certificates-cert-manager-lets-encrypt-staging certificates-cert-manager-lets-encrypt-staging UNTESTED
Cluster
kind
Mechanisms
addon:cert-manager
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

certificates-cert-manager-lets-encrypt-staging certificates-cert-manager-lets-encrypt-staging UNTESTED
Cluster
kind
Mechanisms
addon:cert-manager
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

certificates-cert-manager-lets-encrypt-staging certificates-cert-manager-lets-encrypt-staging UNTESTED
Cluster
kind
Mechanisms
addon:cert-manager
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

certificates-cert-manager-lets-encrypt-staging certificates-cert-manager-lets-encrypt-staging PASS
Cluster
kind
Mechanisms
addon:cert-manager
Tags
nightly
Assertions · agent 0
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release sample in ns/sample is deployed
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-bench-2 -n sample wait --for=condition=Ready pods --timeout=5m --all
    pod/sample-5db589c76f-7qn6m condition met
    PASS: pods Ready in ns/sample
    NAME                      READY   STATUS    RESTARTS   AGE
    sample-5db589c76f-7qn6m   1/1     Running   0          4s
  • PASS smoke-script
    notes
    exec: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/assertions/cert-manager-letsencrypt-staging.sh (RELEASE=sample NAMESPACE=sample)
    ==> Verifying Let's Encrypt staging ClusterIssuer status
    INFO: LE staging ClusterIssuer not Ready (reason: ErrRegisterACMEAccount)
    INFO: ACME registration may require network access to Let's Encrypt staging endpoint
    PASS: LE staging ClusterIssuer exists (ACME challenge stubbed for offline compatibility)
    ==> Verifying self-signed ClusterIssuer is Ready
    clusterissuer.cert-manager.io/chart-test-swarm-selfsigned condition met
    PASS: self-signed ClusterIssuer Ready=True
    ==> Waiting for Certificate 'sample-tls' Ready (3m max)
    certificate.cert-manager.io/sample-tls condition met
    PASS: Certificate Ready=True
    ==> Verifying TLS Secret 'sample-tls' keys
    Secret keys: ca.crt
    tls.crt
    tls.key
    OK: tls.crt + tls.key present
    ==> Waiting for pod Ready (3m max)
    pod/sample-5db589c76f-7qn6m condition met
    PASS: chart pods Ready
    PASS: cert-manager Let's Encrypt staging integration verified

Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-certificates-cert-manager-lets-encrypt-staging-20260530-104019-6/artifacts/logs

certificates-cert-manager-self-signed-ca certificates-cert-manager-self-signed-ca UNTESTED
Cluster
kind
Mechanisms
addon:cert-manager
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

certificates-cert-manager-self-signed-ca certificates-cert-manager-self-signed-ca UNTESTED
Cluster
kind
Mechanisms
addon:cert-manager
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

certificates-cert-manager-self-signed-ca certificates-cert-manager-self-signed-ca UNTESTED
Cluster
kind
Mechanisms
addon:cert-manager
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

certificates-cert-manager-self-signed-ca certificates-cert-manager-self-signed-ca UNTESTED
Cluster
kind
Mechanisms
addon:cert-manager
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

certificates-cert-manager-self-signed-ca certificates-cert-manager-self-signed-ca UNTESTED
Cluster
kind
Mechanisms
addon:cert-manager
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

certificates-cert-manager-self-signed-ca certificates-cert-manager-self-signed-ca UNTESTED
Cluster
kind
Mechanisms
addon:cert-manager
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

certificates-cert-manager-self-signed-ca certificates-cert-manager-self-signed-ca UNTESTED
Cluster
kind
Mechanisms
addon:cert-manager
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

certificates-cert-manager-self-signed-ca certificates-cert-manager-self-signed-ca UNTESTED
Cluster
kind
Mechanisms
addon:cert-manager
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

certificates-cert-manager-self-signed-ca certificates-cert-manager-self-signed-ca PASS
Cluster
kind
Mechanisms
addon:cert-manager
Tags
nightly
Assertions · agent 0
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release sample in ns/sample is deployed
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-bench-3 -n sample wait --for=condition=Ready pods --timeout=5m --all
    pod/sample-5db589c76f-5bnlw condition met
    PASS: pods Ready in ns/sample
    NAME                      READY   STATUS    RESTARTS   AGE
    sample-5db589c76f-5bnlw   1/1     Running   0          4s
  • PASS smoke-script
    notes
    exec: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/assertions/cert-manager-self-signed.sh (RELEASE=sample NAMESPACE=sample)
    ==> Waiting for Certificate 'sample-tls' Ready (3m max)
    certificate.cert-manager.io/sample-tls condition met
    PASS: Certificate Ready=True
    ==> Verifying TLS Secret 'sample-tls' keys
    Secret keys: ca.crt
    tls.crt
    tls.key
    OK: tls.crt, tls.key, ca.crt all present
    ==> Waiting for pod Ready (3m max)
    pod/sample-5db589c76f-5bnlw condition met
    PASS: chart pods Ready
    ==> Verifying HTTPS reachable from in-cluster curl
    HTTPS response: 200
    PASS: HTTPS 200 with --cacert verification
    ==> Verifying peer certificate SAN
    SAN: X509v3 Subject Alternative Name: 
        DNS:sample.sample.svc, DNS:sample.sample.svc.cluster.local
    PASS: cert SAN includes configured host
    PASS: cert-manager self-signed CA integration verified

Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-certificates-cert-manager-self-signed-ca-20260530-104109-9/artifacts/logs

certificates-cert-manager-wildcard certificates-cert-manager-wildcard UNTESTED
Cluster
kind
Mechanisms
addon:cert-manager
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

certificates-cert-manager-wildcard certificates-cert-manager-wildcard UNTESTED
Cluster
kind
Mechanisms
addon:cert-manager
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

certificates-cert-manager-wildcard certificates-cert-manager-wildcard UNTESTED
Cluster
kind
Mechanisms
addon:cert-manager
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

certificates-cert-manager-wildcard certificates-cert-manager-wildcard UNTESTED
Cluster
kind
Mechanisms
addon:cert-manager
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

certificates-cert-manager-wildcard certificates-cert-manager-wildcard PASS
Cluster
kind
Mechanisms
addon:cert-manager
Tags
nightly
Assertions · agent 0
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release sample in ns/sample is deployed
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-bench-4 -n sample wait --for=condition=Ready pods --timeout=3m --all
    pod/sample-5967fcc884-lmbfh condition met
    PASS: pods Ready in ns/sample
    NAME                      READY   STATUS    RESTARTS   AGE
    sample-5967fcc884-lmbfh   1/1     Running   0          3s
  • PASS smoke-script
    notes
    exec: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/assertions/cert-manager-wildcard.sh (RELEASE=sample NAMESPACE=sample)
    ==> Waiting for Certificate 'sample-wildcard-tls' Ready (3m max)
    certificate.cert-manager.io/sample-wildcard-tls condition met
    PASS: Certificate Ready=True
    ==> Verifying TLS Secret 'sample-wildcard-tls' keys
    Secret keys: ca.crt
    tls.crt
    tls.key
    OK: tls.crt, tls.key, ca.crt all present
    ==> Verifying wildcard certificate SANs
    SAN: X509v3 Subject Alternative Name: 
        DNS:*.test.local, DNS:test.local
    PASS: cert SAN includes DNS:*.test.local and DNS:test.local
    PASS: cert-manager wildcard certificate integration verified

Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-certificates-cert-manager-wildcard-20260530-104202-5/artifacts/logs

certificates-manual-tls-secret-basic certificates-manual-tls-secret-basic UNTESTED
Cluster
kind
Mechanisms
addon:manual-tls-secret
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

certificates-manual-tls-secret-basic certificates-manual-tls-secret-basic UNTESTED
Cluster
kind
Mechanisms
addon:manual-tls-secret
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

certificates-manual-tls-secret-basic certificates-manual-tls-secret-basic UNTESTED
Cluster
kind
Mechanisms
addon:manual-tls-secret
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

certificates-manual-tls-secret-basic certificates-manual-tls-secret-basic PASS
Cluster
kind
Mechanisms
addon:manual-tls-secret
Tags
nightly
Assertions · agent 0
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release sample in ns/sample is deployed
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-bench-5 -n sample wait --for=condition=Ready pods --timeout=5m --all
    pod/sample-676fb884d-fh6jm condition met
    PASS: pods Ready in ns/sample
    NAME                     READY   STATUS    RESTARTS   AGE
    sample-676fb884d-fh6jm   1/1     Running   0          5s
  • PASS smoke-script
    notes
    ==> Verifying TLS Secret 'manual-tls-basic' type
    Secret type: kubernetes.io/tls
    PASS: Secret type is kubernetes.io/tls
    ==> Verifying TLS Secret 'manual-tls-basic' data keys
    Secret keys: tls.crt
    tls.key
    OK: tls.crt, tls.key both present
    ==> Verifying tls.crt is valid PEM
    subject=C=US, ST=CA, O=Chart Test Swarm, CN=sample.sample.svc
    PASS: tls.crt is a valid certificate
    ==> Verifying tls.key is valid PEM
    RSA key ok
    PASS: tls.key is a valid private key
    ==> Waiting for pod Ready (3m max)
    pod/sample-676fb884d-fh6jm condition met
    PASS: chart pods Ready
    ==> Verifying HTTPS reachable from in-cluster curl
    HTTPS response: 200
    PASS: HTTPS 200
    PASS: manual-tls-secret basic scenario verified

Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-certificates-manual-tls-secret-basic-20260530-104250-4/artifacts/logs

certificates-manual-tls-secret-ecdsa certificates-manual-tls-secret-ecdsa UNTESTED
Cluster
kind
Mechanisms
addon:manual-tls-secret
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

certificates-manual-tls-secret-ecdsa certificates-manual-tls-secret-ecdsa UNTESTED
Cluster
kind
Mechanisms
addon:manual-tls-secret
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

certificates-manual-tls-secret-ecdsa certificates-manual-tls-secret-ecdsa UNTESTED
Cluster
kind
Mechanisms
addon:manual-tls-secret
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

certificates-manual-tls-secret-ecdsa certificates-manual-tls-secret-ecdsa PASS
Cluster
kind
Mechanisms
addon:manual-tls-secret
Tags
nightly
Assertions · agent 0
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release sample in ns/sample is deployed
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-bench-6 -n sample wait --for=condition=Ready pods --timeout=5m --all
    pod/sample-5b447d9b74-zbmfr condition met
    PASS: pods Ready in ns/sample
    NAME                      READY   STATUS    RESTARTS   AGE
    sample-5b447d9b74-zbmfr   1/1     Running   0          4s
  • PASS smoke-script
    notes
    exec: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/assertions/manual-tls-ecdsa.sh (RELEASE=sample NAMESPACE=sample)
    ==> Verifying TLS Secret 'manual-tls-ecdsa' exists
    PASS: Secret exists
    ==> Verifying certificate public-key algorithm is ECDSA
    Public Key Algorithm: Public Key Algorithm: id-ecPublicKey
    PASS: certificate uses ECDSA public key
    ==> Verifying ECDSA curve (P-256 or P-384)
    Curve info: ASN1 OID: prime256v1
    PASS: ECDSA curve is in {P-256, P-384}
    ==> Waiting for pod Ready (3m max)
    pod/sample-5b447d9b74-zbmfr condition met
    PASS: chart pods Ready
    ==> Verifying HTTPS reachable from in-cluster curl
    HTTPS response: 200
    PASS: HTTPS 200
    PASS: manual-tls-secret ECDSA scenario verified

Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-certificates-manual-tls-secret-ecdsa-20260530-104326-4/artifacts/logs

certificates-manual-tls-secret-multiple-sans certificates-manual-tls-secret-multiple-sans UNTESTED
Cluster
kind
Mechanisms
addon:manual-tls-secret
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

certificates-manual-tls-secret-multiple-sans certificates-manual-tls-secret-multiple-sans UNTESTED
Cluster
kind
Mechanisms
addon:manual-tls-secret
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

certificates-manual-tls-secret-multiple-sans certificates-manual-tls-secret-multiple-sans PASS
Cluster
kind
Mechanisms
addon:manual-tls-secret
Tags
nightly
Assertions · agent 0
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release sample in ns/sample is deployed
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-bench-7 -n sample wait --for=condition=Ready pods --timeout=5m --all
    pod/sample-6b84d7ddb4-v6xb4 condition met
    PASS: pods Ready in ns/sample
    NAME                      READY   STATUS    RESTARTS   AGE
    sample-6b84d7ddb4-v6xb4   1/1     Running   0          4s
  • PASS smoke-script
    notes
    exec: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/assertions/manual-tls-multiple-sans.sh (RELEASE=sample NAMESPACE=sample)
    ==> Verifying TLS Secret 'manual-tls-multisite' exists
    PASS: Secret exists
    ==> Verifying certificate SANs (>=2 DNS entries)
    SANs: X509v3 Subject Alternative Name: 
        DNS:sample.sample.svc, DNS:api.sample.sample.svc, DNS:admin.sample.sample.svc
    SAN count: 3
    PASS: certificate has 3 SANs (>=2 required)
    ==> Waiting for pod Ready (3m max)
    pod/sample-6b84d7ddb4-v6xb4 condition met
    PASS: chart pods Ready
    ==> Verifying HTTPS reachable from in-cluster curl
    HTTPS response: 200
    PASS: HTTPS 200
    PASS: manual-tls-secret multiple-sans scenario verified

Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-certificates-manual-tls-secret-multiple-sans-20260530-104401-4/artifacts/logs

certificates-mounted-tls-certs-csi-secret-store certificates-mounted-tls-certs-csi-secret-store UNTESTED
Cluster
kind
Mechanisms
addon:mounted-tls-certs
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

certificates-mounted-tls-certs-csi-secret-store certificates-mounted-tls-certs-csi-secret-store UNTESTED
Cluster
kind
Mechanisms
addon:mounted-tls-certs
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

certificates-mounted-tls-certs-csi-secret-store certificates-mounted-tls-certs-csi-secret-store UNTESTED
Cluster
kind
Mechanisms
addon:mounted-tls-certs
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

certificates-mounted-tls-certs-csi-secret-store certificates-mounted-tls-certs-csi-secret-store UNTESTED
Cluster
kind
Mechanisms
addon:mounted-tls-certs
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

certificates-mounted-tls-certs-csi-secret-store certificates-mounted-tls-certs-csi-secret-store UNTESTED
Cluster
kind
Mechanisms
addon:mounted-tls-certs
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

certificates-mounted-tls-certs-csi-secret-store certificates-mounted-tls-certs-csi-secret-store UNTESTED
Cluster
kind
Mechanisms
addon:mounted-tls-certs
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

certificates-mounted-tls-certs-csi-secret-store certificates-mounted-tls-certs-csi-secret-store UNTESTED
Cluster
kind
Mechanisms
addon:mounted-tls-certs
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

certificates-mounted-tls-certs-csi-secret-store certificates-mounted-tls-certs-csi-secret-store PASS
Cluster
kind
Mechanisms
addon:mounted-tls-certs
Tags
nightly
Assertions · agent 0
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release sample in ns/sample is deployed
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-bench-8 -n sample wait --for=condition=Ready pods --timeout=5m --all
    pod/sample-675b745dbc-nq6z8 condition met
    PASS: pods Ready in ns/sample
    NAME                      READY   STATUS    RESTARTS   AGE
    sample-675b745dbc-nq6z8   1/1     Running   0          4s
  • PASS smoke-script
    notes
    Access: (0777/lrwxrwxrwx)  Uid: (    0/    root)   Gid: (    0/    root)
    Access: 2026-05-30 14:45:31.815106009 +0000
    Modify: 2026-05-30 14:45:30.499106008 +0000
    Change: 2026-05-30 14:45:30.499106008 +0000
    PASS: tls.key present at /etc/tls/tls.key
    ==> [5/5] Verifying HTTPS endpoint
    WARN: HTTPS probe failed (may be non-critical on kind)
    
    === CSI full-volume-mount verification: SKIP ===
    REASON: Full CSI volume mount verification (csi.driver=secrets-store.csi.k8s.io
    in pod spec, cert files populated via CSI provider) requires a real CSI provider
    plugin (AWS Secrets Manager, GCP Secret Manager, Azure Key Vault, HashiCorp Vault,
    etc.) which is not available on kind clusters. The scenario verifies:
      1. CSI driver helm chart installs successfully
      2. SecretProviderClass resource is created
      3. Product pod runs and serves HTTPS with TLS certs mounted from a regular Secret
    For full CSI volume-mount testing, run this scenario on a cluster with a
    supported secrets-store CSI provider plugin installed.
    
    PASS: mounted-tls-certs csi-secret-store scenario verified (CSI infra validated)

Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-certificates-mounted-tls-certs-csi-secret-store-20260530-104437-8/artifacts/logs

certificates-mounted-tls-certs-projected-volume certificates-mounted-tls-certs-projected-volume UNTESTED
Cluster
kind
Mechanisms
addon:mounted-tls-certs
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

certificates-mounted-tls-certs-projected-volume certificates-mounted-tls-certs-projected-volume UNTESTED
Cluster
kind
Mechanisms
addon:mounted-tls-certs
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

certificates-mounted-tls-certs-projected-volume certificates-mounted-tls-certs-projected-volume UNTESTED
Cluster
kind
Mechanisms
addon:mounted-tls-certs
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

certificates-mounted-tls-certs-projected-volume certificates-mounted-tls-certs-projected-volume PASS
Cluster
kind
Mechanisms
addon:mounted-tls-certs
Tags
nightly
Assertions · agent 0
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release sample in ns/sample is deployed
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-bench-9 -n sample wait --for=condition=Ready pods --timeout=5m --all
    pod/sample-67c556c9cb-jz9r4 condition met
    PASS: pods Ready in ns/sample
    NAME                      READY   STATUS    RESTARTS   AGE
    sample-67c556c9cb-jz9r4   1/1     Running   0          4s
  • PASS smoke-script
    notes
    PASS: projected volume sources include secret 'mounted-tls-projected'
    ==> Verifying mountPath matches tls.mountPath
    PASS: mountPath=/etc/tls
    ==> Waiting for pod Ready (3m max)
    pod/sample-67c556c9cb-jz9r4 condition met
    PASS: chart pods Ready
    ==> Exec stat /etc/tls/tls.crt in pod
    Defaulted container "app" out of: app, wait-for-tls (init)
      File: '/etc/tls/tls.crt' -> '..data/tls.crt'
      Size: 14        Blocks: 0          IO Block: 4096   symbolic link
    Device: 1000e6h/1048806dInode: 6           Links: 1
    Access: (0777/lrwxrwxrwx)  Uid: (    0/    root)   Gid: (    0/    root)
    Access: 2026-05-30 14:46:05.700367011 +0000
    Modify: 2026-05-30 14:46:03.961367010 +0000
    Change: 2026-05-30 14:46:03.961367010 +0000
    PASS: tls.crt accessible at /etc/tls
    ==> Verifying HTTPS reachable from in-cluster curl
    HTTPS response: 200
    PASS: HTTPS 200
    PASS: mounted-tls-certs projected-volume scenario verified

Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-certificates-mounted-tls-certs-projected-volume-20260530-104535-4/artifacts/logs

certificates-mounted-tls-certs-pvc-mount certificates-mounted-tls-certs-pvc-mount UNTESTED
Cluster
kind
Mechanisms
addon:mounted-tls-certs
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

certificates-mounted-tls-certs-pvc-mount certificates-mounted-tls-certs-pvc-mount UNTESTED
Cluster
kind
Mechanisms
addon:mounted-tls-certs
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

certificates-mounted-tls-certs-pvc-mount certificates-mounted-tls-certs-pvc-mount UNTESTED
Cluster
kind
Mechanisms
addon:mounted-tls-certs
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

certificates-mounted-tls-certs-pvc-mount certificates-mounted-tls-certs-pvc-mount UNTESTED
Cluster
kind
Mechanisms
addon:mounted-tls-certs
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

certificates-mounted-tls-certs-pvc-mount certificates-mounted-tls-certs-pvc-mount UNTESTED
Cluster
kind
Mechanisms
addon:mounted-tls-certs
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

certificates-mounted-tls-certs-pvc-mount certificates-mounted-tls-certs-pvc-mount PASS
Cluster
kind
Mechanisms
addon:mounted-tls-certs
Tags
nightly
Assertions · agent 0
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release sample in ns/sample is deployed
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-bench-10 -n sample wait --for=condition=Ready pods --timeout=10m -l app=sample
    pod/sample-6c94f9dbc-f2brv condition met
    PASS: pods Ready in ns/sample (selector=app=sample)
    NAME                     READY   STATUS    RESTARTS   AGE
    sample-6c94f9dbc-f2brv   1/1     Running   0          9s
  • PASS smoke-script
    notes
    PASS: mountPath=/etc/tls
    ==> Verifying volume source is persistentVolumeClaim
    PASS: volume source is persistentVolumeClaim (claim=mounted-tls-pvc)
    ==> Waiting for pod Ready (3m max)
    pod/sample-6c94f9dbc-f2brv condition met
    PASS: chart pods Ready
    ==> Exec stat /etc/tls/tls.crt in pod
    Defaulted container "app" out of: app, wait-for-tls (init)
      File: /etc/tls/tls.crt
      Size: 1176      Blocks: 8          IO Block: 4096   regular file
    Device: fe01h/65025dInode: 47011       Links: 1
    Access: (0644/-rw-r--r--)  Uid: (    0/    root)   Gid: (    0/    root)
    Access: 2026-05-30 14:46:43.440502000 +0000
    Modify: 2026-05-30 14:46:43.440502000 +0000
    Change: 2026-05-30 14:46:43.441502000 +0000
    PASS: tls.crt accessible at /etc/tls
    ==> Verifying HTTPS reachable from in-cluster curl
    HTTPS response: 200
    PASS: HTTPS 200
    PASS: mounted-tls-certs pvc-mount scenario verified

Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-certificates-mounted-tls-certs-pvc-mount-20260530-104612-8/artifacts/logs

customer-a-istio customer-a-istio UNTESTED
Cluster
kind
Mechanisms
addon:istioaddon:cert-managermesh:istiocustomer:A
Tags
nightlycustomer-replica

⚠ no agent reported on this scenario — UNTESTED

customer-a-istio customer-a-istio UNTESTED
Cluster
kind
Mechanisms
addon:istioaddon:cert-managermesh:istiocustomer:A
Tags
nightlycustomer-replica

⚠ no agent reported on this scenario — UNTESTED

customer-a-istio customer-a-istio PASS
Cluster
kind
Mechanisms
addon:istioaddon:cert-managermesh:istiocustomer:A
Tags
nightlycustomer-replica
Assertions · agent 0
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release sample in ns/sample is deployed
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-bench-11 -n sample wait --for=condition=Ready pods --timeout=5m --all
    pod/sample-5967fcc884-h8rqk condition met
    PASS: pods Ready in ns/sample
    NAME                      READY   STATUS    RESTARTS   AGE
    sample-5967fcc884-h8rqk   1/1     Running   0          3s

Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-customer-a-istio-20260530-104653-3/artifacts/logs

customer-b-gatekeeper customer-b-gatekeeper PASS
Cluster
kind
Mechanisms
addon:gatekeepercustomer:B
Tags
nightlycustomer-replica
Assertions · agent 0
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release sample in ns/sample is deployed
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-bench-12 -n sample wait --for=condition=Ready pods --timeout=5m --all
    pod/sample-5967fcc884-v622j condition met
    PASS: pods Ready in ns/sample
    NAME                      READY   STATUS    RESTARTS   AGE
    sample-5967fcc884-v622j   1/1     Running   0          2s

Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-customer-b-gatekeeper-20260530-104745/artifacts/logs

envoy-gateway envoy-gateway UNTESTED
Cluster
kind
Mechanisms
addon:envoy-gatewaygateway-api:envoy
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

envoy-gateway envoy-gateway UNTESTED
Cluster
kind
Mechanisms
addon:envoy-gatewaygateway-api:envoy
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

envoy-gateway envoy-gateway UNTESTED
Cluster
kind
Mechanisms
addon:envoy-gatewaygateway-api:envoy
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

envoy-gateway envoy-gateway UNTESTED
Cluster
kind
Mechanisms
addon:envoy-gatewaygateway-api:envoy
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

envoy-gateway envoy-gateway PASS
Cluster
kind
Mechanisms
addon:envoy-gatewaygateway-api:envoy
Tags
nightly
Assertions · agent 0
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release envoy-gateway in ns/envoy-gateway-system is deployed
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release sample in ns/sample is deployed
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-bench-13 -n envoy-gateway-system wait --for=condition=Ready pods --timeout=5m -l app.kubernetes.io/name=gateway-helm
    pod/envoy-gateway-56b969757f-tv5hw condition met
    PASS: pods Ready in ns/envoy-gateway-system (selector=app.kubernetes.io/name=gateway-helm)
    NAME                             READY   STATUS    RESTARTS   AGE
    envoy-gateway-56b969757f-tv5hw   1/1     Running   0          13s
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-bench-13 -n sample wait --for=condition=Ready pods --timeout=5m --all
    pod/sample-5967fcc884-pcsm9 condition met
    PASS: pods Ready in ns/sample
    NAME                      READY   STATUS    RESTARTS   AGE
    sample-5967fcc884-pcsm9   1/1     Running   0          3s

Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-envoy-gateway-20260530-104832-6/artifacts/logs

gateway-api-contour-gateway-api-basic gateway-api-contour-gateway-api-basic UNTESTED
Cluster
kind
Mechanisms
addon:contourgateway-api:contour
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

gateway-api-contour-gateway-api-basic gateway-api-contour-gateway-api-basic UNTESTED
Cluster
kind
Mechanisms
addon:contourgateway-api:contour
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

gateway-api-contour-gateway-api-basic gateway-api-contour-gateway-api-basic PASS
Cluster
kind
Mechanisms
addon:contourgateway-api:contour
Tags
nightly
Assertions · agent 0
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release sample in ns/sample is deployed
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-utest-contour-basic -n projectcontour wait --for=condition=Ready pods --timeout=5m -l control-plane=contour-gateway-provisioner
    pod/contour-gateway-provisioner-555bf78b46-2bstv condition met
    PASS: pods Ready in ns/projectcontour (selector=control-plane=contour-gateway-provisioner)
    NAME                                           READY   STATUS    RESTARTS   AGE
    contour-gateway-provisioner-555bf78b46-2bstv   1/1     Running   0          4s
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-utest-contour-basic -n sample wait --for=condition=Ready pods --timeout=5m --all
    pod/sample-7dcd986bd4-74qh7 condition met
    PASS: pods Ready in ns/sample
    NAME                      READY   STATUS    RESTARTS   AGE
    sample-7dcd986bd4-74qh7   1/1     Running   0          4s
  • PASS smoke-script
    notes
    ==> Waiting for GatewayClass contour Accepted=True (3m max)
    PASS: GatewayClass contour Accepted=True
    ==> Waiting for Gateway listener http Programmed=True (5m max)
    PASS: Gateway listener http Programmed=True
    ==> Verifying auto-provisioned Envoy Deployment in sample namespace
    PASS: auto-provisioned Envoy Deployment found (1)
    ==> Waiting for Envoy pods Ready (3m max)
    pod/contour-sample-gw-7c77855479-574rf condition met
    pod/contour-sample-gw-7c77855479-j4g8q condition met
    pod/envoy-sample-gw-qjbpc condition met
    PASS: Envoy pods Ready
    ==> Verifying HTTPRoute sample-route Accepted=True
    PASS: HTTPRoute sample-route Accepted=True
    ==> Getting Envoy Service ClusterIP in sample
    Envoy Service: envoy-sample-gw IP: 10.96.107.37
    ==> Probing backend via gateway (retry up to 2m for data-plane ready)
    HTTP response: 200 (attempt 1)
    HTTP response: 200
    PASS: HTTP 200 through Contour Gateway API
    PASS: contour-gateway-api basic integration verified

Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-gateway-api-contour-gateway-api-basic-20260531-192028-4/artifacts/logs

gateway-api-contour-gateway-api-response-header-modifier gateway-api-contour-gateway-api-response-header-modifier UNTESTED
Cluster
kind
Mechanisms
addon:contourgateway-api:contour
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

gateway-api-contour-gateway-api-response-header-modifier gateway-api-contour-gateway-api-response-header-modifier PASS
Cluster
kind
Mechanisms
addon:contourgateway-api:contour
Tags
nightly
Assertions · agent 0
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release sample in ns/sample is deployed
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-utest-contour-hdr -n projectcontour wait --for=condition=Ready pods --timeout=5m -l control-plane=contour-gateway-provisioner
    pod/contour-gateway-provisioner-555bf78b46-kpn4g condition met
    PASS: pods Ready in ns/projectcontour (selector=control-plane=contour-gateway-provisioner)
    NAME                                           READY   STATUS    RESTARTS   AGE
    contour-gateway-provisioner-555bf78b46-kpn4g   1/1     Running   0          5s
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-utest-contour-hdr -n sample wait --for=condition=Ready pods --timeout=5m --all
    pod/sample-7dcd986bd4-pd8tj condition met
    PASS: pods Ready in ns/sample
    NAME                      READY   STATUS    RESTARTS   AGE
    sample-7dcd986bd4-pd8tj   1/1     Running   0          4s
  • PASS smoke-script
    notes
    ==> Verifying auto-provisioned Envoy Deployment in sample namespace
    PASS: auto-provisioned Envoy Deployment found (1)
    ==> Waiting for Envoy pods Ready (3m max)
    pod/contour-sample-gw-7c77855479-2w7s5 condition met
    pod/contour-sample-gw-7c77855479-zmdsf condition met
    pod/envoy-sample-gw-gggnb condition met
    PASS: Envoy pods Ready
    ==> Verifying HTTPRoute sample-route Accepted=True
    PASS: HTTPRoute sample-route Accepted=True
    ==> Verifying ResponseHeaderModifier filter is configured on HTTPRoute
    Filter type: ResponseHeaderModifier
    PASS: ResponseHeaderModifier filter configured on HTTPRoute
    ==> Getting Envoy Service ClusterIP in sample
    Envoy Service IP: 10.96.189.89
    ==> Probing backend via gateway (retry up to 2m for data-plane ready)
    HTTP response: 200 (attempt 1)
    HTTP response: 200
    X-Powered-By header: x-powered-by: chart-test-swarm
    PASS: X-Powered-By header includes chart-test-swarm as configured
    PASS: contour-gateway-api response-header-modifier integration verified

Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-gateway-api-contour-gateway-api-response-header-modifier-20260531-192122-3/artifacts/logs

gateway-api-contour-gateway-api-route-precedence gateway-api-contour-gateway-api-route-precedence UNTESTED
Cluster
kind
Mechanisms
addon:contourgateway-api:contour
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

gateway-api-contour-gateway-api-route-precedence gateway-api-contour-gateway-api-route-precedence UNTESTED
Cluster
kind
Mechanisms
addon:contourgateway-api:contour
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

gateway-api-contour-gateway-api-route-precedence gateway-api-contour-gateway-api-route-precedence PASS
Cluster
kind
Mechanisms
addon:contourgateway-api:contour
Tags
nightly
Assertions · agent 0
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release sample in ns/sample is deployed
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-utest-contour-precedence -n projectcontour wait --for=condition=Ready pods --timeout=5m -l control-plane=contour-gateway-provisioner
    pod/contour-gateway-provisioner-555bf78b46-59r2b condition met
    PASS: pods Ready in ns/projectcontour (selector=control-plane=contour-gateway-provisioner)
    NAME                                           READY   STATUS    RESTARTS   AGE
    contour-gateway-provisioner-555bf78b46-59r2b   1/1     Running   0          4s
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-utest-contour-precedence -n sample wait --for=condition=Ready pods --timeout=5m --all
    pod/sample-7dcd986bd4-qxd2d condition met
    PASS: pods Ready in ns/sample
    NAME                      READY   STATUS    RESTARTS   AGE
    sample-7dcd986bd4-qxd2d   1/1     Running   0          4s
  • PASS smoke-script
    notes
    ==> Verifying auto-provisioned Envoy Deployment in sample namespace
    PASS: auto-provisioned Envoy Deployment found (1)
    ==> Waiting for Envoy pods Ready (3m max)
    pod/contour-sample-gw-7c77855479-gjqf7 condition met
    pod/contour-sample-gw-7c77855479-hrgs4 condition met
    pod/envoy-sample-gw-sxdft condition met
    PASS: Envoy pods Ready
    ==> Verifying HTTPRoute sample-route-api Accepted=True
    PASS: HTTPRoute sample-route-api Accepted=True
    ==> Verifying HTTPRoute sample-route-api-v2 Accepted=True
    PASS: HTTPRoute sample-route-api-v2 Accepted=True
    ==> Getting Envoy Service ClusterIP in sample
    Envoy Service IP: 10.96.6.230
    ==> Test 1: /api/v2/foo → expect X-Route: v2 (more specific prefix wins)
    Test /api/v2/foo → X-Route header: x-route: v2
    PASS: /api/v2/foo routed to v2 (more specific prefix wins)
    ==> Test 2: /api/foo → expect X-Route: v1 (less specific prefix wins for non-overlapping paths)
    Test /api/foo → X-Route header: x-route: v1
    PASS: /api/foo routed to v1 (less specific prefix wins for non-overlapping)
    PASS: contour-gateway-api route-precedence integration verified

Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-gateway-api-contour-gateway-api-route-precedence-20260531-192210-3/artifacts/logs

gateway-api-envoy-gateway-cert-manager-tls gateway-api-envoy-gateway-cert-manager-tls UNTESTED
Cluster
kind
Mechanisms
addon:envoy-gatewayaddon:cert-managergateway-api:envoy
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

gateway-api-envoy-gateway-cert-manager-tls gateway-api-envoy-gateway-cert-manager-tls PASS
Cluster
kind
Mechanisms
addon:envoy-gatewayaddon:cert-managergateway-api:envoy
Tags
nightly
Assertions · agent 0
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release cert-manager in ns/cert-manager is deployed
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release envoy-gateway in ns/envoy-gateway-system is deployed
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release sample in ns/sample is deployed
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-eg-cm-tls -n cert-manager wait --for=condition=Ready pods --timeout=5m --all
    pod/cert-manager-c69c859c4-25xwl condition met
    pod/cert-manager-cainjector-d6d64f75f-xpcx7 condition met
    pod/cert-manager-webhook-566849c7fc-2pt9m condition met
    PASS: pods Ready in ns/cert-manager
    NAME                                      READY   STATUS    RESTARTS   AGE
    cert-manager-c69c859c4-25xwl              1/1     Running   0          21s
    cert-manager-cainjector-d6d64f75f-xpcx7   1/1     Running   0          21s
    cert-manager-webhook-566849c7fc-2pt9m     1/1     Running   0          21s
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-eg-cm-tls -n envoy-gateway-system wait --for=condition=Ready pods --timeout=5m -l app.kubernetes.io/name=gateway-helm
    pod/envoy-gateway-56b969757f-drw4h condition met
    PASS: pods Ready in ns/envoy-gateway-system (selector=app.kubernetes.io/name=gateway-helm)
    NAME                             READY   STATUS    RESTARTS   AGE
    envoy-gateway-56b969757f-drw4h   1/1     Running   0          33s
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-eg-cm-tls -n sample wait --for=condition=Ready pods --timeout=5m --all
    pod/sample-7dcd986bd4-gjc74 condition met
    PASS: pods Ready in ns/sample
    NAME                      READY   STATUS    RESTARTS   AGE
    sample-7dcd986bd4-gjc74   1/1     Running   0          4s
  • PASS smoke-script
    notes
    httproute.gateway.networking.k8s.io/sample-route created
    ==> Waiting for GatewayClass envoy Accepted=True (3m max)
    PASS: GatewayClass envoy Accepted=True
    ==> Waiting for Gateway listener https Programmed=True (5m max)
    PASS: Gateway listener https Programmed=True
    ==> Verifying gateway listener https is Programmed
    PASS: Listener https Programmed=True
    ==> Verifying HTTPRoute sample-route Accepted=True
    PASS: HTTPRoute sample-route Accepted=True
    ==> Getting envoy data-plane Service ClusterIP
    Gateway Service IP: 10.96.168.123
    ==> Probing HTTPS backend via gateway (retry up to 2m)
    HTTPS response: 200 (attempt 2)
    HTTPS response: 200
    PASS: HTTPS 200 through Envoy Gateway with cert-manager TLS
    ==> Verifying peer certificate matches cert-manager issued cert
    SAN: X509v3 Subject Alternative Name: 
        DNS:sample.sample.svc.cluster.local
    PASS: cert SAN includes sample.sample.svc.cluster.local
    PASS: envoy-gateway + cert-manager TLS compose verified

Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-gateway-api-envoy-gateway-cert-manager-tls-20260531-184029-2/artifacts/logs

gateway-api-envoy-gateway-grpcroute gateway-api-envoy-gateway-grpcroute UNTESTED
Cluster
kind
Mechanisms
addon:envoy-gatewaygateway-api:envoy
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

gateway-api-envoy-gateway-grpcroute gateway-api-envoy-gateway-grpcroute UNTESTED
Cluster
kind
Mechanisms
addon:envoy-gatewaygateway-api:envoy
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

gateway-api-envoy-gateway-grpcroute gateway-api-envoy-gateway-grpcroute UNTESTED
Cluster
kind
Mechanisms
addon:envoy-gatewaygateway-api:envoy
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

gateway-api-envoy-gateway-grpcroute gateway-api-envoy-gateway-grpcroute UNTESTED
Cluster
kind
Mechanisms
addon:envoy-gatewaygateway-api:envoy
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

gateway-api-envoy-gateway-grpcroute gateway-api-envoy-gateway-grpcroute PASS
Cluster
kind
Mechanisms
addon:envoy-gatewaygateway-api:envoy
Tags
nightly
Assertions · agent 0
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release envoy-gateway in ns/envoy-gateway-system is deployed
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release sample in ns/sample is deployed
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-eg-grpc -n envoy-gateway-system wait --for=condition=Ready pods --timeout=5m -l app.kubernetes.io/name=gateway-helm
    pod/envoy-gateway-56b969757f-v4xl4 condition met
    PASS: pods Ready in ns/envoy-gateway-system (selector=app.kubernetes.io/name=gateway-helm)
    NAME                             READY   STATUS    RESTARTS   AGE
    envoy-gateway-56b969757f-v4xl4   1/1     Running   0          16s
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-eg-grpc -n sample wait --for=condition=Ready pods --timeout=5m --all
    pod/grpc-backend-775f8dc876-b8mq7 condition met
    pod/sample-7dcd986bd4-lhclh condition met
    PASS: pods Ready in ns/sample
    NAME                            READY   STATUS    RESTARTS   AGE
    grpc-backend-775f8dc876-b8mq7   1/1     Running   0          5s
    sample-7dcd986bd4-lhclh         1/1     Running   0          5s
  • PASS smoke-script
    notes
    PASS: GatewayClass envoy Accepted=True
    ==> Waiting for Gateway listener http Programmed=True (5m max)
    PASS: Gateway listener http Programmed=True
    ==> Verifying GRPCRoute sample-grpc-route Accepted=True
    PASS: GRPCRoute sample-grpc-route Accepted=True
    ==> Getting envoy data-plane Service ClusterIP
    Gateway Service IP: 10.96.8.129
    ==> Probing gRPC backend via gateway (grpcurl reflection)
    grpcurl output: addsvc.Add
    grpc.gateway.examples.examplepb.ABitOfEverythingService
    grpc.reflection.v1alpha.ServerReflection
    grpcbin.GRPCBin
    hello.HelloService (attempt 2)
    grpcurl output: addsvc.Add
    grpc.gateway.examples.examplepb.ABitOfEverythingService
    grpc.reflection.v1alpha.ServerReflection
    grpcbin.GRPCBin
    hello.HelloService
    PASS: grpcurl reflection listed 5 service(s)
    PASS: envoy-gateway GRPCRoute integration verified

Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-gateway-api-envoy-gateway-grpcroute-20260531-183758-5/artifacts/logs

gateway-api-envoy-gateway-httproute gateway-api-envoy-gateway-httproute UNTESTED
Cluster
kind
Mechanisms
addon:envoy-gatewaygateway-api:envoy
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

gateway-api-envoy-gateway-httproute gateway-api-envoy-gateway-httproute UNTESTED
Cluster
kind
Mechanisms
addon:envoy-gatewaygateway-api:envoy
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

gateway-api-envoy-gateway-httproute gateway-api-envoy-gateway-httproute UNTESTED
Cluster
kind
Mechanisms
addon:envoy-gatewaygateway-api:envoy
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

gateway-api-envoy-gateway-httproute gateway-api-envoy-gateway-httproute UNTESTED
Cluster
kind
Mechanisms
addon:envoy-gatewaygateway-api:envoy
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

gateway-api-envoy-gateway-httproute gateway-api-envoy-gateway-httproute UNTESTED
Cluster
kind
Mechanisms
addon:envoy-gatewaygateway-api:envoy
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

gateway-api-envoy-gateway-httproute gateway-api-envoy-gateway-httproute UNTESTED
Cluster
kind
Mechanisms
addon:envoy-gatewaygateway-api:envoy
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

gateway-api-envoy-gateway-httproute gateway-api-envoy-gateway-httproute UNTESTED
Cluster
kind
Mechanisms
addon:envoy-gatewaygateway-api:envoy
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

gateway-api-envoy-gateway-httproute gateway-api-envoy-gateway-httproute UNTESTED
Cluster
kind
Mechanisms
addon:envoy-gatewaygateway-api:envoy
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

gateway-api-envoy-gateway-httproute gateway-api-envoy-gateway-httproute PASS
Cluster
kind
Mechanisms
addon:envoy-gatewaygateway-api:envoy
Tags
nightly
Assertions · agent 0
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release envoy-gateway in ns/envoy-gateway-system is deployed
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release sample in ns/sample is deployed
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-eg-httproute -n envoy-gateway-system wait --for=condition=Ready pods --timeout=5m -l app.kubernetes.io/name=gateway-helm
    pod/envoy-gateway-56b969757f-lglzx condition met
    PASS: pods Ready in ns/envoy-gateway-system (selector=app.kubernetes.io/name=gateway-helm)
    NAME                             READY   STATUS    RESTARTS   AGE
    envoy-gateway-56b969757f-lglzx   1/1     Running   0          15s
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-eg-httproute -n sample wait --for=condition=Ready pods --timeout=5m --all
    pod/sample-7dcd986bd4-tp8pr condition met
    PASS: pods Ready in ns/sample
    NAME                      READY   STATUS    RESTARTS   AGE
    sample-7dcd986bd4-tp8pr   1/1     Running   0          3s
  • PASS smoke-script
    notes
    exec: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/assertions/envoy-gateway-httproute.sh (RELEASE=sample NAMESPACE=sample)
    ==> Applying GatewayClass + Gateway + HTTPRoute
    gatewayclass.gateway.networking.k8s.io/envoy created
    gateway.gateway.networking.k8s.io/sample-gw created
    httproute.gateway.networking.k8s.io/sample-route created
    ==> Waiting for GatewayClass envoy Accepted=True (3m max)
    PASS: GatewayClass envoy Accepted=True
    ==> Waiting for Gateway listener http Programmed=True (5m max)
    PASS: Gateway listener http Programmed=True
    ==> Verifying HTTPRoute sample-route Accepted=True
    PASS: HTTPRoute sample-route Accepted=True
    ==> Getting envoy data-plane Service ClusterIP
    Gateway Service: envoy-sample-sample-gw-038a7a21 IP: 10.96.158.114
    ==> Probing backend via gateway (retry up to 2m for data-plane ready)
    HTTP response: 200 (attempt 2)
    HTTP response: 200
    PASS: HTTP 200 through Envoy Gateway
    PASS: envoy-gateway HTTPRoute integration verified

Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-gateway-api-envoy-gateway-httproute-20260531-183512-10/artifacts/logs

gateway-api-envoy-gateway-security-policy-attach gateway-api-envoy-gateway-security-policy-attach UNTESTED
Cluster
kind
Mechanisms
addon:envoy-gatewaygateway-api:envoy
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

gateway-api-envoy-gateway-security-policy-attach gateway-api-envoy-gateway-security-policy-attach UNTESTED
Cluster
kind
Mechanisms
addon:envoy-gatewaygateway-api:envoy
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

gateway-api-envoy-gateway-security-policy-attach gateway-api-envoy-gateway-security-policy-attach UNTESTED
Cluster
kind
Mechanisms
addon:envoy-gatewaygateway-api:envoy
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

gateway-api-envoy-gateway-security-policy-attach gateway-api-envoy-gateway-security-policy-attach PASS
Cluster
kind
Mechanisms
addon:envoy-gatewaygateway-api:envoy
Tags
nightly
Assertions · agent 0
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release envoy-gateway in ns/envoy-gateway-system is deployed
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release sample in ns/sample is deployed
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-eg-secpol -n envoy-gateway-system wait --for=condition=Ready pods --timeout=5m -l app.kubernetes.io/name=gateway-helm
    pod/envoy-gateway-56b969757f-wzfp2 condition met
    PASS: pods Ready in ns/envoy-gateway-system (selector=app.kubernetes.io/name=gateway-helm)
    NAME                             READY   STATUS    RESTARTS   AGE
    envoy-gateway-56b969757f-wzfp2   1/1     Running   0          14s
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-eg-secpol -n sample wait --for=condition=Ready pods --timeout=5m --all
    pod/sample-7dcd986bd4-t6x9c condition met
    PASS: pods Ready in ns/sample
    NAME                      READY   STATUS    RESTARTS   AGE
    sample-7dcd986bd4-t6x9c   1/1     Running   0          3s
  • PASS smoke-script
    notes
    gatewayclass.gateway.networking.k8s.io/envoy created
    gateway.gateway.networking.k8s.io/sample-gw created
    ==> Waiting for Gateway listener http Programmed=True (5m max)
    PASS: Gateway listener http Programmed=True
    ==> Applying HTTPRoute + SecurityPolicy
    httproute.gateway.networking.k8s.io/sample-route created
    securitypolicy.gateway.envoyproxy.io/sample-cors-policy created
    ==> Waiting for GatewayClass envoy Accepted=True (3m max)
    PASS: GatewayClass envoy Accepted=True
    ==> Verifying HTTPRoute sample-route Accepted=True
    PASS: HTTPRoute sample-route Accepted=True
    ==> Verifying SecurityPolicy Accepted=True
    PASS: SecurityPolicy sample-cors-policy Accepted=True
    ==> Getting envoy data-plane Service ClusterIP
    Gateway Service IP: 10.96.20.208
    ==> Probing CORS preflight (OPTIONS request)
    CORS response: access-control-allow-origin: http://example.com (attempt 2)
    CORS response: access-control-allow-origin: http://example.com
    PASS: CORS header present on preflight response
    PASS: envoy-gateway SecurityPolicy CORS integration verified

Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-gateway-api-envoy-gateway-security-policy-attach-20260531-183914-4/artifacts/logs

gateway-api-istio-gateway-api-backend-tls-policy gateway-api-istio-gateway-api-backend-tls-policy UNTESTED
Cluster
kind
Mechanisms
addon:istiogateway-api:istio
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

gateway-api-istio-gateway-api-backend-tls-policy gateway-api-istio-gateway-api-backend-tls-policy UNTESTED
Cluster
kind
Mechanisms
addon:istiogateway-api:istio
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

gateway-api-istio-gateway-api-backend-tls-policy gateway-api-istio-gateway-api-backend-tls-policy UNTESTED
Cluster
kind
Mechanisms
addon:istiogateway-api:istio
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

gateway-api-istio-gateway-api-backend-tls-policy gateway-api-istio-gateway-api-backend-tls-policy UNTESTED
Cluster
kind
Mechanisms
addon:istiogateway-api:istio
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

gateway-api-istio-gateway-api-backend-tls-policy gateway-api-istio-gateway-api-backend-tls-policy UNTESTED
Cluster
kind
Mechanisms
addon:istiogateway-api:istio
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

gateway-api-istio-gateway-api-backend-tls-policy gateway-api-istio-gateway-api-backend-tls-policy UNTESTED
Cluster
kind
Mechanisms
addon:istiogateway-api:istio
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

gateway-api-istio-gateway-api-backend-tls-policy gateway-api-istio-gateway-api-backend-tls-policy UNTESTED
Cluster
kind
Mechanisms
addon:istiogateway-api:istio
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

gateway-api-istio-gateway-api-backend-tls-policy gateway-api-istio-gateway-api-backend-tls-policy UNTESTED
Cluster
kind
Mechanisms
addon:istiogateway-api:istio
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

gateway-api-istio-gateway-api-backend-tls-policy gateway-api-istio-gateway-api-backend-tls-policy UNTESTED
Cluster
kind
Mechanisms
addon:istiogateway-api:istio
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

gateway-api-istio-gateway-api-backend-tls-policy gateway-api-istio-gateway-api-backend-tls-policy UNTESTED
Cluster
kind
Mechanisms
addon:istiogateway-api:istio
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

gateway-api-istio-gateway-api-backend-tls-policy gateway-api-istio-gateway-api-backend-tls-policy PASS
Cluster
kind
Mechanisms
addon:istiogateway-api:istio
Tags
nightly
Assertions · agent 0
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release istio-base in ns/istio-system is deployed
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release istiod in ns/istio-system is deployed
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release sample in ns/sample is deployed
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-istio-btls -n istio-system wait --for=condition=Ready pods --timeout=5m -l app=istiod
    pod/istiod-68c4759fc-585tl condition met
    PASS: pods Ready in ns/istio-system (selector=app=istiod)
    NAME                     READY   STATUS    RESTARTS   AGE
    istiod-68c4759fc-585tl   1/1     Running   0          9s
  • PASS smoke-script
    notes
    exec: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/assertions/istio-gateway-api-gen-backend-tls-certs.sh (RELEASE=sample NAMESPACE=sample)
    ==> Generating self-signed CA and TLS cert for backend
    ==> Creating/updating TLS Secret backend-tls-cert
    secret/backend-tls-cert created
    PASS: TLS Secret backend-tls-cert created
    ==> Creating/updating CA ConfigMap backend-ca-cert
    configmap/backend-ca-cert created
    PASS: CA ConfigMap backend-ca-cert created
    PASS: Backend TLS certs generated and applied
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-istio-btls -n sample wait --for=condition=Ready pods --timeout=5m --all
    pod/sample-7dcd986bd4-pwxft condition met
    PASS: pods Ready in ns/sample
    NAME                      READY   STATUS    RESTARTS   AGE
    sample-7dcd986bd4-pwxft   1/1     Running   0          3s
  • PASS smoke-script
    notes
    gatewayclass.gateway.networking.k8s.io/istio configured
    gateway.gateway.networking.k8s.io/sample-gw created
    httproute.gateway.networking.k8s.io/sample-route created
    ==> Waiting for GatewayClass istio Accepted=True (3m max)
    PASS: GatewayClass istio Accepted=True
    ==> Waiting for Gateway listener http Programmed=True (5m max)
    PASS: Gateway listener http Programmed=True
    ==> Verifying HTTPRoute sample-route Accepted=True
    PASS: HTTPRoute sample-route Accepted=True
    ==> Getting Istio data-plane Service ClusterIP
    Gateway Service IP: 10.96.27.33
    ==> Probing backend via gateway (before BackendTLSPolicy, retry up to 2m)
    HTTP response: 200 (attempt 2)
    HTTP response: 200
    PASS: HTTP 200 through Istio Gateway API
    ==> Applying BackendTLSPolicy
    backendtlspolicy.gateway.networking.k8s.io/sample-backend-tls created
    ==> Waiting for BackendTLSPolicy Accepted=True (2m max)
    PASS: BackendTLSPolicy sample-backend-tls Accepted=True
    PASS: istio-gateway-api BackendTLSPolicy integration verified

Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-gateway-api-istio-gateway-api-backend-tls-policy-20260531-184029-11/artifacts/logs

gateway-api-istio-gateway-api-basic gateway-api-istio-gateway-api-basic UNTESTED
Cluster
kind
Mechanisms
addon:istiogateway-api:istio
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

gateway-api-istio-gateway-api-basic gateway-api-istio-gateway-api-basic UNTESTED
Cluster
kind
Mechanisms
addon:istiogateway-api:istio
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

gateway-api-istio-gateway-api-basic gateway-api-istio-gateway-api-basic UNTESTED
Cluster
kind
Mechanisms
addon:istiogateway-api:istio
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

gateway-api-istio-gateway-api-basic gateway-api-istio-gateway-api-basic PASS
Cluster
kind
Mechanisms
addon:istiogateway-api:istio
Tags
nightly
Assertions · agent 0
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release istio-base in ns/istio-system is deployed
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release istiod in ns/istio-system is deployed
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release sample in ns/sample is deployed
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-istio-basic -n istio-system wait --for=condition=Ready pods --timeout=5m -l app=istiod
    pod/istiod-54b585df85-ssk4l condition met
    PASS: pods Ready in ns/istio-system (selector=app=istiod)
    NAME                      READY   STATUS    RESTARTS   AGE
    istiod-54b585df85-ssk4l   1/1     Running   0          8s
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-istio-basic -n sample wait --for=condition=Ready pods --timeout=5m --all
    pod/sample-7dcd986bd4-pl7dz condition met
    PASS: pods Ready in ns/sample
    NAME                      READY   STATUS    RESTARTS   AGE
    sample-7dcd986bd4-pl7dz   1/1     Running   0          4s
  • PASS smoke-script
    notes
    ==> Applying GatewayClass + Gateway + HTTPRoute
    Warning: resource gatewayclasses/istio is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by kubectl apply. kubectl apply should only be used on resources created declaratively by either kubectl create --save-config or kubectl apply. The missing annotation will be patched automatically.
    gatewayclass.gateway.networking.k8s.io/istio configured
    gateway.gateway.networking.k8s.io/sample-gw created
    httproute.gateway.networking.k8s.io/sample-route created
    ==> Waiting for GatewayClass istio Accepted=True (3m max)
    PASS: GatewayClass istio Accepted=True
    ==> Waiting for Gateway listener http Programmed=True (5m max)
    PASS: Gateway listener http Programmed=True
    ==> Verifying auto-provisioned Deployment in sample namespace
    PASS: auto-provisioned Deployment found (1)
    ==> Verifying HTTPRoute sample-route Accepted=True
    PASS: HTTPRoute sample-route Accepted=True
    ==> Getting Istio data-plane Service ClusterIP
    Gateway Service: sample-gw-istio IP: 10.96.130.172
    ==> Probing backend via gateway (retry up to 2m for data-plane ready)
    HTTP response: 200 (attempt 2)
    HTTP response: 200
    PASS: HTTP 200 through Istio Gateway API
    PASS: istio-gateway-api basic integration verified

Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-gateway-api-istio-gateway-api-basic-20260531-183758-4/artifacts/logs

gateway-api-istio-gateway-api-multi-listener gateway-api-istio-gateway-api-multi-listener UNTESTED
Cluster
kind
Mechanisms
addon:istiogateway-api:istio
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

gateway-api-istio-gateway-api-multi-listener gateway-api-istio-gateway-api-multi-listener UNTESTED
Cluster
kind
Mechanisms
addon:istiogateway-api:istio
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

gateway-api-istio-gateway-api-multi-listener gateway-api-istio-gateway-api-multi-listener UNTESTED
Cluster
kind
Mechanisms
addon:istiogateway-api:istio
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

gateway-api-istio-gateway-api-multi-listener gateway-api-istio-gateway-api-multi-listener PASS
Cluster
kind
Mechanisms
addon:istiogateway-api:istio
Tags
nightly
Assertions · agent 0
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release istio-base in ns/istio-system is deployed
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release istiod in ns/istio-system is deployed
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release sample in ns/sample is deployed
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-istio-multi -n istio-system wait --for=condition=Ready pods --timeout=5m -l app=istiod
    pod/istiod-54b585df85-tp7wb condition met
    PASS: pods Ready in ns/istio-system (selector=app=istiod)
    NAME                      READY   STATUS    RESTARTS   AGE
    istiod-54b585df85-tp7wb   1/1     Running   0          8s
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-istio-multi -n sample wait --for=condition=Ready pods --timeout=5m --all
    pod/sample-7dcd986bd4-9sxwz condition met
    PASS: pods Ready in ns/sample
    NAME                      READY   STATUS    RESTARTS   AGE
    sample-7dcd986bd4-9sxwz   1/1     Running   0          3s
  • PASS smoke-script
    notes
    PASS: GatewayClass istio Accepted=True
    ==> Verifying Gateway has >= 2 listeners
    PASS: Gateway has 2 listeners: http https
    ==> Waiting for Gateway listener http Programmed=True (5m max)
    PASS: Gateway listener http Programmed=True
    ==> Waiting for Gateway listener https Programmed=True (5m max)
    PASS: Gateway listener https Programmed=True
    ==> Verifying HTTPRoute sample-route Accepted=True
    PASS: HTTPRoute sample-route Accepted=True
    ==> Getting Istio data-plane Service ClusterIP
    Gateway Service IP: 10.96.193.110
    ==> Probing HTTP backend via gateway (retry up to 2m)
    HTTP response: 200 (attempt 2)
    HTTP response: 200
    PASS: HTTP 200 on port 80
    ==> Probing HTTPS backend via gateway (retry up to 2m)
    HTTPS response: 200 (attempt 1)
    HTTPS response: 200
    PASS: HTTPS 200 on port 443
    PASS: istio-gateway-api multi-listener integration verified

Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-gateway-api-istio-gateway-api-multi-listener-20260531-183914-5/artifacts/logs

ingress-controllers-contour-basic-httpproxy ingress-controllers-contour-basic-httpproxy UNTESTED
Cluster
kind
Mechanisms
addon:contour
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

ingress-controllers-contour-basic-httpproxy ingress-controllers-contour-basic-httpproxy UNTESTED
Cluster
kind
Mechanisms
addon:contour
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

ingress-controllers-contour-basic-httpproxy ingress-controllers-contour-basic-httpproxy UNTESTED
Cluster
kind
Mechanisms
addon:contour
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

ingress-controllers-contour-basic-httpproxy ingress-controllers-contour-basic-httpproxy PASS
Cluster
kind
Mechanisms
addon:contour
Tags
nightly
Assertions · agent 0
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release sample in ns/sample is deployed
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-default -n sample wait --for=condition=Ready pods --timeout=5m --all
    pod/sample-69469cb4c6-prm2m condition met
    PASS: pods Ready in ns/sample
    NAME                      READY   STATUS    RESTARTS   AGE
    sample-69469cb4c6-prm2m   1/1     Running   0          3s
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-default -n projectcontour wait --for=condition=Ready pods --timeout=3m --all
    pod/contour-contour-5847f7c7f9-lmw56 condition met
    pod/contour-envoy-vqpc9 condition met
    PASS: pods Ready in ns/projectcontour
    NAME                               READY   STATUS    RESTARTS   AGE
    contour-contour-5847f7c7f9-lmw56   1/1     Running   0          28s
    contour-envoy-vqpc9                2/2     Running   0          28s
  • PASS smoke-script
    notes
    pod/contour-envoy-vqpc9 condition met
    PASS: envoy pod Ready
    ==> Waiting for contour controller pod Ready (3m max)
    pod/contour-contour-5847f7c7f9-lmw56 condition met
    PASS: contour controller pod Ready
    ==> Waiting for product pod Ready (3m max)
    pod/sample-69469cb4c6-prm2m condition met
    PASS: product pods Ready
    ==> Getting envoy pod IP (probe via pod IP)
    envoy pod IP: 10.244.0.6
    ==> Verifying HTTPProxy exists and status is valid
    HTTPProxy status: valid
    PASS: HTTPProxy status is valid
    ==> Probing HTTP with Host header (expect 200) on envoy container port 8080
    HTTP response (with Host): 200
    PASS: HTTP 200 with Host header
    ==> Probing HTTP without Host header (expect 404) on envoy container port 8080
    HTTP response (without Host): 404
    PASS: HTTP 404 without Host header (envoy default)
    PASS: Contour basic HTTPProxy integration verified

Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-ingress-controllers-contour-basic-httpproxy-20260530-213232-4/artifacts/logs

ingress-controllers-contour-rate-limit ingress-controllers-contour-rate-limit FAIL
Cluster
kind
Mechanisms
addon:contour
Tags
nightly
Error
error 243 B · 4 ln
smoke-script:
exec: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/assertions/contour-rate-limit.sh (RELEASE=sample NAMESPACE=sample)
==> Waiting for envoy pod Ready (3m max)
error: no matching resources found
Log
/Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-ingress-controllers-contour-rate-limit-20260530-145216/artifacts/logs
Assertions · agent 0
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release sample in ns/sample is deployed
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-default -n sample wait --for=condition=Ready pods --timeout=5m --all
    pod/sample-69469cb4c6-lhtgf condition met
    PASS: pods Ready in ns/sample
    NAME                      READY   STATUS    RESTARTS   AGE
    sample-69469cb4c6-lhtgf   1/1     Running   0          3s
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-default -n projectcontour wait --for=condition=Ready pods --timeout=3m --all
    pod/contour-contour-5847f7c7f9-npc58 condition met
    pod/contour-envoy-6ss8t condition met
    PASS: pods Ready in ns/projectcontour
    NAME                               READY   STATUS    RESTARTS   AGE
    contour-contour-5847f7c7f9-npc58   1/1     Running   0          28s
    contour-envoy-6ss8t                2/2     Running   0          28s
  • FAIL smoke-script
    notes
    exec: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/assertions/contour-rate-limit.sh (RELEASE=sample NAMESPACE=sample)
    ==> Waiting for envoy pod Ready (3m max)
    error: no matching resources found

Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-ingress-controllers-contour-rate-limit-20260530-145216/artifacts/logs

ingress-controllers-contour-tls-delegation ingress-controllers-contour-tls-delegation UNTESTED
Cluster
kind
Mechanisms
addon:contour
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

ingress-controllers-contour-tls-delegation ingress-controllers-contour-tls-delegation UNTESTED
Cluster
kind
Mechanisms
addon:contour
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

ingress-controllers-contour-tls-delegation ingress-controllers-contour-tls-delegation UNTESTED
Cluster
kind
Mechanisms
addon:contour
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

ingress-controllers-contour-tls-delegation ingress-controllers-contour-tls-delegation UNTESTED
Cluster
kind
Mechanisms
addon:contour
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

ingress-controllers-contour-tls-delegation ingress-controllers-contour-tls-delegation PASS
Cluster
kind
Mechanisms
addon:contour
Tags
nightly
Assertions · agent 0
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release sample in ns/sample is deployed
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-default -n sample wait --for=condition=Ready pods --timeout=5m --all
    pod/sample-69469cb4c6-95llp condition met
    PASS: pods Ready in ns/sample
    NAME                      READY   STATUS    RESTARTS   AGE
    sample-69469cb4c6-95llp   1/1     Running   0          2s
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-default -n projectcontour wait --for=condition=Ready pods --timeout=3m --all
    pod/contour-contour-5847f7c7f9-cf76m condition met
    pod/contour-envoy-srmjb condition met
    PASS: pods Ready in ns/projectcontour
    NAME                               READY   STATUS    RESTARTS   AGE
    contour-contour-5847f7c7f9-cf76m   1/1     Running   0          28s
    contour-envoy-srmjb                2/2     Running   0          28s
  • PASS smoke-script
    notes
    pod/sample-69469cb4c6-95llp condition met
    PASS: product pods Ready
    ==> Verifying TLSCertificateDelegation exists
    tlscertificatedelegation.projectcontour.io/sample-tls-delegation
    PASS: TLSCertificateDelegation sample-tls-delegation exists
    ==> Verifying TLS secret exists in tls-secrets namespace
    secret/sample-tls
    PASS: TLS secret sample-tls exists
    ==> Verifying HTTPProxy status is valid
    HTTPProxy status: valid
    PASS: HTTPProxy status is valid
    ==> Getting envoy pod IP
    envoy pod IP: 10.244.0.6
    ==> Probing HTTPS (expect 200) on envoy container port 8443
    HTTPS response: 200
    PASS: HTTPS 200 with delegated TLS cert
    ==> Verifying cert subject (expect CN=sample.test.local)
    Certificate subject: subject=CN=sample.test.local
    PASS: certificate CN matches sample.test.local
    PASS: Contour TLS delegation integration verified

Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-ingress-controllers-contour-tls-delegation-20260530-214220-5/artifacts/logs

ingress-controllers-nginx-ingress-basic ingress-controllers-nginx-ingress-basic UNTESTED
Cluster
kind
Mechanisms
addon:nginx-ingress
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

ingress-controllers-nginx-ingress-basic ingress-controllers-nginx-ingress-basic PASS
Cluster
kind
Mechanisms
addon:nginx-ingress
Tags
nightly
Assertions · agent 0
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release sample in ns/sample is deployed
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-default -n sample wait --for=condition=Ready pods --timeout=5m --all
    pod/sample-69469cb4c6-kfwbt condition met
    PASS: pods Ready in ns/sample
    NAME                      READY   STATUS    RESTARTS   AGE
    sample-69469cb4c6-kfwbt   1/1     Running   0          4s
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-default -n ingress-nginx wait --for=condition=Ready pods --timeout=3m --all
    pod/ingress-nginx-controller-d74c658c5-zh5x9 condition met
    PASS: pods Ready in ns/ingress-nginx
    NAME                                       READY   STATUS    RESTARTS   AGE
    ingress-nginx-controller-d74c658c5-zh5x9   1/1     Running   0          29s
  • PASS smoke-script
    notes
    exec: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/assertions/nginx-basic.sh (RELEASE=sample NAMESPACE=sample)
    ==> Waiting for nginx controller pod Ready (3m max)
    pod/ingress-nginx-controller-d74c658c5-zh5x9 condition met
    PASS: nginx controller pod Ready
    ==> Waiting for product pod Ready (3m max)
    pod/sample-69469cb4c6-kfwbt condition met
    PASS: product pods Ready
    ==> Verifying Ingress exists with ingressClassName: nginx
    Ingress class: nginx
    PASS: Ingress carries ingressClassName: nginx
    ==> Getting nginx controller pod IP
    NGINX pod IP: 10.244.0.6
    ==> Probing HTTP with Host header (expect 200)
    HTTP response (with Host): 200
    PASS: HTTP 200 with Host header
    ==> Verifying nginx controller logs show request matched product Service
    PASS: controller logs reference product Service 'sample'
    PASS: NGINX Ingress basic integration verified

Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-ingress-controllers-nginx-ingress-basic-20260530-213120-2/artifacts/logs

ingress-controllers-nginx-ingress-canary ingress-controllers-nginx-ingress-canary UNTESTED
Cluster
kind
Mechanisms
addon:nginx-ingress
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

ingress-controllers-nginx-ingress-canary ingress-controllers-nginx-ingress-canary PASS
Cluster
kind
Mechanisms
addon:nginx-ingress
Tags
nightly
Assertions · agent 0
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release sample in ns/sample is deployed
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-default -n sample wait --for=condition=Ready pods --timeout=5m --all
    pod/sample-69469cb4c6-24fnm condition met
    pod/sample-canary-575699b698-86scv condition met
    PASS: pods Ready in ns/sample
    NAME                             READY   STATUS    RESTARTS   AGE
    sample-69469cb4c6-24fnm          1/1     Running   0          3s
    sample-canary-575699b698-86scv   1/1     Running   0          3s
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-default -n ingress-nginx wait --for=condition=Ready pods --timeout=3m --all
    pod/ingress-nginx-controller-d74c658c5-c2npd condition met
    PASS: pods Ready in ns/ingress-nginx
    NAME                                       READY   STATUS    RESTARTS   AGE
    ingress-nginx-controller-d74c658c5-c2npd   1/1     Running   0          29s
  • PASS smoke-script
    notes
    PASS: canary pod Ready
    ==> Verifying stable Ingress exists
    ingress.networking.k8s.io/sample-stable
    PASS: stable Ingress exists
    ==> Verifying canary Ingress exists with canary annotations
    Canary flag: 'true', canary-weight: '20'
    PASS: canary Ingress has correct annotations
    ==> Getting nginx controller pod IP
    NGINX pod IP: 10.244.0.6
    ==> Running 100 canary probes (expect 10-30 canary hits)
      ... probe 20/100: canary=5 stable=15
      ... probe 40/100: canary=11 stable=29
      ... probe 60/100: canary=17 stable=43
      ... probe 80/100: canary=22 stable=58
      ... probe 100/100: canary=26 stable=74
    
    Canary hits: 26/100 (20% target)
    Stable hits: 74/100
    PASS: canary traffic in range [10, 30] — 26 hits
    PASS: NGINX Ingress canary integration verified

Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-ingress-controllers-nginx-ingress-canary-20260530-213615-2/artifacts/logs

ingress-controllers-nginx-ingress-default-backend ingress-controllers-nginx-ingress-default-backend UNTESTED
Cluster
kind
Mechanisms
addon:nginx-ingress
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

ingress-controllers-nginx-ingress-default-backend ingress-controllers-nginx-ingress-default-backend UNTESTED
Cluster
kind
Mechanisms
addon:nginx-ingress
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

ingress-controllers-nginx-ingress-default-backend ingress-controllers-nginx-ingress-default-backend UNTESTED
Cluster
kind
Mechanisms
addon:nginx-ingress
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

ingress-controllers-nginx-ingress-default-backend ingress-controllers-nginx-ingress-default-backend UNTESTED
Cluster
kind
Mechanisms
addon:nginx-ingress
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

ingress-controllers-nginx-ingress-default-backend ingress-controllers-nginx-ingress-default-backend UNTESTED
Cluster
kind
Mechanisms
addon:nginx-ingress
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

ingress-controllers-nginx-ingress-default-backend ingress-controllers-nginx-ingress-default-backend UNTESTED
Cluster
kind
Mechanisms
addon:nginx-ingress
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

ingress-controllers-nginx-ingress-default-backend ingress-controllers-nginx-ingress-default-backend PASS
Cluster
kind
Mechanisms
addon:nginx-ingress
Tags
nightly
Assertions · agent 0
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release sample in ns/sample is deployed
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-default -n sample wait --for=condition=Ready pods --timeout=5m --all
    pod/sample-69469cb4c6-k62qx condition met
    PASS: pods Ready in ns/sample
    NAME                      READY   STATUS    RESTARTS   AGE
    sample-69469cb4c6-k62qx   1/1     Running   0          2s
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-default -n ingress-nginx wait --for=condition=Ready pods --timeout=3m --all
    pod/custom-default-backend-6f9895b6b7-hn5r9 condition met
    pod/ingress-nginx-controller-765bc57f9-q9v87 condition met
    PASS: pods Ready in ns/ingress-nginx
    NAME                                       READY   STATUS    RESTARTS   AGE
    custom-default-backend-6f9895b6b7-hn5r9    1/1     Running   0          36s
    ingress-nginx-controller-765bc57f9-q9v87   1/1     Running   0          28s
  • PASS smoke-script
    notes
    exec: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/assertions/nginx-default-backend.sh (RELEASE=sample NAMESPACE=sample)
    ==> Waiting for nginx controller pod Ready (3m max)
    pod/ingress-nginx-controller-765bc57f9-q9v87 condition met
    PASS: nginx controller pod Ready
    ==> Waiting for product pod Ready (3m max)
    pod/sample-69469cb4c6-k62qx condition met
    PASS: product pods Ready
    ==> Waiting for custom default backend pod Ready (2m max)
    pod/custom-default-backend-6f9895b6b7-hn5r9 condition met
    PASS: custom default backend pod Ready
    ==> Getting nginx controller pod IP
    NGINX pod IP: 10.244.0.7
    ==> Probing HTTP without Host header (should hit custom default backend)
    Response body: 'chart-test-swarm-default-backend'
    PASS: custom default backend served distinctive body 'chart-test-swarm-default-backend'
    ==> Verifying Host-matched request still reaches product Service
    HTTP response (with Host): 200
    PASS: HTTP 200 with matching Host header
    PASS: NGINX Ingress default backend integration verified

Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-ingress-controllers-nginx-ingress-default-backend-20260530-213502-7/artifacts/logs

ingress-controllers-nginx-ingress-snippet-annotations ingress-controllers-nginx-ingress-snippet-annotations UNTESTED
Cluster
kind
Mechanisms
addon:nginx-ingress
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

ingress-controllers-nginx-ingress-snippet-annotations ingress-controllers-nginx-ingress-snippet-annotations PASS
Cluster
kind
Mechanisms
addon:nginx-ingress
Tags
nightly
Assertions · agent 0
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release sample in ns/sample is deployed
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-default -n sample wait --for=condition=Ready pods --timeout=5m --all
    pod/sample-69469cb4c6-t89sh condition met
    PASS: pods Ready in ns/sample
    NAME                      READY   STATUS    RESTARTS   AGE
    sample-69469cb4c6-t89sh   1/1     Running   0          4s
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-default -n ingress-nginx wait --for=condition=Ready pods --timeout=3m --all
    pod/ingress-nginx-controller-d74c658c5-856ch condition met
    PASS: pods Ready in ns/ingress-nginx
    NAME                                       READY   STATUS    RESTARTS   AGE
    ingress-nginx-controller-d74c658c5-856ch   1/1     Running   0          29s
  • PASS smoke-script
    notes
    exec: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/assertions/nginx-snippet-annotations.sh (RELEASE=sample NAMESPACE=sample)
    ==> Waiting for nginx controller pod Ready (3m max)
    pod/ingress-nginx-controller-d74c658c5-856ch condition met
    PASS: nginx controller pod Ready
    ==> Waiting for product pod Ready (3m max)
    pod/sample-69469cb4c6-t89sh condition met
    PASS: product pods Ready
    ==> Verifying Ingress has configuration-snippet annotation
    PASS: Ingress has nginx.ingress.kubernetes.io/configuration-snippet annotation
    Snippet content: add_header X-Test "chart-test-swarm";
    ==> Getting nginx controller pod IP
    NGINX pod IP: 10.244.0.6
    ==> Probing HTTP with Host header (expect 200 with X-Test header)
    HTTP response code: 200
    PASS: HTTP 200 with Host header
    ==> Verifying snippet-injected header 'X-Test: chart-test-swarm'
    Response header X-Test: 'chart-test-swarm'
    PASS: snippet-injected header 'X-Test: chart-test-swarm' present
    PASS: NGINX Ingress snippet annotations integration verified

Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-ingress-controllers-nginx-ingress-snippet-annotations-20260530-213350-2/artifacts/logs

ingress-controllers-nginx-ingress-tls-cert-manager ingress-controllers-nginx-ingress-tls-cert-manager UNTESTED
Cluster
kind
Mechanisms
addon:cert-manageraddon:nginx-ingress
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

ingress-controllers-nginx-ingress-tls-cert-manager ingress-controllers-nginx-ingress-tls-cert-manager UNTESTED
Cluster
kind
Mechanisms
addon:cert-manageraddon:nginx-ingress
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

ingress-controllers-nginx-ingress-tls-cert-manager ingress-controllers-nginx-ingress-tls-cert-manager PASS
Cluster
kind
Mechanisms
addon:cert-manageraddon:nginx-ingress
Tags
nightly
Assertions · agent 0
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release sample in ns/sample is deployed
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-default -n sample wait --for=condition=Ready pods --timeout=5m --all
    pod/sample-69469cb4c6-swdpn condition met
    PASS: pods Ready in ns/sample
    NAME                      READY   STATUS    RESTARTS   AGE
    sample-69469cb4c6-swdpn   1/1     Running   0          3s
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-default -n cert-manager wait --for=condition=Ready pods --timeout=3m --all
    pod/cert-manager-c69c859c4-6f2qv condition met
    pod/cert-manager-cainjector-d6d64f75f-wnxt7 condition met
    pod/cert-manager-webhook-566849c7fc-2xck7 condition met
    PASS: pods Ready in ns/cert-manager
    NAME                                      READY   STATUS    RESTARTS   AGE
    cert-manager-c69c859c4-6f2qv              1/1     Running   0          57s
    cert-manager-cainjector-d6d64f75f-wnxt7   1/1     Running   0          57s
    cert-manager-webhook-566849c7fc-2xck7     1/1     Running   0          57s
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-default -n ingress-nginx wait --for=condition=Ready pods --timeout=3m --all
    pod/ingress-nginx-controller-d74c658c5-9bvlx condition met
    PASS: pods Ready in ns/ingress-nginx
    NAME                                       READY   STATUS    RESTARTS   AGE
    ingress-nginx-controller-d74c658c5-9bvlx   1/1     Running   0          29s
  • PASS smoke-script
    notes
    tls.key
    OK: tls.crt, tls.key, ca.crt all present
    ==> Waiting for nginx controller pod Ready (3m max)
    pod/ingress-nginx-controller-d74c658c5-9bvlx condition met
    PASS: nginx controller pod Ready
    ==> Waiting for product pod Ready (3m max)
    pod/sample-69469cb4c6-swdpn condition met
    PASS: product pods Ready
    ==> Verifying Ingress exists with TLS
    TLS host: sample.test.local, TLS secret: sample-tls
    PASS: Ingress TLS references cert-manager Secret 'sample-tls'
    ==> Getting nginx controller pod IP
    NGINX pod IP: 10.244.0.10
    ==> Probing HTTPS with --cacert (expect 200 with cert chain rooted at ClusterIssuer CA)
    HTTPS response: 200
    PASS: HTTPS 200 with --cacert verification
    ==> Verifying peer certificate issuer matches ClusterIssuer CA
    Cert issuer: issuer=CN=sample.test.local
    NOTE: cert issuer 'issuer=CN=sample.test.local' — ClusterIssuer CA may use different DN (informational)
    PASS: Cross-feature cert-manager + nginx-ingress TLS integration verified

Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-ingress-controllers-nginx-ingress-tls-cert-manager-20260530-214046-3/artifacts/logs

ingress-controllers-traefik-basic ingress-controllers-traefik-basic UNTESTED
Cluster
kind
Mechanisms
addon:traefik
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

ingress-controllers-traefik-basic ingress-controllers-traefik-basic UNTESTED
Cluster
kind
Mechanisms
addon:traefik
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

ingress-controllers-traefik-basic ingress-controllers-traefik-basic UNTESTED
Cluster
kind
Mechanisms
addon:traefik
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

ingress-controllers-traefik-basic ingress-controllers-traefik-basic UNTESTED
Cluster
kind
Mechanisms
addon:traefik
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

ingress-controllers-traefik-basic ingress-controllers-traefik-basic UNTESTED
Cluster
kind
Mechanisms
addon:traefik
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

ingress-controllers-traefik-basic ingress-controllers-traefik-basic UNTESTED
Cluster
kind
Mechanisms
addon:traefik
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

ingress-controllers-traefik-basic ingress-controllers-traefik-basic UNTESTED
Cluster
kind
Mechanisms
addon:traefik
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

ingress-controllers-traefik-basic ingress-controllers-traefik-basic UNTESTED
Cluster
kind
Mechanisms
addon:traefik
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

ingress-controllers-traefik-basic ingress-controllers-traefik-basic PASS
Cluster
kind
Mechanisms
addon:traefik
Tags
nightly
Assertions · agent 0
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release sample in ns/sample is deployed
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-default -n sample wait --for=condition=Ready pods --timeout=5m --all
    pod/sample-69469cb4c6-xj4l4 condition met
    PASS: pods Ready in ns/sample
    NAME                      READY   STATUS    RESTARTS   AGE
    sample-69469cb4c6-xj4l4   1/1     Running   0          3s
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-default -n traefik wait --for=condition=Ready pods --timeout=3m --all
    pod/traefik-77657478fd-7tkhn condition met
    PASS: pods Ready in ns/traefik
    NAME                       READY   STATUS    RESTARTS   AGE
    traefik-77657478fd-7tkhn   1/1     Running   0          7s
  • PASS smoke-script
    notes
    exec: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/assertions/traefik-basic.sh (RELEASE=sample NAMESPACE=sample)
    ==> Waiting for Traefik pod Ready (3m max)
    pod/traefik-77657478fd-7tkhn condition met
    PASS: Traefik pod Ready
    ==> Waiting for product pod Ready (3m max)
    pod/sample-69469cb4c6-xj4l4 condition met
    PASS: product pods Ready
    ==> Getting Traefik pod IP (probe via pod IP)
    Traefik pod IP: 10.244.0.5
    ==> Verifying IngressRoute exists
    ingressroute.traefik.io/sample-basic
    PASS: IngressRoute sample-basic exists
    ==> Probing HTTP with Host header (expect 200) on container port 8000
    HTTP response (with Host): 200
    PASS: HTTP 200 with Host header
    ==> Probing HTTP without Host header (expect 404) on container port 8000
    HTTP response (without Host): 404
    PASS: HTTP 404 without Host header (Traefik default)
    PASS: Traefik basic IngressRoute integration verified

Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-ingress-controllers-traefik-basic-20260530-212546-9/artifacts/logs

ingress-controllers-traefik-ingressroute-crd ingress-controllers-traefik-ingressroute-crd UNTESTED
Cluster
kind
Mechanisms
addon:traefik
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

ingress-controllers-traefik-ingressroute-crd ingress-controllers-traefik-ingressroute-crd PASS
Cluster
kind
Mechanisms
addon:traefik
Tags
nightly
Assertions · agent 0
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release sample in ns/sample is deployed
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-default -n sample wait --for=condition=Ready pods --timeout=5m --all
    pod/sample-69469cb4c6-shksp condition met
    PASS: pods Ready in ns/sample
    NAME                      READY   STATUS    RESTARTS   AGE
    sample-69469cb4c6-shksp   1/1     Running   0          3s
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-default -n traefik wait --for=condition=Ready pods --timeout=3m --all
    pod/traefik-77657478fd-97lhs condition met
    PASS: pods Ready in ns/traefik
    NAME                       READY   STATUS    RESTARTS   AGE
    traefik-77657478fd-97lhs   1/1     Running   0          8s
  • PASS smoke-script
    notes
    exec: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/assertions/traefik-ingressroute-crd.sh (RELEASE=sample NAMESPACE=sample)
    ==> Waiting for Traefik pod Ready (3m max)
    pod/traefik-77657478fd-97lhs condition met
    PASS: Traefik pod Ready
    ==> Waiting for product pod Ready (3m max)
    pod/sample-69469cb4c6-shksp condition met
    PASS: product pods Ready
    ==> Verifying IngressRoute CRD is used (not classic Ingress)
    IngressRoute count: 1
    PASS: IngressRoute.traefik.io/v1alpha1 resources present
    ==> Verifying no classic Ingress resources exist
    Classic Ingress count: 0
    PASS: no classic Ingress resources (CRD-only routing)
    ==> Getting Traefik pod IP
    Traefik pod IP: 10.244.0.5
    ==> Probing HTTP with Host header (expect 200)
    HTTP response: 200
    PASS: HTTP 200 through IngressRoute CRD
    PASS: Traefik IngressRoute CRD integration verified

Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-ingress-controllers-traefik-ingressroute-crd-20260530-212932-2/artifacts/logs

ingress-controllers-traefik-middleware-chain ingress-controllers-traefik-middleware-chain UNTESTED
Cluster
kind
Mechanisms
addon:traefik
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

ingress-controllers-traefik-middleware-chain ingress-controllers-traefik-middleware-chain UNTESTED
Cluster
kind
Mechanisms
addon:traefik
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

ingress-controllers-traefik-middleware-chain ingress-controllers-traefik-middleware-chain PASS
Cluster
kind
Mechanisms
addon:traefik
Tags
nightly
Assertions · agent 0
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release sample in ns/sample is deployed
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-default -n sample wait --for=condition=Ready pods --timeout=5m --all
    pod/sample-69469cb4c6-mv9n7 condition met
    PASS: pods Ready in ns/sample
    NAME                      READY   STATUS    RESTARTS   AGE
    sample-69469cb4c6-mv9n7   1/1     Running   0          3s
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-default -n traefik wait --for=condition=Ready pods --timeout=3m --all
    pod/traefik-77657478fd-wjgpc condition met
    PASS: pods Ready in ns/traefik
    NAME                       READY   STATUS    RESTARTS   AGE
    traefik-77657478fd-wjgpc   1/1     Running   0          9s
  • PASS smoke-script
    notes
    ==> Waiting for Traefik pod Ready (3m max)
    pod/traefik-77657478fd-wjgpc condition met
    PASS: Traefik pod Ready
    ==> Waiting for product pod Ready (3m max)
    pod/sample-69469cb4c6-mv9n7 condition met
    PASS: product pods Ready
    ==> Verifying Middleware CR exists
    middleware.traefik.io/add-test-header
    PASS: Middleware add-test-header exists
    ==> Verifying IngressRoute references the Middleware
    PASS: IngressRoute references Middleware 'add-test-header'
    ==> Getting Traefik pod IP
    Traefik pod IP: 10.244.0.5
    ==> Probing HTTP with Host header (expect 200 with X-Test header)
    HTTP response code: 200
    PASS: HTTP 200 with Host header
    ==> Verifying middleware-injected header 'X-Test: chart-test-swarm'
    Response header X-Test: 'chart-test-swarm'
    PASS: middleware injected header 'X-Test: chart-test-swarm'
    PASS: Traefik middleware chain integration verified

Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-ingress-controllers-traefik-middleware-chain-20260530-213039-3/artifacts/logs

ingress-controllers-traefik-tls-passthrough ingress-controllers-traefik-tls-passthrough UNTESTED
Cluster
kind
Mechanisms
addon:traefik
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

ingress-controllers-traefik-tls-passthrough ingress-controllers-traefik-tls-passthrough UNTESTED
Cluster
kind
Mechanisms
addon:traefik
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

ingress-controllers-traefik-tls-passthrough ingress-controllers-traefik-tls-passthrough UNTESTED
Cluster
kind
Mechanisms
addon:traefik
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

ingress-controllers-traefik-tls-passthrough ingress-controllers-traefik-tls-passthrough UNTESTED
Cluster
kind
Mechanisms
addon:traefik
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

ingress-controllers-traefik-tls-passthrough ingress-controllers-traefik-tls-passthrough UNTESTED
Cluster
kind
Mechanisms
addon:traefik
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

ingress-controllers-traefik-tls-passthrough ingress-controllers-traefik-tls-passthrough PASS
Cluster
kind
Mechanisms
addon:traefik
Tags
nightly
Assertions · agent 0
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release sample in ns/sample is deployed
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-default -n sample wait --for=condition=Ready pods --timeout=5m --all
    pod/sample-697b9f98fb-8rdzm condition met
    PASS: pods Ready in ns/sample
    NAME                      READY   STATUS    RESTARTS   AGE
    sample-697b9f98fb-8rdzm   1/1     Running   0          5s
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-default -n traefik wait --for=condition=Ready pods --timeout=3m --all
    pod/traefik-77657478fd-c8nwp condition met
    PASS: pods Ready in ns/traefik
    NAME                       READY   STATUS    RESTARTS   AGE
    traefik-77657478fd-c8nwp   1/1     Running   0          16s
  • PASS smoke-script
    notes
    exec: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/assertions/traefik-tls-passthrough.sh (RELEASE=sample NAMESPACE=sample)
    ==> Waiting for Traefik pod Ready (3m max)
    pod/traefik-77657478fd-c8nwp condition met
    PASS: Traefik pod Ready
    ==> Waiting for product pod Ready (3m max)
    pod/sample-697b9f98fb-8rdzm condition met
    PASS: product pods Ready
    ==> Getting Traefik pod IP
    Traefik pod IP: 10.244.0.5
    ==> Verifying IngressRouteTCP exists with tls.passthrough=true
    PASS: IngressRouteTCP tls.passthrough=true
    ==> Extracting backend certificate subject
    Backend cert subject: subject=C=US, ST=CA, O=Chart Test Swarm, CN=sample.sample.svc
    ==> Probing HTTPS through Traefik (expect 200, backend cert)
    HTTPS response: 200
    PASS: HTTPS 200 through Traefik
    ==> Verifying served cert matches backend cert (not Traefik default)
    Served cert subject: *  subject: C=US; ST=CA; O=Chart Test Swarm; CN=sample.sample.svc
    PASS: served cert subject matches backend cert (CN=sample.sample.svc)
    PASS: Traefik TLS passthrough integration verified

Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-ingress-controllers-traefik-tls-passthrough-20260530-212802-6/artifacts/logs

minimal minimal UNTESTED
Cluster
kind
Mechanisms
addon:none
Tags
pr-subsetnightly

⚠ no agent reported on this scenario — UNTESTED

minimal minimal UNTESTED
Cluster
kind
Mechanisms
addon:none
Tags
pr-subsetnightly

⚠ no agent reported on this scenario — UNTESTED

minimal minimal UNTESTED
Cluster
kind
Mechanisms
addon:none
Tags
pr-subsetnightly

⚠ no agent reported on this scenario — UNTESTED

minimal minimal UNTESTED
Cluster
kind
Mechanisms
addon:none
Tags
pr-subsetnightly

⚠ no agent reported on this scenario — UNTESTED

minimal minimal UNTESTED
Cluster
kind
Mechanisms
addon:none
Tags
pr-subsetnightly

⚠ no agent reported on this scenario — UNTESTED

minimal minimal UNTESTED
Cluster
kind
Mechanisms
addon:none
Tags
pr-subsetnightly

⚠ no agent reported on this scenario — UNTESTED

minimal minimal UNTESTED
Cluster
kind
Mechanisms
addon:none
Tags
pr-subsetnightly

⚠ no agent reported on this scenario — UNTESTED

minimal minimal UNTESTED
Cluster
kind
Mechanisms
addon:none
Tags
pr-subsetnightly

⚠ no agent reported on this scenario — UNTESTED

minimal minimal UNTESTED
Cluster
kind
Mechanisms
addon:none
Tags
pr-subsetnightly

⚠ no agent reported on this scenario — UNTESTED

minimal minimal INTERRUPTED
Cluster
kind
Mechanisms
addon:none
Tags
pr-subsetnightly

⚠ no agent reported on this scenario — UNTESTED

service-mesh-istio-ingress-gateway-basic service-mesh-istio-ingress-gateway-basic UNTESTED
Cluster
kind
Mechanisms
addon:istiomesh:istio-ingress-gateway
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

service-mesh-istio-ingress-gateway-basic service-mesh-istio-ingress-gateway-basic UNTESTED
Cluster
kind
Mechanisms
addon:istiomesh:istio-ingress-gateway
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

service-mesh-istio-ingress-gateway-basic service-mesh-istio-ingress-gateway-basic PASS
Cluster
kind
Mechanisms
addon:istiomesh:istio-ingress-gateway
Tags
nightly
Assertions · agent 0
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release istio-base in ns/istio-system is deployed
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release istiod in ns/istio-system is deployed
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release istio-ingressgateway in ns/istio-system is deployed
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release sample in ns/sample is deployed
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-default -n istio-system wait --for=condition=Ready pods --timeout=5m -l app=istiod
    pod/istiod-54b585df85-bt7bq condition met
    PASS: pods Ready in ns/istio-system (selector=app=istiod)
    NAME                      READY   STATUS    RESTARTS   AGE
    istiod-54b585df85-bt7bq   1/1     Running   0          13s
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-default -n istio-system wait --for=condition=Ready pods --timeout=3m -l app=istio-ingressgateway
    pod/istio-ingressgateway-8584b67974-ph6t8 condition met
    PASS: pods Ready in ns/istio-system (selector=app=istio-ingressgateway)
    NAME                                    READY   STATUS    RESTARTS   AGE
    istio-ingressgateway-8584b67974-ph6t8   1/1     Running   0          8s
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-default -n sample wait --for=condition=Ready pods --timeout=3m --all
    pod/sample-7dcd986bd4-cf9gd condition met
    PASS: pods Ready in ns/sample
    NAME                      READY   STATUS    RESTARTS   AGE
    sample-7dcd986bd4-cf9gd   1/1     Running   0          3s
  • PASS smoke-script
    notes
    exec: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/assertions/istio-ingress-gateway-basic.sh (RELEASE=sample NAMESPACE=sample)
    ==> Creating Istio Gateway + VirtualService
    gateway.networking.istio.io/sample-igw created
    virtualservice.networking.istio.io/sample-vs created
    ==> Waiting for istiod to reconcile Gateway (15s)
    ==> Verifying Gateway resource is admitted
      ✓ Gateway sample-igw exists
    ==> Verifying VirtualService resource exists
      ✓ VirtualService sample-vs exists
    ==> Getting istio-ingressgateway pod IP
      Gateway pod IP: 10.244.0.6
    ==> Probing product through istio ingress gateway
    HTTP response through gateway: 200
    PASS: traffic routed through istio ingress gateway
    PASS: istio ingress gateway basic integration verified

Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-service-mesh-istio-ingress-gateway-basic-20260531-204053-3/artifacts/logs

service-mesh-istio-ingress-gateway-jwt service-mesh-istio-ingress-gateway-jwt UNTESTED
Cluster
kind
Mechanisms
addon:istiomesh:istio-ingress-gateway
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

service-mesh-istio-ingress-gateway-jwt service-mesh-istio-ingress-gateway-jwt UNTESTED
Cluster
kind
Mechanisms
addon:istiomesh:istio-ingress-gateway
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

service-mesh-istio-ingress-gateway-jwt service-mesh-istio-ingress-gateway-jwt PASS
Cluster
kind
Mechanisms
addon:istiomesh:istio-ingress-gateway
Tags
nightly
Assertions · agent 0
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release istio-base in ns/istio-system is deployed
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release istiod in ns/istio-system is deployed
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release istio-ingressgateway in ns/istio-system is deployed
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release sample in ns/sample is deployed
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-default -n istio-system wait --for=condition=Ready pods --timeout=5m -l app=istiod
    pod/istiod-54b585df85-dtws8 condition met
    PASS: pods Ready in ns/istio-system (selector=app=istiod)
    NAME                      READY   STATUS    RESTARTS   AGE
    istiod-54b585df85-dtws8   1/1     Running   0          12s
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-default -n istio-system wait --for=condition=Ready pods --timeout=3m -l app=istio-ingressgateway
    pod/istio-ingressgateway-8584b67974-gccjm condition met
    PASS: pods Ready in ns/istio-system (selector=app=istio-ingressgateway)
    NAME                                    READY   STATUS    RESTARTS   AGE
    istio-ingressgateway-8584b67974-gccjm   1/1     Running   0          7s
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-default -n sample wait --for=condition=Ready pods --timeout=3m --all
    pod/sample-7dcd986bd4-tqwz9 condition met
    PASS: pods Ready in ns/sample
    NAME                      READY   STATUS    RESTARTS   AGE
    sample-7dcd986bd4-tqwz9   1/1     Running   0          3s
  • PASS smoke-script
    notes
    ==> Creating Istio Gateway + VirtualService
    gateway.networking.istio.io/sample-igw created
    virtualservice.networking.istio.io/sample-vs created
    ==> Creating RequestAuthentication (JWT validation)
    configmap/jwt-jwks created
    requestauthentication.security.istio.io/sample-jwt-auth created
    ==> Creating AuthorizationPolicy (require JWT via ALLOW)
    authorizationpolicy.security.istio.io/sample-require-jwt created
    ==> Waiting for istiod to reconcile policies (15s)
    ==> Getting istio-ingressgateway pod IP
      Gateway pod IP: 10.244.0.6
    ==> Signing JWT with test issuer key
      JWT generated (expires in 1h)
    ==> Test 1: Request WITHOUT Bearer token → expect 401 or 403
      HTTP code (no auth): 403
      ✓ Request without token correctly rejected
    ==> Test 2: Request WITH valid Bearer token → expect 200
      HTTP code (with valid JWT): 200
      ✓ Request with valid JWT succeeds
    PASS: istio ingress gateway JWT authentication verified

Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-service-mesh-istio-ingress-gateway-jwt-20260531-205541-3/artifacts/logs

service-mesh-istio-ingress-gateway-multi-host service-mesh-istio-ingress-gateway-multi-host UNTESTED
Cluster
kind
Mechanisms
addon:istiomesh:istio-ingress-gateway
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

service-mesh-istio-ingress-gateway-multi-host service-mesh-istio-ingress-gateway-multi-host PASS
Cluster
kind
Mechanisms
addon:istiomesh:istio-ingress-gateway
Tags
nightly
Assertions · agent 0
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release istio-base in ns/istio-system is deployed
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release istiod in ns/istio-system is deployed
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release istio-ingressgateway in ns/istio-system is deployed
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release sample in ns/sample is deployed
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-default -n istio-system wait --for=condition=Ready pods --timeout=5m -l app=istiod
    pod/istiod-54b585df85-r6fcx condition met
    PASS: pods Ready in ns/istio-system (selector=app=istiod)
    NAME                      READY   STATUS    RESTARTS   AGE
    istiod-54b585df85-r6fcx   1/1     Running   0          11s
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-default -n istio-system wait --for=condition=Ready pods --timeout=3m -l app=istio-ingressgateway
    pod/istio-ingressgateway-8584b67974-v9thg condition met
    PASS: pods Ready in ns/istio-system (selector=app=istio-ingressgateway)
    NAME                                    READY   STATUS    RESTARTS   AGE
    istio-ingressgateway-8584b67974-v9thg   1/1     Running   0          7s
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-default -n sample wait --for=condition=Ready pods --timeout=3m --all
    pod/sample-7dcd986bd4-2c9wj condition met
    PASS: pods Ready in ns/sample
    NAME                      READY   STATUS    RESTARTS   AGE
    sample-7dcd986bd4-2c9wj   1/1     Running   0          3s
  • PASS smoke-script
    notes
    exec: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/assertions/istio-ingress-gateway-multi-host.sh (RELEASE=sample NAMESPACE=sample)
    ==> Creating multi-host Istio Gateway + VirtualService
    gateway.networking.istio.io/sample-igw-multi created
    Warning: virtualService rule #1 match #0 is not used (duplicate/overlapping match in rule #0)
    Warning: virtualService rule #1 not used (all matches used by prior rules)
    virtualservice.networking.istio.io/sample-vs-multi created
    ==> Waiting for istiod to reconcile Gateway + VirtualService (15s)
    ==> Verifying Gateway resource is admitted
      ✓ Gateway sample-igw-multi exists
    ==> Getting istio-ingressgateway pod IP
      Gateway pod IP: 10.244.0.6
    ==> Probing skywatcher host through gateway
      Skywatcher HTTP code: 200
    ==> Probing api host through gateway
      API HTTP code: 200
    PASS: multi-host routing through istio ingress gateway verified

Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-service-mesh-istio-ingress-gateway-multi-host-20260531-204940-2/artifacts/logs

service-mesh-istio-ingress-gateway-request-authentication service-mesh-istio-ingress-gateway-request-authentication UNTESTED
Cluster
kind
Mechanisms
addon:istiomesh:istio-ingress-gateway
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

service-mesh-istio-ingress-gateway-request-authentication service-mesh-istio-ingress-gateway-request-authentication PASS
Cluster
kind
Mechanisms
addon:istiomesh:istio-ingress-gateway
Tags
nightly
Assertions · agent 0
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release istio-base in ns/istio-system is deployed
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release istiod in ns/istio-system is deployed
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release istio-ingressgateway in ns/istio-system is deployed
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release sample in ns/sample is deployed
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-default -n istio-system wait --for=condition=Ready pods --timeout=5m -l app=istiod
    pod/istiod-54b585df85-bwxw4 condition met
    PASS: pods Ready in ns/istio-system (selector=app=istiod)
    NAME                      READY   STATUS    RESTARTS   AGE
    istiod-54b585df85-bwxw4   1/1     Running   0          12s
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-default -n istio-system wait --for=condition=Ready pods --timeout=3m -l app=istio-ingressgateway
    pod/istio-ingressgateway-8584b67974-flc49 condition met
    PASS: pods Ready in ns/istio-system (selector=app=istio-ingressgateway)
    NAME                                    READY   STATUS    RESTARTS   AGE
    istio-ingressgateway-8584b67974-flc49   1/1     Running   0          7s
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-default -n sample wait --for=condition=Ready pods --timeout=3m --all
    pod/sample-7dcd986bd4-gk7dz condition met
    PASS: pods Ready in ns/sample
    NAME                      READY   STATUS    RESTARTS   AGE
    sample-7dcd986bd4-gk7dz   1/1     Running   0          3s
  • PASS smoke-script
    notes
    ==> JWT key: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/fixtures/service-mesh/jwt/jwt-key.pem
    ==> JWKS:    /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/fixtures/service-mesh/jwt/jwks.json
    ==> Creating Istio Gateway + VirtualService
    gateway.networking.istio.io/sample-igw created
    virtualservice.networking.istio.io/sample-vs created
    ==> Creating RequestAuthentication (JWT validation ONLY, no deny)
    requestauthentication.security.istio.io/sample-jwt-validate created
    ==> Waiting for istiod to reconcile policies (15s)
    ==> Getting istio-ingressgateway pod IP
      Gateway pod IP: 10.244.0.6
    ==> Test 1: Request WITHOUT Bearer token → should pass (no deny rule)
      HTTP code (no auth): 200
      ✓ Request without token passes through (no enforcement)
    ==> Test 2: Request WITH valid JWT → should succeed
      HTTP code (valid JWT): 200
      ✓ Request with valid JWT succeeds
    ==> Test 3: Request WITH invalid JWT (wrong issuer) → should be rejected
      HTTP code (invalid JWT): 401
      ✓ Invalid JWT correctly rejected (RequestAuthentication validates)
    PASS: istio ingress gateway RequestAuthentication (validate-only, no deny) verified

Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-service-mesh-istio-ingress-gateway-request-authentication-20260531-205915-2/artifacts/logs

service-mesh-istio-service-mesh-cert-manager-tls service-mesh-istio-service-mesh-cert-manager-tls UNTESTED
Cluster
kind
Mechanisms
addon:istioaddon:cert-managermesh:istio-service-mesh
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

service-mesh-istio-service-mesh-cert-manager-tls service-mesh-istio-service-mesh-cert-manager-tls PASS
Cluster
kind
Mechanisms
addon:istioaddon:cert-managermesh:istio-service-mesh
Tags
nightly
Assertions · agent 0
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release cert-manager in ns/cert-manager is deployed
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release istio-base in ns/istio-system is deployed
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release istiod in ns/istio-system is deployed
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release istio-ingressgateway in ns/istio-system is deployed
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release sample in ns/sample is deployed
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-default -n cert-manager wait --for=condition=Ready pods --timeout=5m --all
    pod/cert-manager-c69c859c4-dw6t2 condition met
    pod/cert-manager-cainjector-d6d64f75f-wmg4t condition met
    pod/cert-manager-webhook-566849c7fc-zxg54 condition met
    PASS: pods Ready in ns/cert-manager
    NAME                                      READY   STATUS    RESTARTS   AGE
    cert-manager-c69c859c4-dw6t2              1/1     Running   0          39s
    cert-manager-cainjector-d6d64f75f-wmg4t   1/1     Running   0          39s
    cert-manager-webhook-566849c7fc-zxg54     1/1     Running   0          39s
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-default -n istio-system wait --for=condition=Ready pods --timeout=5m --all
    pod/istio-ingressgateway-8584b67974-xphfm condition met
    pod/istiod-54b585df85-287x8 condition met
    PASS: pods Ready in ns/istio-system
    NAME                                    READY   STATUS    RESTARTS   AGE
    istio-ingressgateway-8584b67974-xphfm   1/1     Running   0          8s
    istiod-54b585df85-287x8                 1/1     Running   0          15s
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-default -n sample wait --for=condition=Ready pods --timeout=5m --all
    pod/sample-6f8587999b-dkq2f condition met
    PASS: pods Ready in ns/sample
    NAME                      READY   STATUS    RESTARTS   AGE
    sample-6f8587999b-dkq2f   1/1     Running   0          4s
  • PASS smoke-script
    notes
    2026-06-01T00:19:26.545770Zinfocachereturned workload certificate from cachettl=23h59m59.454230079s
    2026-06-01T00:19:26.545915Zinfocachereturned workload trust anchor from cachettl=23h59m59.454085371s
    2026-06-01T00:19:26.545994Zinfocachereturned workload trust anchor from cachettl=23h59m59.454005996s
    2026-06-01T00:19:26.915710ZinfoReadiness succeeded in 646.41675ms
    2026-06-01T00:19:26.915967ZinfoEnvoy proxy is ready
    ==> Running istioctl analyze (downloading if needed)
      Downloading istioctl 1.27.9...
    SKIP: istioctl not available; skipping analyze step
    ==> Testing HTTPS through Istio Gateway with TLS
    pod/ct-gw-tls-probe created
    pod/ct-gw-tls-probe condition met
    PASS: test pod ct-gw-tls-probe ready
    Gateway service IP: 10.96.144.5
    HTTPS response through Gateway: 200
    PASS: HTTPS 200 through Istio Gateway with cert-manager-issued cert
    ==> Verifying peer certificate issuer matches cert-manager
    Peer cert issuer: 
    pod "ct-gw-tls-probe" force deleted from sample namespace
    NOTE: peer certificate issuer not matching expected pattern: 
    PASS: Istio Gateway + cert-manager TLS cross-feature compose verified

Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-service-mesh-istio-service-mesh-cert-manager-tls-20260531-201823-2/artifacts/logs

service-mesh-istio-service-mesh-peer-authentication service-mesh-istio-service-mesh-peer-authentication PASS
Cluster
kind
Mechanisms
addon:istiomesh:istio-service-mesh
Tags
nightly
Assertions · agent 0
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release istio-base in ns/istio-system is deployed
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release istiod in ns/istio-system is deployed
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release sample in ns/sample is deployed
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-default -n istio-system wait --for=condition=Ready pods --timeout=5m -l app=istiod
    pod/istiod-54b585df85-vg2rp condition met
    PASS: pods Ready in ns/istio-system (selector=app=istiod)
    NAME                      READY   STATUS    RESTARTS   AGE
    istiod-54b585df85-vg2rp   1/1     Running   0          7s
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-default -n sample wait --for=condition=Ready pods --timeout=5m --all
    pod/sample-6f8587999b-cmc6x condition met
    PASS: pods Ready in ns/sample
    NAME                      READY   STATUS    RESTARTS   AGE
    sample-6f8587999b-cmc6x   1/1     Running   0          4s
  • PASS smoke-script
    notes
    PASS: in-mesh traffic allowed under PERMISSIVE
    ==> Phase 2: Updating PeerAuthentication to STRICT
    peerauthentication.security.istio.io/sample-perm configured
    ==> Verifying PeerAuthentication STRICT
    PeerAuthentication mode: STRICT
    PASS: PeerAuthentication updated to STRICT
    ==> Waiting 10s for mTLS policy propagation
    ==> Phase 2a: Non-mesh probe under STRICT (expect rejection)
    Non-mesh HTTP under STRICT: 000
    PASS: non-mesh traffic rejected under STRICT (code=000)
    ==> Phase 2b: In-mesh probe under STRICT (expect 200)
    In-mesh HTTP under STRICT: 200
    PASS: in-mesh traffic still works under STRICT via auto-upgraded mTLS
    ==> Cleaning up pods and control namespace
    pod "ct-nonmesh" deleted from sample-plain namespace
    error: timed out waiting for the condition on pods/ct-nonmesh
    pod "ct-mesh-probe" deleted from sample namespace
    error: timed out waiting for the condition on pods/ct-mesh-probe
    namespace "sample-plain" deleted
    PASS: istio PeerAuthentication lifecycle verified

Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-service-mesh-istio-service-mesh-peer-authentication-20260531-200357/artifacts/logs

service-mesh-istio-service-mesh-sidecar-injection service-mesh-istio-service-mesh-sidecar-injection UNTESTED
Cluster
kind
Mechanisms
addon:istiomesh:istio-service-mesh
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

service-mesh-istio-service-mesh-sidecar-injection service-mesh-istio-service-mesh-sidecar-injection UNTESTED
Cluster
kind
Mechanisms
addon:istiomesh:istio-service-mesh
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

service-mesh-istio-service-mesh-sidecar-injection service-mesh-istio-service-mesh-sidecar-injection FAIL
Cluster
kind
Mechanisms
addon:istiomesh:istio-service-mesh
Tags
nightly
Error
error 1145 B · 20 ln
smoke-script:
exec: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/assertions/istio-sidecar-injection.sh (RELEASE=sample NAMESPACE=sample)
==> Labeling namespace sample for istio injection
namespace/sample labeled
==> Restarting deployments to pick up sidecar injection
  Restarting deployment/sample
deployment.apps/sample restarted
  Waiting for rollout of deployment/sample to complete (3m max)
Waiting for deployment "sample" rollout to finish: 1 old replicas are pending termination...
Waiting for deployment "sample" rollout to finish: 1 old replicas are pending termination...
deployment "sample" successfully rolled out
PASS: all deployments rolled out
==> Waiting 5s for old pods to terminate
==> Verifying istio-proxy sidecar injected into every product pod
  Pod sample-cff994cb6-tjl8j (deploy/sample) containers (2): app istio-proxy
    ✓ istio-proxy sidecar present
PASS: every Running product pod has exactly 2 containers including istio-proxy
==> Probing product Service over the mesh from an in-mesh pod
HTTP response from in-mesh probe: 000
FAIL: expected HTTP 200 from in-mesh probe, got 000
Log
/Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-service-mesh-istio-service-mesh-sidecar-injection-20260531-195326-3/artifacts/logs
Assertions · agent 0
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release istio-base in ns/istio-system is deployed
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release istiod in ns/istio-system is deployed
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release sample in ns/sample is deployed
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-default -n istio-system wait --for=condition=Ready pods --timeout=5m -l app=istiod
    pod/istiod-54b585df85-8gw77 condition met
    PASS: pods Ready in ns/istio-system (selector=app=istiod)
    NAME                      READY   STATUS    RESTARTS   AGE
    istiod-54b585df85-8gw77   1/1     Running   0          8s
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-default -n sample wait --for=condition=Ready pods --timeout=5m --all
    pod/sample-6f8587999b-9tmfl condition met
    PASS: pods Ready in ns/sample
    NAME                      READY   STATUS    RESTARTS   AGE
    sample-6f8587999b-9tmfl   1/1     Running   0          4s
  • FAIL smoke-script
    notes
    exec: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/assertions/istio-sidecar-injection.sh (RELEASE=sample NAMESPACE=sample)
    ==> Labeling namespace sample for istio injection
    namespace/sample labeled
    ==> Restarting deployments to pick up sidecar injection
      Restarting deployment/sample
    deployment.apps/sample restarted
      Waiting for rollout of deployment/sample to complete (3m max)
    Waiting for deployment "sample" rollout to finish: 1 old replicas are pending termination...
    Waiting for deployment "sample" rollout to finish: 1 old replicas are pending termination...
    deployment "sample" successfully rolled out
    PASS: all deployments rolled out
    ==> Waiting 5s for old pods to terminate
    ==> Verifying istio-proxy sidecar injected into every product pod
      Pod sample-cff994cb6-tjl8j (deploy/sample) containers (2): app istio-proxy
        ✓ istio-proxy sidecar present
    PASS: every Running product pod has exactly 2 containers including istio-proxy
    ==> Probing product Service over the mesh from an in-mesh pod
    HTTP response from in-mesh probe: 000
    FAIL: expected HTTP 200 from in-mesh probe, got 000

Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-service-mesh-istio-service-mesh-sidecar-injection-20260531-195326-3/artifacts/logs

service-mesh-istio-service-mesh-strict-mtls service-mesh-istio-service-mesh-strict-mtls UNTESTED
Cluster
kind
Mechanisms
addon:istiomesh:istio-service-mesh
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

service-mesh-istio-service-mesh-strict-mtls service-mesh-istio-service-mesh-strict-mtls PASS
Cluster
kind
Mechanisms
addon:istiomesh:istio-service-mesh
Tags
nightly
Assertions · agent 0
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release istio-base in ns/istio-system is deployed
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release istiod in ns/istio-system is deployed
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release sample in ns/sample is deployed
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-default -n istio-system wait --for=condition=Ready pods --timeout=5m -l app=istiod
    pod/istiod-54b585df85-rqjwh condition met
    PASS: pods Ready in ns/istio-system (selector=app=istiod)
    NAME                      READY   STATUS    RESTARTS   AGE
    istiod-54b585df85-rqjwh   1/1     Running   0          7s
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-default -n sample wait --for=condition=Ready pods --timeout=5m --all
    pod/sample-6f8587999b-fs8zw condition met
    PASS: pods Ready in ns/sample
    NAME                      READY   STATUS    RESTARTS   AGE
    sample-6f8587999b-fs8zw   1/1     Running   0          3s
  • PASS smoke-script
    notes
    ==> Creating non-mesh namespace sample-plain (no injection label)
    namespace/sample-plain created
    ==> Non-mesh probe: plain HTTP from pod without sidecar (expect failure)
    pod/ct-nonmesh created
    pod/ct-nonmesh condition met
    HTTP response from non-mesh probe: 000
    PASS: plain HTTP from non-mesh pod rejected (code=000)
    ==> In-mesh probe: HTTP from pod with sidecar (expect 200)
    pod/ct-mesh-probe created
      Waiting for in-mesh probe pod to be ready (2m max)
    pod/ct-mesh-probe condition met
    HTTP response from in-mesh probe: 200
    PASS: in-mesh pod reached product Service with HTTP 200 via auto-upgraded mTLS
    pod "ct-nonmesh" deleted from sample-plain namespace
    error: timed out waiting for the condition on pods/ct-nonmesh
    pod "ct-mesh-probe" deleted from sample namespace
    error: timed out waiting for the condition on pods/ct-mesh-probe
    ==> Cleaning up control namespace
    namespace "sample-plain" deleted
    PASS: istio strict mTLS integration verified

Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-service-mesh-istio-service-mesh-strict-mtls-20260531-200148-2/artifacts/logs

service-mesh-istio-service-mesh-telemetry-v2 service-mesh-istio-service-mesh-telemetry-v2 PASS
Cluster
kind
Mechanisms
addon:istiomesh:istio-service-mesh
Tags
nightly
Assertions · agent 0
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release istio-base in ns/istio-system is deployed
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release istiod in ns/istio-system is deployed
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release sample in ns/sample is deployed
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-default -n istio-system wait --for=condition=Ready pods --timeout=5m -l app=istiod
    pod/istiod-54b585df85-fcqgz condition met
    PASS: pods Ready in ns/istio-system (selector=app=istiod)
    NAME                      READY   STATUS    RESTARTS   AGE
    istiod-54b585df85-fcqgz   1/1     Running   0          8s
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-default -n sample wait --for=condition=Ready pods --timeout=5m --all
    pod/sample-6f8587999b-bc9pp condition met
    PASS: pods Ready in ns/sample
    NAME                      READY   STATUS    RESTARTS   AGE
    sample-6f8587999b-bc9pp   1/1     Running   0          3s
  • PASS smoke-script
    notes
    Waiting for deployment "sample" rollout to finish: 1 old replicas are pending termination...
    Waiting for deployment "sample" rollout to finish: 1 old replicas are pending termination...
    deployment "sample" successfully rolled out
    PASS: all deployments rolled out with sidecars
    ==> Applying Telemetry resource in namespace sample
    telemetry.telemetry.istio.io/sample-telemetry created
    PASS: Telemetry resource sample-telemetry created
    ==> Verifying Telemetry resource exists
    PASS: Telemetry resource confimed
    ==> Verifying Telemetry spec has accessLogging
    Access log provider: envoy
    PASS: access logging configured with envoy provider
    ==> Querying istio-proxy stats endpoint for metrics
      Probing proxy stats on pod sample-6f8587999b-bc9pp sidecar istio-proxy
    NOTE: istio-proxy stats returned but no upstream_cx_active metrics found (may be initial)
    NOTE: istio_requests_total not yet present (no traffic generated)
    ==> Verifying istio-proxy can generate access logs
    NOTE: local request returned empty (may be normal for nginx default page)
    NOTE: prometheus metrics path may not be directly visible in stats endpoint
    PASS: istio Telemetry v2 integration verified

Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-service-mesh-istio-service-mesh-telemetry-v2-20260531-200615/artifacts/logs

service-mesh-linkerd-basic-mesh service-mesh-linkerd-basic-mesh UNTESTED
Cluster
kind
Mechanisms
addon:linkerdmesh:linkerd
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

service-mesh-linkerd-basic-mesh service-mesh-linkerd-basic-mesh UNTESTED
Cluster
kind
Mechanisms
addon:linkerdmesh:linkerd
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

service-mesh-linkerd-basic-mesh service-mesh-linkerd-basic-mesh UNTESTED
Cluster
kind
Mechanisms
addon:linkerdmesh:linkerd
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

service-mesh-linkerd-basic-mesh service-mesh-linkerd-basic-mesh UNTESTED
Cluster
kind
Mechanisms
addon:linkerdmesh:linkerd
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

service-mesh-linkerd-basic-mesh service-mesh-linkerd-basic-mesh UNTESTED
Cluster
kind
Mechanisms
addon:linkerdmesh:linkerd
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

service-mesh-linkerd-basic-mesh service-mesh-linkerd-basic-mesh UNTESTED
Cluster
kind
Mechanisms
addon:linkerdmesh:linkerd
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

service-mesh-linkerd-basic-mesh service-mesh-linkerd-basic-mesh UNTESTED
Cluster
kind
Mechanisms
addon:linkerdmesh:linkerd
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

service-mesh-linkerd-basic-mesh service-mesh-linkerd-basic-mesh UNTESTED
Cluster
kind
Mechanisms
addon:linkerdmesh:linkerd
Tags
nightly

⚠ no agent reported on this scenario — UNTESTED

service-mesh-linkerd-basic-mesh service-mesh-linkerd-basic-mesh PASS
Cluster
kind
Mechanisms
addon:linkerdmesh:linkerd
Tags
nightly
Assertions · agent 0
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release linkerd-crds in ns/linkerd is deployed
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release linkerd-control-plane in ns/linkerd is deployed
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release sample in ns/sample is deployed
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-default -n linkerd wait --for=condition=Ready pods --timeout=10m --all
    pod/linkerd-destination-649b766779-zsh7h condition met
    pod/linkerd-identity-68fb644f96-8267h condition met
    pod/linkerd-proxy-injector-57f9597568-s6cks condition met
    PASS: pods Ready in ns/linkerd
    NAME                                      READY   STATUS    RESTARTS   AGE
    linkerd-destination-649b766779-zsh7h      4/4     Running   0          41s
    linkerd-identity-68fb644f96-8267h         2/2     Running   0          41s
    linkerd-proxy-injector-57f9597568-s6cks   2/2     Running   0          41s
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-default -n sample wait --for=condition=Ready pods --timeout=5m --all
    pod/sample-7dcd986bd4-nmc67 condition met
    pod/sample-scope-c689dc867-xb476 condition met
    PASS: pods Ready in ns/sample
    NAME                           READY   STATUS    RESTARTS   AGE
    sample-7dcd986bd4-nmc67        1/1     Running   0          40s
    sample-scope-c689dc867-xb476   1/1     Running   0          40s
  • PASS smoke-script
    notes
    × 'linkerd-config' config map exists
        configmaps "linkerd-config" is forbidden: User "system:serviceaccount:sample:default" cannot get resource "configmaps" in API group "" in the namespace "linkerd"
        see https://linkerd.io/2.14/checks/#l5d-existence-linkerd-config for hints
    
    Failed to run extensions checks: namespaces is forbidden: User "system:serviceaccount:sample:default" cannot list resource "namespaces" in API group "" at the cluster scope
    ==> Check exit code: 1
    WARN: linkerd check did not produce expected 'Status check results' message
      This may be due to the probe pod not having cluster-wide RBAC.
      The sidecar injection verification above is the primary gate.
    pod "ct-linkerd-check" deleted from sample namespace
    ==> Probing product Service from an in-mesh test pod
    pod/ct-mesh-probe created
      Waiting for probe pod to be ready (2m max)
    pod/ct-mesh-probe condition met
      Probe pod containers: linkerd-proxy ct-mesh-probe
    HTTP response from in-mesh probe: 200
    PASS: in-mesh pod reached product Service with HTTP 200
    pod "ct-mesh-probe" deleted from sample namespace
    error: timed out waiting for the condition on pods/ct-mesh-probe
    PASS: linkerd basic mesh integration verified

Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-service-mesh-linkerd-basic-mesh-20260531-225454-10/artifacts/logs

subchart-postgres-internal subchart-postgres-internal PASS
Cluster
kind
Mechanisms
subchart:postgres-internal
Tags
pr-subsetnightly
Assertions · agent 0
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release sample in ns/sample is deployed
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-bench-15 -n sample wait --for=condition=Ready pods --timeout=4m --all
    pod/sample-5967fcc884-v2mm7 condition met
    PASS: pods Ready in ns/sample
    NAME                      READY   STATUS    RESTARTS   AGE
    sample-5967fcc884-v2mm7   1/1     Running   0          2s

Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-subchart-postgres-internal-20260530-104951/artifacts/logs

with-cert-manager with-cert-manager UNTESTED
Cluster
kind
Mechanisms
addon:cert-manager
Tags
pr-subsetnightly

⚠ no agent reported on this scenario — UNTESTED

with-cert-manager with-cert-manager UNTESTED
Cluster
kind
Mechanisms
addon:cert-manager
Tags
pr-subsetnightly

⚠ no agent reported on this scenario — UNTESTED

with-cert-manager with-cert-manager UNTESTED
Cluster
kind
Mechanisms
addon:cert-manager
Tags
pr-subsetnightly

⚠ no agent reported on this scenario — UNTESTED

with-cert-manager with-cert-manager PASS
Cluster
kind
Mechanisms
addon:cert-manager
Tags
pr-subsetnightly
Assertions · agent 0
  • PASS helm-status-deployed
    notes
    helm status: deployed
    PASS: release sample in ns/sample is deployed
  • PASS pods-ready
    notes
    kubectl --context kind-chart-test-swarm-bench-16 -n sample wait --for=condition=Ready pods --timeout=5m --all
    pod/sample-5967fcc884-jg4pc condition met
    PASS: pods Ready in ns/sample
    NAME                      READY   STATUS    RESTARTS   AGE
    sample-5967fcc884-jg4pc   1/1     Running   0          3s

Logs: /Users/rohit/Documents/chart-test-swarm/examples/sample-product-chart/chart-test/reports/scenario-with-cert-manager-20260530-105022-4/artifacts/logs