vichaos commented on issue #882: URL: https://github.com/apache/apisix-helm-chart/issues/882#issuecomment-3424619766
@AlinsRan I suspect that having an APISIX instance running in the ingress-apisix namespace is causing APISIX pods in other namespaces to pass their health checks and appear ready. This image showing that APISIX instance in `alpha` namespace pass their health checks when I have deployed another APISIX instance running in the `ingress-apisix` namespace <img width="3120" height="1779" alt="Image" src="https://github.com/user-attachments/assets/e104a534-bfd8-4f90-8916-6fdfde02db4c"; /> Here is the controller logs Controller log in `alpha` namespace ``` $ kubectl logs apisix-private-ingress-controller-5fb899b87-4cqpj -n alpha Defaulted container "manager" out of: manager, adc-server 2025-10-21T03:47:34.274Z INFO root/root.go:136 controller start configuration {"config": {"log_level":"info","controller_name":"apisix.apache.org/apisix-ingress-controller","leader_election_id":"apisix-ingress-controller-leader","metrics_addr":":8080","enable_http2":false,"probe_addr":":8081","secure_metrics":false,"leader_election":{"lease_duration":"30s","renew_deadline":"20s","retry_period":"2s"},"exec_adc_timeout":"15s","provider":{"type":"apisix-standalone","sync_period":"1m0s","init_sync_delay":"20m0s"}}} 2025-10-21T03:47:34Z info client/client.go:57 using HTTP ADC Executor {"server_url": "http://127.0.0.1:3000"} 2025-10-21T03:47:34.276Z INFO setup manager/run.go:186 check ReferenceGrants is enabled 2025-10-21T03:47:35.082Z INFO setup manager/run.go:197 setting up controllers 2025-10-21T03:47:35.094Z INFO setup manager/run.go:212 setting up health checks 2025-10-21T03:47:35.094Z INFO setup manager/run.go:218 setting up ready checks 2025-10-21T03:47:35.094Z INFO setup manager/run.go:224 starting controller manager 2025-10-21T03:47:35.094Z INFO controller-runtime.controller-runtime.metrics server/server.go:208 Starting metrics server 2025-10-21T03:47:35.095Z INFO controller-runtime manager/server.go:83 starting server {"name": "health probe", "addr": "[::]:8081"} 2025-10-21T03:47:35.095Z INFO controller-runtime.controller-runtime.metrics server/server.go:247 Serving metrics server {"bindAddress": ":8080", "secure": false} I1021 03:47:35.297435 1 leaderelection.go:254] attempting to acquire leader lease alpha/apisix-ingress-controller-leader... ``` Controller log in `ingress-apisix` namespace ``` Defaulted container "manager" out of: manager, adc-server 2025-10-21T03:57:21.574Z INFO root/root.go:136 controller start configuration {"config": {"log_level":"info","controller_name":"apisix.apache.org/apisix-ingress-controller","leader_election_id":"apisix-ingress-controller-leader","metrics_addr":":8080","enable_http2":false,"probe_addr":":8081","secure_metrics":false,"leader_election":{"lease_duration":"30s","renew_deadline":"20s","retry_period":"2s"},"exec_adc_timeout":"15s","provider":{"type":"apisix-standalone","sync_period":"1m0s","init_sync_delay":"20m0s"}}} 2025-10-21T03:57:21Z info client/client.go:57 using HTTP ADC Executor {"server_url": "http://127.0.0.1:3000"} 2025-10-21T03:57:21.579Z INFO setup manager/run.go:186 check ReferenceGrants is enabled 2025-10-21T03:57:21.590Z INFO setup manager/run.go:197 setting up controllers 2025-10-21T03:57:21.600Z INFO setup manager/run.go:212 setting up health checks 2025-10-21T03:57:21.600Z INFO setup manager/run.go:218 setting up ready checks 2025-10-21T03:57:21.600Z INFO setup manager/run.go:224 starting controller manager 2025-10-21T03:57:21.600Z INFO controller-runtime.controller-runtime.metrics server/server.go:208 Starting metrics server 2025-10-21T03:57:21.601Z INFO controller-runtime manager/server.go:83 starting server {"name": "health probe", "addr": "[::]:8081"} 2025-10-21T03:57:21.601Z INFO controller-runtime.controller-runtime.metrics server/server.go:247 Serving metrics server {"bindAddress": ":8080", "secure": false} I1021 03:57:21.801946 1 leaderelection.go:254] attempting to acquire leader lease ingress-apisix/apisix-ingress-controller-leader... I1021 03:57:52.067610 1 leaderelection.go:268] successfully acquired lease ingress-apisix/apisix-ingress-controller-leader 2025-10-21T03:57:52.068Z INFO status.updater status/updater.go:131 started status update handler 2025-10-21T03:57:52.070Z INFO controller-runtime controller/controller.go:175 Starting EventSource {"controller": "apisixconsumer", "controllerGroup": "apisix.apache.org", "controllerKind": "ApisixConsumer", "source": "kind source: *v2.ApisixConsumer"} 2025-10-21T03:57:52.070Z INFO controller-runtime controller/controller.go:175 Starting EventSource {"controller": "apisixconsumer", "controllerGroup": "apisix.apache.org", "controllerKind": "ApisixConsumer", "source": "kind source: *v1.IngressClass"} 2025-10-21T03:57:52.070Z INFO controller-runtime controller/controller.go:175 Starting EventSource {"controller": "gateway", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "source": "kind source: *v1.Gateway"} 2025-10-21T03:57:52.070Z INFO controller-runtime controller/controller.go:175 Starting EventSource {"controller": "apisixconsumer", "controllerGroup": "apisix.apache.org", "controllerKind": "ApisixConsumer", "source": "kind source: *v1alpha1.GatewayProxy"} 2025-10-21T03:57:52.070Z INFO controller-runtime controller/controller.go:175 Starting EventSource {"controller": "ingress", "controllerGroup": "networking.k8s.io", "controllerKind": "Ingress", "source": "kind source: *v1.Ingress"} 2025-10-21T03:57:52.070Z INFO controller-runtime controller/controller.go:175 Starting EventSource {"controller": "ingress", "controllerGroup": "networking.k8s.io", "controllerKind": "Ingress", "source": "kind source: *v1.IngressClass"} 2025-10-21T03:57:52.070Z INFO controller-runtime controller/controller.go:175 Starting EventSource {"controller": "ingress", "controllerGroup": "networking.k8s.io", "controllerKind": "Ingress", "source": "kind source: *v1.EndpointSlice"} 2025-10-21T03:57:52.070Z INFO controller-runtime controller/controller.go:175 Starting EventSource {"controller": "ingress", "controllerGroup": "networking.k8s.io", "controllerKind": "Ingress", "source": "kind source: *v1.Secret"} 2025-10-21T03:57:52.070Z INFO controller-runtime controller/controller.go:175 Starting EventSource {"controller": "ingress", "controllerGroup": "networking.k8s.io", "controllerKind": "Ingress", "source": "kind source: *v1alpha1.BackendTrafficPolicy"} 2025-10-21T03:57:52.070Z INFO controller-runtime controller/controller.go:175 Starting EventSource {"controller": "ingress", "controllerGroup": "networking.k8s.io", "controllerKind": "Ingress", "source": "kind source: *v1alpha1.HTTPRoutePolicy"} 2025-10-21T03:57:52.070Z INFO controller-runtime controller/controller.go:175 Starting EventSource {"controller": "ingress", "controllerGroup": "networking.k8s.io", "controllerKind": "Ingress", "source": "kind source: *v1alpha1.GatewayProxy"} 2025-10-21T03:57:52.070Z INFO controller-runtime controller/controller.go:175 Starting EventSource {"controller": "ingress", "controllerGroup": "networking.k8s.io", "controllerKind": "Ingress", "source": "channel source: 0xc0000f5e30"} 2025-10-21T03:57:52.070Z INFO controller-runtime controller/controller.go:175 Starting EventSource {"controller": "gateway", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "source": "kind source: *v1.GatewayClass"} 2025-10-21T03:57:52.070Z INFO controller-runtime controller/controller.go:183 Starting Controller {"controller": "ingress", "controllerGroup": "networking.k8s.io", "controllerKind": "Ingress"} 2025-10-21T03:57:52.070Z INFO controller-runtime controller/controller.go:175 Starting EventSource {"controller": "gateway", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "source": "kind source: *v1.HTTPRoute"} 2025-10-21T03:57:52.070Z INFO controller-runtime controller/controller.go:175 Starting EventSource {"controller": "gateway", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "source": "kind source: *v1alpha1.GatewayProxy"} 2025-10-21T03:57:52.070Z INFO controller-runtime controller/controller.go:175 Starting EventSource {"controller": "gateway", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "source": "kind source: *v1.Secret"} 2025-10-21T03:57:52.070Z INFO controller-runtime controller/controller.go:175 Starting EventSource {"controller": "apisixconsumer", "controllerGroup": "apisix.apache.org", "controllerKind": "ApisixConsumer", "source": "kind source: *v1.Secret"} 2025-10-21T03:57:52.070Z INFO controller-runtime controller/controller.go:175 Starting EventSource {"controller": "gateway", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "source": "kind source: *v1beta1.ReferenceGrant"} 2025-10-21T03:57:52.070Z INFO controller-runtime controller/controller.go:183 Starting Controller {"controller": "gateway", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway"} 2025-10-21T03:57:52.070Z INFO controller-runtime controller/controller.go:183 Starting Controller {"controller": "apisixconsumer", "controllerGroup": "apisix.apache.org", "controllerKind": "ApisixConsumer"} 2025-10-21T03:57:52.070Z INFO controller-runtime controller/controller.go:175 Starting EventSource {"controller": "apisixglobalrule", "controllerGroup": "apisix.apache.org", "controllerKind": "ApisixGlobalRule", "source": "kind source: *v2.ApisixGlobalRule"} 2025-10-21T03:57:52.070Z INFO controller-runtime controller/controller.go:175 Starting EventSource {"controller": "apisixglobalrule", "controllerGroup": "apisix.apache.org", "controllerKind": "ApisixGlobalRule", "source": "kind source: *v1.IngressClass"} 2025-10-21T03:57:52.071Z INFO controller-runtime controller/controller.go:175 Starting EventSource {"controller": "apisixglobalrule", "controllerGroup": "apisix.apache.org", "controllerKind": "ApisixGlobalRule", "source": "kind source: *v1alpha1.GatewayProxy"} 2025-10-21T03:57:52.071Z INFO controller-runtime controller/controller.go:183 Starting Controller {"controller": "apisixglobalrule", "controllerGroup": "apisix.apache.org", "controllerKind": "ApisixGlobalRule"} 2025-10-21T03:57:52.071Z INFO controller-runtime controller/controller.go:175 Starting EventSource {"controller": "consumer", "controllerGroup": "apisix.apache.org", "controllerKind": "Consumer", "source": "kind source: *v1alpha1.Consumer"} 2025-10-21T03:57:52.071Z INFO controller-runtime controller/controller.go:175 Starting EventSource {"controller": "consumer", "controllerGroup": "apisix.apache.org", "controllerKind": "Consumer", "source": "kind source: *v1.Gateway"} 2025-10-21T03:57:52.071Z INFO controller-runtime controller/controller.go:175 Starting EventSource {"controller": "consumer", "controllerGroup": "apisix.apache.org", "controllerKind": "Consumer", "source": "kind source: *v1.Secret"} 2025-10-21T03:57:52.071Z INFO controller-runtime controller/controller.go:175 Starting EventSource {"controller": "consumer", "controllerGroup": "apisix.apache.org", "controllerKind": "Consumer", "source": "kind source: *v1alpha1.GatewayProxy"} 2025-10-21T03:57:52.071Z INFO controller-runtime controller/controller.go:183 Starting Controller {"controller": "consumer", "controllerGroup": "apisix.apache.org", "controllerKind": "Consumer"} 2025-10-21T03:57:52.071Z INFO controller-runtime controller/controller.go:175 Starting EventSource {"controller": "gatewayclass", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "GatewayClass", "source": "kind source: *v1.GatewayClass"} 2025-10-21T03:57:52.071Z INFO controller-runtime controller/controller.go:183 Starting Controller {"controller": "gatewayclass", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "GatewayClass"} 2025-10-21T03:57:52.071Z INFO controller-runtime controller/controller.go:175 Starting EventSource {"controller": "ingressclass", "controllerGroup": "networking.k8s.io", "controllerKind": "IngressClass", "source": "kind source: *v1.IngressClass"} 2025-10-21T03:57:52.071Z INFO controller-runtime controller/controller.go:175 Starting EventSource {"controller": "ingressclass", "controllerGroup": "networking.k8s.io", "controllerKind": "IngressClass", "source": "kind source: *v1alpha1.GatewayProxy"} 2025-10-21T03:57:52.071Z INFO controller-runtime controller/controller.go:175 Starting EventSource {"controller": "ingressclass", "controllerGroup": "networking.k8s.io", "controllerKind": "IngressClass", "source": "kind source: *v1.Secret"} 2025-10-21T03:57:52.071Z INFO controller-runtime controller/controller.go:183 Starting Controller {"controller": "ingressclass", "controllerGroup": "networking.k8s.io", "controllerKind": "IngressClass"} 2025-10-21T03:57:52.072Z INFO controller-runtime controller/controller.go:175 Starting EventSource {"controller": "apisixroute", "controllerGroup": "apisix.apache.org", "controllerKind": "ApisixRoute", "source": "kind source: *v2.ApisixRoute"} 2025-10-21T03:57:52.072Z INFO controller-runtime controller/controller.go:175 Starting EventSource {"controller": "apisixroute", "controllerGroup": "apisix.apache.org", "controllerKind": "ApisixRoute", "source": "kind source: *v1.IngressClass"} 2025-10-21T03:57:52.072Z INFO controller-runtime controller/controller.go:175 Starting EventSource {"controller": "apisixroute", "controllerGroup": "apisix.apache.org", "controllerKind": "ApisixRoute", "source": "kind source: *v1alpha1.GatewayProxy"} 2025-10-21T03:57:52.072Z INFO controller-runtime controller/controller.go:175 Starting EventSource {"controller": "apisixroute", "controllerGroup": "apisix.apache.org", "controllerKind": "ApisixRoute", "source": "kind source: *v1.EndpointSlice"} 2025-10-21T03:57:52.072Z INFO controller-runtime controller/controller.go:175 Starting EventSource {"controller": "apisixroute", "controllerGroup": "apisix.apache.org", "controllerKind": "ApisixRoute", "source": "kind source: *v1.Secret"} 2025-10-21T03:57:52.072Z INFO controller-runtime controller/controller.go:175 Starting EventSource {"controller": "apisixroute", "controllerGroup": "apisix.apache.org", "controllerKind": "ApisixRoute", "source": "kind source: *v2.ApisixUpstream"} 2025-10-21T03:57:52.072Z INFO controller-runtime controller/controller.go:175 Starting EventSource {"controller": "apisixroute", "controllerGroup": "apisix.apache.org", "controllerKind": "ApisixRoute", "source": "kind source: *v2.ApisixPluginConfig"} 2025-10-21T03:57:52.072Z INFO controller-runtime controller/controller.go:183 Starting Controller {"controller": "apisixroute", "controllerGroup": "apisix.apache.org", "controllerKind": "ApisixRoute"} 2025-10-21T03:57:52.072Z INFO controller-runtime controller/controller.go:175 Starting EventSource {"controller": "apisixpluginconfig", "controllerGroup": "apisix.apache.org", "controllerKind": "ApisixPluginConfig", "source": "kind source: *v2.ApisixPluginConfig"} 2025-10-21T03:57:52.072Z INFO controller-runtime controller/controller.go:183 Starting Controller {"controller": "apisixpluginconfig", "controllerGroup": "apisix.apache.org", "controllerKind": "ApisixPluginConfig"} 2025-10-21T03:57:52.072Z INFO controller-runtime controller/controller.go:175 Starting EventSource {"controller": "apisixupstream", "controllerGroup": "apisix.apache.org", "controllerKind": "ApisixUpstream", "source": "kind source: *v2.ApisixUpstream"} 2025-10-21T03:57:52.072Z INFO controller-runtime controller/controller.go:183 Starting Controller {"controller": "apisixupstream", "controllerGroup": "apisix.apache.org", "controllerKind": "ApisixUpstream"} 2025-10-21T03:57:52.072Z INFO controller-runtime controller/controller.go:175 Starting EventSource {"controller": "httproute", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "HTTPRoute", "source": "kind source: *v1.HTTPRoute"} 2025-10-21T03:57:52.072Z INFO controller-runtime controller/controller.go:175 Starting EventSource {"controller": "httproute", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "HTTPRoute", "source": "kind source: *v1.EndpointSlice"} 2025-10-21T03:57:52.072Z INFO controller-runtime controller/controller.go:175 Starting EventSource {"controller": "apisixtls", "controllerGroup": "apisix.apache.org", "controllerKind": "ApisixTls", "source": "kind source: *v2.ApisixTls"} 2025-10-21T03:57:52.072Z INFO controller-runtime controller/controller.go:175 Starting EventSource {"controller": "httproute", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "HTTPRoute", "source": "kind source: *v1alpha1.PluginConfig"} 2025-10-21T03:57:52.072Z INFO controller-runtime controller/controller.go:175 Starting EventSource {"controller": "apisixtls", "controllerGroup": "apisix.apache.org", "controllerKind": "ApisixTls", "source": "kind source: *v1.IngressClass"} 2025-10-21T03:57:52.073Z INFO controller-runtime controller/controller.go:175 Starting EventSource {"controller": "apisixtls", "controllerGroup": "apisix.apache.org", "controllerKind": "ApisixTls", "source": "kind source: *v1alpha1.GatewayProxy"} 2025-10-21T03:57:52.073Z INFO controller-runtime controller/controller.go:175 Starting EventSource {"controller": "apisixtls", "controllerGroup": "apisix.apache.org", "controllerKind": "ApisixTls", "source": "kind source: *v1.Secret"} 2025-10-21T03:57:52.073Z INFO controller-runtime controller/controller.go:183 Starting Controller {"controller": "apisixtls", "controllerGroup": "apisix.apache.org", "controllerKind": "ApisixTls"} 2025-10-21T03:57:52.073Z INFO controller-runtime controller/controller.go:175 Starting EventSource {"controller": "httproute", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "HTTPRoute", "source": "kind source: *v1.Gateway"} 2025-10-21T03:57:52.073Z INFO controller-runtime controller/controller.go:175 Starting EventSource {"controller": "httproute", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "HTTPRoute", "source": "kind source: *v1alpha1.BackendTrafficPolicy"} 2025-10-21T03:57:52.073Z INFO controller-runtime controller/controller.go:175 Starting EventSource {"controller": "gatewayproxy", "controllerGroup": "apisix.apache.org", "controllerKind": "GatewayProxy", "source": "kind source: *v1alpha1.GatewayProxy"} 2025-10-21T03:57:52.073Z INFO controller-runtime controller/controller.go:175 Starting EventSource {"controller": "httproute", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "HTTPRoute", "source": "kind source: *v1alpha1.HTTPRoutePolicy"} 2025-10-21T03:57:52.073Z INFO controller-runtime controller/controller.go:175 Starting EventSource {"controller": "gatewayproxy", "controllerGroup": "apisix.apache.org", "controllerKind": "GatewayProxy", "source": "kind source: *v1.Service"} 2025-10-21T03:57:52.074Z INFO controller-runtime controller/controller.go:175 Starting EventSource {"controller": "gatewayproxy", "controllerGroup": "apisix.apache.org", "controllerKind": "GatewayProxy", "source": "kind source: *v1.EndpointSlice"} 2025-10-21T03:57:52.074Z INFO controller-runtime controller/controller.go:175 Starting EventSource {"controller": "gatewayproxy", "controllerGroup": "apisix.apache.org", "controllerKind": "GatewayProxy", "source": "kind source: *v1.Secret"} 2025-10-21T03:57:52.074Z INFO controller-runtime controller/controller.go:175 Starting EventSource {"controller": "gatewayproxy", "controllerGroup": "apisix.apache.org", "controllerKind": "GatewayProxy", "source": "kind source: *v1.Gateway"} 2025-10-21T03:57:52.074Z INFO controller-runtime controller/controller.go:175 Starting EventSource {"controller": "gatewayproxy", "controllerGroup": "apisix.apache.org", "controllerKind": "GatewayProxy", "source": "kind source: *v1.IngressClass"} 2025-10-21T03:57:52.074Z INFO controller-runtime controller/controller.go:183 Starting Controller {"controller": "gatewayproxy", "controllerGroup": "apisix.apache.org", "controllerKind": "GatewayProxy"} 2025-10-21T03:57:52.074Z INFO controller-runtime controller/controller.go:175 Starting EventSource {"controller": "httproute", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "HTTPRoute", "source": "kind source: *v1alpha1.GatewayProxy"} 2025-10-21T03:57:52.074Z INFO controller-runtime controller/controller.go:175 Starting EventSource {"controller": "httproute", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "HTTPRoute", "source": "kind source: *v1beta1.ReferenceGrant"} 2025-10-21T03:57:52.074Z INFO controller-runtime controller/controller.go:175 Starting EventSource {"controller": "httproute", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "HTTPRoute", "source": "channel source: 0xc0000f5d50"} 2025-10-21T03:57:52.074Z INFO controller-runtime controller/controller.go:183 Starting Controller {"controller": "httproute", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "HTTPRoute"} 2025-10-21T03:57:52.175Z INFO controller-runtime controller/controller.go:217 Starting workers {"controller": "apisixupstream", "controllerGroup": "apisix.apache.org", "controllerKind": "ApisixUpstream", "worker count": 1} 2025-10-21T03:57:52.175Z INFO controller-runtime controller/controller.go:217 Starting workers {"controller": "apisixconsumer", "controllerGroup": "apisix.apache.org", "controllerKind": "ApisixConsumer", "worker count": 1} 2025-10-21T03:57:52.176Z INFO controller-runtime controller/controller.go:217 Starting workers {"controller": "apisixpluginconfig", "controllerGroup": "apisix.apache.org", "controllerKind": "ApisixPluginConfig", "worker count": 1} 2025-10-21T03:57:52.176Z INFO status.updater status/updater.go:122 updating status {"name": "helloworld-grpc-example", "namespace": "alpha", "kind": "Unknown"} 2025-10-21T03:57:52.181Z INFO controller-runtime controller/controller.go:217 Starting workers {"controller": "apisixtls", "controllerGroup": "apisix.apache.org", "controllerKind": "ApisixTls", "worker count": 1} 2025-10-21T03:57:52.181Z INFO controller-runtime controller/controller.go:217 Starting workers {"controller": "apisixroute", "controllerGroup": "apisix.apache.org", "controllerKind": "ApisixRoute", "worker count": 1} 2025-10-21T03:57:52.181Z INFO controller-runtime controller/controller.go:217 Starting workers {"controller": "gatewayclass", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "GatewayClass", "worker count": 1} 2025-10-21T03:57:52.181Z INFO controllers.ApisixRoute controller/utils.go:1319 found GatewayProxy for IngressClass {"ingressClass": "apisix-alpha-private", "gatewayproxy": "apisix-alpha-private-config"} 2025-10-21T03:57:52.181Z INFO controller-runtime controller/controller.go:217 Starting workers {"controller": "apisixglobalrule", "controllerGroup": "apisix.apache.org", "controllerKind": "ApisixGlobalRule", "worker count": 1} 2025-10-21T03:57:52.181Z INFO controllers.ApisixRoute controller/utils.go:1344 found secret for GatewayProxy provider {"ingressClass": "apisix-alpha-private", "gatewayproxy": "apisix-alpha-private-config", "secret": "apisix-private"} 2025-10-21T03:57:52.181Z INFO controller-runtime controller/controller.go:217 Starting workers {"controller": "consumer", "controllerGroup": "apisix.apache.org", "controllerKind": "Consumer", "worker count": 1} 2025-10-21T03:57:52.181Z INFO controller-runtime controller/controller.go:217 Starting workers {"controller": "ingressclass", "controllerGroup": "networking.k8s.io", "controllerKind": "IngressClass", "worker count": 1} 2025-10-21T03:57:52.181Z INFO controller-runtime controller/controller.go:217 Starting workers {"controller": "ingress", "controllerGroup": "networking.k8s.io", "controllerKind": "Ingress", "worker count": 1} 2025-10-21T03:57:52.181Z INFO controller-runtime controller/controller.go:217 Starting workers {"controller": "httproute", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "HTTPRoute", "worker count": 1} 2025-10-21T03:57:52.181Z INFO controller-runtime controller/controller.go:217 Starting workers {"controller": "gatewayproxy", "controllerGroup": "apisix.apache.org", "controllerKind": "GatewayProxy", "worker count": 1} 2025-10-21T03:57:52.181Z INFO controller-runtime controller/controller.go:217 Starting workers {"controller": "gateway", "controllerGroup": "gateway.networking.k8s.io", "controllerKind": "Gateway", "worker count": 1} 2025-10-21T03:57:52.182Z INFO controllers.ApisixRoute controller/utils.go:1319 found GatewayProxy for IngressClass {"ingressClass": "apisix-alpha-private", "gatewayproxy": "apisix-alpha-private-config"} 2025-10-21T03:57:52.182Z INFO controllers.ApisixRoute controller/utils.go:1344 found secret for GatewayProxy provider {"ingressClass": "apisix-alpha-private", "gatewayproxy": "apisix-alpha-private-config", "secret": "apisix-private"} 2025-10-21T03:57:52.183Z INFO controllers.ApisixRoute controller/utils.go:1319 found GatewayProxy for IngressClass {"ingressClass": "apisix-alpha-private", "gatewayproxy": "apisix-alpha-private-config"} 2025-10-21T03:57:52.183Z INFO controllers.ApisixRoute controller/utils.go:1344 found secret for GatewayProxy provider {"ingressClass": "apisix-alpha-private", "gatewayproxy": "apisix-alpha-private-config", "secret": "apisix-private"} 2025-10-21T03:57:52.185Z INFO status.updater status/updater.go:122 updating status {"name": "http-inspect", "namespace": "alpha", "kind": "Unknown"} 2025-10-21T03:57:52.194Z INFO status.updater status/updater.go:122 updating status {"name": "admin-server", "namespace": "alpha", "kind": "Unknown"} 2025-10-21T03:57:52.202Z INFO status.updater status/updater.go:122 updating status {"name": "file-upload-upstream", "namespace": "alpha", "kind": "Unknown"} 2025-10-21T03:57:52.214Z INFO status.updater status/updater.go:122 updating status {"name": "admin-server", "namespace": "alpha", "kind": "ApisixRoute"} 2025-10-21T03:57:52.227Z INFO status.updater status/updater.go:122 updating status {"name": "file-upload-route", "namespace": "alpha", "kind": "ApisixRoute"} 2025-10-21T03:57:52.239Z INFO status.updater status/updater.go:122 updating status {"name": "helloworld-grpc-example", "namespace": "alpha", "kind": "ApisixRoute"} 2025-10-21T03:57:53Z error client/executor.go:261 failed to run http sync for server {"server": "http://172.31.230.32:9180,http://172.29.93.53:9180";, "error": "ServerAddr: http://172.31.230.32:9180,http://172.29.93.53:9180, Err: HTTP 500: {\"message\":\"AxiosError: Request failed with status code 404\"}"} 2025-10-21T03:57:53Z error client/client.go:255 failed to execute adc command {"error": "ADC execution error for GatewayProxy/alpha/apisix-alpha-private-config: [ServerAddr: http://172.31.230.32:9180,http://172.29.93.53:9180, Err: HTTP 500: {\"message\":\"AxiosError: Request failed with status code 404\"}]", "config": {"name":"GatewayProxy/alpha/apisix-alpha-private-config","serverAddrs":["http://172.31.230.32:9180","http://172.29.93.53:9180"],"tlsVerify":false}} 2025-10-21T03:57:53Z error client/client.go:200 failed to sync resources {"name": "GatewayProxy/alpha/apisix-alpha-private-config", "error": "ADC execution errors: [ADC execution error for GatewayProxy/alpha/apisix-alpha-private-config: [ServerAddr: http://172.31.230.32:9180,http://172.29.93.53:9180, Err: HTTP 500: {\"message\":\"AxiosError: Request failed with status code 404\"}]]"} 2025-10-21T03:57:53Z error apisix/provider.go:251 failed to sync 1 configs: GatewayProxy/alpha/apisix-alpha-private-config 2025-10-21T03:57:53.178Z INFO status.updater status/updater.go:122 updating status {"name": "file-upload-route", "namespace": "alpha", "kind": "ApisixRoute"} 2025-10-21T03:57:53.189Z INFO status.updater status/updater.go:122 updating status {"name": "admin-server", "namespace": "alpha", "kind": "ApisixRoute"} 2025-10-21T03:57:53.200Z INFO status.updater status/updater.go:122 updating status {"name": "helloworld-grpc-example", "namespace": "alpha", "kind": "ApisixRoute"} 2025-10-21T03:57:53Z error client/executor.go:261 failed to run http sync for server {"server": "http://172.31.230.32:9180,http://172.29.93.53:9180";, "error": "ServerAddr: http://172.31.230.32:9180,http://172.29.93.53:9180, Err: HTTP 500: {\"message\":\"AxiosError: Request failed with status code 404\"}"} 2025-10-21T03:57:53Z error client/client.go:255 failed to execute adc command {"error": "ADC execution error for GatewayProxy/alpha/apisix-alpha-private-config: [ServerAddr: http://172.31.230.32:9180,http://172.29.93.53:9180, Err: HTTP 500: {\"message\":\"AxiosError: Request failed with status code 404\"}]", "config": {"name":"GatewayProxy/alpha/apisix-alpha-private-config","serverAddrs":["http://172.31.230.32:9180","http://172.29.93.53:9180"],"tlsVerify":false}} 2025-10-21T03:57:53Z error client/client.go:200 failed to sync resources {"name": "GatewayProxy/alpha/apisix-alpha-private-config", "error": "ADC execution errors: [ADC execution error for GatewayProxy/alpha/apisix-alpha-private-config: [ServerAddr: http://172.31.230.32:9180,http://172.29.93.53:9180, Err: HTTP 500: {\"message\":\"AxiosError: Request failed with status code 404\"}]]"} 2025-10-21T03:57:53Z error apisix/provider.go:251 failed to sync 1 configs: GatewayProxy/alpha/apisix-alpha-private-config 2025-10-21T03:58:01Z error client/executor.go:261 failed to run http sync for server {"server": "http://172.31.230.32:9180,http://172.29.93.53:9180";, "error": "ServerAddr: http://172.31.230.32:9180,http://172.29.93.53:9180, Err: HTTP 500: {\"message\":\"AxiosError: Request failed with status code 404\"}"} 2025-10-21T03:58:01Z error client/client.go:255 failed to execute adc command {"error": "ADC execution error for GatewayProxy/alpha/apisix-alpha-private-config: [ServerAddr: http://172.31.230.32:9180,http://172.29.93.53:9180, Err: HTTP 500: {\"message\":\"AxiosError: Request failed with status code 404\"}]", "config": {"name":"GatewayProxy/alpha/apisix-alpha-private-config","serverAddrs":["http://172.31.230.32:9180","http://172.29.93.53:9180"],"tlsVerify":false}} 2025-10-21T03:58:01Z error client/client.go:200 failed to sync resources {"name": "GatewayProxy/alpha/apisix-alpha-private-config", "error": "ADC execution errors: [ADC execution error for GatewayProxy/alpha/apisix-alpha-private-config: [ServerAddr: http://172.31.230.32:9180,http://172.29.93.53:9180, Err: HTTP 500: {\"message\":\"AxiosError: Request failed with status code 404\"}]]"} 2025-10-21T03:58:01Z error apisix/provider.go:251 failed to sync 1 configs: GatewayProxy/alpha/apisix-alpha-private-config ``` You can see that `GatewayProxy/alpha/apisix-alpha-private-config` appeared in ingress-controller `ingress-apisix` namespace I believe there's a cross-namespace interference issue where the APISIX deployment in ingress-apisix is inadvertently satisfying health check endpoints for APISIX instances in other namespaces -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
