theoribeiro commented on issue #416:
URL:
https://github.com/apache/pulsar-helm-chart/issues/416#issuecomment-1866979002
@lhotari
Here's the output of `kubectl get -n pulsar_namespace events
--sort-by=.lastTimestamp` after setting `functions.rbac.limit_to_namespace=true`
```
7m18s Normal NoPods
poddisruptionbudget/pulsar-bookie No matching
pods found
7m18s Normal ADD
secret/sh.helm.release.v1.pulsar.v1
pulsar/sh.helm.release.v1.pulsar.v1
7m17s Normal NoPods
poddisruptionbudget/pulsar-proxy No matching
pods found
7m17s Normal NoPods
poddisruptionbudget/pulsar-zookeeper No matching
pods found
7m11s Normal ADD
service/pulsar-recovery
pulsar/pulsar-recovery
7m11s Normal ADD service/pulsar-bookie
pulsar/pulsar-bookie
7m11s Normal ADD service/pulsar-broker
pulsar/pulsar-broker
7m10s Normal UPDATE service/pulsar-proxy
pulsar/pulsar-proxy
7m10s Normal EnsuringLoadBalancer service/pulsar-proxy
Ensuring load balancer
7m10s Normal ADD service/pulsar-proxy
pulsar/pulsar-proxy
7m10s Normal ADD
service/pulsar-zookeeper
pulsar/pulsar-zookeeper
7m10s Normal ADD
service/pulsar-toolset
pulsar/pulsar-toolset
7m9s Normal WaitForFirstConsumer
persistentvolumeclaim/pulsar-bookie-journal-pulsar-bookie-0 waiting for
first consumer to be created before binding
7m9s Normal ExternalProvisioning
persistentvolumeclaim/pulsar-bookie-journal-pulsar-bookie-0 waiting for a
volume to be created, either by external provisioner "pd.csi.storage.gke.io" or
manually created by system administrator
7m9s Normal ExternalProvisioning
persistentvolumeclaim/pulsar-bookie-ledgers-pulsar-bookie-0 waiting for a
volume to be created, either by external provisioner "pd.csi.storage.gke.io" or
manually created by system administrator
7m9s Normal Provisioning
persistentvolumeclaim/pulsar-bookie-ledgers-pulsar-bookie-0 External
provisioner is provisioning volume for claim
"pulsar/pulsar-bookie-ledgers-pulsar-bookie-0"
7m9s Normal SuccessfulCreate
statefulset/pulsar-recovery create Pod
pulsar-recovery-0 in StatefulSet pulsar-recovery successful
7m9s Normal WaitForFirstConsumer
persistentvolumeclaim/pulsar-bookie-ledgers-pulsar-bookie-0 waiting for
first consumer to be created before binding
7m9s Normal Scheduled pod/pulsar-recovery-0
Successfully assigned
pulsar/pulsar-recovery-0 to gk3-trinio-pool-3-afc9cad4-t8tf
7m9s Normal SuccessfulCreate
statefulset/pulsar-bookie create Claim
pulsar-bookie-journal-pulsar-bookie-0 Pod pulsar-bookie-0 in StatefulSet
pulsar-bookie success
7m9s Normal Provisioning
persistentvolumeclaim/pulsar-bookie-journal-pulsar-bookie-0 External
provisioner is provisioning volume for claim
"pulsar/pulsar-bookie-journal-pulsar-bookie-0"
7m9s Normal SuccessfulCreate
statefulset/pulsar-bookie create Pod
pulsar-bookie-0 in StatefulSet pulsar-bookie successful
7m9s Normal SuccessfulCreate
statefulset/pulsar-bookie create Claim
pulsar-bookie-ledgers-pulsar-bookie-0 Pod pulsar-bookie-0 in StatefulSet
pulsar-bookie success
7m8s Normal Scheduled pod/pulsar-proxy-0
Successfully assigned
pulsar/pulsar-proxy-0 to gk3-trinio-pool-3-afc9cad4-t8tf
7m8s Normal DNSRecordProvisioningSucceeded service/pulsar-proxy
DNS records updated
7m8s Normal Created pod/pulsar-recovery-0
Created container
pulsar-bookkeeper-verify-clusterid
7m8s Normal Scheduled pod/pulsar-broker-0
Successfully assigned
pulsar/pulsar-broker-0 to gk3-trinio-pool-3-afc9cad4-t8tf
7m8s Normal SuccessfulCreate
statefulset/pulsar-toolset create Pod
pulsar-toolset-0 in StatefulSet pulsar-toolset successful
7m8s Normal Scheduled pod/pulsar-toolset-0
Successfully assigned
pulsar/pulsar-toolset-0 to gk3-trinio-pool-3-afc9cad4-t8tf
7m8s Normal Pulled pod/pulsar-recovery-0
Container image
"apachepulsar/pulsar-all:3.0.2" already present on machine
7m8s Normal Started pod/pulsar-recovery-0
Started container
pulsar-bookkeeper-verify-clusterid
7m8s Normal SuccessfulCreate
statefulset/pulsar-proxy create Pod
pulsar-proxy-0 in StatefulSet pulsar-proxy successful
7m7s Normal WaitForFirstConsumer
persistentvolumeclaim/pulsar-zookeeper-data-pulsar-zookeeper-0 waiting for
first consumer to be created before binding
7m7s Normal Created pod/pulsar-proxy-0
Created container
wait-zookeeper-ready
7m7s Normal Pulled pod/pulsar-proxy-0
Container image
"apachepulsar/pulsar-all:3.0.2" already present on machine
7m7s Normal SuccessfulCreate
job/pulsar-pulsar-init Created pod:
pulsar-pulsar-init-k8twv
7m7s Normal SuccessfulCreate
job/pulsar-bookie-init Created pod:
pulsar-bookie-init-cw8qb
7m7s Normal SuccessfulCreate
statefulset/pulsar-zookeeper create Pod
pulsar-zookeeper-0 in StatefulSet pulsar-zookeeper successful
7m7s Normal Pulled pod/pulsar-toolset-0
Container image
"apachepulsar/pulsar-all:3.0.2" already present on machine
7m7s Normal Pulled pod/pulsar-broker-0
Container image
"apachepulsar/pulsar-all:3.0.2" already present on machine
7m7s Normal Created pod/pulsar-broker-0
Created container
wait-zookeeper-ready
7m7s Normal Started pod/pulsar-broker-0
Started container
wait-zookeeper-ready
7m7s Normal SuccessfulCreate
statefulset/pulsar-zookeeper create Claim
pulsar-zookeeper-data-pulsar-zookeeper-0 Pod pulsar-zookeeper-0 in StatefulSet
pulsar-zookeeper success
7m7s Normal Started pod/pulsar-proxy-0
Started container
wait-zookeeper-ready
7m7s Normal Provisioning
persistentvolumeclaim/pulsar-zookeeper-data-pulsar-zookeeper-0 External
provisioner is provisioning volume for claim
"pulsar/pulsar-zookeeper-data-pulsar-zookeeper-0"
7m6s Normal Started pod/pulsar-toolset-0
Started container pulsar-toolset
7m6s Normal Created pod/pulsar-toolset-0
Created container pulsar-toolset
7m5s Normal ProvisioningSucceeded
persistentvolumeclaim/pulsar-bookie-journal-pulsar-bookie-0 Successfully
provisioned volume pvc-5995ec5a-df45-42de-886a-166d2a7f2378
7m5s Normal Scheduled pod/pulsar-bookie-0
Successfully assigned
pulsar/pulsar-bookie-0 to gk3-trinio-pool-3-afc9cad4-t8tf
7m5s Normal ProvisioningSucceeded
persistentvolumeclaim/pulsar-bookie-ledgers-pulsar-bookie-0 Successfully
provisioned volume pvc-5afbf7bd-2fc8-4a03-94da-1f1f7a3f8938
7m5s Normal DNSRecordProvisioningSucceeded
service/pulsar-toolset DNS records
updated
7m4s Normal ExternalProvisioning
persistentvolumeclaim/pulsar-zookeeper-data-pulsar-zookeeper-0 waiting for a
volume to be created, either by external provisioner "pd.csi.storage.gke.io" or
manually created by system administrator
7m3s Normal Scheduled
pod/pulsar-zookeeper-0 Successfully
assigned pulsar/pulsar-zookeeper-0 to gk3-trinio-pool-3-afc9cad4-t8tf
7m3s Normal ProvisioningSucceeded
persistentvolumeclaim/pulsar-zookeeper-data-pulsar-zookeeper-0 Successfully
provisioned volume pvc-d1e96ae9-d07e-485e-ba6a-68323c5fa062
7m Normal SuccessfulAttachVolume pod/pulsar-bookie-0
AttachVolume.Attach succeeded for
volume "pvc-5afbf7bd-2fc8-4a03-94da-1f1f7a3f8938"
6m56s Normal SuccessfulAttachVolume
pod/pulsar-zookeeper-0
AttachVolume.Attach succeeded for volume
"pvc-d1e96ae9-d07e-485e-ba6a-68323c5fa062"
6m55s Normal TriggeredScaleUp
pod/pulsar-bookie-init-cw8qb pod triggered
scale-up:
[{https://www.googleapis.com/compute/v1/projects/trinio-dev/zones/us-central1-f/instanceGroups/gk3-trinio-pool-2-02bc9742-grp
0->1 (max: 1000)}]
6m55s Normal TriggeredScaleUp
pod/pulsar-pulsar-init-k8twv pod triggered
scale-up:
[{https://www.googleapis.com/compute/v1/projects/trinio-dev/zones/us-central1-f/instanceGroups/gk3-trinio-pool-2-02bc9742-grp
0->1 (max: 1000)}]
6m53s Normal Started
pod/pulsar-zookeeper-0 Started
container pulsar-zookeeper
6m53s Normal Pulled
pod/pulsar-zookeeper-0 Container
image "apachepulsar/pulsar-all:3.0.2" already present on machine
6m53s Normal Created
pod/pulsar-zookeeper-0 Created
container pulsar-zookeeper
6m52s Normal SuccessfulAttachVolume pod/pulsar-bookie-0
AttachVolume.Attach succeeded for
volume "pvc-5995ec5a-df45-42de-886a-166d2a7f2378"
6m50s Normal Created pod/pulsar-bookie-0
Created container
pulsar-bookkeeper-verify-clusterid
6m50s Normal Started pod/pulsar-bookie-0
Started container
pulsar-bookkeeper-verify-clusterid
6m50s Normal Pulled pod/pulsar-bookie-0
Container image
"apachepulsar/pulsar-all:3.0.2" already present on machine
6m50s Normal DNSRecordProvisioningSucceeded
service/pulsar-zookeeper DNS records
updated
6m49s Normal DNSRecordProvisioningSucceeded service/pulsar-bookie
DNS records updated
6m24s Warning FailedScheduling
pod/pulsar-bookie-init-cw8qb 0/1 nodes are
available: 1 Insufficient cpu. preemption: 0/1 nodes are available: 1 No
preemption victims found for incoming pod..
6m24s Warning FailedScheduling
pod/pulsar-pulsar-init-k8twv 0/1 nodes are
available: 1 Insufficient cpu. preemption: 0/1 nodes are available: 1 No
preemption victims found for incoming pod..
6m21s Normal EnsuredLoadBalancer service/pulsar-proxy
Ensured load balancer
5m46s Normal Scheduled
pod/pulsar-bookie-init-cw8qb Successfully
assigned pulsar/pulsar-bookie-init-cw8qb to gk3-trinio-pool-2-02bc9742-5zkb
5m46s Normal Scheduled
pod/pulsar-pulsar-init-k8twv Successfully
assigned pulsar/pulsar-pulsar-init-k8twv to gk3-trinio-pool-2-02bc9742-5zkb
5m44s Normal TaintManagerEviction
pod/pulsar-bookie-init-cw8qb Cancelling
deletion of Pod pulsar/pulsar-bookie-init-cw8qb
5m44s Normal TaintManagerEviction
pod/pulsar-pulsar-init-k8twv Cancelling
deletion of Pod pulsar/pulsar-pulsar-init-k8twv
5m17s Normal Pulling
pod/pulsar-pulsar-init-k8twv Pulling image
"apachepulsar/pulsar-all:3.0.2"
5m13s Normal Pulling
pod/pulsar-bookie-init-cw8qb Pulling image
"apachepulsar/pulsar-all:3.0.2"
4m14s Normal Pulled
pod/pulsar-pulsar-init-k8twv Successfully
pulled image "apachepulsar/pulsar-all:3.0.2" in 1m3.151860213s (1m3.151872603s
including waiting)
4m14s Normal Pulled
pod/pulsar-bookie-init-cw8qb Successfully
pulled image "apachepulsar/pulsar-all:3.0.2" in 39.039710652s (59.646624077s
including waiting)
4m10s Normal Created
pod/pulsar-pulsar-init-k8twv Created
container wait-zookeeper-ready
4m10s Normal Created
pod/pulsar-bookie-init-cw8qb Created
container wait-zookeeper-ready
4m9s Normal Started
pod/pulsar-pulsar-init-k8twv Started
container wait-zookeeper-ready
4m9s Normal Started
pod/pulsar-bookie-init-cw8qb Started
container wait-zookeeper-ready
4m4s Normal Pulled
pod/pulsar-pulsar-init-k8twv Container
image "apachepulsar/pulsar-all:3.0.2" already present on machine
4m4s Normal Created
pod/pulsar-pulsar-init-k8twv Created
container pulsar-bookkeeper-verify-clusterid
4m4s Normal Pulled
pod/pulsar-bookie-init-cw8qb Container
image "apachepulsar/pulsar-all:3.0.2" already present on machine
4m4s Normal Created
pod/pulsar-bookie-init-cw8qb Created
container pulsar-bookie-init
4m3s Normal Started
pod/pulsar-pulsar-init-k8twv Started
container pulsar-bookkeeper-verify-clusterid
4m3s Normal Started
pod/pulsar-bookie-init-cw8qb Started
container pulsar-bookie-init
3m43s Normal Created
pod/pulsar-pulsar-init-k8twv Created
container pulsar-pulsar-init
3m43s Normal Pulled
pod/pulsar-pulsar-init-k8twv Container
image "apachepulsar/pulsar-all:3.0.2" already present on machine
3m43s Normal Started
pod/pulsar-pulsar-init-k8twv Started
container pulsar-pulsar-init
3m42s Normal Completed
job/pulsar-bookie-init Job completed
3m37s Normal Pulled pod/pulsar-recovery-0
Container image
"apachepulsar/pulsar-all:3.0.2" already present on machine
3m37s Normal Started pod/pulsar-recovery-0
Started container pulsar-recovery
3m37s Normal Pulled pod/pulsar-bookie-0
Container image
"apachepulsar/pulsar-all:3.0.2" already present on machine
3m37s Normal Created pod/pulsar-bookie-0
Created container pulsar-bookie
3m37s Normal Started pod/pulsar-bookie-0
Started container pulsar-bookie
3m37s Normal Created pod/pulsar-recovery-0
Created container pulsar-recovery
3m35s Normal DNSRecordProvisioningSucceeded
service/pulsar-recovery DNS records
updated
3m28s Normal Completed
job/pulsar-pulsar-init Job completed
3m25s Normal Pulled pod/pulsar-broker-0
Container image
"apachepulsar/pulsar-all:3.0.2" already present on machine
3m25s Normal Created pod/pulsar-broker-0
Created container
wait-bookkeeper-ready
3m25s Normal Started pod/pulsar-broker-0
Started container
wait-bookkeeper-ready
3m24s Normal Pulled pod/pulsar-proxy-0
Container image
"apachepulsar/pulsar-all:3.0.2" already present on machine
3m24s Normal Created pod/pulsar-proxy-0
Created container wait-broker-ready
3m23s Normal Started pod/pulsar-proxy-0
Started container wait-broker-ready
3m21s Warning Unhealthy pod/pulsar-bookie-0
Readiness probe failed: Get
"http://10.108.1.168:8000/api/v1/bookie/is_ready": dial tcp 10.108.1.168:8000:
connect: connection refused
3m21s Warning Unhealthy pod/pulsar-bookie-0
Liveness probe failed: Get
"http://10.108.1.168:8000/api/v1/bookie/state": dial tcp 10.108.1.168:8000:
connect: connection refused
3m16s Normal Pulled pod/pulsar-broker-0
Container image
"apachepulsar/pulsar-all:3.0.2" already present on machine
3m16s Normal Created pod/pulsar-broker-0
Created container pulsar-broker
3m16s Normal Started pod/pulsar-broker-0
Started container pulsar-broker
2m38s Warning Unhealthy pod/pulsar-broker-0
Readiness probe failed: Get
"http://10.108.1.164:8080/status.html": dial tcp 10.108.1.164:8080: connect:
connection refused
2m38s Warning Unhealthy pod/pulsar-broker-0
Liveness probe failed: Get
"http://10.108.1.164:8080/status.html": dial tcp 10.108.1.164:8080: connect:
connection refused
2m6s Normal UPDATE
secret/sh.helm.release.v1.pulsar.v1
pulsar/sh.helm.release.v1.pulsar.v1
118s Warning Unhealthy pod/pulsar-broker-0
Liveness probe failed: HTTP probe
failed with statuscode: 404
114s Warning Unhealthy pod/pulsar-broker-0
Readiness probe failed: HTTP probe
failed with statuscode: 404
110s Normal Killing pod/pulsar-broker-0
Stopping container pulsar-broker
110s Warning Evicted pod/pulsar-broker-0
Pod ephemeral local storage usage
exceeds the total limit of containers 1Gi.
100s Warning ExceededGracePeriod pod/pulsar-broker-0
Container runtime did not kill the
pod within specified grace period.
97s Normal NoPods
poddisruptionbudget/pulsar-broker No matching
pods found
97s Normal SuccessfulCreate
statefulset/pulsar-broker create Pod
pulsar-broker-0 in StatefulSet pulsar-broker successful
97s Warning RecreatingFailedPod
statefulset/pulsar-broker StatefulSet
pulsar/pulsar-broker is recreating failed Pod pulsar-broker-0
97s Normal SuccessfulDelete
statefulset/pulsar-broker delete Pod
pulsar-broker-0 in StatefulSet pulsar-broker successful
97s Normal Scheduled pod/pulsar-broker-0
Successfully assigned
pulsar/pulsar-broker-0 to gk3-trinio-pool-3-afc9cad4-t8tf
96s Normal Pulled pod/pulsar-broker-0
Container image
"apachepulsar/pulsar-all:3.0.2" already present on machine
96s Normal Created pod/pulsar-broker-0
Created container
wait-zookeeper-ready
96s Normal Started pod/pulsar-broker-0
Started container
wait-zookeeper-ready
95s Normal DNSRecordProvisioningSucceeded service/pulsar-broker
DNS records updated
89s Normal Pulled pod/pulsar-broker-0
Container image
"apachepulsar/pulsar-all:3.0.2" already present on machine
88s Normal Created pod/pulsar-broker-0
Created container
wait-bookkeeper-ready
88s Normal Started pod/pulsar-broker-0
Started container
wait-bookkeeper-ready
79s Normal Pulled pod/pulsar-broker-0
Container image
"apachepulsar/pulsar-all:3.0.2" already present on machine
79s Normal Created pod/pulsar-broker-0
Created container pulsar-broker
79s Normal Started pod/pulsar-broker-0
Started container pulsar-broker
27s Warning Unhealthy pod/pulsar-broker-0
Readiness probe failed: Get
"http://10.108.1.171:8080/status.html": dial tcp 10.108.1.171:8080: connect:
connection refused
27s Warning Unhealthy pod/pulsar-broker-0
Liveness probe failed: Get
"http://10.108.1.171:8080/status.html": dial tcp 10.108.1.171:8080: connect:
connection refused
18s Normal UpdatedLoadBalancer service/pulsar-proxy
Updated load balancer with new hosts
7s Warning Unhealthy pod/pulsar-broker-0
Liveness probe failed: HTTP probe
failed with statuscode: 404
0s Warning Unhealthy pod/pulsar-broker-0
Readiness probe failed: HTTP probe
failed with statuscode: 404
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
