Hello!
I am experimenting with removing Zookeeper from our Druid cluster
in Kubernetes. (Druid version 0.21.1, Kubernetes 1.18.19) I am setting up a
test Druid cluster in its own namespace, following the instructions here:
https://druid.apache.org/docs/latest/development/extensions-core/kubernetes.html
When I bring up any node, I get an error: json: cannot unmarshal object
into Go value of type jsonpatch.Patch
Here is the error and the json message from the druid-router as it came up:
2021-08-04T17:08:29,343 INFO [main]
org.apache.druid.k8s.discovery.K8sDruidNodeAnnouncer - Json Patch For Node
Announcement:
[[{"op":"add","path":"/metadata/labels/druidDiscoveryAnnouncement-router","value":"true"},{"op":"add","path":"/metadata/labels/druidDiscoveryAnnouncement-id-hash","value":"1339985469"},{"op":"add","path":"/metadata/labels/druidDiscoveryAnnouncement-cluster-identifier","value":"druid-customer-data"},{"op":"add","path":"/metadata/annotations/druidNodeInfo-router","value":"{\"druidNode\":{\"service\":\"druid/router\",\"host\":\"test-ns-druid-router-59c45bf7b4-gcvhz.druid-router-service.test-ns.svc.cluster.local\",\"bindOnHost\":false,\"plaintextPort\":8080,\"port\":-1,\"tlsPort\":-1,\"enablePlaintextPort\":true,\"enableTlsPort\":false},\"nodeType\":\"router\",\"services\":{}}"}]]
2021-08-04T17:08:29,416 WARN [main]
org.apache.druid.java.util.common.RetryUtils - Retrying (1 of 2) in 1,066ms.
org.apache.druid.java.util.common.RE: Failed to patch
pod[test-ns/test-ns-druid-router-59c45bf7b4-gcvhz], code[400], error[{
"kind": "Status",
"apiVersion": "v1",
"metadata": {
},
"status": "Failure",
"message": "json: cannot unmarshal object into Go value of type
jsonpatch.Patch",
"reason": "BadRequest",
"code": 400
}].
The json message *seems* OK. I manually attempt to patch the pod using the
message from the log, and that works:
$ kubectl patch pod $ROUTER_POD -n test-ns --type='json' -p
'[{"op":"add","path":"/metadata/labels/druidDiscoveryAnnouncement-router","value":"true"},{"op":"add","path":"/metadata/labels/druidDiscoveryAnnouncement-id-hash","value":"1339985469"},{"op":"add","path":"/metadata/labels/druidDiscoveryAnnouncement-cluster-identifier","value":"druid-customer-data"},{"op":"add","path":"/metadata/annotations/druidNodeInfo-router","value":"{\"druidNode\":{\"service\":\"druid/router\",\"host\":\"test-ns-druid-router-59c45bf7b4-gcvhz.druid-router-service.test-ns.svc.cluster.local\",\"bindOnHost\":false,\"plaintextPort\":8080,\"port\":-1,\"tlsPort\":-1,\"enablePlaintextPort\":true,\"enableTlsPort\":false},\"nodeType\":\"router\",\"services\":{}}"}]'
pod/test-ns-druid-router-59c45bf7b4-ftpt7 patched
I am at a loss. Can someone point me in the right direction on what to look
for?
Thanks for any help!
-Ken Hayes
