Jorge, If you cant publish then its either a configuration issue or you need to restart the containers
Marco has the pointer to where the configuration error exists - its one of the helm charts but I cant remember which one. If its the dmaap layer not talking successfully to kafka try the following: I usually Delete the PODS from the rancher GUI in a specific sequence and they will automatically restart. Delete kafka Wait 30 seconds Delete dmaap This usually works. Try to POST and then GET (2 times since the first GET needs to register) If that doesnt work then try going one more level deeper to restart zookeeper, then kafka then dmaap Delete zookeeper Wait 30 seoncs Delete kafka Wait 30 Delete dmaap If that doenst work then I would get the DMaaP team involved. Brian From: [email protected] <[email protected]> On Behalf Of HERNANDEZ-HERRERO, JORGE Sent: Tuesday, May 08, 2018 8:06 PM To: [email protected] Subject: [onap-discuss] [dmaap] cannot publish events on dmaap ***Security Advisory: This Message Originated Outside of AT&T *** Reference http://cso.att.com/EmailSecurity/IDSP.html for more information. Hello DMaaP/Integration team, I set up a new fresh OOM installation. I can see one of the topics of interest there pre-configured. policy@dev-drools-0:/opt/app/policy/config$ curl --silent -X GET http://message-router:3904/topics/<https://urldefense.proofpoint.com/v2/url?u=http-3A__message-2Drouter-3A3904_topics_&d=DwQFAg&c=LFYZ-o9_HUMeMTSQicvjIg&r=e3d1ehx3DI5AoMgDmi2Fzw&m=nGDF8UykjiJP-poPRKNUeiYAgGGGzbkAgcwv9PpkYBY&s=7W8cHjJQCDUDzmeqtqsp37CmcgG5lHN2OWJmZUD5ieo&e=> | grep PDPD "PDPD-CONFIGURATION", I can perform subscribe operations: policy@dev-drools-0:/opt/app/policy/config$ curl --silent -X GET http://message-router:3904/events/PDPD-CONFIGURATION/1/1<https://urldefense.proofpoint.com/v2/url?u=http-3A__message-2Drouter-3A3904_events_PDPD-2DCONFIGURATION_1_1&d=DwQFAg&c=LFYZ-o9_HUMeMTSQicvjIg&r=e3d1ehx3DI5AoMgDmi2Fzw&m=nGDF8UykjiJP-poPRKNUeiYAgGGGzbkAgcwv9PpkYBY&s=HgRy9hqPOAMx9q5XuEqq5R370nu8OOAide7zUnlN4_A&e=> [] But I cannot perform publish operations (get 404): policy@dev-drools-0:/opt/app/policy/config$ curl --silent -X POST --header "Content-Type: application/json" -d "{}" http:// message-router:3904/events/PDPD-CONFIGURATION {"mrstatus":5007,"helpURL":"http://onap.readthedocs.io","message":"Error<https://urldefense.proofpoint.com/v2/url?u=http-3A__onap.readthedocs.io-2522-2C-2522message-2522-3A-2522Error&d=DwQFAg&c=LFYZ-o9_HUMeMTSQicvjIg&r=e3d1ehx3DI5AoMgDmi2Fzw&m=nGDF8UykjiJP-poPRKNUeiYAgGGGzbkAgcwv9PpkYBY&s=lL5CNZ2jpVaNXKidNZ214SQv4ROdxT_XSvBI-oBQwhY&e=> while publishing data to topic.:PDPD-CONFIGURATION.Successfully published number of messages :0.null","status":404} I see rolling errors in message-router pod: ifiableProperties - Property metadata.broker.list is overridden to message-router-kafka:9092 ""2018-05-08 22:08:36,694 [097a371d-09ce-44d0-b02c-ede05f615dc6--PDPD-CONFIGURATION_dev-drools-1-leader-finder-thread] INFO kafka.utils.VerifiableProperties - Property request.timeout.ms is overridden to 30000 ""2018-05-08 22:08:36,694 [097a371d-09ce-44d0-b02c-ede05f615dc6--PDPD-CONFIGURATION_dev-drools-1-leader-finder-thread] INFO kafka.client.ClientUtils$ - Fetching metadata from broker id:0,host:message-router-kafka,port:9092 with correlation id 436 for 1 topic(s) Set(PDPD-CONFIGURATION) ""2018-05-08 22:08:36,694 [8395b334-088e-4b1e-a9eb-aa8f25a6150d--APPC-CL_dev-drools-1-leader-finder-thread] INFO kafka.producer.SyncProducer - Disconnecting from message-router-kafka:9092 ""2018-05-08 22:08:36,694 [8395b334-088e-4b1e-a9eb-aa8f25a6150d--APPC-CL_dev-drools-1-leader-finder-thread] INFO kafka.consumer.ConsumerFetcherManager - [ConsumerFetcherManager-1525817225806] Added fetcher for partitions ArrayBuffer() ""2018-05-08 22:08:36,695 [097a371d-09ce-44d0-b02c-ede05f615dc6--PDPD-CONFIGURATION_dev-drools-1-leader-finder-thread] INFO kafka.producer.SyncProducer - Connected to message-router-kafka:9092 for producing ""2018-05-08 22:08:36,695 [a6927931-4e13-49eb-a772-81bbe5854e34--APPC-CL_dev-drools-2-leader-finder-thread] INFO kafka.utils.VerifiableProperties - Verifying properties ""2018-05-08 22:08:36,695 [a6927931-4e13-49eb-a772-81bbe5854e34--APPC-CL_dev-drools-2-leader-finder-thread] INFO kafka.utils.VerifiableProperties - Property client.id is overridden to a6927931-4e13-49eb-a772-81bbe5854e34--APPC-CL ""2018-05-08 22:08:36,695 [097a371d-09ce-44d0-b02c-ede05f615dc6--PDPD-CONFIGURATION_dev-drools-1-leader-finder-thread] INFO kafka.producer.SyncProducer - Disconnecting from message-router-kafka:9092 ""2018-05-08 22:08:36,695 [a6927931-4e13-49eb-a772-81bbe5854e34--APPC-CL_dev-drools-2-leader-finder-thread] INFO kafka.utils.VerifiableProperties - Property metadata.broker.list is overridden to message-router-kafka:9092 ""2018-05-08 22:08:36,695 [a6927931-4e13-49eb-a772-81bbe5854e34--APPC-CL_dev-drools-2-leader-finder-thread] INFO kafka.utils.VerifiableProperties - Property request.timeout.ms is overridden to 30000 ""2018-05-08 22:08:36,695 [a6927931-4e13-49eb-a772-81bbe5854e34--APPC-CL_dev-drools-2-leader-finder-thread] INFO kafka.client.ClientUtils$ - Fetching metadata from broker id:0,host:message-router-kafka,port:9092 with correlation id 311 for 1 topic(s) Set(APPC-CL) ""2018-05-08 22:08:36,695 [097a371d-09ce-44d0-b02c-ede05f615dc6--PDPD-CONFIGURATION_dev-drools-1-leader-finder-thread] INFO kafka.consumer.ConsumerFetcherManager - [ConsumerFetcherManager-1525817223734] Added fetcher for partitions ArrayBuffer() ""2018-05-08 22:08:36,696 [a6927931-4e13-49eb-a772-81bbe5854e34--APPC-CL_dev-drools-2-leader-finder-thread] INFO kafka.producer.SyncProducer - Connected to message-router-kafka:9092 for producing ""2018-05-08 22:08:36,696 [a6927931-4e13-49eb-a772-81bbe5854e34--APPC-CL_dev-drools-2-leader-finder-thread] INFO kafka.producer.SyncProducer - Disconnecting from message-router-kafka:9092 ""2018-05-08 22:08:36,696 [a6927931-4e13-49eb-a772-81bbe5854e34--APPC-CL_dev-drools-2-leader-finder-thread] INFO kafka.consumer.ConsumerFetcherManager - [ConsumerFetcherManager-1525817251891] Added fetcher for partitions ArrayBuffer() ""2018-05-08 22:08:36,720 [qtp1555093762-111] ERROR com.att.nsa.cambria.backends.kafka.KafkaConsumer - 1a5ee485-a519-4fc5-83c0-49759fb58b7e(dev-drools-3)/PDPD-CONFIGURATION: ConsumerTimeoutException in Kafka consumer; returning null & Exception at nextMessage() : kafka.consumer.ConsumerTimeoutException ""2018-05-08 22:08:36,720 [qtp1555093762-111] ERROR com.att.nsa.cambria.backends.kafka.KafkaConsumer - 1a5ee485-a519-4fc5-83c0-49759fb58b7e(dev-drools-3)/PDPD-CONFIGURATION: ConsumerTimeoutException in Kafka consumer; returning null & Exception at nextMessage() : kafka.consumer.ConsumerTimeoutException "22:08:36.720 [qtp1555093762-111] ERROR com.att.nsa.cambria.backends.kafka.KafkaConsumer - 1a5ee485-a519-4fc5-83c0-49759fb58b7e(dev-drools-3)/PDPD-CONFIGURATION: ConsumerTimeoutException in Kafka consumer; returning null & Exception at nextMessage() : kafka.consumer.ConsumerTimeoutException Pods up: ubuntu@k8sx:~/oom/kubernetes$ kubectl get pods --all-namespaces -o=wide NAMESPACE NAME READY STATUS RESTARTS AGE IP NODE kube-system heapster-76b8cd7b5-hbtdm 1/1 Running 2 12d 10.42.141.193 k8sx kube-system kube-dns-5d7b4487c9-h7z26 3/3 Running 6 12d 10.42.159.123 k8sx kube-system kubernetes-dashboard-f9577fffd-266ww 1/1 Running 4 12d 10.42.116.116 k8sx kube-system monitoring-grafana-997796fcf-ht99z 1/1 Running 2 12d 10.42.168.225 k8sx kube-system monitoring-influxdb-56fdcd96b-8tm6l 1/1 Running 3 12d 10.42.153.214 k8sx kube-system tiller-deploy-54bcc55dd5-srvwq 1/1 Running 2 12d 10.42.32.77 k8sx onap dev-brmsgw-5dbc4c8dc4-bz9mm 1/1 Running 0 3m 10.42.136.217 k8sx onap dev-dbc-pg-0 1/1 Running 0 3m 10.42.118.91 k8sx onap dev-dbc-pg-1 1/1 Running 0 2m 10.42.140.88 k8sx onap dev-dmaap-bus-controller-7675f9b455-kpbpb 1/1 Running 0 3m 10.42.57.51 k8sx onap dev-drools-0 1/1 Running 0 3m 10.42.16.84 k8sx onap dev-drools-1 1/1 Running 0 2m 10.42.42.172 k8sx onap dev-drools-2 1/1 Running 0 1m 10.42.51.123 k8sx onap dev-drools-3 1/1 Running 0 1m 10.42.25.232 k8sx onap dev-kube2msb-579fc77c54-vcqds 1/1 Running 0 3m 10.42.109.32 k8sx onap dev-message-router-b5bdc599c-88grl 1/1 Running 0 3m 10.42.239.7 k8sx onap dev-message-router-kafka-774bcd9886-gnrpf 1/1 Running 0 3m 10.42.110.202 k8sx onap dev-message-router-zookeeper-66f4f9f5b6-n65l4 1/1 Running 0 3m 10.42.181.41 k8sx onap dev-msb-consul-7bc4fcc8-dmxw6 1/1 Running 0 3m 10.42.241.245 k8sx onap dev-msb-discovery-768547bcb-2tlq6 2/2 Running 0 3m 10.42.153.102 k8sx onap dev-msb-eag-5d95686c67-5k5d9 2/2 Running 0 3m 10.42.110.26 k8sx onap dev-msb-iag-675b649848-lrq4r 2/2 Running 0 3m 10.42.218.124 k8sx onap dev-nexus-7d96568f5f-8xqx5 1/1 Running 0 3m 10.42.239.98 k8sx onap dev-pap-8587696769-7x4nr 2/2 Running 0 3m 10.42.149.209 k8sx onap dev-pdp-0 2/2 Running 0 3m 10.42.25.22 k8sx onap dev-pdp-1 2/2 Running 0 1m 10.42.134.116 k8sx onap dev-policydb-587d55bdff-92fgj 1/1 Running 0 3m 10.42.243.156 k8sx onap dev-robot-6bf5f455bb-cx58r 1/1 Running 0 3m 10.42.172.145 k8sx Can you please advice on how to correct this problem? Thank you. Jorge
_______________________________________________ onap-discuss mailing list [email protected] https://lists.onap.org/mailman/listinfo/onap-discuss
