its fine from what i can tell although i don't see the udp publishing you mentioned... and you are using a common pollster so i'm not sure what vsg meter. based on what you pasted, it's probably the kafka publisher.
On 18/08/16 01:37 AM, Raghunath D wrote: Hi Gordon, Did you get a chance to look at pipeline.yaml pasted to http://paste.openstack.org/show/558688/ Could you please provide some pointer how to resolve this issue. With Best Regards Raghunath Dudyala Tata Consultancy Services Limited Mailto: raghunat...@tcs.com<mailto:raghunat...@tcs.com> Website: http://www.tcs.com ____________________________________________ Experience certainty. IT Services Business Solutions Consulting ____________________________________________ -----Raghunath D <raghunat...@tcs.com><mailto:raghunat...@tcs.com> wrote: ----- To: openstack-dev@lists.openstack.org<mailto:openstack-dev@lists.openstack.org> From: Raghunath D <raghunat...@tcs.com><mailto:raghunat...@tcs.com> Date: 08/17/2016 09:30AM Subject: Re: [openstack-dev] FW: [Ceilometer]:Duplicate messages with Ceilometer Kafka Publisher. Hi Gordon, As suggested I pasted pipeline.yaml content to paste.openstack.org http://paste.openstack.org/show/558688/ With Best Regards Raghunath Dudyala Tata Consultancy Services Limited Mailto: raghunat...@tcs.com<mailto:raghunat...@tcs.com> Website: <http://www.tcs.com> http://www.tcs.com ____________________________________________ Experience certainty. IT Services Business Solutions Consulting ____________________________________________ -----gordon chung <g...@live.ca><mailto:g...@live.ca> wrote: ----- To: "openstack-dev@lists.openstack.org"<mailto:openstack-dev@lists.openstack.org> <openstack-dev@lists.openstack.org><mailto:openstack-dev@lists.openstack.org> From: gordon chung <g...@live.ca><mailto:g...@live.ca> Date: 08/16/2016 07:51PM Subject: Re: [openstack-dev] FW: [Ceilometer]:Duplicate messages with Ceilometer Kafka Publisher. what does your pipeline.yaml look like? maybe paste it to paste.openstack.org. i imagine it's correct if your udp publishing works as expected. On 16/08/16 04:04 AM, Raghunath D wrote: Hi Simon, I have two openstack setup's one with kilo and other with mitaka. Please find details of kafka version's below: Kilo kafka client library Version:1.3.1 Mitaka kafka client library Version:1.3.1 Kafka server version on both kilo and mitaka: kafka_2.11-0.9.0.0.tgz One observation is on kilo openstack setup I didn't see duplicate message issue,while on mitaka setup I am experiencing this issue. With Best Regards Raghunath Dudyala Tata Consultancy Services Limited Mailto: <mailto:raghunat...@tcs.com> raghunat...@tcs.com<mailto:raghunat...@tcs.com> Website: <http://www.tcs.com> http://www.tcs.com ____________________________________________ Experience certainty. IT Services Business Solutions Consulting ____________________________________________ - From: Simon Pasquier [mailto:spasqu...@mirantis.com] Sent: Thursday, August 11, 2016 2:34 AM To: OpenStack Development Mailing List (not for usage questions) <openstack-dev@lists.openstack.org><mailto:openstack-dev@lists.openstack.org> Subject: Re: [openstack-dev] [Ceilometer]:Duplicate messages with Ceilometer Kafka Publisher. Hi Which version of Kafka do you use? BR Simon On Thu, Aug 11, 2016 at 10:13 AM, Raghunath D <<mailto:raghunat...@tcs.com>raghunat...@tcs.com<mailto:raghunat...@tcs.com>> wrote: Hi , We are injecting events to our custom plugin in ceilometer. The ceilometer pipeline.yaml is configured to publish these events over kafka and udp, consuming these samples using kafka and udp clients. KAFKA publisher: ----------------------- When the events are sent continously ,we can see duplicate msg's are recevied in kafka client. From the log it seems ceilometer kafka publisher is failed to send msg's,but still these msgs are received by kafka server.So when kafka resends these failed msgs we can see duplicate msg's received in kafka client. Please find the attached log for reference. Is this know issue ? Is their any workaround for this issue ? UDP publisher: No duplicate msg's issue seen here and it is working as expected. With Best Regards Raghunath Dudyala Tata Consultancy Services Limited Mailto: <mailto:raghunat...@tcs.com> raghunat...@tcs.com<mailto:raghunat...@tcs.com> Website: <http://www.tcs.com/> http://www.tcs.com ____________________________________________ Experience certainty. IT Services Business Solutions Consulting ____________________________________________ =====-----=====-----===== Notice: The information contained in this e-mail message and/or attachments to it may contain confidential or privileged information. If you are not the intended recipient, any dissemination, use, review, distribution, printing or copying of the information contained in this e-mail message and/or attachments to it are strictly prohibited. If you have received this communication in error, please notify us by reply e-mail or telephone and immediately and permanently delete the message and any attachments. Thank you __________________________________________________________________________ OpenStack Development Mailing List (not for usage questions) Unsubscribe: <http://openstack-dev-requ...@lists.openstack.org?subject:unsubscribe> openstack-dev-requ...@lists.openstack.org?subject:unsubscribe<mailto:openstack-dev-requ...@lists.openstack.org?subject:unsubscribe> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev [attachment "ATT00001.txt" removed by Raghunath D/HYD/TCS] __________________________________________________________________________ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe<mailto:openstack-dev-requ...@lists.openstack.org?subject:unsubscribe> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev -- gord __________________________________________________________________________ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe<mailto:openstack-dev-requ...@lists.openstack.org?subject:unsubscribe> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev __________________________________________________________________________ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe<mailto:openstack-dev-requ...@lists.openstack.org?subject:unsubscribe> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev __________________________________________________________________________ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe<mailto:openstack-dev-requ...@lists.openstack.org?subject:unsubscribe> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev -- gord
__________________________________________________________________________ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev