Re: [openstack-dev] [Ceilometer]: Instance creation and deletion metrics in ceilometer !

[Raghunath D]

Hi,


what meters are you looking for specifically? as Ganpat mentioned, we 
only derive a few meters from Nova notifications[1]. i don't understand 
your comment about being able to see events on kafka. by 'events' do you 
mean Ceilometer Events[2]?

[1] 
https://github.com/openstack/ceilometer/blob/master/ceilometer/meter/data/meters.yaml#L83-L127
[2] http://docs.openstack.org/developer/ceilometer/events.html

Yes,here I am referring  to Events[2].

My requirement is to get sample/counter with "instance" name ,with event_type 
compute.instance.*

For example:

{u'counter_name': u'instance', u'user_id': u'0eddb9bb412b4b2783fbdb04c7786fbd', 
u'message_signature': 
u'a575aee7540c8aac5d481fbeb6c96e8a967814c7f7d712b3b3da0a4ebccabb1d', 
u'timestamp': u'2016-11-01 07:34:42.994144', u'resource_id': 
u'1784a230-5038-46e9-9a2e-f96dabc1ea26', u'message_id': 
u'a7bac522-a005-11e6-abbb-52540074f46a', u'source': u'openstack', 
u'counter_unit': u'instance', u'counter_volume': 1, u'project_id': 
u'33dbef1a1442476b9c5935287df86f2c', u'resource_metadata': 
{u'state_description': u'', u'event_type': u'compute.instance.delete.end', 
u'availability_zone': u'nova', u'terminated_at': u'2016-11-01T07:34:42.167439', 
u'ephemeral_gb': 0, u'instance_type_id': 5, u'deleted_at': 
u'2016-11-01T07:34:42.00', u'reservation_id': u'r-bhq970mr', u'memory_mb': 
2048, u'display_name': u'mysite_exampleservice-1', u'hostname': 
u'mysite-exampleservice-1', u'state': u'deleted', u'progress': u'', 
u'launched_at': u'2016-10-31T21:54:53.00', u'node': 
u'chilly-police.cord.lab', u'ramdisk_id': u'', u'access_ip_v6': None, 
u'disk_gb': 20, u'access_ip_v4': None, u'kernel_id': u'', u'host': 
u'compute.chilly-police', u'user_id': u'0eddb9bb412b4b2783fbdb04c7786fbd', 
u'image_ref_url': 
u'http://10.1.0.18:9292/images/8f2185b2-1669-46df-8a01-88b3abd88aa5', 
u'cell_name': u'', u'root_gb': 20, u'tenant_id': 
u'33dbef1a1442476b9c5935287df86f2c', u'created_at': u'2016-10-31 
21:54:32+00:00', u'instance_id': u'1784a230-5038-46e9-9a2e-f96dabc1ea26', 
u'instance_type': u'm1.small', u'vcpus': 1, u'image_meta': {u'min_disk': u'20', 
u'container_format': u'bare', u'min_ram': u'0', u'disk_format': u'raw', 
u'base_image_ref': u'8f2185b2-1669-46df-8a01-88b3abd88aa5'}, u'architecture': 
None, u'os_type': None, u'instance_flavor_id': u'2'}, u'counter_type': 
u'gauge'}'

Now I am able to do this by  creating event_definitions.yaml 
,event_pipeline.yaml as mentioned bt Ganpat and updating conf files:

1,ceilometer.conf:
   notification_topics = notifications
   [notification]
   store_events = True
   [event]
   drop_unmatched_notifications = False
   definitions_cfg_file = /etc/ceilometer/event_definitions.yaml

With Best Regards
 Raghunath Dudyala
 Tata Consultancy Services Limited
 Mailto: raghunat...@tcs.com
 Website: http://www.tcs.com
 
 Experience certainty.  IT Services
Business Solutions
Consulting
 
 

-gordon chung <g...@live.ca> wrote: -
To: "openstack-dev@lists.openstack.org" <openstack-dev@lists.openstack.org>
From: gordon chung <g...@live.ca>
Date: 10/31/2016 09:54PM
Subject: Re: [openstack-dev] [Ceilometer]: Instance creation and deletion 
metrics in ceilometer !

what meters are you looking for specifically? as Ganpat mentioned, we 
only derive a few meters from Nova notifications[1]. i don't understand 
your comment about being able to see events on kafka. by 'events' do you 
mean Ceilometer Events[2]?

[1] 
https://github.com/openstack/ceilometer/blob/master/ceilometer/meter/data/meters.yaml#L83-L127
[2] http://docs.openstack.org/developer/ceilometer/events.html



On 31/10/16 04:27 AM, Raghunath D wrote:
> Hi Ganpat,
>
> I want the samples related with these events.
>
> With Best Regards
> Raghunath Dudyala
> Tata Consultancy Services Limited
> Mailto: raghunat...@tcs.com
> Website: http://www.tcs.com
> 
> Experience certainty. IT Services
> Business Solutions
> Consulting
> 
>
>
> -Ganpat Agarwal <gans.develo...@gmail.com> wrote: -
> To: "OpenStack Development Mailing List (not for usage questions)"
> <openstack-dev@lists.openstack.org>
> From: Ganpat Agarwal <gans.develo...@gmail.com>
> Date: 10/27/2016 12:02PM
> Subject: Re: [openstack-dev] [Ceilometer]: Instance creation and
> deletion metrics in ceilometer !
>
> Hi Raghunath,
>
> I am not able to understand your use case for compute.instance.* events.
>
> You are trying to catch the instance start and end events OR you want
> the samples related with these events?
>
> Regards,
> Ganpat
>
> On Wed, Oct 26, 2016 at 6:00 PM, Raghunath D <raghunat...@tcs.com
> <mailto:r

Re: [openstack-dev] [Ceilometer]: Instance creation and deletion metrics in ceilometer !

[Raghunath D]

 Hi Ganpat,

I want the samples related with these events.

With Best Regards
 Raghunath Dudyala
 Tata Consultancy Services Limited
 Mailto: raghunat...@tcs.com
 Website: http://www.tcs.com
 
 Experience certainty.  IT Services
Business Solutions
Consulting
 
 

-Ganpat Agarwal <gans.develo...@gmail.com> wrote: -
To: "OpenStack Development Mailing List (not for usage questions)" 
<openstack-dev@lists.openstack.org>
From: Ganpat Agarwal <gans.develo...@gmail.com>
Date: 10/27/2016 12:02PM
Subject: Re: [openstack-dev] [Ceilometer]: Instance creation and deletion 
metrics in ceilometer !

Hi Raghunath,

I am not able to understand your use case for compute.instance.* events.

You are trying to catch the instance start and end events OR you want the 
samples related with these events?

Regards,
Ganpat

On Wed, Oct 26, 2016 at 6:00 PM, Raghunath D <raghunat...@tcs.com> wrote:
 Hi Ganpat/Gord,

Callback for compute.instance.create.end events under 
ceilometer.compute.notifications should be invoked for those notification 
events on the nova exchange using the notifications.info topic. 
But this is not happening,we can see events related to them and can receive 
events over kafka.

I can see from logs which print my debug print during the loading of 
notification plugin.
"2016-10-26 03:46:32.010 34977 INFO ceilometer.compute.notifications.instance 
[req-1ad3d5c9-5eab-404d-9fbe-f1605e93691f - - - - -] Check 
ComputeInstanceNotificationBase notification:"

Do we need to change any thing in the configuration file of ceilometer or nova 
to achive this.
It would be great help for me if this is fixed.

With Best Regards
 Raghunath Dudyala
 Tata Consultancy Services Limited
 Mailto: raghunat...@tcs.com
 Website: http://www.tcs.com
 
 Experience certainty.IT Services
 Business Solutions
 Consulting
 
 

-Ganpat Agarwal <gans.develo...@gmail.com> wrote: -
To: "OpenStack Development Mailing List (not for usage questions)" 
<openstack-dev@lists.openstack.org>
From: Ganpat Agarwal <gans.develo...@gmail.com>
Date: 10/25/2016 09:32PM

Subject: Re: [openstack-dev] [Ceilometer]: Instance creation and deletion 
metrics in ceilometer !

Hi Raghunath,

You can look at this file for details of meters related with compute.instance.*

ceilometer/meter/data/meters.yaml

Additionally, you can look at this link for compute meters documentation

http://docs.openstack.org/admin-guide/telemetry-measurements.html


Also, have a look at "Meters definitions" section on this link

http://docs.openstack.org/admin-guide/telemetry-data-collection.html#meter-definitions

Regards,
Ganpat


On Tue, Oct 25, 2016 at 5:45 PM, Raghunath D <raghunat...@tcs.com> wrote:
 Hi Ganpat,

 Are you able to see merers/samples related to compute.instance.* in ceilometer 
meter-list or ceilometer sample-list.
My application which will read info from ceilometer publisher (pipeline.yaml) 
and I am looking for meters realted to ceilometer.instance.*

With Best Regards
 Raghunath Dudyala
 Tata Consultancy Services Limited
 Mailto: raghunat...@tcs.com
 Website: http://www.tcs.com
 
 Experience certainty.IT Services
 Business Solutions
 Consulting
 
 

-Ganpat Agarwal <gans.develo...@gmail.com> wrote: -
To: "OpenStack Development Mailing List (not for usage questions)" 
<openstack-dev@lists.openstack.org>
From: Ganpat Agarwal <gans.develo...@gmail.com>
Date: 10/25/2016 05:05PM
Subject: Re: [openstack-dev] [Ceilometer]: Instance creation and deletion 
metrics in ceilometer !


Hi,

I am able to get event notifications on kafka by applying these configurations:

nova.conf
instance_usage_audit = True
instance_usage_audit_period = hour
notify_on_state_change = vm_and_task_state

notification_driver = messagingv2

Restart nova compute service

ceilometer.conf
 [event]
 drop_unmatched_notifications = False
 definitions_cfg_file = /etc/ceilometer/event_definitions.yaml


event_pipeline.yaml
---
sources:
    - name: event_source
      events:
         - compute.instance.*
      sinks:
          - event_sink
sinks:
    - name: event_sink
      transformers:
      triggers:
      publishers:
          #- notifier://
          #- file:///home/stack/test?max_bytes=1000_count=5
  
          - kafka://kafka-broker:9092?topic=ceilometer


service ceilometer-api restart
 
service ceilometer-agent-notification restart


Wait for couple of minutes and you should be getting the events on your

Re: [openstack-dev] [Ceilometer]: Instance creation and deletion metrics in ceilometer !

[Raghunath D]

 Hi Ganpat/Gord,

Callback for compute.instance.create.end events under 
ceilometer.compute.notifications should be invoked for those notification 
events on the nova exchange using the notifications.info topic. 
But this is not happening,we can see events related to them and can receive 
events over kafka.

I can see from logs which print my debug print during the loading of 
notification plugin.
"2016-10-26 03:46:32.010 34977 INFO ceilometer.compute.notifications.instance 
[req-1ad3d5c9-5eab-404d-9fbe-f1605e93691f - - - - -] Check 
ComputeInstanceNotificationBase notification:"

Do we need to change any thing in the configuration file of ceilometer or nova 
to achive this.
It would be great help for me if this is fixed.

With Best Regards
 Raghunath Dudyala
 Tata Consultancy Services Limited
 Mailto: raghunat...@tcs.com
 Website: http://www.tcs.com
 
 Experience certainty.  IT Services
Business Solutions
Consulting
 
 

-Ganpat Agarwal <gans.develo...@gmail.com> wrote: -
To: "OpenStack Development Mailing List (not for usage questions)" 
<openstack-dev@lists.openstack.org>
From: Ganpat Agarwal <gans.develo...@gmail.com>
Date: 10/25/2016 09:32PM
Subject: Re: [openstack-dev] [Ceilometer]: Instance creation and deletion 
metrics in ceilometer !

Hi Raghunath,

You can look at this file for details of meters related with compute.instance.*

ceilometer/meter/data/meters.yaml

Additionally, you can look at this link for compute meters documentation

http://docs.openstack.org/admin-guide/telemetry-measurements.html


Also, have a look at "Meters definitions" section on this link

http://docs.openstack.org/admin-guide/telemetry-data-collection.html#meter-definitions

Regards,
Ganpat


On Tue, Oct 25, 2016 at 5:45 PM, Raghunath D <raghunat...@tcs.com> wrote:
 Hi Ganpat,

 Are you able to see merers/samples related to compute.instance.* in ceilometer 
meter-list or ceilometer sample-list.
My application which will read info from ceilometer publisher (pipeline.yaml) 
and I am looking for meters realted to ceilometer.instance.*

With Best Regards
 Raghunath Dudyala
 Tata Consultancy Services Limited
 Mailto: raghunat...@tcs.com
 Website: http://www.tcs.com
 
 Experience certainty.IT Services
 Business Solutions
 Consulting
 
 

-Ganpat Agarwal <gans.develo...@gmail.com> wrote: -
To: "OpenStack Development Mailing List (not for usage questions)" 
<openstack-dev@lists.openstack.org>
From: Ganpat Agarwal <gans.develo...@gmail.com>
Date: 10/25/2016 05:05PM
Subject: Re: [openstack-dev] [Ceilometer]: Instance creation and deletion 
metrics in ceilometer !


Hi,

I am able to get event notifications on kafka by applying these configurations:

nova.conf
instance_usage_audit = True
instance_usage_audit_period = hour
notify_on_state_change = vm_and_task_state

notification_driver = messagingv2

Restart nova compute service

ceilometer.conf
 [event]
 drop_unmatched_notifications = False
 definitions_cfg_file = /etc/ceilometer/event_definitions.yaml


event_pipeline.yaml
---
sources:
    - name: event_source
      events:
         - compute.instance.*
      sinks:
          - event_sink
sinks:
    - name: event_sink
      transformers:
      triggers:
      publishers:
          #- notifier://
          #- file:///home/stack/test?max_bytes=1000_count=5
  
          - kafka://kafka-broker:9092?topic=ceilometer


service ceilometer-api restart
 
service ceilometer-agent-notification restart


Wait for couple of minutes and you should be getting the events on your kafka 
consumer and in ceilometer notifications logs as well



tail -f /var/log/ceilometer/ceilometer-agent-notification.log


Let me know if it helps.


Regards,
Ganpat


On Tue, Oct 25, 2016 at 3:02 PM, Raghunath D <raghunat...@tcs.com> wrote:
Hi ,
 
Can some one please suggest how to instance notifications in ceilometer.

With Best Regards
 Raghunath Dudyala
 Tata Consultancy Services Limited
 Mailto: raghunat...@tcs.com
 Website: http://www.tcs.com
 
 Experience certainty.IT Services
 Business Solutions
     Consulting
 ____
 

-----Raghunath D/HYD/TCS wrote: -
To: openstack-dev@lists.openstack.org
From: Raghunath D/HYD/TCS
Date: 10/18/2016 08:01PM
Subject: [openstack-dev] [Ceilometer]: Instance creation and deletion metrics 
in ceilometer !


 Hi ,

How can instance created and deleted information/sample can be retrieved from 
ceilometer.
What entries should be there in

Re: [openstack-dev] [Ceilometer]: Instance creation and deletion metrics in ceilometer !

[Raghunath D]

 Hi Ganpat,

 Are you able to see merers/samples related to compute.instance.* in ceilometer 
meter-list or ceilometer sample-list.
My application which will read info from ceilometer publisher (pipeline.yaml) 
and I am looking for meters realted to ceilometer.instance.*

With Best Regards
 Raghunath Dudyala
 Tata Consultancy Services Limited
 Mailto: raghunat...@tcs.com
 Website: http://www.tcs.com
 
 Experience certainty.  IT Services
Business Solutions
Consulting
 
 

-Ganpat Agarwal <gans.develo...@gmail.com> wrote: -
To: "OpenStack Development Mailing List (not for usage questions)" 
<openstack-dev@lists.openstack.org>
From: Ganpat Agarwal <gans.develo...@gmail.com>
Date: 10/25/2016 05:05PM
Subject: Re: [openstack-dev] [Ceilometer]: Instance creation and deletion 
metrics in ceilometer !

Hi,

I am able to get event notifications on kafka by applying these configurations:

nova.conf
instance_usage_audit = True
instance_usage_audit_period = hour
notify_on_state_change = vm_and_task_state

notification_driver = messagingv2

Restart nova compute service

ceilometer.conf
 [event]
 drop_unmatched_notifications = False
 definitions_cfg_file = /etc/ceilometer/event_definitions.yaml


event_pipeline.yaml
---
sources:
    - name: event_source
      events:
         - compute.instance.*
      sinks:
          - event_sink
sinks:
    - name: event_sink
      transformers:
      triggers:
      publishers:
          #- notifier://
          #- file:///home/stack/test?max_bytes=1000_count=5
  
          - kafka://kafka-broker:9092?topic=ceilometer


service ceilometer-api restart
 
service ceilometer-agent-notification restart


Wait for couple of minutes and you should be getting the events on your kafka 
consumer and in ceilometer notifications logs as well



tail -f /var/log/ceilometer/ceilometer-agent-notification.log


Let me know if it helps.


Regards,
Ganpat


On Tue, Oct 25, 2016 at 3:02 PM, Raghunath D <raghunat...@tcs.com> wrote:
Hi ,
 
Can some one please suggest how to instance notifications in ceilometer.

With Best Regards
 Raghunath Dudyala
 Tata Consultancy Services Limited
 Mailto: raghunat...@tcs.com
 Website: http://www.tcs.com
 
 Experience certainty.IT Services
 Business Solutions
 Consulting
 ________
 

-Raghunath D/HYD/TCS wrote: -
To: openstack-dev@lists.openstack.org
From: Raghunath D/HYD/TCS
Date: 10/18/2016 08:01PM
Subject: [openstack-dev] [Ceilometer]: Instance creation and deletion metrics 
in ceilometer !


 Hi ,

How can instance created and deleted information/sample can be retrieved from 
ceilometer.
What entries should be there in pipeline.yaml  to get instance deleted 
information.

I tried to have meters- "instance" in pipeline.yam but it always gives active 
instance details,
and no details of deleted instances.

With Best Regards
 Raghunath Dudyala
 Tata Consultancy Services Limited
 Mailto: raghunat...@tcs.com
 Website: http://www.tcs.com
 
 Experience certainty.IT Services
 Business Solutions
 Consulting
 
  
=-=-=
 Notice: The information contained in this e-mail
 message and/or attachments to it may contain 
 confidential or privileged information. If you are 
 not the intended recipient, any dissemination, use, 
 review, distribution, printing or copying of the 
 information contained in this e-mail message 
 and/or attachments to it are strictly prohibited. If 
 you have received this communication in error, 
 please notify us by reply e-mail or telephone and 
 immediately and permanently delete the message 
 and any attachments. Thank you
  
__
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
 

 
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

Re: [openstack-dev] [Ceilometer]: Instance creation and deletion metrics in ceilometer !

[Raghunath D]

Hi ,
 
Can some one please suggest how to instance notifications in ceilometer.

With Best Regards
 Raghunath Dudyala
 Tata Consultancy Services Limited
 Mailto: raghunat...@tcs.com
 Website: http://www.tcs.com
 
 Experience certainty.  IT Services
Business Solutions
Consulting
 
 

-Raghunath D/HYD/TCS wrote: -
To: openstack-dev@lists.openstack.org
From: Raghunath D/HYD/TCS
Date: 10/18/2016 08:01PM
Subject: [openstack-dev] [Ceilometer]: Instance creation and deletion metrics 
in ceilometer !

 Hi ,

How can instance created and deleted information/sample can be retrieved from 
ceilometer.
What entries should be there in pipeline.yaml  to get instance deleted 
information.

I tried to have meters- "instance" in pipeline.yam but it always gives active 
instance details,
and no details of deleted instances.

With Best Regards
 Raghunath Dudyala
 Tata Consultancy Services Limited
 Mailto: raghunat...@tcs.com
 Website: http://www.tcs.com
 
 Experience certainty.  IT Services
Business Solutions
Consulting
 
  
=-=-=
Notice: The information contained in this e-mail
message and/or attachments to it may contain 
confidential or privileged information. If you are 
not the intended recipient, any dissemination, use, 
review, distribution, printing or copying of the 
information contained in this e-mail message 
and/or attachments to it are strictly prohibited. If 
you have received this communication in error, 
please notify us by reply e-mail or telephone and 
immediately and permanently delete the message 
and any attachments. Thank you


__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

[openstack-dev] [Ceilometer]: Instance creation and deletion metrics in ceilometer !

[Raghunath D]

 Hi ,

How can instance created and deleted information/sample can be retrieved from 
ceilometer.
What entries should be there in pipeline.yaml  to get instance deleted 
information.

I tried to have meters- "instance" in pipeline.yam but it always gives active 
instance details,
and no details of deleted instances.

With Best Regards
 Raghunath Dudyala
 Tata Consultancy Services Limited
 Mailto: raghunat...@tcs.com
 Website: http://www.tcs.com
 
 Experience certainty.  IT Services
Business Solutions
Consulting
 
 
=-=-=
Notice: The information contained in this e-mail
message and/or attachments to it may contain 
confidential or privileged information. If you are 
not the intended recipient, any dissemination, use, 
review, distribution, printing or copying of the 
information contained in this e-mail message 
and/or attachments to it are strictly prohibited. If 
you have received this communication in error, 
please notify us by reply e-mail or telephone and 
immediately and permanently delete the message 
and any attachments. Thank you


__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

Re: [openstack-dev] [ceilometer] ceilometer liberty detect instance creation

[Raghunath D]

Hi,

Please launch an instance using openstack dashboard or nova boot command and 
check once again "ceilometer meter-list".

With Best Regards
 Raghunath Dudyala
 Tata Consultancy Services Limited
 Mailto: raghunat...@tcs.com
 Website: http://www.tcs.com
 
 Experience certainty.  IT Services
Business Solutions
Consulting
 
 

-Yue Xin  wrote: -
To: "OpenStack Development Mailing List (not for usage questions)" 

From: Yue Xin 
Date: 10/04/2016 07:53PM
Subject: [openstack-dev] [ceilometer] ceilometer liberty detect instance
creation

Hi all,

I have installed the ceilometer liberty version. but when i use the command 
"ceilometer meter-list" there is no "instance.creation" "network.creation" 
appears(which can be detected on mitaka version), may i ask is this because of 
the version limit? Or there is some configuration file should be modified in 
order to be able to detect?

Thanks a lot.

Regards,
Yue  
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
=-=-=
Notice: The information contained in this e-mail
message and/or attachments to it may contain 
confidential or privileged information. If you are 
not the intended recipient, any dissemination, use, 
review, distribution, printing or copying of the 
information contained in this e-mail message 
and/or attachments to it are strictly prohibited. If 
you have received this communication in error, 
please notify us by reply e-mail or telephone and 
immediately and permanently delete the message 
and any attachments. Thank you


__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

[openstack-dev] [Ceilometer]:Ceilometer kafka publisher is not consistent !

[Raghunath D]

 Hi ,

I have below entries in my pipeline.yaml file:

sources:
  - name: meter_source
  interval: 600
  meters:
  - "*"
 sinks:
    - name: meter_sink
  transformers:
  publishers:
  - notifier://
  - kafka://localhost:9092?topic=ceilometer

The behaviour of kafka is not consistent.I have to restart 
ceilometer-agent-notification to work it properly.
After restart it works for some time and will start throwing errors.

http://paste.openstack.org/show/572186/
Should I raise a bug for this issue ?

It would be a great help to how to debug and fix this issue.

With Best Regards
 Raghunath Dudyala
 Tata Consultancy Services Limited
 Mailto: raghunat...@tcs.com
 Website: http://www.tcs.com
 
 Experience certainty.  IT Services
Business Solutions
Consulting
 
 
=-=-=
Notice: The information contained in this e-mail
message and/or attachments to it may contain 
confidential or privileged information. If you are 
not the intended recipient, any dissemination, use, 
review, distribution, printing or copying of the 
information contained in this e-mail message 
and/or attachments to it are strictly prohibited. If 
you have received this communication in error, 
please notify us by reply e-mail or telephone and 
immediately and permanently delete the message 
and any attachments. Thank you


__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

Re: [openstack-dev] FW: [Ceilometer]:Duplicate messages with Ceilometer Kafka Publisher.

[Raghunath D]

Hi Gordon,

Did you get a chance to look at pipeline.yaml pasted to 
http://paste.openstack.org/show/558688/
Could you please provide some pointer how to resolve this issue.

With Best Regards
 Raghunath Dudyala
 Tata Consultancy Services Limited
 Mailto: raghunat...@tcs.com
 Website: http://www.tcs.com
 
 Experience certainty.  IT Services
Business Solutions
Consulting
 
 

-Raghunath D <raghunat...@tcs.com> wrote: -
To: openstack-dev@lists.openstack.org
From: Raghunath D <raghunat...@tcs.com>
Date: 08/17/2016 09:30AM
Subject: Re: [openstack-dev] FW: [Ceilometer]:Duplicate messages with 
Ceilometer Kafka Publisher.

Hi Gordon,

As suggested I pasted pipeline.yaml content to paste.openstack.org

http://paste.openstack.org/show/558688/

With Best Regards
 Raghunath Dudyala
 Tata Consultancy Services Limited
 Mailto: raghunat...@tcs.com
 Website: http://www.tcs.com
 
 Experience certainty.IT Services
 Business Solutions
 Consulting
 
 

-gordon chung <g...@live.ca> wrote: -
To: "openstack-dev@lists.openstack.org" <openstack-dev@lists.openstack.org>
From: gordon chung <g...@live.ca>
Date: 08/16/2016 07:51PM
Subject: Re: [openstack-dev] FW: [Ceilometer]:Duplicate messages with 
Ceilometer Kafka Publisher.

 what does your pipeline.yaml look like? maybe paste it to 
paste.openstack.org. i imagine it's correct if your udp publishing works as 
expected.
 
 
 
On 16/08/16 04:04 AM, Raghunath D wrote:
   Hi Simon,
 
 I have two openstack setup's one with kilo and other with mitaka.
 
 Please find details of kafka version's below:
 Kilo kafka client library Version:1.3.1
 Mitaka kafka client library Version:1.3.1
 Kafka server version on both kilo and mitaka: kafka_2.11-0.9.0.0.tgz
 
 One observation is on kilo openstack setup I didn't see duplicate message 
issue,while on mitaka
 setup I am experiencing this issue.
 
 With Best Regards
 Raghunath Dudyala
 Tata Consultancy Services Limited
 Mailto:  raghunat...@tcs.com
 Website:  http://www.tcs.com
 
 Experience certainty. IT Services
 Business Solutions
 Consulting
 
 
 
 -
 
 
 From: Simon Pasquier [mailto:spasqu...@mirantis.com] 
 
 Sent: Thursday, August 11, 2016 2:34 AM
 To: OpenStack Development Mailing List (not for usage questions)  
<openstack-dev@lists.openstack.org>
 Subject: Re: [openstack-dev] [Ceilometer]:Duplicate messages with Ceilometer 
Kafka Publisher.
  
 
 
 
 
 Hi
  Which version of Kafka do you use?
  BR
  Simon
  
  
 
 On Thu, Aug 11, 2016 at 10:13 AM, Raghunath D <raghunat...@tcs.com> wrote:
  Hi , 
 
   We are injecting events to our custom plugin in ceilometer. 
   The ceilometer pipeline.yaml  is configured to publish these events over 
kafka and udp, consuming these samples using kafka and udp clients. 
 
   KAFKA publisher: 
   --- 
   When the events are sent continously ,we can see duplicate msg's are 
recevied in kafka client. 
   From the log it seems ceilometer kafka publisher is failed to send msg's,but 
still these msgs 
   are received by kafka server.So when kafka resends these failed msgs we can 
see duplicate msg's 
   received in kafka client. 
   Please find the attached log for reference. 
   Is this know issue ? 
   Is their any workaround for this issue ? 
 
   UDP publisher: 
     No duplicate msg's issue seen here and it is working as expected. 
 
         
 
 With Best Regards
 Raghunath Dudyala
 Tata Consultancy Services Limited
 Mailto:  raghunat...@tcs.com
 Website: http://www.tcs.com
 
 Experience certainty.        IT Services
                        Business Solutions
                        Consulting
 
 =-=-=
 Notice: The information contained in this e-mail
 message and/or attachments to it may contain 
 confidential or privileged information. If you are 
 not the intended recipient, any dissemination, use, 
 review, distribution, printing or copying of the 
 information contained in this e-mail message 
 and/or attachments to it are strictly prohibited. If 
 you have received this communication in error, 
 please notify us by reply e-mail or telephone and 
 immediately and permanently delete the message 
 and any attachments. Thank you
 
 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe:  openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
    
    
 
 [atta

Re: [openstack-dev] FW: [Ceilometer]:Duplicate messages with Ceilometer Kafka Publisher.

[Raghunath D]

Hi Gordon,

As suggested I pasted pipeline.yaml content to paste.openstack.org

http://paste.openstack.org/show/558688/

With Best Regards
 Raghunath Dudyala
 Tata Consultancy Services Limited
 Mailto: raghunat...@tcs.com
 Website: http://www.tcs.com
 
 Experience certainty.  IT Services
Business Solutions
Consulting
 
 

-gordon chung <g...@live.ca> wrote: -
To: "openstack-dev@lists.openstack.org" <openstack-dev@lists.openstack.org>
From: gordon chung <g...@live.ca>
Date: 08/16/2016 07:51PM
Subject: Re: [openstack-dev] FW: [Ceilometer]:Duplicate messages with 
Ceilometer Kafka Publisher.

 what does your pipeline.yaml look like? maybe paste it to 
paste.openstack.org. i imagine it's correct if your udp publishing works as 
expected.
 
 
 
On 16/08/16 04:04 AM, Raghunath D wrote:
   Hi Simon,
 
 I have two openstack setup's one with kilo and other with mitaka.
 
 Please find details of kafka version's below:
 Kilo kafka client library Version:1.3.1
 Mitaka kafka client library Version:1.3.1
 Kafka server version on both kilo and mitaka: kafka_2.11-0.9.0.0.tgz
 
 One observation is on kilo openstack setup I didn't see duplicate message 
issue,while on mitaka
 setup I am experiencing this issue.
 
 With Best Regards
 Raghunath Dudyala
 Tata Consultancy Services Limited
 Mailto:  raghunat...@tcs.com
 Website:  http://www.tcs.com
 
 Experience certainty. IT Services
 Business Solutions
 Consulting
 
 
 
 -
 
 
 From: Simon Pasquier [mailto:spasqu...@mirantis.com] 
 
 Sent: Thursday, August 11, 2016 2:34 AM
 To: OpenStack Development Mailing List (not for usage questions)  
<openstack-dev@lists.openstack.org>
 Subject: Re: [openstack-dev] [Ceilometer]:Duplicate messages with Ceilometer 
Kafka Publisher.
  
 
 
 
 
 Hi
  Which version of Kafka do you use?
  BR
  Simon
  
  
 
 On Thu, Aug 11, 2016 at 10:13 AM, Raghunath D <raghunat...@tcs.com> wrote:
  Hi , 
 
   We are injecting events to our custom plugin in ceilometer. 
   The ceilometer pipeline.yaml  is configured to publish these events over 
kafka and udp, consuming these samples using kafka and udp clients. 
 
   KAFKA publisher: 
   --- 
   When the events are sent continously ,we can see duplicate msg's are 
recevied in kafka client. 
   From the log it seems ceilometer kafka publisher is failed to send msg's,but 
still these msgs 
   are received by kafka server.So when kafka resends these failed msgs we can 
see duplicate msg's 
   received in kafka client. 
   Please find the attached log for reference. 
   Is this know issue ? 
   Is their any workaround for this issue ? 
 
   UDP publisher: 
     No duplicate msg's issue seen here and it is working as expected. 
 
         
 
 With Best Regards
 Raghunath Dudyala
 Tata Consultancy Services Limited
 Mailto:  raghunat...@tcs.com
 Website: http://www.tcs.com
 
 Experience certainty.        IT Services
                        Business Solutions
                        Consulting
 
 =-=-=
 Notice: The information contained in this e-mail
 message and/or attachments to it may contain 
 confidential or privileged information. If you are 
 not the intended recipient, any dissemination, use, 
 review, distribution, printing or copying of the 
 information contained in this e-mail message 
 and/or attachments to it are strictly prohibited. If 
 you have received this communication in error, 
 please notify us by reply e-mail or telephone and 
 immediately and permanently delete the message 
 and any attachments. Thank you
 
 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe:  openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
    

 
 [attachment "ATT1.txt" removed by Raghunath D/HYD/TCS] 
  
 
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
  
 
-- 
gord   
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
 __
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-re

Re: [openstack-dev] FW: [Ceilometer]:Duplicate messages with Ceilometer Kafka Publisher.

[Raghunath D]

 Hi Simon,

I have two openstack setup's one with kilo and other with mitaka.

Please find details of kafka version's below:
Kilo kafka client library Version:1.3.1
Mitaka kafka client library Version:1.3.1
Kafka server version on both kilo and mitaka: kafka_2.11-0.9.0.0.tgz

One observation is on kilo openstack setup I didn't see duplicate message 
issue,while on mitaka
setup I am experiencing this issue.

With Best Regards
 Raghunath Dudyala
 Tata Consultancy Services Limited
 Mailto: raghunat...@tcs.com
 Website: http://www.tcs.com
 
 Experience certainty.  IT Services
Business Solutions
Consulting
 
 

-
From: Simon Pasquier [mailto:spasqu...@mirantis.com] 
 Sent: Thursday, August 11, 2016 2:34 AM
 To: OpenStack Development Mailing List (not for usage questions) 
<openstack-dev@lists.openstack.org>
 Subject: Re: [openstack-dev] [Ceilometer]:Duplicate messages with Ceilometer 
Kafka Publisher.
  
 
 
 
 
 Hi
  Which version of Kafka do you use?
  BR
  Simon
  
  
 
 On Thu, Aug 11, 2016 at 10:13 AM, Raghunath D <raghunat...@tcs.com> wrote:
  Hi , 
 
   We are injecting events to our custom plugin in ceilometer. 
   The ceilometer pipeline.yaml  is configured to publish these events over 
kafka and udp, consuming these samples using kafka and udp clients. 
 
   KAFKA publisher: 
   --- 
   When the events are sent continously ,we can see duplicate msg's are 
recevied in kafka client. 
   From the log it seems ceilometer kafka publisher is failed to send msg's,but 
still these msgs 
   are received by kafka server.So when kafka resends these failed msgs we can 
see duplicate msg's 
   received in kafka client. 
   Please find the attached log for reference. 
   Is this know issue ? 
   Is their any workaround for this issue ? 
 
   UDP publisher: 
     No duplicate msg's issue seen here and it is working as expected. 
 
         
 
 With Best Regards
 Raghunath Dudyala
 Tata Consultancy Services Limited
 Mailto: raghunat...@tcs.com
 Website: http://www.tcs.com
 
 Experience certainty.        IT Services
                        Business Solutions
                        Consulting
 
 =-=-=
 Notice: The information contained in this e-mail
 message and/or attachments to it may contain 
 confidential or privileged information. If you are 
 not the intended recipient, any dissemination, use, 
 review, distribution, printing or copying of the 
 information contained in this e-mail message 
 and/or attachments to it are strictly prohibited. If 
 you have received this communication in error, 
 please notify us by reply e-mail or telephone and 
 immediately and permanently delete the message 
 and any attachments. Thank you
 
 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe:  openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
    
 

[attachment "ATT1.txt" removed by Raghunath D/HYD/TCS]__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

[openstack-dev] [Ceilometer]:Duplicate messages with Ceilometer Kafka Publisher.

[Raghunath D]

Hi ,

  We are injecting events to our custom plugin in ceilometer.
  The ceilometer pipeline.yaml  is configured to publish these events over 
kafka and udp, consuming these samples using kafka and udp clients.

  KAFKA publisher:
  ---
  When the events are sent continously ,we can see duplicate msg's are 
recevied in kafka client.
  From the log it seems ceilometer kafka publisher is failed to send 
msg's,but still these msgs 
  are received by kafka server.So when kafka resends these failed msgs we 
can see duplicate msg's
  received in kafka client.
  Please find the attached log for reference.
  Is this know issue ?
  Is their any workaround for this issue ?

  UDP publisher:
No duplicate msg's issue seen here and it is working as expected.

 

With Best Regards
Raghunath Dudyala
Tata Consultancy Services Limited
Mailto: raghunat...@tcs.com
Website: http://www.tcs.com

Experience certainty.   IT Services
Business Solutions
Consulting

=-=-=
Notice: The information contained in this e-mail
message and/or attachments to it may contain 
confidential or privileged information. If you are 
not the intended recipient, any dissemination, use, 
review, distribution, printing or copying of the 
information contained in this e-mail message 
and/or attachments to it are strictly prohibited. If 
you have received this communication in error, 
please notify us by reply e-mail or telephone and 
immediately and permanently delete the message 
and any attachments. Thank you


2016-08-11 06:46:49.251 25048 DEBUG oslo_messaging._drivers.amqpdriver [-] 
received message msg_id: None reply to None __call__ 
/usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py:201
2016-08-11 06:46:49.255 25048 INFO 
ceilometer.network.ext_services.vcpe.notifications 
[req-1dfff14f-52b4-4814-9cf5-5e1a8629d370 - - - - -] SRIKANTH: Received VCPE 
notification: vcpe_id=vcpe-222-432
2016-08-11 06:46:49.263 25048 DEBUG oslo_messaging._drivers.amqpdriver 
[req-1dfff14f-52b4-4814-9cf5-5e1a8629d370 - - - - -] CAST unique_id: 
c0485a71dd7b454abc520ae36d99620c NOTIFY exchange 'ceilometer' topic 
'metering.sample' _send 
/usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py:438
2016-08-11 06:46:49.272 25048 DEBUG kafka.conn 
[req-1dfff14f-52b4-4814-9cf5-5e1a8629d370 - - - - -]  Request 21: 
ProduceRequest_v0(required_acks=1, timeout=1000, topics=[(topic='ceilometer', 
partitions=[(partition=0, messages=['(offset=0, 
message=\'d\\x86\\x1a\\x80\\x00\\x00\\xff\\xff\\xff\\xff\\x00\\x00\\x02o{"counter_name":
 "vsg", "resource_id": "vcpe-222-432", "timestamp": 
"2016-08-11T06:46:49.248787", "counter_volume": 1, "user_id": 
"1e3ce043029547f1a61c1996d1a531a2", "message_signature": 
"c12644c101b3926dd743b64ed530417eac3788af52912f654a3ee12c564633b3", 
"resource_metadata": {"tenant_id": "3a397e70f64e4e40b69b6266c634d9d0", "host": 
"vcpe_publisher", "vcpe_id": "vcpe-222-432", "user_id": 
"1e3ce043029547f1a61c1996d1a531a2", "event_type": "vcpe"}, "source": 
"openstack", "counter_unit": "vsg", "project_id": 
"3a397e70f64e4e40b69b6266c634d9d0", "message_id": 
"60ef0722-5f8f-11e6-8c47-fa163e7e4feb", "counter_type": "gauge"}\')'])])]) 
_send /usr/local/lib/python2.7/dist-packages/kafka/conn.py:541
2016-08-11 06:46:49.278 25048 DEBUG oslo_messaging._drivers.amqpdriver [-] 
received message msg_id: None reply to None __call__ 
/usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py:201
2016-08-11 06:46:49.280 25048 INFO 
ceilometer.network.ext_services.vcpe.notifications 
[req-775522ad-360a-4d16-b0d5-c1749ca0caa3 - - - - -] SRIKANTH: Received VCPE 
cache.size notification
2016-08-11 06:46:49.285 25048 DEBUG oslo_messaging._drivers.amqpdriver 
[req-775522ad-360a-4d16-b0d5-c1749ca0caa3 - - - - -] CAST unique_id: 
7dfe4cf5eabe431c811fe20b700a87d7 NOTIFY exchange 'ceilometer' topic 
'metering.sample' _send 
/usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py:438
2016-08-11 06:46:49.293 25048 ERROR kafka.conn 
[req-775522ad-360a-4d16-b0d5-c1749ca0caa3 - - - - -] Error sending 
ProduceRequest_v0(required_acks=1, timeout=1000, topics=[(topic='ceilometer', 
partitions=[(partition=0, messages=['(offset=0, 
message=\'\\\'}\\xc1\\x9a\\x00\\x00\\xff\\xff\\xff\\xff\\x00\\x00\\x02\\xa8{"counter_name":
 "vsg.dns.cache.size", "resource_id": "vcpe-222-432", "timestamp": 
"2016-08-11T06:46:49.255965", "counter_volume": 150.0, "user_id": 
"1e3ce043029547f1a61c1996d1a531a2", "message_signature": 
"ba9345526de6c2387c1ae9a09e2835ef649d176047d46d55422b0f0d09c2b637", 
"resource_metadata": {"user_id": "1e3ce043029547f1a61c1996d1a531a2", 
"event_type": "vcpe.dns.cache.size", "tenant_id": 
"3a397e70f64e4e40b69b6266c634d9d0", "host": "vcpe_publisher", "cache_size": 
150, "vcpe_id": "vcpe-222-432"}, "source": "openstack", "counter_unit": 
"entries", 

Re: [openstack-dev] [ceilometer] :Regarding wild card configuration in pipeline.yaml

[Raghunath D]

Hi Gord,

Could you please kindly suggest how to proceed further on the below issue as 
we are somewhat blocked in our development activity due to the wildcard issue.

With Best Regards
Raghunath Dudyala
Tata Consultancy Services Limited
Mailto: raghunat...@tcs.com
Website: http://www.tcs.com

Experience certainty. IT Services
Business Solutions
Consulting




-Raghunath D/HYD/TCS wrote: - 
To: openstack-dev@lists.openstack.org
From: Raghunath D/HYD/TCS
Date: 01/21/2016 01:06PM
Cc: "Srikanth Vavilapalli" <srikanth.vavilapa...@ericsson.com>
Subject: Re: [openstack-dev] [ceilometer] :Regarding wild card configuration in 
pipeline.yaml


Hi ,
 
 Just to reframe my query:
  I have a meter subscription m1.* for publisher p1 and I need a subset of m1.* 
 notifications for ex:m1.xyz.* for publisher p2.
If we add p2 to already exisiting sink along with p1,  p2 will get other 
notification's along with m1.xyz.* which are not needed for p2.
 
To avoid this we had the following entry in pipeline;

sources:
  -name : m1meter
   meters: m1.*,!m1.xyz.*
   sinks:
-m1sink   
   .
  -name : m2meter
   meters:m1.xyz.*
   sinks:
-m2sink
sinks:
 -name: m1sink
  publishers:
   -p1
   
  -name: m2sink
  publishers:
   -p1
   -p2
 
>From reply mail it seems there is no strict restriction to support this.Could 
>you please let me know how should we handle such cases in ceilometer.
If we do code modification in pipeline module of ceilometer does it effects any 
other parts of ceilometer frame work.
 
 
Thanks and Regards
Raghunath.
 
 
Copied reply mail content from 
http://osdir.com/ml/openstack-dev/2016-01/msg01346.html for reference, due to 
some reason I am not getting reply mail to my mailbox.
-Copied Mail Start 
here-
hi,

i don't completely recall why we don't allow wildcarded exclude and include 
meters. it's probably because there's ambiguity of ordering of wildcard which 
can lead to different filter results.

someone can correct me, but i don't think there's a strict requirement that 
stops us from supporting both at once, just that it's not there.

as it stands now. you'll need to explicitly list out the meters you want (or 
don't want) sent to each pipeline.

cheers,
gord.
-Mail End 
Here-

With Best Regards
Raghunath Dudyala
Tata Consultancy Services Limited
Mailto: raghunat...@tcs.com
Website: http://www.tcs.com

Experience certainty. IT Services
Business Solutions
Consulting
________



-Raghunath D/HYD/TCS wrote: - 
To: openstack-dev@lists.openstack.org
From: Raghunath D/HYD/TCS
Date: 01/20/2016 07:09PM
Cc: "Srikanth Vavilapalli" <srikanth.vavilapa...@ericsson.com>
Subject: [openstack-dev] [ceilometer] :Regarding wild card configuration in 
pipeline.yaml


Hi ,
 
We have one use-case for which we are using ceilometer for getting 
notifications.
 
We have meter's m1.*,m1.xyz.* and publishers(kafka/udp) as p1 and p2.
i.m1.* notifications/meter data should send to p1 and p2
ii.m1.xyz.* notifications/meter data should send to p1.

We can correlate m1.* as network.* and m1.xyz.* as network.incoming.*
The pipeline.yaml is updated as:
--
sources:
  -name : m1meter
   meters: m1.*,m1.xyz.*
   sinks:
-m1sink   

sinks:
 -name: m1sink
  publishers:
   -p1
   -p2


With the above configuration p1 also receives other than m1.xyz.* notifications
which are not subscribed by p1.To avoid this duplication's,pipeline.yaml is 
updates as:
-
sources:
  -name : m1meter
   meters: m1.*,!m1.xyz.*
   sinks:
-m1sink   
   .
  -name : m2meter
   meters:m1.xyz.*
   sinks:
-m2sink
sinks:
 -name: m1sink
  publishers:
   -p1
   -p2
 
 -name: m2sink
  publishers:
   -p1

  
This configuration is failing under source rule checking with reason "both 
included and
excluded meters specified.

Info/Help needed:
  Do we have any way in ceilometer frame work to achieve this or 

Re: [openstack-dev] [ceilometer] :Regarding wild card configuration in pipeline.yaml

[Raghunath D]

Hi ,

 Just to reframe my query:
  I have a meter subscription m1.* for publisher p1 and I need a subset of m1.* 
 notifications for ex:m1.xyz.* for publisher p2.
If we add p2 to already exisiting sink along with p1,  p2 will get other 
notification's along with m1.xyz.* which are not needed for p2.

To avoid this we had the following entry in pipeline;

sources:
  -name : m1meter
   meters: m1.*,!m1.xyz.*
   sinks:
-m1sink   
   .
  -name : m2meter
   meters:m1.xyz.*
   sinks:
-m2sink
sinks:
 -name: m1sink
  publishers:
   -p1
   
  -name: m2sink
  publishers:
   -p1
   -p2
 
>From reply mail it seems there is no strict restriction to support this.Could 
>you please let me know how should we handle such cases in ceilometer.
If we do code modification in pipeline module of ceilometer does it effects any 
other parts of ceilometer frame work.


Thanks and Regards
Raghunath.


Copied reply mail content from 
http://osdir.com/ml/openstack-dev/2016-01/msg01346.html for reference, due to 
some reason I am not getting reply mail to my mailbox.
-Copied Mail Start 
here-
hi,

i don't completely recall why we don't allow wildcarded exclude and include 
meters. it's probably because there's ambiguity of ordering of wildcard which 
can lead to different filter results.

someone can correct me, but i don't think there's a strict requirement that 
stops us from supporting both at once, just that it's not there.

as it stands now. you'll need to explicitly list out the meters you want (or 
don't want) sent to each pipeline.

cheers,
gord.
-Mail End 
Here-

With Best Regards
Raghunath Dudyala
Tata Consultancy Services Limited
Mailto: raghunat...@tcs.com
Website: http://www.tcs.com

Experience certainty. IT Services
Business Solutions
Consulting




-Raghunath D/HYD/TCS wrote: - 
To: openstack-dev@lists.openstack.org
From: Raghunath D/HYD/TCS
Date: 01/20/2016 07:09PM
Cc: "Srikanth Vavilapalli" <srikanth.vavilapa...@ericsson.com>
Subject: [openstack-dev] [ceilometer] :Regarding wild card configuration in 
pipeline.yaml


Hi ,
 
We have one use-case for which we are using ceilometer for getting 
notifications.
 
We have meter's m1.*,m1.xyz.* and publishers(kafka/udp) as p1 and p2.
i.m1.* notifications/meter data should send to p1 and p2
ii.m1.xyz.* notifications/meter data should send to p1.

We can correlate m1.* as network.* and m1.xyz.* as network.incoming.*
The pipeline.yaml is updated as:
--
sources:
  -name : m1meter
   meters: m1.*,m1.xyz.*
   sinks:
-m1sink   

sinks:
 -name: m1sink
  publishers:
   -p1
   -p2


With the above configuration p1 also receives other than m1.xyz.* notifications
which are not subscribed by p1.To avoid this duplication's,pipeline.yaml is 
updates as:
-
sources:
  -name : m1meter
   meters: m1.*,!m1.xyz.*
   sinks:
-m1sink   
   .
  -name : m2meter
   meters:m1.xyz.*
   sinks:
-m2sink
sinks:
 -name: m1sink
  publishers:
   -p1
   -p2
 
 -name: m2sink
  publishers:
   -p1

  
This configuration is failing under source rule checking with reason "both 
included and
excluded meters specified.

Info/Help needed:
  Do we have any way in ceilometer frame work to achieve this or could you 
provide 
us some suggestions how to achieve this in ceilometer.
 
With Best Regards
Raghunath Dudyala
Tata Consultancy Services Limited
Mailto: raghunat...@tcs.com
Website: http://www.tcs.com

Experience certainty. IT Services
Business Solutions
Consulting

=-=-=
Notice: The information contained in this e-mail
message and/or attachments to it may contain 
confidential or privileged information. If you are 
not the intended recipient, any dissemination, use, 
review, distribution, printing or copying of the 
information contained in this e-mail message 
and/or attachments to it are strictly prohibited. If 
you have received this comm

[openstack-dev] [ceilometer] :Regarding wild card configuration in pipeline.yaml

[Raghunath D]

Hi ,

We have one use-case for which we are using ceilometer for getting 
notifications.

We have meter's m1.*,m1.xyz.* and publishers(kafka/udp) as p1 and p2.
i.m1.* notifications/meter data should send to p1 and p2
ii.m1.xyz.* notifications/meter data should send to p1.

We can correlate m1.* as network.* and m1.xyz.* as network.incoming.*
The pipeline.yaml is updated as:
--
sources:
  -name : m1meter
   meters: m1.*,m1.xyz.*
   sinks:
-m1sink   

sinks:
 -name: m1sink
  publishers:
   -p1
   -p2


With the above configuration p1 also receives other than m1.xyz.* notifications
which are not subscribed by p1.To avoid this duplication's,pipeline.yaml is 
updates as:
-
sources:
  -name : m1meter
   meters: m1.*,!m1.xyz.*
   sinks:
-m1sink   
   .
  -name : m2meter
   meters:m1.xyz.*
   sinks:
-m2sink
sinks:
 -name: m1sink
  publishers:
   -p1
   -p2
 
 -name: m2sink
  publishers:
   -p1

  
This configuration is failing under source rule checking with reason "both 
included and
excluded meters specified.

Info/Help needed:
  Do we have any way in ceilometer frame work to achieve this or could you 
provide 
us some suggestions how to achieve this in ceilometer.
 
With Best Regards
Raghunath Dudyala
Tata Consultancy Services Limited
Mailto: raghunat...@tcs.com
Website: http://www.tcs.com

Experience certainty. IT Services
Business Solutions
Consulting

=-=-=
Notice: The information contained in this e-mail
message and/or attachments to it may contain 
confidential or privileged information. If you are 
not the intended recipient, any dissemination, use, 
review, distribution, printing or copying of the 
information contained in this e-mail message 
and/or attachments to it are strictly prohibited. If 
you have received this communication in error, 
please notify us by reply e-mail or telephone and 
immediately and permanently delete the message 
and any attachments. Thank you


__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

[openstack-dev] [Ceilometer]:Subscribe and Publish Notification frame work in Ceilometer !

[Raghunath D]

Hi Pradeep,

Presently we are looking for a monitoring service.Using monitoring service 
user's/application's 
will subscribe for few notification's/events from openstack infrastructure and 
monitoring service
will publish these notification to user's/application's.

We are exploring Ceilometer for this purpose.We came across below blue print 
which is similar to our requirement.

 https://blueprints.launchpad.net/ceilometer/+spec/declarative-notifications.

We have few queries on declarative-notifications frame work,could you please 
help us in addressing them:

1.We are looking for an API for Subcribing/Publishing notification.Do this 
frame work exposes any such API,if yes could you 
   please provide us API doc or spec how to use it.
2.If the frame work doesn't have such API,does any of the development group is 
working in this area.
3.Please suggest what would be the best place in ceilometer notification frame 
work(publisher/dispatcher/..)
   to implement the Subscribe and Publish API.

With Best Regards
Raghunath Dudyala
Tata Consultancy Services Limited
Mailto: raghunat...@tcs.com
Website: http://www.tcs.com

Experience certainty.   IT Services
Business Solutions
Consulting

=-=-=
Notice: The information contained in this e-mail
message and/or attachments to it may contain 
confidential or privileged information. If you are 
not the intended recipient, any dissemination, use, 
review, distribution, printing or copying of the 
information contained in this e-mail message 
and/or attachments to it are strictly prohibited. If 
you have received this communication in error, 
please notify us by reply e-mail or telephone and 
immediately and permanently delete the message 
and any attachments. Thank you


__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

Re: [openstack-dev] [neutron] [QoS] QoS weekly meeting

[Raghunath D]

Hi  Miguel,

I am interested to join this meeting.
I assume that CC of this mail are from different time zones.Please provide
time slot with common time zone.

With Best Regards
Raghunath Dudyala
Tata Consultancy Services Limited
Mailto: raghunat...@tcs.com
Website: http://www.tcs.com

Experience certainty.   IT Services
Business Solutions
Consulting



-Miguel Ángel Ajo majop...@redhat.com wrote: -
To: openstack-dev@lists.openstack.org
From: Miguel Ángel Ajo majop...@redhat.com
Date: 04/06/2015 09:26PM
Cc: Kyle Mestery mest...@mestery.com, Sean M. Collins s...@coreitpro.com, 
irenab@gmail.com irenab@gmail.com, Suresh Balineni 
sbalin...@juniper.net, Raghunath D raghunat...@tcs.com, Tal Anker 
anker...@mellanox.com, livnat Peer lp...@redhat.com, Nir Yechiel 
nyech...@redhat.com, Vikram Choudhary vikram.choudh...@huawei.com, 
Kalyankumar Asangi kaly...@huawei.com, Dhruv Dhody dhruv.dh...@huawei.com, 
Dongfeng (C) albert.dongf...@huawei.com
Subject: [neutron] [QoS] QoS weekly meeting

I#8217;d like to co-organized a QoS weekly meeting with Sean M. Collins,

    In the last few years, the interest for QoS support has increased, Sean has 
been leading
this effort [1] and we believe we should get into a consensus about how to 
model an extension
to let vendor plugins implement QoS capabilities on network ports and tenant 
networks, and
how to extend agents, and the reference implementation  others [2]

    As per discussion we#8217;ve had during the last few months [3], I believe 
we should start simple, but
prepare a model allowing future extendibility, to allow for example specific 
traffic rules (per port,
per IP, etc..), congestion notification support [4], #8230;

    It#8217;s the first time I#8217;m trying to organize an openstack/neutron 
meeting, so, I don#8217;t know what#8217;s the
best way to do it, or find the best timeslot. I guess interested people may 
have a saying, so I#8217;ve 
looped anybody I know is interested in the CC of this mail. 


Miguel Ángel Ajo

[1] https://blueprints.launchpad.net/neutron/+spec/quantum-qos-api
[2] 
https://drive.google.com/file/d/0B2XATqL7DxHFRHNjU3k1UFNYRjQ/view?usp=sharing
[3] 
https://docs.google.com/document/d/1xUx0Oq-txz_qVA2eYE1kIAJlwxGCSqXHgQEEGylwlZE/edit#heading=h.2pdgqfl3a231
[4] 
https://blueprints.launchpad.net/neutron/+spec/explicit-congestion-notification
=-=-=
Notice: The information contained in this e-mail
message and/or attachments to it may contain 
confidential or privileged information. If you are 
not the intended recipient, any dissemination, use, 
review, distribution, printing or copying of the 
information contained in this e-mail message 
and/or attachments to it are strictly prohibited. If 
you have received this communication in error, 
please notify us by reply e-mail or telephone and 
immediately and permanently delete the message 
and any attachments. Thank you


__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev