Re: [openstack-dev] [Ceilometer]: Instance creation and deletion metrics in ceilometer !

[Adrian Turjak]

On 04/11/16 01:16, Julien Danjou wrote:
> On Thu, Nov 03 2016, Adrian Turjak wrote:
>
>> I'd need to double check exactly what query it is, but it effectively
>> amounts to:
>> "List all instance metric samples where project_id is  and timestamp
>> is in time range -"
>>
>> The time range is an hour + leadin from last hour to catch the last
>> sample from the previous window.
> You can do exactly the same thing in Gnocchi by listing resources alive
> during the timeframe you are interested in.
>
> The main gain by switching to Gnocchi is that you don't have to "sync
> every hour from Ceilometer". You can just use it as a backend to
> generate your billing directly.
>
Yeah, sounds like it. I've been looking forward to playing with gnocchi
for a while but just had no time and honestly it's about time we switch
to using it. Ceilometer was a pain and it always felt like we were
coding around issues in Ceilometer.

I have a feeling we'll still need to transform the data into our own
system, but it will become much easier. I'll use the switch to gnocchi
as an excuse to refactor most of our billing I think.

Thanks for answering my questions. :)


__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

Re: [openstack-dev] [Ceilometer]: Instance creation and deletion metrics in ceilometer !

[gordon chung]

On 02/11/16 08:10 PM, Adrian Turjak wrote:
>
> On 03/11/16 03:01, gordon chung wrote:
>> gnocchi captures the state of a resource and it's history. this is
>> accessible by looking at resource history. i'm not entirely sure if that
>> handles your case, may you could provide the queries you use and we
>> could figure out equivalent gnocchi queries. i built a ceilometer vs
>> gnocchi usage deck[1] that may help but it's more focused on metrics
>> rather than resource history.
>>
>> [1] http://www.slideshare.net/GordonChung/ceilometer-to-gnocchi
>>
>> cheers,
>
> I'd need to double check exactly what query it is, but it effectively
> amounts to:
> "List all instance metric samples where project_id is  and timestamp
> is in time range -"
>
> The time range is an hour + leadin from last hour to catch the last
> sample from the previous window.
>
> We then group by resource id, and for each instance check the metadata.
> If a sample exists, then the instance exists, and depending on what
> states the metadata shows it was in we know for how much of that hour we
> will be billing. Basically, we don't care about the actual volume/data
> of the metric, just the sample metadata from the resource at that point
> in time.
>
> The above is what our billing aggregation service does ever hour against
> ceilometer. So we're not using ceilometer directly for billing, just are
> a source for the data we wish to aggregate and transform into something
> we can bill.
>
> It looks like we can still achieve the same thing in gnocchi with any
> instance metric that has resource metadata (cpu_util) since gnocchi
> stores the changes in the metadata over time. Can we though bypass the
> metric and look at changes in resource metadata directly?
>

yeah, as jd mentioned, it seems like Gnocchi covers your use case and 
makes it a bit easier. yes, you can look at resource data and history 
without considering metrics (that's actually how it's designed, resource 
and metric data separate). you can search for resources or get it's 
history[1]. there's an equivalent client call if needed.


[1] http://gnocchi.xyz/rest.html#searching-for-resources


cheers,
-- 
gord

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

Re: [openstack-dev] [Ceilometer]: Instance creation and deletion metrics in ceilometer !

[Julien Danjou]

On Thu, Nov 03 2016, Maxime Belanger wrote:

Hi Maxime,

> We had this project of our own for a couple years and it was not meant to
> replace Ceilometer at all. For our billing use case, yes it did replace
> Ceilometer because scaling issues. We just wanted to propose it to the
> community as a matter of sharing knowledge.

Yeah, and that's cool. :)

> So currently I'm not sure there is a project that does the same thing in
> Telemetry unless I'm mistaken. Yes there was Ceilometer, but for reason of api
> performance issue when hitting a huge DB with a lot of historic data. It was
> not scalling at all. Right now, not sure where Ceilometer is going in terms of
> dev and there is Aodh, but from what I read, it's for alerting purposes.

Today, Ceilometer is in charge of the polling + notification listening,
and feeds that into the system you want, in our case, Gnocchi.

It seems you have only one project for all of that, where we have built
2 projects that can be reused in different context, but coupled do the
same thing (and probably more) than what Almanach does.

I swiftly encourage you to take a look at what Ceilometer+Gnocchi can
do, as it may be a good surprise for you. And if it does not cover your
use case(s), it'd be very interesting to us to know where it fails.

Cheers,
-- 
Julien Danjou
;; Free Software hacker
;; https://julien.danjou.info


signature.asc
Description: PGP signature
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

Re: [openstack-dev] [Ceilometer]: Instance creation and deletion metrics in ceilometer !

[Julien Danjou]

On Thu, Nov 03 2016, Adrian Turjak wrote:

> I'd need to double check exactly what query it is, but it effectively
> amounts to:
> "List all instance metric samples where project_id is  and timestamp
> is in time range -"
>
> The time range is an hour + leadin from last hour to catch the last
> sample from the previous window.

You can do exactly the same thing in Gnocchi by listing resources alive
during the timeframe you are interested in.

The main gain by switching to Gnocchi is that you don't have to "sync
every hour from Ceilometer". You can just use it as a backend to
generate your billing directly.

-- 
Julien Danjou
// Free Software hacker
// https://julien.danjou.info


signature.asc
Description: PGP signature
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

Re: [openstack-dev] [Ceilometer]: Instance creation and deletion metrics in ceilometer !

[Maxime Belanger]

Hi Emilien,


We had this project of our own for a couple years and it was not meant to 
replace Ceilometer at all. For our billing use case, yes it did replace 
Ceilometer because scaling issues. We just wanted to propose it to the 
community as a matter of sharing knowledge.


This system just collects events that we/you care about and store them as a 
stream so you could reuse them later (in our case billing). And by the way 
Almanach doesn't do billing at all. You could even plug it to Cloud Kitty as a 
data source if you want.

So currently I'm not sure there is a project that does the same thing in 
Telemetry unless I'm mistaken. Yes there was Ceilometer, but for reason of api 
performance issue when hitting a huge DB with a lot of historic data. It was 
not scalling at all. Right now, not sure where Ceilometer is going in terms of 
dev and there is Aodh, but from what I read, it's for alerting purposes.


So now you know the "Why we are here now"...


Max




From: Emilien Macchi 
Sent: November 2, 2016 6:02:50 PM
To: OpenStack Development Mailing List (not for usage questions)
Subject: Re: [openstack-dev] [Ceilometer]: Instance creation and deletion 
metrics in ceilometer !

On Wed, Nov 2, 2016 at 2:33 PM, Maxime Belanger  wrote:
> Hi Raghunath,
>
>
> We are usign Almanach : https://github.com/openstack/almanach. I think your
[https://avatars0.githubusercontent.com/u/324574?v=3&s=400]<https://github.com/openstack/almanach>

openstack/almanach<https://github.com/openstack/almanach>
github.com
almanach - Record the utilization of OpenStack resources for each tenant



> use case pretty much fits what this project does.
> We implemented this as a replacement of Ceilometer to gather usage on
> instances and volumes. We query it to do our billing calculation.

I am failing to understand why we create projects to replace official
projects that would have the same mission statement or common
technical goals.  We saw it with Monasca and AFIK it didn't work very
well.
Have you engaged collaboration with Telemetry team to work together as
a community and propose your use-case to the roadmap if some feature
was missing?

I'm very interested to know from "Almanach" developers why we're here
now.  I personally like to think OpenStack contributors work as a
community and meet common goals by communicating on the appropriate
channels.
Please correct me if I'm wrong in the case this project is totally
doing something else, my knowledge in Telemetry is limited from my
user perspective.

> It is of course a less complete solution than CloudKitty + Gnocchi but
> suites our needs for now.
>
> Maxime
>
> ____
> From: Raghunath D 
> Sent: October 25, 2016 5:32:13 AM
> To: openstack-dev@lists.openstack.org
> Subject: Re: [openstack-dev] [Ceilometer]: Instance creation and deletion
> metrics in ceilometer !
>
> Hi ,
>
> Can some one please suggest how to instance notifications in ceilometer.
>
> With Best Regards
> Raghunath Dudyala
> Tata Consultancy Services Limited
> Mailto: raghunat...@tcs.com
> Website: http://www.tcs.com
TCS: IT Services, Consulting and Business Solutions<http://www.tcs.com/>
www.tcs.com
Tata Consultancy Services’ IT services, consulting and business solutions 
deliver real results to global businesses to help them experience certainty.



> 
> Experience certainty. IT Services
> Business Solutions
> Consulting
> ________________
>
>
> -----Raghunath D/HYD/TCS wrote: -
> To: openstack-dev@lists.openstack.org
> From: Raghunath D/HYD/TCS
> Date: 10/18/2016 08:01PM
> Subject: [openstack-dev] [Ceilometer]: Instance creation and deletion
> metrics in ceilometer !
>
> Hi ,
>
> How can instance created and deleted information/sample can be retrieved
> from ceilometer.
> What entries should be there in pipeline.yaml  to get instance deleted
> information.
>
> I tried to have meters- "instance" in pipeline.yam but it always gives
> active instance details,
> and no details of deleted instances.
>
> With Best Regards
> Raghunath Dudyala
> Tata Consultancy Services Limited
> Mailto: raghunat...@tcs.com
> Website: http://www.tcs.com
TCS: IT Services, Consulting and Business Solutions<http://www.tcs.com/>
www.tcs.com
Tata Consultancy Services’ IT services, consulting and business solutions 
deliver real results to global businesses to help them experience certainty.



> 
> Experience certainty. IT Services
> Business Solutions
> Consulting
> 
>
> =-=-=
> Notice: The information c

Re: [openstack-dev] [Ceilometer]: Instance creation and deletion metrics in ceilometer !

[Adrian Turjak]

On 03/11/16 03:01, gordon chung wrote:
> gnocchi captures the state of a resource and it's history. this is 
> accessible by looking at resource history. i'm not entirely sure if that 
> handles your case, may you could provide the queries you use and we 
> could figure out equivalent gnocchi queries. i built a ceilometer vs 
> gnocchi usage deck[1] that may help but it's more focused on metrics 
> rather than resource history.
>
> [1] http://www.slideshare.net/GordonChung/ceilometer-to-gnocchi
>
> cheers,

I'd need to double check exactly what query it is, but it effectively
amounts to:
"List all instance metric samples where project_id is  and timestamp
is in time range -"

The time range is an hour + leadin from last hour to catch the last
sample from the previous window.

We then group by resource id, and for each instance check the metadata.
If a sample exists, then the instance exists, and depending on what
states the metadata shows it was in we know for how much of that hour we
will be billing. Basically, we don't care about the actual volume/data
of the metric, just the sample metadata from the resource at that point
in time.

The above is what our billing aggregation service does ever hour against
ceilometer. So we're not using ceilometer directly for billing, just are
a source for the data we wish to aggregate and transform into something
we can bill.

It looks like we can still achieve the same thing in gnocchi with any
instance metric that has resource metadata (cpu_util) since gnocchi
stores the changes in the metadata over time. Can we though bypass the
metric and look at changes in resource metadata directly?


__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

Re: [openstack-dev] [Ceilometer]: Instance creation and deletion metrics in ceilometer !

[Emilien Macchi]

On Wed, Nov 2, 2016 at 2:33 PM, Maxime Belanger  wrote:
> Hi Raghunath,
>
>
> We are usign Almanach : https://github.com/openstack/almanach. I think your
> use case pretty much fits what this project does.
> We implemented this as a replacement of Ceilometer to gather usage on
> instances and volumes. We query it to do our billing calculation.

I am failing to understand why we create projects to replace official
projects that would have the same mission statement or common
technical goals.  We saw it with Monasca and AFIK it didn't work very
well.
Have you engaged collaboration with Telemetry team to work together as
a community and propose your use-case to the roadmap if some feature
was missing?

I'm very interested to know from "Almanach" developers why we're here
now.  I personally like to think OpenStack contributors work as a
community and meet common goals by communicating on the appropriate
channels.
Please correct me if I'm wrong in the case this project is totally
doing something else, my knowledge in Telemetry is limited from my
user perspective.

> It is of course a less complete solution than CloudKitty + Gnocchi but
> suites our needs for now.
>
> Maxime
>
> 
> From: Raghunath D 
> Sent: October 25, 2016 5:32:13 AM
> To: openstack-dev@lists.openstack.org
> Subject: Re: [openstack-dev] [Ceilometer]: Instance creation and deletion
> metrics in ceilometer !
>
> Hi ,
>
> Can some one please suggest how to instance notifications in ceilometer.
>
> With Best Regards
> Raghunath Dudyala
> Tata Consultancy Services Limited
> Mailto: raghunat...@tcs.com
> Website: http://www.tcs.com
> 
> Experience certainty. IT Services
> Business Solutions
> Consulting
> 
>
>
> -Raghunath D/HYD/TCS wrote: -----
> To: openstack-dev@lists.openstack.org
> From: Raghunath D/HYD/TCS
> Date: 10/18/2016 08:01PM
> Subject: [openstack-dev] [Ceilometer]: Instance creation and deletion
> metrics in ceilometer !
>
> Hi ,
>
> How can instance created and deleted information/sample can be retrieved
> from ceilometer.
> What entries should be there in pipeline.yaml  to get instance deleted
> information.
>
> I tried to have meters- "instance" in pipeline.yam but it always gives
> active instance details,
> and no details of deleted instances.
>
> With Best Regards
> Raghunath Dudyala
> Tata Consultancy Services Limited
> Mailto: raghunat...@tcs.com
> Website: http://www.tcs.com
> 
> Experience certainty. IT Services
> Business Solutions
> Consulting
> 
>
> =-=-=
> Notice: The information contained in this e-mail
> message and/or attachments to it may contain
> confidential or privileged information. If you are
> not the intended recipient, any dissemination, use,
> review, distribution, printing or copying of the
> information contained in this e-mail message
> and/or attachments to it are strictly prohibited. If
> you have received this communication in error,
> please notify us by reply e-mail or telephone and
> immediately and permanently delete the message
> and any attachments. Thank you
>
>
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>



-- 
Emilien Macchi

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

Re: [openstack-dev] [Ceilometer]: Instance creation and deletion metrics in ceilometer !

[Maxime Belanger]

Hi Raghunath,


We are usign Almanach : https://github.com/openstack/almanach. I think your use 
case pretty much fits what this project does.
We implemented this as a replacement of Ceilometer to gather usage on instances 
and volumes. We query it to do our billing calculation.
It is of course a less complete solution than CloudKitty + Gnocchi but suites 
our needs for now.

Maxime


From: Raghunath D 
Sent: October 25, 2016 5:32:13 AM
To: openstack-dev@lists.openstack.org
Subject: Re: [openstack-dev] [Ceilometer]: Instance creation and deletion 
metrics in ceilometer !

Hi ,

Can some one please suggest how to instance notifications in ceilometer.

With Best Regards
Raghunath Dudyala
Tata Consultancy Services Limited
Mailto: raghunat...@tcs.com
Website: http://www.tcs.com

Experience certainty. IT Services
Business Solutions
Consulting



-Raghunath D/HYD/TCS wrote: -
To: openstack-dev@lists.openstack.org
From: Raghunath D/HYD/TCS
Date: 10/18/2016 08:01PM
Subject: [openstack-dev] [Ceilometer]: Instance creation and deletion metrics 
in ceilometer !

Hi ,

How can instance created and deleted information/sample can be retrieved from 
ceilometer.
What entries should be there in pipeline.yaml  to get instance deleted 
information.

I tried to have meters- "instance" in pipeline.yam but it always gives active 
instance details,
and no details of deleted instances.

With Best Regards
Raghunath Dudyala
Tata Consultancy Services Limited
Mailto: raghunat...@tcs.com
Website: http://www.tcs.com

Experience certainty. IT Services
Business Solutions
Consulting


=-=-=
Notice: The information contained in this e-mail
message and/or attachments to it may contain
confidential or privileged information. If you are
not the intended recipient, any dissemination, use,
review, distribution, printing or copying of the
information contained in this e-mail message
and/or attachments to it are strictly prohibited. If
you have received this communication in error,
please notify us by reply e-mail or telephone and
immediately and permanently delete the message
and any attachments. Thank you
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

Re: [openstack-dev] [Ceilometer]: Instance creation and deletion metrics in ceilometer !

[gordon chung]

On 02/11/16 01:39 AM, Adrian Turjak wrote:
> Been vaguely following this thread and I have a question.
>
> Just to confirm, as I haven't touched ceilometer code in ages, the
> instance metric still exists? Or at least something like it?

it sort of exists currently. we don't build it from notifications but 
the pollster still generates it. (but it will be dropped unless people 
tell us otherwise.)

>
> We're currently using ceilometer as the data collection for our billing,
> and the instance metric is our primary way of billing for compute mainly
> because it tells us which instances exist at a given point in time. We
> further then use the metadata of that metric to get instance state
> (building, active, shutdown, terminating, etc) to determine if we should
> bill it.

i'm curious, what is the query you are using to get this information? 
the state information still is available via events which in the case of 
gnocchi, it uses to store resource state alongside metrics

>
> With the changes to ceilometer and the move to gnocchi I know we will
> need to rebuild how we handle billing data as we upgrade, but what I'm
> worried about is if gnocchi+ceilometer have some equivalent to the
> instance metric that will supply us with the same data, or do we now
> need to do our own notification monitoring...

i believe all the data is still available in some form. regarding 
gnocchi specifically, it takes sample data to capture measurements for a 
metric and takes event data to capture state (and possibly other metadata)

>
> Basically what I need is time series data of, this instance was in this
> state from this period to that period, and if I query for a range I get
> the ranges or changes in that time series. Is something like that
> present, or if not would I be able to make something like that in
> gnocchi? That way I can then query for a time range and know what state
> changes occurred for a given instance.

gnocchi captures the state of a resource and it's history. this is 
accessible by looking at resource history. i'm not entirely sure if that 
handles your case, may you could provide the queries you use and we 
could figure out equivalent gnocchi queries. i built a ceilometer vs 
gnocchi usage deck[1] that may help but it's more focused on metrics 
rather than resource history.

[1] http://www.slideshare.net/GordonChung/ceilometer-to-gnocchi

cheers,
-- 
gord

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

Re: [openstack-dev] [Ceilometer]: Instance creation and deletion metrics in ceilometer !

[Adrian Turjak]

Been vaguely following this thread and I have a question.

Just to confirm, as I haven't touched ceilometer code in ages, the
instance metric still exists? Or at least something like it?

We're currently using ceilometer as the data collection for our billing,
and the instance metric is our primary way of billing for compute mainly
because it tells us which instances exist at a given point in time. We
further then use the metadata of that metric to get instance state
(building, active, shutdown, terminating, etc) to determine if we should
bill it.

With the changes to ceilometer and the move to gnocchi I know we will
need to rebuild how we handle billing data as we upgrade, but what I'm
worried about is if gnocchi+ceilometer have some equivalent to the
instance metric that will supply us with the same data, or do we now
need to do our own notification monitoring...

Basically what I need is time series data of, this instance was in this
state from this period to that period, and if I query for a range I get
the ranges or changes in that time series. Is something like that
present, or if not would I be able to make something like that in
gnocchi? That way I can then query for a time range and know what state
changes occurred for a given instance.

After my current project I think I may need to dig into gnocchi and
ceilometer again because I'm so far behind where things currently are. :(

On 02/11/16 17:01, Ganpat Agarwal wrote:
> That's correct.
>
> We can have meters only for those things which we can measure like
> cpu, memory etc.
>
> If we want to keep a count of instance creation and deletion, you will
> need to monitor the events and look for specific event types like
> compute.instance.create.end or compute.instance.delete.end.
>
> On Wed, Nov 2, 2016 at 2:42 AM, gordon chung  > wrote:
>
>
>
> On 01/11/16 05:30 AM, Raghunath D wrote:
> > My requirement is to get sample/counter with "instance" name ,with
> > event_type *compute.instance.**
>
> we don't build instance meter anymore because it's not a meter as it's
> not measuring anything.
>
> --
> gord
>
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe:
> openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> 
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
> 
>
>
>
>
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

Re: [openstack-dev] [Ceilometer]: Instance creation and deletion metrics in ceilometer !

[Ganpat Agarwal]

That's correct.

We can have meters only for those things which we can measure like cpu,
memory etc.

If we want to keep a count of instance creation and deletion, you will need
to monitor the events and look for specific event types like
compute.instance.create.end or compute.instance.delete.end.

On Wed, Nov 2, 2016 at 2:42 AM, gordon chung  wrote:

>
>
> On 01/11/16 05:30 AM, Raghunath D wrote:
> > My requirement is to get sample/counter with "instance" name ,with
> > event_type *compute.instance.**
>
> we don't build instance meter anymore because it's not a meter as it's
> not measuring anything.
>
> --
> gord
>
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

Re: [openstack-dev] [Ceilometer]: Instance creation and deletion metrics in ceilometer !

[gordon chung]

On 01/11/16 05:30 AM, Raghunath D wrote:
> My requirement is to get sample/counter with "instance" name ,with
> event_type *compute.instance.**

we don't build instance meter anymore because it's not a meter as it's 
not measuring anything.

-- 
gord

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

Re: [openstack-dev] [Ceilometer]: Instance creation and deletion metrics in ceilometer !

[Raghunath D]

Hi,


what meters are you looking for specifically? as Ganpat mentioned, we 
only derive a few meters from Nova notifications[1]. i don't understand 
your comment about being able to see events on kafka. by 'events' do you 
mean Ceilometer Events[2]?

[1] 
https://github.com/openstack/ceilometer/blob/master/ceilometer/meter/data/meters.yaml#L83-L127
[2] http://docs.openstack.org/developer/ceilometer/events.html

Yes,here I am referring  to Events[2].

My requirement is to get sample/counter with "instance" name ,with event_type 
compute.instance.*

For example:

{u'counter_name': u'instance', u'user_id': u'0eddb9bb412b4b2783fbdb04c7786fbd', 
u'message_signature': 
u'a575aee7540c8aac5d481fbeb6c96e8a967814c7f7d712b3b3da0a4ebccabb1d', 
u'timestamp': u'2016-11-01 07:34:42.994144', u'resource_id': 
u'1784a230-5038-46e9-9a2e-f96dabc1ea26', u'message_id': 
u'a7bac522-a005-11e6-abbb-52540074f46a', u'source': u'openstack', 
u'counter_unit': u'instance', u'counter_volume': 1, u'project_id': 
u'33dbef1a1442476b9c5935287df86f2c', u'resource_metadata': 
{u'state_description': u'', u'event_type': u'compute.instance.delete.end', 
u'availability_zone': u'nova', u'terminated_at': u'2016-11-01T07:34:42.167439', 
u'ephemeral_gb': 0, u'instance_type_id': 5, u'deleted_at': 
u'2016-11-01T07:34:42.00', u'reservation_id': u'r-bhq970mr', u'memory_mb': 
2048, u'display_name': u'mysite_exampleservice-1', u'hostname': 
u'mysite-exampleservice-1', u'state': u'deleted', u'progress': u'', 
u'launched_at': u'2016-10-31T21:54:53.00', u'node': 
u'chilly-police.cord.lab', u'ramdisk_id': u'', u'access_ip_v6': None, 
u'disk_gb': 20, u'access_ip_v4': None, u'kernel_id': u'', u'host': 
u'compute.chilly-police', u'user_id': u'0eddb9bb412b4b2783fbdb04c7786fbd', 
u'image_ref_url': 
u'http://10.1.0.18:9292/images/8f2185b2-1669-46df-8a01-88b3abd88aa5', 
u'cell_name': u'', u'root_gb': 20, u'tenant_id': 
u'33dbef1a1442476b9c5935287df86f2c', u'created_at': u'2016-10-31 
21:54:32+00:00', u'instance_id': u'1784a230-5038-46e9-9a2e-f96dabc1ea26', 
u'instance_type': u'm1.small', u'vcpus': 1, u'image_meta': {u'min_disk': u'20', 
u'container_format': u'bare', u'min_ram': u'0', u'disk_format': u'raw', 
u'base_image_ref': u'8f2185b2-1669-46df-8a01-88b3abd88aa5'}, u'architecture': 
None, u'os_type': None, u'instance_flavor_id': u'2'}, u'counter_type': 
u'gauge'}'

Now I am able to do this by  creating event_definitions.yaml 
,event_pipeline.yaml as mentioned bt Ganpat and updating conf files:

1,ceilometer.conf:
   notification_topics = notifications
   [notification]
   store_events = True
   [event]
   drop_unmatched_notifications = False
   definitions_cfg_file = /etc/ceilometer/event_definitions.yaml

With Best Regards
 Raghunath Dudyala
 Tata Consultancy Services Limited
 Mailto: raghunat...@tcs.com
 Website: http://www.tcs.com
 
 Experience certainty.  IT Services
Business Solutions
Consulting
 
 

-gordon chung  wrote: -
To: "openstack-dev@lists.openstack.org" 
From: gordon chung 
Date: 10/31/2016 09:54PM
Subject: Re: [openstack-dev] [Ceilometer]: Instance creation and deletion 
metrics in ceilometer !

what meters are you looking for specifically? as Ganpat mentioned, we 
only derive a few meters from Nova notifications[1]. i don't understand 
your comment about being able to see events on kafka. by 'events' do you 
mean Ceilometer Events[2]?

[1] 
https://github.com/openstack/ceilometer/blob/master/ceilometer/meter/data/meters.yaml#L83-L127
[2] http://docs.openstack.org/developer/ceilometer/events.html



On 31/10/16 04:27 AM, Raghunath D wrote:
> Hi Ganpat,
>
> I want the samples related with these events.
>
> With Best Regards
> Raghunath Dudyala
> Tata Consultancy Services Limited
> Mailto: raghunat...@tcs.com
> Website: http://www.tcs.com
> 
> Experience certainty. IT Services
> Business Sol

Re: [openstack-dev] [Ceilometer]: Instance creation and deletion metrics in ceilometer !

[gordon chung]

what meters are you looking for specifically? as Ganpat mentioned, we 
only derive a few meters from Nova notifications[1]. i don't understand 
your comment about being able to see events on kafka. by 'events' do you 
mean Ceilometer Events[2]?

[1] 
https://github.com/openstack/ceilometer/blob/master/ceilometer/meter/data/meters.yaml#L83-L127
[2] http://docs.openstack.org/developer/ceilometer/events.html



On 31/10/16 04:27 AM, Raghunath D wrote:
> Hi Ganpat,
>
> I want the samples related with these events.
>
> With Best Regards
> Raghunath Dudyala
> Tata Consultancy Services Limited
> Mailto: raghunat...@tcs.com
> Website: http://www.tcs.com
> 
> Experience certainty. IT Services
> Business Solutions
> Consulting
> 
>
>
> -Ganpat Agarwal  wrote: -
> To: "OpenStack Development Mailing List (not for usage questions)"
> 
> From: Ganpat Agarwal 
> Date: 10/27/2016 12:02PM
> Subject: Re: [openstack-dev] [Ceilometer]: Instance creation and
> deletion metrics in ceilometer !
>
> Hi Raghunath,
>
> I am not able to understand your use case for compute.instance.* events.
>
> You are trying to catch the instance start and end events OR you want
> the samples related with these events?
>
> Regards,
> Ganpat
>
> On Wed, Oct 26, 2016 at 6:00 PM, Raghunath D  <mailto:raghunat...@tcs.com>> wrote:
>
> Hi Ganpat/Gord,
>
> Callback for compute.instance.create.end events under
> ceilometer.compute.notifications should be invoked for those
> notification events on the nova exchange using the
> notifications.info <http://notifications.info> topic.
> But this is not happening,we can see events related to them and can
> receive events over kafka.
>
> I can see from logs which print my debug print during the loading of
> notification plugin.
> "2016-10-26 03:46:32.010 34977 INFO
> ceilometer.compute.notifications.instance
> [req-1ad3d5c9-5eab-404d-9fbe-f1605e93691f - - - - -] Check
> ComputeInstanceNotificationBase notification:"
>
> Do we need to change any thing in the configuration file of
> ceilometer or nova to achive this.
> It would be great help for me if this is fixed.
>
> With Best Regards
> Raghunath Dudyala
> Tata Consultancy Services Limited
> Mailto: raghunat...@tcs.com <mailto:raghunat...@tcs.com>
> Website: http://www.tcs.com
> 
> Experience certainty. IT Services
> Business Solutions
> Consulting
> 
>
>
> -Ganpat Agarwal  <mailto:gans.develo...@gmail.com>> wrote: -
> To: "OpenStack Development Mailing List (not for usage questions)"
>  <mailto:openstack-dev@lists.openstack.org>>
> From: Ganpat Agarwal  <mailto:gans.develo...@gmail.com>>
> Date: 10/25/2016 09:32PM
>
> Subject: Re: [openstack-dev] [Ceilometer]: Instance creation and
> deletion metrics in ceilometer !
>
> Hi Raghunath,
>
> You can look at this file for details of meters related with
> compute.instance.*
>
> ceilometer/meter/data/meters.yaml
>
> Additionally, you can look at this link for compute meters documentation
>
> http://docs.openstack.org/admin-guide/telemetry-measurements.html
> <http://docs.openstack.org/admin-guide/telemetry-measurements.html>
>
>
> Also, have a look at "Meters definitions" section on this link
>
> 
> http://docs.openstack.org/admin-guide/telemetry-data-collection.html#meter-definitions
> 
> <http://docs.openstack.org/admin-guide/telemetry-data-collection.html#meter-definitions>
>
> Regards,
> Ganpat
>
>
> On Tue, Oct 25, 2016 at 5:45 PM, Raghunath D  <mailto:raghunat...@tcs.com>> wrote:
>
> Hi Ganpat,
>
>  Are you able to see merers/samples related to
> compute.instance.* in ceilometer meter-list or ceilometer
> sample-list.
> My application which will read info from ceilometer publisher
> (pipeline.yaml) and I am looking for meters realted to
> ceilometer.instance.*
>
> With Best Regards
> Raghunath Dudyala
> Tata Consultancy Services Limited
> Mailto: raghunat...@tcs.com <mailto:raghunat...@tcs.com>
> Website: http://www.tcs.com
> 
> Experience certainty. IT Services
>     Business Solutions
&

Re: [openstack-dev] [Ceilometer]: Instance creation and deletion metrics in ceilometer !

[Raghunath D]

 Hi Ganpat,

I want the samples related with these events.

With Best Regards
 Raghunath Dudyala
 Tata Consultancy Services Limited
 Mailto: raghunat...@tcs.com
 Website: http://www.tcs.com
 
 Experience certainty.  IT Services
Business Solutions
Consulting
 
 

-Ganpat Agarwal  wrote: -
To: "OpenStack Development Mailing List (not for usage questions)" 

From: Ganpat Agarwal 
Date: 10/27/2016 12:02PM
Subject: Re: [openstack-dev] [Ceilometer]: Instance creation and deletion 
metrics in ceilometer !

Hi Raghunath,

I am not able to understand your use case for compute.instance.* events.

You are trying to catch the instance start and end events OR you want the 
samples related with these events?

Regards,
Ganpat

On Wed, Oct 26, 2016 at 6:00 PM, Raghunath D  wrote:
 Hi Ganpat/Gord,

Callback for compute.instance.create.end events under 
ceilometer.compute.notifications should be invoked for those notification 
events on the nova exchange using the notifications.info topic. 
But this is not happening,we can see events related to them and can receive 
events over kafka.

I can see from logs which print my debug print during the loading of 
notification plugin.
"2016-10-26 03:46:32.010 34977 INFO ceilometer.compute.notifications.instance 
[req-1ad3d5c9-5eab-404d-9fbe-f1605e93691f - - - - -] Check 
ComputeInstanceNotificationBase notification:"

Do we need to change any thing in the configuration file of ceilometer or nova 
to achive this.
It would be great help for me if this is fixed.

With Best Regards
 Raghunath Dudyala
 Tata Consultancy Services Limited
 Mailto: raghunat...@tcs.com
 Website: http://www.tcs.com
 
 Experience certainty.IT Services
 Business Solutions
 Consulting
 
 

-Ganpat Agarwal  wrote: -
To: "OpenStack Development Mailing List (not for usage questions)" 

From: Ganpat Agarwal 
Date: 10/25/2016 09:32PM

Subject: Re: [openstack-dev] [Ceilometer]: Instance creation and deletion 
metrics in ceilometer !

Hi Raghunath,

You can look at this file for details of meters related with compute.instance.*

ceilometer/meter/data/meters.yaml

Additionally, you can look at this link for compute meters documentation

http://docs.openstack.org/admin-guide/telemetry-measurements.html


Also, have a look at "Meters definitions" section on this link

http://docs.openstack.org/admin-guide/telemetry-data-collection.html#meter-definitions

Regards,
Ganpat


On Tue, Oct 25, 2016 at 5:45 PM, Raghunath D  wrote:
 Hi Ganpat,

 Are you able to see merers/samples related to compute.instance.* in ceilometer 
meter-list or ceilometer sample-list.
My application which will read info from ceilometer publisher (pipeline.yaml) 
and I am looking for meters realted to ceilometer.instance.*

With Best Regards
 Raghunath Dudyala
 Tata Consultancy Services Limited
 Mailto: raghunat...@tcs.com
 Website: http://www.tcs.com
 
 Experience certainty.IT Services
 Business Solutions
 Consulting
 
 

-Ganpat Agarwal  wrote: -
To: "OpenStack Development Mailing List (not for usage questions)" 

From: Ganpat Agarwal 
Date: 10/25/2016 05:05PM
Subject: Re: [openstack-dev] [Ceilometer]: Instance creation and deletion 
metrics in ceilometer !


Hi,

I am able to get event notifications on kafka by applying these configurations:

nova.conf
instance_usage_audit = True
instance_usage_audit_period = hour
notify_on_state_change = vm_and_task_state

notification_driver = messagingv2

Restart nova compute service

ceilometer.conf
 [event]
 drop_unmatched_notifications = False
 definitions_cfg_file = /etc/ceilometer/event_definitions.yaml


event_pipeline.yaml
---
sources:
    - name: event_source
      events:
         - compute.instance.*
      sinks:
          - event_sink
sinks:
    - name: event_sink
      transformers:
      triggers:
      publishers:
          #- notifier://
          #- file:///home/stack/test?max_bytes=1000&backup_count=5
  
          - kafka://kafka-broker:9092?topic=ceilometer


service ceilometer-api restart
 
service ceilometer-agent-notification restart


Wait for couple of minutes and you should be getting the events on your kafka 
consumer and in ceilometer notifications logs as well



tail -f /var/log/ceilometer/ceilometer-agent-notification.log


Let me know if it helps.


Regards,
Ganpat


On Tue, Oct 25, 2016 at 3:02 PM, Raghunath D  wrote:
Hi ,
 
Can some one please suggest how to instance notifications in ceilometer.

With Best Regards
 Raghun

Re: [openstack-dev] [Ceilometer]: Instance creation and deletion metrics in ceilometer !

[Ganpat Agarwal]

Hi Raghunath,

I am not able to understand your use case for compute.instance.* events.

You are trying to catch the instance start and end events OR you want the
samples related with these events?

Regards,
Ganpat

On Wed, Oct 26, 2016 at 6:00 PM, Raghunath D  wrote:

> Hi Ganpat/Gord,
>
> Callback for compute.instance.create.end events under 
> ceilometer.compute.notifications
> should be invoked for those notification events on the nova exchange using
> the notifications.info topic.
> But this is not happening,we can see events related to them and can
> receive events over kafka.
>
> I can see from logs which print my debug print during the loading of
> notification plugin.
> "2016-10-26 03:46:32.010 34977 INFO ceilometer.compute.notifications.instance
> [req-1ad3d5c9-5eab-404d-9fbe-f1605e93691f - - - - -] Check
> ComputeInstanceNotificationBase notification:"
>
> Do we need to change any thing in the configuration file of ceilometer or
> nova to achive this.
> It would be great help for me if this is fixed.
>
> With Best Regards
> Raghunath Dudyala
> Tata Consultancy Services Limited
> Mailto: raghunat...@tcs.com
> Website: http://www.tcs.com
> 
> Experience certainty. IT Services
> Business Solutions
> Consulting
> 
>
>
> -Ganpat Agarwal  wrote: -
> To: "OpenStack Development Mailing List (not for usage questions)" <
> openstack-dev@lists.openstack.org>
> From: Ganpat Agarwal 
> Date: 10/25/2016 09:32PM
>
> Subject: Re: [openstack-dev] [Ceilometer]: Instance creation and deletion
> metrics in ceilometer !
>
> Hi Raghunath,
>
> You can look at this file for details of meters related with
> compute.instance.*
>
> ceilometer/meter/data/meters.yaml
>
> Additionally, you can look at this link for compute meters documentation
>
> http://docs.openstack.org/admin-guide/telemetry-measurements.html
>
>
> Also, have a look at "Meters definitions" section on this link
>
> http://docs.openstack.org/admin-guide/telemetry-data-
> collection.html#meter-definitions
>
> Regards,
> Ganpat
>
>
> On Tue, Oct 25, 2016 at 5:45 PM, Raghunath D  wrote:
>
>> Hi Ganpat,
>>
>>  Are you able to see merers/samples related to compute.instance.* in
>> ceilometer meter-list or ceilometer sample-list.
>> My application which will read info from ceilometer publisher
>> (pipeline.yaml) and I am looking for meters realted to ceilometer.instance.*
>>
>> With Best Regards
>> Raghunath Dudyala
>> Tata Consultancy Services Limited
>> Mailto: raghunat...@tcs.com
>> Website: http://www.tcs.com
>> 
>> Experience certainty. IT Services
>> Business Solutions
>> Consulting
>> ____________
>>
>>
>> -Ganpat Agarwal  wrote: -
>> To: "OpenStack Development Mailing List (not for usage questions)" <
>> openstack-dev@lists.openstack.org>
>> From: Ganpat Agarwal 
>> Date: 10/25/2016 05:05PM
>> Subject: Re: [openstack-dev] [Ceilometer]: Instance creation and deletion
>> metrics in ceilometer !
>>
>>
>> Hi,
>>
>> I am able to get event notifications on kafka by applying these
>> configurations:
>>
>> nova.conf
>>
>> instance_usage_audit = True
>>
>> instance_usage_audit_period = hour
>>
>> notify_on_state_change = vm_and_task_state
>>
>> notification_driver = messagingv2
>>
>> Restart nova compute service
>>
>> ceilometer.conf
>>
>> [event]
>>
>> drop_unmatched_notifications = False
>>
>> definitions_cfg_file = /etc/ceilometer/event_definitions.yaml
>>
>>
>> event_pipeline.yaml
>>
>> ---
>>
>> sources:
>>
>> - name: event_source
>>
>>   events:
>>
>>  - compute.instance.*
>>
>>   sinks:
>>
>>   - event_sink
>>
>> sinks:
>>
>> - name: event_sink
>>
>>   transformers:
>>
>>   triggers:
>>
>>   publishers:
>>
>>   #- notifier://
>>
>>   #- file:///home/stack/test?max_bytes=1000&backup_count=5
>>
>>   - kafka://kafka-broker:9092?topic=ceilometer
>>
>>
>> service ceilometer-api restart
>>
>> service ceilometer-agent-notification restart
>>
>>
>> Wait for couple of minutes and you should be getting the events on your
>> 

Re: [openstack-dev] [Ceilometer]: Instance creation and deletion metrics in ceilometer !

[Raghunath D]

 Hi Ganpat/Gord,

Callback for compute.instance.create.end events under 
ceilometer.compute.notifications should be invoked for those notification 
events on the nova exchange using the notifications.info topic. 
But this is not happening,we can see events related to them and can receive 
events over kafka.

I can see from logs which print my debug print during the loading of 
notification plugin.
"2016-10-26 03:46:32.010 34977 INFO ceilometer.compute.notifications.instance 
[req-1ad3d5c9-5eab-404d-9fbe-f1605e93691f - - - - -] Check 
ComputeInstanceNotificationBase notification:"

Do we need to change any thing in the configuration file of ceilometer or nova 
to achive this.
It would be great help for me if this is fixed.

With Best Regards
 Raghunath Dudyala
 Tata Consultancy Services Limited
 Mailto: raghunat...@tcs.com
 Website: http://www.tcs.com
 
 Experience certainty.  IT Services
Business Solutions
Consulting
 
 

-Ganpat Agarwal  wrote: -
To: "OpenStack Development Mailing List (not for usage questions)" 

From: Ganpat Agarwal 
Date: 10/25/2016 09:32PM
Subject: Re: [openstack-dev] [Ceilometer]: Instance creation and deletion 
metrics in ceilometer !

Hi Raghunath,

You can look at this file for details of meters related with compute.instance.*

ceilometer/meter/data/meters.yaml

Additionally, you can look at this link for compute meters documentation

http://docs.openstack.org/admin-guide/telemetry-measurements.html


Also, have a look at "Meters definitions" section on this link

http://docs.openstack.org/admin-guide/telemetry-data-collection.html#meter-definitions

Regards,
Ganpat


On Tue, Oct 25, 2016 at 5:45 PM, Raghunath D  wrote:
 Hi Ganpat,

 Are you able to see merers/samples related to compute.instance.* in ceilometer 
meter-list or ceilometer sample-list.
My application which will read info from ceilometer publisher (pipeline.yaml) 
and I am looking for meters realted to ceilometer.instance.*

With Best Regards
 Raghunath Dudyala
 Tata Consultancy Services Limited
 Mailto: raghunat...@tcs.com
 Website: http://www.tcs.com
 
 Experience certainty.IT Services
 Business Solutions
 Consulting
 
 

-Ganpat Agarwal  wrote: -
To: "OpenStack Development Mailing List (not for usage questions)" 

From: Ganpat Agarwal 
Date: 10/25/2016 05:05PM
Subject: Re: [openstack-dev] [Ceilometer]: Instance creation and deletion 
metrics in ceilometer !


Hi,

I am able to get event notifications on kafka by applying these configurations:

nova.conf
instance_usage_audit = True
instance_usage_audit_period = hour
notify_on_state_change = vm_and_task_state

notification_driver = messagingv2

Restart nova compute service

ceilometer.conf
 [event]
 drop_unmatched_notifications = False
 definitions_cfg_file = /etc/ceilometer/event_definitions.yaml


event_pipeline.yaml
---
sources:
    - name: event_source
      events:
         - compute.instance.*
      sinks:
          - event_sink
sinks:
    - name: event_sink
      transformers:
      triggers:
      publishers:
          #- notifier://
          #- file:///home/stack/test?max_bytes=1000&backup_count=5
  
          - kafka://kafka-broker:9092?topic=ceilometer


service ceilometer-api restart
 
service ceilometer-agent-notification restart


Wait for couple of minutes and you should be getting the events on your kafka 
consumer and in ceilometer notifications logs as well



tail -f /var/log/ceilometer/ceilometer-agent-notification.log


Let me know if it helps.


Regards,
Ganpat


On Tue, Oct 25, 2016 at 3:02 PM, Raghunath D  wrote:
Hi ,
 
Can some one please suggest how to instance notifications in ceilometer.

With Best Regards
 Raghunath Dudyala
 Tata Consultancy Services Limited
 Mailto: raghunat...@tcs.com
 Website: http://www.tcs.com
 
 Experience certainty.IT Services
 Business Solutions
 Consulting
 
 

-Raghunath D/HYD/TCS wrote: -
To: openstack-dev@lists.openstack.org
From: Raghunath D/HYD/TCS
Date: 10/18/2016 08:01PM
Subject: [openstack-dev] [Ceilometer]: Instance creation and deletion metrics 
in ceilometer !


 Hi ,

How can instance created and deleted information/sample can be retrieved from 
ceilometer.
What entries should be there in pipeline.yaml  to get instance deleted 
information.

I tried to have meters- "instance" in pipeline.yam but it always gives active 
instance details,
and no details of deleted instances.

With Best Regards
 Raghunath Dudyala
 Tata Consultancy Servic

Re: [openstack-dev] [Ceilometer]: Instance creation and deletion metrics in ceilometer !

[Ganpat Agarwal]

Hi Raghunath,

You can look at this file for details of meters related with
compute.instance.*

ceilometer/meter/data/meters.yaml

Additionally, you can look at this link for compute meters documentation

http://docs.openstack.org/admin-guide/telemetry-measurements.html


Also, have a look at "Meters definitions" section on this link

http://docs.openstack.org/admin-guide/telemetry-data-collection.html#meter-definitions

Regards,
Ganpat


On Tue, Oct 25, 2016 at 5:45 PM, Raghunath D  wrote:

> Hi Ganpat,
>
>  Are you able to see merers/samples related to compute.instance.* in
> ceilometer meter-list or ceilometer sample-list.
> My application which will read info from ceilometer publisher
> (pipeline.yaml) and I am looking for meters realted to ceilometer.instance.*
>
> With Best Regards
> Raghunath Dudyala
> Tata Consultancy Services Limited
> Mailto: raghunat...@tcs.com
> Website: http://www.tcs.com
> 
> Experience certainty. IT Services
> Business Solutions
> Consulting
> 
>
>
> -Ganpat Agarwal  wrote: -
> To: "OpenStack Development Mailing List (not for usage questions)" <
> openstack-dev@lists.openstack.org>
> From: Ganpat Agarwal 
> Date: 10/25/2016 05:05PM
> Subject: Re: [openstack-dev] [Ceilometer]: Instance creation and deletion
> metrics in ceilometer !
>
>
> Hi,
>
> I am able to get event notifications on kafka by applying these
> configurations:
>
> nova.conf
>
> instance_usage_audit = True
>
> instance_usage_audit_period = hour
>
> notify_on_state_change = vm_and_task_state
>
> notification_driver = messagingv2
>
> Restart nova compute service
>
> ceilometer.conf
>
> [event]
>
> drop_unmatched_notifications = False
>
> definitions_cfg_file = /etc/ceilometer/event_definitions.yaml
>
>
> event_pipeline.yaml
>
> ---
>
> sources:
>
> - name: event_source
>
>   events:
>
>  - compute.instance.*
>
>   sinks:
>
>   - event_sink
>
> sinks:
>
> - name: event_sink
>
>   transformers:
>
>   triggers:
>
>   publishers:
>
>   #- notifier://
>
>   #- file:///home/stack/test?max_bytes=1000&backup_count=5
>
>   - kafka://kafka-broker:9092?topic=ceilometer
>
>
> service ceilometer-api restart
>
> service ceilometer-agent-notification restart
>
>
> Wait for couple of minutes and you should be getting the events on your
> kafka consumer and in ceilometer notifications logs as well
>
> tail -f /var/log/ceilometer/ceilometer-agent-notification.log
>
>
> Let me know if it helps.
>
>
> Regards,
>
> Ganpat
>
>
>
> On Tue, Oct 25, 2016 at 3:02 PM, Raghunath D  wrote:
>
>> Hi ,
>>
>> Can some one please suggest how to instance notifications in ceilometer.
>>
>> With Best Regards
>> Raghunath Dudyala
>> Tata Consultancy Services Limited
>> Mailto: raghunat...@tcs.com
>> Website: http://www.tcs.com
>> 
>> Experience certainty. IT Services
>> Business Solutions
>> Consulting
>> 
>>
>>
>> -Raghunath D/HYD/TCS wrote: -
>> To: openstack-dev@lists.openstack.org
>> From: Raghunath D/HYD/TCS
>> Date: 10/18/2016 08:01PM
>> Subject: [openstack-dev] [Ceilometer]: Instance creation and deletion
>> metrics in ceilometer !
>>
>>
>> Hi ,
>>
>> How can instance created and deleted information/sample can be retrieved
>> from ceilometer.
>> What entries should be there in pipeline.yaml  to get instance deleted
>> information.
>>
>> I tried to have meters- "instance" in pipeline.yam but it always gives
>> active instance details,
>> and no details of deleted instances.
>>
>> With Best Regards
>> Raghunath Dudyala
>> Tata Consultancy Services Limited
>> Mailto: raghunat...@tcs.com
>> Website: http://www.tcs.com
>> 
>> Experience certainty. IT Services
>> Business Solutions
>> Consulting
>> 
>>
>> =-=-=
>> Notice: The information contained in this e-mail
>> message and/or attachments to it may contain
>> confidential or privileged information. If you are
>> not the intended recipient, any dissemination, use,
>> review, distribution, printing or copying of the
>> information contained in this e-mail mes

Re: [openstack-dev] [Ceilometer]: Instance creation and deletion metrics in ceilometer !

[Raghunath D]

 Hi Ganpat,

 Are you able to see merers/samples related to compute.instance.* in ceilometer 
meter-list or ceilometer sample-list.
My application which will read info from ceilometer publisher (pipeline.yaml) 
and I am looking for meters realted to ceilometer.instance.*

With Best Regards
 Raghunath Dudyala
 Tata Consultancy Services Limited
 Mailto: raghunat...@tcs.com
 Website: http://www.tcs.com
 
 Experience certainty.  IT Services
Business Solutions
Consulting
 
 

-Ganpat Agarwal  wrote: -
To: "OpenStack Development Mailing List (not for usage questions)" 

From: Ganpat Agarwal 
Date: 10/25/2016 05:05PM
Subject: Re: [openstack-dev] [Ceilometer]: Instance creation and deletion 
metrics in ceilometer !

Hi,

I am able to get event notifications on kafka by applying these configurations:

nova.conf
instance_usage_audit = True
instance_usage_audit_period = hour
notify_on_state_change = vm_and_task_state

notification_driver = messagingv2

Restart nova compute service

ceilometer.conf
 [event]
 drop_unmatched_notifications = False
 definitions_cfg_file = /etc/ceilometer/event_definitions.yaml


event_pipeline.yaml
---
sources:
    - name: event_source
      events:
         - compute.instance.*
      sinks:
          - event_sink
sinks:
    - name: event_sink
      transformers:
      triggers:
      publishers:
          #- notifier://
          #- file:///home/stack/test?max_bytes=1000&backup_count=5
  
          - kafka://kafka-broker:9092?topic=ceilometer


service ceilometer-api restart
 
service ceilometer-agent-notification restart


Wait for couple of minutes and you should be getting the events on your kafka 
consumer and in ceilometer notifications logs as well



tail -f /var/log/ceilometer/ceilometer-agent-notification.log


Let me know if it helps.


Regards,
Ganpat


On Tue, Oct 25, 2016 at 3:02 PM, Raghunath D  wrote:
Hi ,
 
Can some one please suggest how to instance notifications in ceilometer.

With Best Regards
 Raghunath Dudyala
 Tata Consultancy Services Limited
 Mailto: raghunat...@tcs.com
 Website: http://www.tcs.com
 
 Experience certainty.IT Services
 Business Solutions
 Consulting
 
 

-Raghunath D/HYD/TCS wrote: -
To: openstack-dev@lists.openstack.org
From: Raghunath D/HYD/TCS
Date: 10/18/2016 08:01PM
Subject: [openstack-dev] [Ceilometer]: Instance creation and deletion metrics 
in ceilometer !


 Hi ,

How can instance created and deleted information/sample can be retrieved from 
ceilometer.
What entries should be there in pipeline.yaml  to get instance deleted 
information.

I tried to have meters- "instance" in pipeline.yam but it always gives active 
instance details,
and no details of deleted instances.

With Best Regards
 Raghunath Dudyala
 Tata Consultancy Services Limited
 Mailto: raghunat...@tcs.com
 Website: http://www.tcs.com
 
 Experience certainty.IT Services
 Business Solutions
 Consulting
 
  
=-=-=
 Notice: The information contained in this e-mail
 message and/or attachments to it may contain 
 confidential or privileged information. If you are 
 not the intended recipient, any dissemination, use, 
 review, distribution, printing or copying of the 
 information contained in this e-mail message 
 and/or attachments to it are strictly prohibited. If 
 you have received this communication in error, 
 please notify us by reply e-mail or telephone and 
 immediately and permanently delete the message 
 and any attachments. Thank you
  
__
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
 

 
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

Re: [openstack-dev] [Ceilometer]: Instance creation and deletion metrics in ceilometer !

[Ganpat Agarwal]

Hi,

I am able to get event notifications on kafka by applying these
configurations:

nova.conf

instance_usage_audit = True

instance_usage_audit_period = hour

notify_on_state_change = vm_and_task_state

notification_driver = messagingv2

Restart nova compute service

ceilometer.conf

[event]

drop_unmatched_notifications = False

definitions_cfg_file = /etc/ceilometer/event_definitions.yaml


event_pipeline.yaml

---

sources:

- name: event_source

  events:

 - compute.instance.*

  sinks:

  - event_sink

sinks:

- name: event_sink

  transformers:

  triggers:

  publishers:

  #- notifier://

  #- file:///home/stack/test?max_bytes=1000&backup_count=5

  - kafka://kafka-broker:9092?topic=ceilometer


service ceilometer-api restart

service ceilometer-agent-notification restart


Wait for couple of minutes and you should be getting the events on your
kafka consumer and in ceilometer notifications logs as well

tail -f /var/log/ceilometer/ceilometer-agent-notification.log


Let me know if it helps.


Regards,

Ganpat



On Tue, Oct 25, 2016 at 3:02 PM, Raghunath D  wrote:

> Hi ,
>
> Can some one please suggest how to instance notifications in ceilometer.
>
> With Best Regards
> Raghunath Dudyala
> Tata Consultancy Services Limited
> Mailto: raghunat...@tcs.com
> Website: http://www.tcs.com
> 
> Experience certainty. IT Services
> Business Solutions
> Consulting
> 
>
>
> -Raghunath D/HYD/TCS wrote: -
> To: openstack-dev@lists.openstack.org
> From: Raghunath D/HYD/TCS
> Date: 10/18/2016 08:01PM
> Subject: [openstack-dev] [Ceilometer]: Instance creation and deletion
> metrics in ceilometer !
>
>
> Hi ,
>
> How can instance created and deleted information/sample can be retrieved
> from ceilometer.
> What entries should be there in pipeline.yaml  to get instance deleted
> information.
>
> I tried to have meters- "instance" in pipeline.yam but it always gives
> active instance details,
> and no details of deleted instances.
>
> With Best Regards
> Raghunath Dudyala
> Tata Consultancy Services Limited
> Mailto: raghunat...@tcs.com
> Website: http://www.tcs.com
> 
> Experience certainty. IT Services
> Business Solutions
> Consulting
> 
>
> =-=-=
> Notice: The information contained in this e-mail
> message and/or attachments to it may contain
> confidential or privileged information. If you are
> not the intended recipient, any dissemination, use,
> review, distribution, printing or copying of the
> information contained in this e-mail message
> and/or attachments to it are strictly prohibited. If
> you have received this communication in error,
> please notify us by reply e-mail or telephone and
> immediately and permanently delete the message
> and any attachments. Thank you
>
>
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
>
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

Re: [openstack-dev] [Ceilometer]: Instance creation and deletion metrics in ceilometer !

[Raghunath D]

Hi ,
 
Can some one please suggest how to instance notifications in ceilometer.

With Best Regards
 Raghunath Dudyala
 Tata Consultancy Services Limited
 Mailto: raghunat...@tcs.com
 Website: http://www.tcs.com
 
 Experience certainty.  IT Services
Business Solutions
Consulting
 
 

-Raghunath D/HYD/TCS wrote: -
To: openstack-dev@lists.openstack.org
From: Raghunath D/HYD/TCS
Date: 10/18/2016 08:01PM
Subject: [openstack-dev] [Ceilometer]: Instance creation and deletion metrics 
in ceilometer !

 Hi ,

How can instance created and deleted information/sample can be retrieved from 
ceilometer.
What entries should be there in pipeline.yaml  to get instance deleted 
information.

I tried to have meters- "instance" in pipeline.yam but it always gives active 
instance details,
and no details of deleted instances.

With Best Regards
 Raghunath Dudyala
 Tata Consultancy Services Limited
 Mailto: raghunat...@tcs.com
 Website: http://www.tcs.com
 
 Experience certainty.  IT Services
Business Solutions
Consulting
 
  
=-=-=
Notice: The information contained in this e-mail
message and/or attachments to it may contain 
confidential or privileged information. If you are 
not the intended recipient, any dissemination, use, 
review, distribution, printing or copying of the 
information contained in this e-mail message 
and/or attachments to it are strictly prohibited. If 
you have received this communication in error, 
please notify us by reply e-mail or telephone and 
immediately and permanently delete the message 
and any attachments. Thank you


__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

[openstack-dev] [Ceilometer]: Instance creation and deletion metrics in ceilometer !

[Raghunath D]

 Hi ,

How can instance created and deleted information/sample can be retrieved from 
ceilometer.
What entries should be there in pipeline.yaml  to get instance deleted 
information.

I tried to have meters- "instance" in pipeline.yam but it always gives active 
instance details,
and no details of deleted instances.

With Best Regards
 Raghunath Dudyala
 Tata Consultancy Services Limited
 Mailto: raghunat...@tcs.com
 Website: http://www.tcs.com
 
 Experience certainty.  IT Services
Business Solutions
Consulting
 
 
=-=-=
Notice: The information contained in this e-mail
message and/or attachments to it may contain 
confidential or privileged information. If you are 
not the intended recipient, any dissemination, use, 
review, distribution, printing or copying of the 
information contained in this e-mail message 
and/or attachments to it are strictly prohibited. If 
you have received this communication in error, 
please notify us by reply e-mail or telephone and 
immediately and permanently delete the message 
and any attachments. Thank you


__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev