Re: [openstack-dev] [ceilometer] about add transformer into libvirt

2017-12-18 Thread gordon chung


On 2017-12-18 10:28 AM, Jaze Lee wrote:
> Is there some document about how to use rate? I do not find any about it
> Thanks.
> 

https://gnocchi.xyz/rest.html#archive-policy

its' similar to how other aggregates are defined. it's just not part of 
default aggregation methods.

-- 
gord
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [ceilometer] about add transformer into libvirt

2017-12-18 Thread Jaze Lee
2017-12-18 21:17 GMT+08:00 gordon chung :
>
>
> On 2017-12-17 11:08 PM, Jaze Lee wrote:
>> Hello.
>>
>> 2017-12-16 9:30 GMT+08:00 Jaze Lee :
>>> 2017-12-15 23:17 GMT+08:00 gordon chung :


 On 2017-12-14 10:38 PM, Jaze Lee wrote:
> It sounds like great. When the gnocchi can be ready to do transformer's 
> work?
> If it takes long time, we have to move to compute temporarily.

 it already exists in gnocchi 4.1+. we just need to change the workflow
 in ceilometer so it integrates with gnocchi.
>>> Oh, I do not quite understand, can you give more details?
>>> I do not know change which part of workflow in ceilometer.
>>>
>
> i don't openstack on weekends.
Sorry...

>
> what needs to change is that rate aggregate needs to be enabled for
> specific meters such as cpu. this will effectively calculate the cputime
> per second. then you apply the same maths on timeseries that transformer
> does when you query gnocchi.

Is there some document about how to use rate? I do not find any about it
Thanks.

>
> --
> gord
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev



-- 
谦谦君子

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [ceilometer] about add transformer into libvirt

2017-12-18 Thread gordon chung


On 2017-12-17 11:08 PM, Jaze Lee wrote:
> Hello.
> 
> 2017-12-16 9:30 GMT+08:00 Jaze Lee :
>> 2017-12-15 23:17 GMT+08:00 gordon chung :
>>>
>>>
>>> On 2017-12-14 10:38 PM, Jaze Lee wrote:
 It sounds like great. When the gnocchi can be ready to do transformer's 
 work?
 If it takes long time, we have to move to compute temporarily.
>>>
>>> it already exists in gnocchi 4.1+. we just need to change the workflow
>>> in ceilometer so it integrates with gnocchi.
>> Oh, I do not quite understand, can you give more details?
>> I do not know change which part of workflow in ceilometer.
>>

i don't openstack on weekends.

what needs to change is that rate aggregate needs to be enabled for 
specific meters such as cpu. this will effectively calculate the cputime 
per second. then you apply the same maths on timeseries that transformer 
does when you query gnocchi.

-- 
gord
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [ceilometer] about add transformer into libvirt

2017-12-17 Thread Jaze Lee
Hello.

2017-12-16 9:30 GMT+08:00 Jaze Lee :
> 2017-12-15 23:17 GMT+08:00 gordon chung :
>>
>>
>> On 2017-12-14 10:38 PM, Jaze Lee wrote:
>>> It sounds like great. When the gnocchi can be ready to do transformer's 
>>> work?
>>> If it takes long time, we have to move to compute temporarily.
>>
>> it already exists in gnocchi 4.1+. we just need to change the workflow
>> in ceilometer so it integrates with gnocchi.
> Oh, I do not quite understand, can you give more details?
> I do not know change which part of workflow in ceilometer.
>
>
>>
>>
>> --
>> gord
>> __
>> OpenStack Development Mailing List (not for usage questions)
>> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
>
>
> --
> 谦谦君子



-- 
谦谦君子

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [ceilometer] about add transformer into libvirt

2017-12-15 Thread Jaze Lee
2017-12-15 23:17 GMT+08:00 gordon chung :
>
>
> On 2017-12-14 10:38 PM, Jaze Lee wrote:
>> It sounds like great. When the gnocchi can be ready to do transformer's work?
>> If it takes long time, we have to move to compute temporarily.
>
> it already exists in gnocchi 4.1+. we just need to change the workflow
> in ceilometer so it integrates with gnocchi.
Oh, I do not quite understand, can you give more details?
I do not know change which part of workflow in ceilometer.


>
>
> --
> gord
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev



-- 
谦谦君子

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [ceilometer] about add transformer into libvirt

2017-12-15 Thread gordon chung


On 2017-12-14 10:38 PM, Jaze Lee wrote:
> It sounds like great. When the gnocchi can be ready to do transformer's work?
> If it takes long time, we have to move to compute temporarily.

it already exists in gnocchi 4.1+. we just need to change the workflow 
in ceilometer so it integrates with gnocchi.


-- 
gord
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [ceilometer] about add transformer into libvirt

2017-12-14 Thread Jaze Lee
2017-12-14 22:34 GMT+08:00 gordon chung :
>
>
> On 2017-12-14 04:14 AM, Jaze Lee wrote:
>>> The plan is to actually make the TSDB (Gnocchi) do that job for us.
>> What ?
>> Is there some detail on this plan ?  If it did, then we do not need
>> workload partition, and scale with agent process happily
>>
>
> Gnocchi can capture rate information and can also have mathematical
> operations applied to it. there are some examples here:
> https://gnocchi.xyz/rest.html#examples. i imagine we'll change the gate
> workflow to that eventually.
It sounds like great. When the gnocchi can be ready to do transformer's work?
If it takes long time, we have to move to compute temporarily.

>
> you will still need partitioning for HA of central agents... and
> currently, the only way to get batch support is with workload_partitioning.
>
> but yes, moving the transformation to storage will provide the most
> durable solution for transformations.
>
> cheers,
>
> --
> gord
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev



-- 
谦谦君子

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [ceilometer] about add transformer into libvirt

2017-12-14 Thread gordon chung


On 2017-12-14 04:14 AM, Jaze Lee wrote:
>> The plan is to actually make the TSDB (Gnocchi) do that job for us.
> What ?
> Is there some detail on this plan ?  If it did, then we do not need
> workload partition, and scale with agent process happily
> 

Gnocchi can capture rate information and can also have mathematical 
operations applied to it. there are some examples here: 
https://gnocchi.xyz/rest.html#examples. i imagine we'll change the gate 
workflow to that eventually.

you will still need partitioning for HA of central agents... and 
currently, the only way to get batch support is with workload_partitioning.

but yes, moving the transformation to storage will provide the most 
durable solution for transformations.

cheers,

-- 
gord
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [ceilometer] about add transformer into libvirt

2017-12-14 Thread Jaze Lee
2017-12-14 16:58 GMT+08:00 Julien Danjou :
> On Thu, Dec 14 2017, Jaze Lee wrote:
>
>> Oh, sorry.  I found libvirt can not get cpu.util, cpu.delta, and
>> network/disk rate info directly
>> from inspector. So i mean, we can move this into compute pollster.
>> Before it sends to notifications.sample,
>> transform it. Then we can scale notification agent and do not have
>> flapping sample problems
>
> The plan is to actually make the TSDB (Gnocchi) do that job for us.
What ?
Is there some detail on this plan ?  If it did, then we do not need
workload partition, and scale with agent process happily


>
> --
> Julien Danjou
> /* Free Software hacker
>https://julien.danjou.info */



-- 
谦谦君子

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [ceilometer] about add transformer into libvirt

2017-12-14 Thread Julien Danjou
On Thu, Dec 14 2017, Jaze Lee wrote:

> Oh, sorry.  I found libvirt can not get cpu.util, cpu.delta, and
> network/disk rate info directly
> from inspector. So i mean, we can move this into compute pollster.
> Before it sends to notifications.sample,
> transform it. Then we can scale notification agent and do not have
> flapping sample problems

The plan is to actually make the TSDB (Gnocchi) do that job for us.

-- 
Julien Danjou
/* Free Software hacker
   https://julien.danjou.info */


signature.asc
Description: PGP signature
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [ceilometer] about add transformer into libvirt

2017-12-13 Thread Jaze Lee
2017-12-13 21:16 GMT+08:00 gordon chung :
>
>
> On 2017-12-13 01:52 AM, Jaze Lee wrote:
>> Hello,
>>
>>  What about move transformer to compute pollster? If we do this, we
>> do not need
>>  transformer any more
>
> sorry, i don't understand. if you move the transformer, you still have a
> transformer.

Oh, sorry.  I found libvirt can not get cpu.util, cpu.delta, and
network/disk rate info directly
from inspector. So i mean, we can move this into compute pollster.
Before it sends to notifications.sample,
transform it. Then we can scale notification agent and do not have
flapping sample problems


>
>
> --
> gord
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev



-- 
谦谦君子

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [ceilometer] about add transformer into libvirt

2017-12-13 Thread gordon chung


On 2017-12-13 01:52 AM, Jaze Lee wrote:
> Hello,
> 
>  What about move transformer to compute pollster? If we do this, we
> do not need
>  transformer any more

sorry, i don't understand. if you move the transformer, you still have a 
transformer.


-- 
gord
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [ceilometer] about add transformer into libvirt

2017-12-12 Thread Jaze Lee
Hello,

What about move transformer to compute pollster? If we do this, we
do not need
transformer any more



-- 
谦谦君子

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev