[openstack-dev] [Ceilometer][MongoDB] Using native time to live feature in MongoDB

2014-11-06 Thread Igor Degtiarov
Hi stackers,

I'm working on solving bug [1]. Time to live feature has native
implementation in MongoDB thru index.

Now we remove docs from resource table if they have no relations with
existing samples in meter table while samples are removed when time to
live is expired. So it seems that we can use ttl index also in
resource table and remove reduce operation from the code.

We update field last_sample_timestamp in resource table with every new
sample that is received from certain resource. So adding ttl index to
that field gives the same result as reduce operation in
clear_expired_metering_data, but it will work in background with low
priority and won't block database.

Change request with implementation of ttl index in resource table [2].

[1] https://bugs.launchpad.net/ceilometer/+bug/1270779
[2] https://review.openstack.org/#/c/132988/

Cheers, Igor.

___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Ceilometer][MongoDB] Using native time to live feature in MongoDB

2014-11-06 Thread ZhiQiang Fan
+1

On Thu, Nov 6, 2014 at 6:27 PM, Igor Degtiarov idegtia...@mirantis.com
wrote:

 Hi stackers,

 I'm working on solving bug [1]. Time to live feature has native
 implementation in MongoDB thru index.

 Now we remove docs from resource table if they have no relations with
 existing samples in meter table while samples are removed when time to
 live is expired. So it seems that we can use ttl index also in
 resource table and remove reduce operation from the code.

 We update field last_sample_timestamp in resource table with every new
 sample that is received from certain resource. So adding ttl index to
 that field gives the same result as reduce operation in
 clear_expired_metering_data, but it will work in background with low
 priority and won't block database.

 Change request with implementation of ttl index in resource table [2].

 [1] https://bugs.launchpad.net/ceilometer/+bug/1270779
 [2] https://review.openstack.org/#/c/132988/

 Cheers, Igor.

 ___
 OpenStack-dev mailing list
 OpenStack-dev@lists.openstack.org
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev




-- 
blog: zqfan.github.com
git: github.com/zqfan
___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev