Re: [openstack-dev] [gnocchi] host field information flapping for instance resource-type

2016-10-13 Thread gordon chung 
you might want to try editing 
https://github.com/openstack/ceilometer/blob/master/etc/ceilometer/gnocchi_resources.yaml#L62

-  host: resource_metadata.host
+  host: resource_metadata.(instance_host|host)

that might work? if it does, feel free to push it back to community.

On 13/10/16 04:53 PM, gordon chung wrote:
> it actually might be related to this previous fix:
> https://github.com/openstack/ceilometer/commit/de5ff7303d6f278ef37149297bbb7d2e77f45a0d

-- 
gord

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

Re: [openstack-dev] [gnocchi] host field information flapping for instance resource-type

2016-10-13 Thread gordon chung 
i won't lie, i don't remember opening that bug.lol

it actually might be related to this previous fix: 
https://github.com/openstack/ceilometer/commit/de5ff7303d6f278ef37149297bbb7d2e77f45a0d

On 12/10/16 08:49 PM, Jake Yip wrote:
> Hi all!
>
> We've been trying to get gnocchi working us, and have been hitting some
> performance bottlenecks. It seems that the 'host' field for the instance
> resource-type flaps between host id and host names. This makes the
> gnocchi dispatcher calls an update per resource which is a HTTP PATCH
> call. The large amount of HTTP calls causes gnocchi to be unable to keep
> up with ceilometer, essentially making it unworkable for us in production.
>
> I've tried removing this update code and can get ~5x the performance. So
> I guess the questions are,
>
> 1) why is the host information flapping? Are there difference services
> generating this data?
>
> 2) If gnocchi data can be viewable by the user, should we only have host
> id in the resource? (similar to what nova shows to user)
>
> 3) Anyone running gnocchi in prod, can you let us know how is it going?
>
> Any pointers to track down this issue will be appreciated! There is a
> bug[1] open for this issue but I hope this email can reach more people.
>
> FYI, we are running Mitaka ceilometer and gnocchi, but we have patched
> ceilometer to use the Newton gnocchi dispatcher to help with performance.
>
> [1] https://bugs.launchpad.net/ceilometer/+bug/1569037
>
> Jake Yip,
> DevOps Engineer,
> Core Services, NeCTAR Research Cloud,
> The University of Melbourne
>
>
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>

-- 
gord

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

Re: [openstack-dev] [gnocchi] host field information flapping for instance resource-type

2016-10-13 Thread Julien Danjou 
On Thu, Oct 13 2016, Jake Yip wrote:

Hi Jake,

It's probably better to keep updating the bug, so I've added my comments
there too. :)

> 1) why is the host information flapping? Are there difference services
> generating this data?

Likely divergence between Nova notifications and Ceilometer polling
through Nova API I'd say. But I didn't check.

> 2) If gnocchi data can be viewable by the user, should we only have host id
> in the resource? (similar to what nova shows to user)

I'm not that familiar with Nova, but if compute host have ids that are
also stored as resource_id in Gnocchi, it's likely better to use them.

-- 
Julien Danjou
// Free Software hacker
// https://julien.danjou.info


signature.asc
Description: PGP signature
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev