Bringing it back to the list, and cc'ing Alok and Gokul as some of this relates to the overall VES design.
OK, ready to work on testing your patch. I can locally edit the ves-setup script to pull the patch when I clone barometer in the VES Agent (ves_app) container. Quick questions first though: * How do I (as noted in the patch) get ves_app to generate messages for the guest, hypervisor, and node separately? Do I need to run 3 instances of the ves_app? * Should I use the yaml files in the repo or the one (merged) that you provided Friday? I assume I should use the ones in the repo. Thanks, Bryan Sullivan | AT&T From: SULLIVAN, BRYAN L (BRYAN L) Sent: Monday, November 20, 2017 5:36 AM To: 'Mytnyk, VolodymyrX' <[email protected]>; Tahhan, Maryam <[email protected]> Cc: Mcmahon, Tony B <[email protected]>; Power, Damien <[email protected]> Subject: RE: [opnfv-tech-discuss] [barometer] ves_app.py exception when collecting from multiple collectd clients I'm using Barometer master and guest mode based upon the discussions we had (not the merged yaml). Trying to keep it simple on my end so I can get the basic single node deployment completed. That's done now as of https://gerrit.opnfv.org/gerrit/#/c/47475/ so I can start looking at your recent changes. Deploying patches from other repos gets a little complicated as I clone Barometer in the scripts, and have to edit the script to include checkout of your patch. So I usually wait until changes from other repos have merged to test. But I'll see what I can do in the meantime. Thanks, Bryan Sullivan | AT&T From: Mytnyk, VolodymyrX [mailto:[email protected]] Sent: Monday, November 20, 2017 5:18 AM To: SULLIVAN, BRYAN L (BRYAN L) <[email protected]<mailto:[email protected]>>; Tahhan, Maryam <[email protected]<mailto:[email protected]>> Cc: Mcmahon, Tony B <[email protected]<mailto:[email protected]>>; Power, Damien <[email protected]<mailto:[email protected]>> Subject: RE: [opnfv-tech-discuss] [barometer] ves_app.py exception when collecting from multiple collectd clients Hi Bryan, Based on the logs you provided AssertionError: Wrong SELECT condition, selected 4 metrics looks like the latest changes of VES app is not used. E.g. the https://gerrit.opnfv.org/gerrit/#/c/47427/<https://urldefense.proofpoint.com/v2/url?u=https-3A__gerrit.opnfv.org_gerrit_-23_c_47427_&d=DwMFAg&c=LFYZ-o9_HUMeMTSQicvjIg&r=ML-JPRZQOfToJjMwlJLPlcWimAEwMA5DZGNIrk-cgy0&m=wvfRnqnK1lxmd6iX8-opA5DLkTYOTy2WAtC-81JI7qc&s=lsPEgr9kC5dQSvNnVsMfzKNuVv4E3ZmbaqThVx6NXYc&e=> patch is not applied. 1. Are you sure that this patch is applied and node.yaml configuration is used by VES application? 2. Are you using collectd configuration files ( guests/hosts) provided by me on Friday? Thanks and Regards, Volodymyr From: SULLIVAN, BRYAN L (BRYAN L) [mailto:[email protected]] Sent: Monday, November 20, 2017 3:09 PM To: Tahhan, Maryam <[email protected]<mailto:[email protected]>> Cc: Mytnyk, VolodymyrX <[email protected]<mailto:[email protected]>>; Mcmahon, Tony B <[email protected]<mailto:[email protected]>>; Power, Damien <[email protected]<mailto:[email protected]>> Subject: RE: [opnfv-tech-discuss] [barometer] ves_app.py exception when collecting from multiple collectd clients If there's a better way to report issues, e.g. thru the github mirror, let me know. I do have a number of things to followup on from the testing. Thanks, Bryan Sullivan | AT&T From: Tahhan, Maryam [mailto:[email protected]] Sent: Monday, November 20, 2017 5:06 AM To: SULLIVAN, BRYAN L (BRYAN L) <[email protected]<mailto:[email protected]>> Cc: Mytnyk, VolodymyrX <[email protected]<mailto:[email protected]>>; Mcmahon, Tony B <[email protected]<mailto:[email protected]>>; Power, Damien <[email protected]<mailto:[email protected]>> Subject: RE: [opnfv-tech-discuss] [barometer] ves_app.py exception when collecting from multiple collectd clients Hey Bryan Thanks for the bug report. I've pinged Volodymyr on this, not sure if he follows the mailing list. BR Maryam From: [email protected]<mailto:[email protected]> [mailto:[email protected]] On Behalf Of SULLIVAN, BRYAN L (BRYAN L) Sent: Monday, November 20, 2017 4:39 AM To: '[email protected]' <[email protected]<mailto:[email protected]>> Subject: [opnfv-tech-discuss] [barometer] ves_app.py exception when collecting from multiple collectd clients Hi Barometer team, The exception below came up when the ves_app began getting events from multiple collectd clients (one on each compute node). This occurs when there is a shared kafka server and a single ves_app instance which is getting the events from the multiple collectd clients. The exceptions started happening as soon as I activated the 2nd collectd client. The exception info "AssertionError: Wrong SELECT condition, selected 4 metrics" changed from "2 metrics" to "4 metrics" as I added the 2nd thru 4th collectd client, so I'm pretty sure the issue is related to there being more than one collectd client. Let me know if you need more info. Exception in thread Thread-130: Traceback (most recent call last): File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner self.run() File "/usr/lib/python2.7/threading.py", line 1073, in run self.function(*self.args, **self.kwargs) File "/opt/ves/barometer/3rd_party/collectd-ves-app/ves_app/normalizer.py", line 561, in on_timer self.process_measurements() File "/opt/ves/barometer/3rd_party/collectd-ves-app/ves_app/normalizer.py", line 583, in process_measurements measurements = loader.get_data() File "/usr/local/lib/python2.7/dist-packages/yaml/constructor.py", line 33, in get_data return self.construct_document(self.get_node()) File "/usr/local/lib/python2.7/dist-packages/yaml/constructor.py", line 48, in construct_document for dummy in generator: File "/usr/local/lib/python2.7/dist-packages/yaml/constructor.py", line 398, in construct_yaml_map value = self.construct_mapping(node) File "/usr/local/lib/python2.7/dist-packages/yaml/constructor.py", line 208, in construct_mapping return BaseConstructor.construct_mapping(self, node, deep=deep) File "/usr/local/lib/python2.7/dist-packages/yaml/constructor.py", line 133, in construct_mapping value = self.construct_object(value_node, deep=deep) File "/usr/local/lib/python2.7/dist-packages/yaml/constructor.py", line 88, in construct_object data = constructor(self, node) File "/opt/ves/barometer/3rd_party/collectd-ves-app/ves_app/normalizer.py", line 411, in from_yaml items.append(loader.construct_mapping(item)) File "/usr/local/lib/python2.7/dist-packages/yaml/constructor.py", line 208, in construct_mapping return BaseConstructor.construct_mapping(self, node, deep=deep) File "/usr/local/lib/python2.7/dist-packages/yaml/constructor.py", line 133, in construct_mapping value = self.construct_object(value_node, deep=deep) File "/usr/local/lib/python2.7/dist-packages/yaml/constructor.py", line 88, in construct_object data = constructor(self, node) File "/opt/ves/barometer/3rd_party/collectd-ves-app/ves_app/normalizer.py", line 350, in from_yaml 'Wrong SELECT condition, selected {} metrics'.format(len(metrics)) AssertionError: Wrong SELECT condition, selected 4 metrics Thanks, Bryan Sullivan | AT&T
_______________________________________________ opnfv-tech-discuss mailing list [email protected] https://lists.opnfv.org/mailman/listinfo/opnfv-tech-discuss
