Sure, that works too. If there’s anyone available to talk today over IRC, I’m bryan_att and will be working on this today.
Thanks, Bryan Sullivan | AT&T From: Aaron Smith [mailto:aasm...@redhat.com] Sent: Monday, November 13, 2017 6:34 AM To: SULLIVAN, BRYAN L (BRYAN L) <bryan.sulli...@research.att.com> Cc: opnfv-tech-discuss@lists.opnfv.org Subject: Re: [opnfv-tech-discuss] [barometer] Issues in VES Guide Hi Bryan, Can we talk about this during the second part of the Weekly meeting tomorrow? Aaron On Sun, Nov 12, 2017 at 9:41 PM, SULLIVAN, BRYAN L (BRYAN L) <bryan.sulli...@research.att.com<mailto:bryan.sulli...@research.att.com>> wrote: Hi Barometer team, I’d like to have a call asap this week, or an IRC chat, to discuss the issues I’ve found in scripting the VES install, and other questions on how this is intended to (or can) work. My WIP patch for VES is at https://gerrit.opnfv.org/gerrit/#/c/47101/<https://urldefense.proofpoint.com/v2/url?u=https-3A__gerrit.opnfv.org_gerrit_-23_c_47101_&d=DwMFaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=ML-JPRZQOfToJjMwlJLPlcWimAEwMA5DZGNIrk-cgy0&m=ntavL3wyrZN_YIKkGikYots9sUMdeopLU2VpPJISxps&s=NTctm40IWucZulZXFazZQHtEXJlu_sY_gt8xnT7SMN0&e=>. Once this is working, you can refer to it in the guide as an example of how to automate the process. This will be much less painful than following the manual step-by-step process (which anyway will be documented in the script), and will be used in CI for VES. Thanks, Bryan Sullivan | AT&T From: SULLIVAN, BRYAN L (BRYAN L) Sent: Sunday, November 12, 2017 9:45 AM To: 'opnfv-tech-discuss@lists.opnfv.org<mailto:opnfv-tech-discuss@lists.opnfv.org>' <opnfv-tech-discuss@lists.opnfv.org<mailto:opnfv-tech-discuss@lists.opnfv.org>> Subject: RE: [barometer] Issues in VES Guide Hi Barometer team, Getting beyond the issues noted below (which still need to be addressed in the user guide): * Setting the hostname in /etc/hosts prevented the kafka server from exiting Here are a couple of other issues that need to be addressed as well: * The “producer – consumer” test shown only works when you are installing interactively, as the “consumer” part does not automatically return control back to the shell or script. So when scripting this either we have to just assume that the kafka server is running properly, or we need a method of testing it that works in a script. * At “Install development tools:” the guide only references how to do this for Centos. It should also clarify for Ubuntu (there is no “group” operation in apt-get). Thanks, Bryan Sullivan | AT&T From: SULLIVAN, BRYAN L (BRYAN L) Sent: Friday, November 10, 2017 10:40 AM To: 'opnfv-tech-discuss@lists.opnfv.org<mailto:opnfv-tech-discuss@lists.opnfv.org>' <opnfv-tech-discuss@lists.opnfv.org<mailto:opnfv-tech-discuss@lists.opnfv.org>> Subject: [barometer] Issues in VES Guide Hi Barometer team, Any help below is appreciated. I am scripting the setup for the new version of the VES plugin per http://docs.opnfv.org/en/latest/submodules/barometer/docs/release/userguide/collectd.ves.userguide.html<https://urldefense.proofpoint.com/v2/url?u=http-3A__docs.opnfv.org_en_latest_submodules_barometer_docs_release_userguide_collectd.ves.userguide.html&d=DwMFaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=ML-JPRZQOfToJjMwlJLPlcWimAEwMA5DZGNIrk-cgy0&m=ntavL3wyrZN_YIKkGikYots9sUMdeopLU2VpPJISxps&s=TvzMfuMYJ8pEENUkkURnOgAWfQ7_tVWVMnzXOJ90DoA&e=> I have found a couple of issues as below. Here are the steps I am using per the guide (note the additional step needed below, in bold): # TODO: Guide should reference use of “apt-get” vs “apt”, per Ubuntu advice on which works better in scripts sudo apt-get install -y default-jre sudo apt-get install -y zookeeperd sudo apt-get install -y python-pip sudo pip install kafka-python wget "http://www-eu.apache.org/dist/kafka/0.11.0.0/kafka_2.11-0.11.0.0.tgz<https://urldefense.proofpoint.com/v2/url?u=http-3A__www-2Deu.apache.org_dist_kafka_0.11.0.0_kafka-5F2.11-2D0.11.0.0.tgz&d=DwMFaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=ML-JPRZQOfToJjMwlJLPlcWimAEwMA5DZGNIrk-cgy0&m=ntavL3wyrZN_YIKkGikYots9sUMdeopLU2VpPJISxps&s=JFi0Nr3iliKP33GvGYAHn8eFHL9aMrZq3GxRqhdrxOw&e=>" tar -xvzf kafka_2.11-0.11.0.0.tgz sed -i -- 's/#delete.topic.enable=true/delete.topic.enable=true/' kafka_2.11-0.11.0.0/config/server.properties<https://urldefense.proofpoint.com/v2/url?u=http-3A__server.properties&d=DwQFaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=ML-JPRZQOfToJjMwlJLPlcWimAEwMA5DZGNIrk-cgy0&m=ntavL3wyrZN_YIKkGikYots9sUMdeopLU2VpPJISxps&s=wvW57XCN7UDakxBC6kKQtyF3oDE2zEVj-jLctOO7qsY&e=> sudo nohup kafka_2.11-0.11.0.0/bin/kafka-server-start.sh<https://urldefense.proofpoint.com/v2/url?u=http-3A__server-2Dstart.sh&d=DwQFaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=ML-JPRZQOfToJjMwlJLPlcWimAEwMA5DZGNIrk-cgy0&m=ntavL3wyrZN_YIKkGikYots9sUMdeopLU2VpPJISxps&s=WO9G4qyDm87PISQA88ng009ZdB9aHsdNIzHF5dhSBzM&e=> \ kafka_2.11-0.11.0.0/config/server.properties<https://urldefense.proofpoint.com/v2/url?u=http-3A__server.properties&d=DwQFaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=ML-JPRZQOfToJjMwlJLPlcWimAEwMA5DZGNIrk-cgy0&m=ntavL3wyrZN_YIKkGikYots9sUMdeopLU2VpPJISxps&s=wvW57XCN7UDakxBC6kKQtyF3oDE2zEVj-jLctOO7qsY&e=> > kafka_2.11-0.11.0.0/kafka.log 2>&1 & # TODO: missing step in guide: hostname must be in /etc/hosts echo "$(ip route get 8.8.8.8<https://urldefense.proofpoint.com/v2/url?u=http-3A__8.8.8.8&d=DwQFaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=ML-JPRZQOfToJjMwlJLPlcWimAEwMA5DZGNIrk-cgy0&m=ntavL3wyrZN_YIKkGikYots9sUMdeopLU2VpPJISxps&s=KOMQFev4hJpZi50ic2pPeiR9a0ieCvuxCfIo6Xuh79I&e=> | awk '{print $NF; exit}') $HOSTNAME" | sudo tee -a /etc/hosts sudo nohup kafka_2.11-0.11.0.0/bin/kafka-server-start.sh<https://urldefense.proofpoint.com/v2/url?u=http-3A__server-2Dstart.sh&d=DwQFaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=ML-JPRZQOfToJjMwlJLPlcWimAEwMA5DZGNIrk-cgy0&m=ntavL3wyrZN_YIKkGikYots9sUMdeopLU2VpPJISxps&s=WO9G4qyDm87PISQA88ng009ZdB9aHsdNIzHF5dhSBzM&e=> \ kafka_2.11-0.11.0.0/config/server.properties<https://urldefense.proofpoint.com/v2/url?u=http-3A__server.properties&d=DwQFaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=ML-JPRZQOfToJjMwlJLPlcWimAEwMA5DZGNIrk-cgy0&m=ntavL3wyrZN_YIKkGikYots9sUMdeopLU2VpPJISxps&s=wvW57XCN7UDakxBC6kKQtyF3oDE2zEVj-jLctOO7qsY&e=> > kafka_2.11-0.11.0.0/kafka.log 2>&1 & kafka_2.11-0.11.0.0/bin/kafka-console-consumer.sh<https://urldefense.proofpoint.com/v2/url?u=http-3A__console-2Dconsumer.sh&d=DwQFaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=ML-JPRZQOfToJjMwlJLPlcWimAEwMA5DZGNIrk-cgy0&m=ntavL3wyrZN_YIKkGikYots9sUMdeopLU2VpPJISxps&s=nCC_pHKpg8ho9AwHn5kdtdM_ZeMnKssiENaCDGl6NJE&e=> --zookeeper localhost:2181 --topic TopicTest --from-beginning When I run the server, it exits. I saw the note about the exit when I ran the “Producer” test per the guide, which complained that there was no Broker available (I guess due to the exit). After that I ran the “Consumer” test (I did not see the note about the server exit yet), which has hanged, and I can’t quit that command. Any ideas for: * what I do now, to get my terminal prompt back (other than wipe the server and start again) * what may have caused the server to exit ubuntu@opnfv01:~$ sudo nohup kafka_2.11-0.11.0.0/bin/kafka-server-start.sh<https://urldefense.proofpoint.com/v2/url?u=http-3A__server-2Dstart.sh&d=DwQFaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=ML-JPRZQOfToJjMwlJLPlcWimAEwMA5DZGNIrk-cgy0&m=ntavL3wyrZN_YIKkGikYots9sUMdeopLU2VpPJISxps&s=WO9G4qyDm87PISQA88ng009ZdB9aHsdNIzHF5dhSBzM&e=> \ > > kafka_2.11-0.11.0.0/config/server.properties<https://urldefense.proofpoint.com/v2/url?u=http-3A__server.properties&d=DwQFaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=ML-JPRZQOfToJjMwlJLPlcWimAEwMA5DZGNIrk-cgy0&m=ntavL3wyrZN_YIKkGikYots9sUMdeopLU2VpPJISxps&s=wvW57XCN7UDakxBC6kKQtyF3oDE2zEVj-jLctOO7qsY&e=> > > kafka_2.11-0.11.0.0/kafka.log 2>&1 & [1] 6797 ubuntu@opnfv01:~$ ubuntu@opnfv01:~$ echo "Hello, World" | kafka_2.11-0.11.0.0/bin/kafka-console-producer.sh<https://urldefense.proofpoint.com/v2/url?u=http-3A__console-2Dproducer.sh&d=DwQFaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=ML-JPRZQOfToJjMwlJLPlcWimAEwMA5DZGNIrk-cgy0&m=ntavL3wyrZN_YIKkGikYots9sUMdeopLU2VpPJISxps&s=zslZnpt_WqJnA-xlg-2avWeBTcrpVIxVOusDuJf5wSA&e=> \ [1]+ Exit 1 sudo nohup kafka_2.11-0.11.0.0/bin/kafka-server-start.sh<https://urldefense.proofpoint.com/v2/url?u=http-3A__server-2Dstart.sh&d=DwQFaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=ML-JPRZQOfToJjMwlJLPlcWimAEwMA5DZGNIrk-cgy0&m=ntavL3wyrZN_YIKkGikYots9sUMdeopLU2VpPJISxps&s=WO9G4qyDm87PISQA88ng009ZdB9aHsdNIzHF5dhSBzM&e=> kafka_2.11-0.11.0.0/config/server.properties<https://urldefense.proofpoint.com/v2/url?u=http-3A__server.properties&d=DwQFaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=ML-JPRZQOfToJjMwlJLPlcWimAEwMA5DZGNIrk-cgy0&m=ntavL3wyrZN_YIKkGikYots9sUMdeopLU2VpPJISxps&s=wvW57XCN7UDakxBC6kKQtyF3oDE2zEVj-jLctOO7qsY&e=> > kafka_2.11-0.11.0.0/kafka.log 2>&1 > --broker-list localhost:9092 --topic TopicTest > /dev/null [2017-11-10 18:22:18,189] WARN Connection to node -1 could not be established. Broker may not be available. (org.apache.kafka.clients.NetworkClient) [2017-11-10 18:22:18,241] WARN Connection to node -1 could not be established. Broker may not be available. (org.apache.kafka.clients.NetworkClient) ... ubuntu@opnfv01:~$ kafka_2.11-0.11.0.0/bin/kafka-console-consumer.sh<https://urldefense.proofpoint.com/v2/url?u=http-3A__console-2Dconsumer.sh&d=DwQFaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=ML-JPRZQOfToJjMwlJLPlcWimAEwMA5DZGNIrk-cgy0&m=ntavL3wyrZN_YIKkGikYots9sUMdeopLU2VpPJISxps&s=nCC_pHKpg8ho9AwHn5kdtdM_ZeMnKssiENaCDGl6NJE&e=> --zookeeper localhost:2181 --topic TopicTest --from-beginning Using the ConsoleConsumer with old consumer is deprecated and will be removed in a future major release. Consider using the new consumer by passing [bootstrap-server] instead of [zookeeper]. [2017-11-10 18:25:34,303] WARN [console-consumer-18617_opnfv01-1510338334002-e1877230], no brokers found when trying to rebalance. (kafka.consumer.ZookeeperConsumerConnector) ^C ^C^C^C^C^C^C^C^C^C Thanks, Bryan Sullivan | AT&T _______________________________________________ opnfv-tech-discuss mailing list opnfv-tech-discuss@lists.opnfv.org<mailto:opnfv-tech-discuss@lists.opnfv.org> https://lists.opnfv.org/mailman/listinfo/opnfv-tech-discuss<https://urldefense.proofpoint.com/v2/url?u=https-3A__lists.opnfv.org_mailman_listinfo_opnfv-2Dtech-2Ddiscuss&d=DwMFaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=ML-JPRZQOfToJjMwlJLPlcWimAEwMA5DZGNIrk-cgy0&m=ntavL3wyrZN_YIKkGikYots9sUMdeopLU2VpPJISxps&s=Nk4evZQEwVZqpmSYSAy3tz2Zig4r41zo4EmahO-jq-w&e=> -- AARON SMITH SENIOR PRINCIPAL SOFTWARE ENGINEER, NFVPE Red Hat <https://urldefense.proofpoint.com/v2/url?u=https-3A__www.redhat.com_&d=DwMFaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=ML-JPRZQOfToJjMwlJLPlcWimAEwMA5DZGNIrk-cgy0&m=ntavL3wyrZN_YIKkGikYots9sUMdeopLU2VpPJISxps&s=x4wlVR9__2xHBvHQNiN5cx4YQ29PVGKCz37mbj0j07c&e=> 314 Littleton Rd, Westford, MA 01886 aasm...@redhat.com<mailto:aasm...@redhat.com> M: 617.877.4814<tel:617.877.4814> [https://www.redhat.com/files/brand/email/sig-redhat.png]<https://urldefense.proofpoint.com/v2/url?u=https-3A__red.ht_sig&d=DwMFaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=ML-JPRZQOfToJjMwlJLPlcWimAEwMA5DZGNIrk-cgy0&m=ntavL3wyrZN_YIKkGikYots9sUMdeopLU2VpPJISxps&s=XhakxRE-YTT4Y-KZprC39k-R7_mssQQw0DBxm6xmQyo&e=>
_______________________________________________ opnfv-tech-discuss mailing list opnfv-tech-discuss@lists.opnfv.org https://lists.opnfv.org/mailman/listinfo/opnfv-tech-discuss
