回复:RE: Hibench build fail
Hi Ted and Grace, Retried with Spark 1.4.0,still failed with same phenomenon.here is a log.FYI. What else details may help?BTW, is it a necessary step to run Hibench test for my spark cluster? I also tried to skip building Hibench to execute bin/run-all.sh, but also got errors while running.thanks. Thanksamp;Best regards! San.Luo - 原始邮件 - 发件人:Huang, Jie jie.hu...@intel.com 收件人:Ted Yu yuzhih...@gmail.com, ?? luohui20...@sina.com 抄送人:user user@spark.apache.org 主题:RE: Hibench build fail 日期:2015年07月08日 09点20分 Hi Hui, Could you please add more descriptions (about the failure) in HiBench github Issues? HiBench works with spark 1.2 and above. Thank you Best Regards, Grace (Huang Jie) From: Ted Yu [mailto:yuzhih...@gmail.com] Sent: Wednesday, July 8, 2015 12:50 AM To: 罗辉 Cc: user; Huang, Jie Subject: Re: Hibench build fail bq. Need I specify my spark version Looks like the build used 1.4.0 SNAPSHOT. Please use 1.4.0 release. Cheers On Mon, Jul 6, 2015 at 11:50 PM, luohui20...@sina.com wrote: Hi grace, recently I am trying Hibench to evaluate my spark cluster, however I got a problem in building Hibench, would you help to take a look? thanks. It fails at building Sparkbench, and you may check the attched pic for more info. My spark version :1.3.1,hadoop version :2.7.0 and HiBench version:4.0, python 2.6.6. It is reported that failed for spark1.4 and MR1,which I didn't install in my cluster.Need I specify my spark version and hadoop version when I am running bin/build-all.sh? thanks. Thanksamp;Best regards! San.Luo - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org Hibench_nohup.out Description: Binary data - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
回复:回复:RE: Hibench build fail
should I add dependencies for spark-core_2.10,spark-yarn_2.10,spark-streaming_2.10, org.apache.spark:spark-mllib_2.10,:spark-hive_2.10,:spark-graphx_2.10 in pom.xml?if yes, there are 7 pom.xml in HiBench listing below, which one to modify? [root@spark-study HiBench-master]# find ./ -name pom.xml ./src/nutchindexing/pom.xml ./src/pegasus/pom.xml ./src/sparkbench/pom.xml ./src/mahout/pom.xml ./src/hivebench/pom.xml ./src/pom.xml ./src/autogen/pom.xml Thanksamp;Best regards! San.Luo - 原始邮件 - 发件人:luohui20...@sina.com 收件人:jie.huang jie.hu...@intel.com, Ted Yu yuzhih...@gmail.com 抄送人:user user@spark.apache.org 主题:回复:RE: Hibench build fail 日期:2015年07月08日 15点38分 Hi Ted and Grace, Retried with Spark 1.4.0,still failed with same phenomenon.here is a log.FYI. What else details may help?BTW, is it a necessary step to run Hibench test for my spark cluster? I also tried to skip building Hibench to execute bin/run-all.sh, but also got errors while running.thanks. Thanksamp;Best regards! San.Luo - 原始邮件 - 发件人:Huang, Jie jie.hu...@intel.com 收件人:Ted Yu yuzhih...@gmail.com, ?? luohui20...@sina.com 抄送人:user user@spark.apache.org 主题:RE: Hibench build fail 日期:2015年07月08日 09点20分 Hi Hui, Could you please add more descriptions (about the failure) in HiBench github Issues? HiBench works with spark 1.2 and above. Thank you Best Regards, Grace (Huang Jie) From: Ted Yu [mailto:yuzhih...@gmail.com] Sent: Wednesday, July 8, 2015 12:50 AM To: 罗辉 Cc: user; Huang, Jie Subject: Re: Hibench build fail bq. Need I specify my spark version Looks like the build used 1.4.0 SNAPSHOT. Please use 1.4.0 release. Cheers On Mon, Jul 6, 2015 at 11:50 PM, luohui20...@sina.com wrote: Hi grace, recently I am trying Hibench to evaluate my spark cluster, however I got a problem in building Hibench, would you help to take a look? thanks. It fails at building Sparkbench, and you may check the attched pic for more info. My spark version :1.3.1,hadoop version :2.7.0 and HiBench version:4.0, python 2.6.6. It is reported that failed for spark1.4 and MR1,which I didn't install in my cluster.Need I specify my spark version and hadoop version when I am running bin/build-all.sh? thanks. Thanksamp;Best regards! San.Luo - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
Re: Hibench build fail
bq. Need I specify my spark version Looks like the build used 1.4.0 SNAPSHOT. Please use 1.4.0 release. Cheers On Mon, Jul 6, 2015 at 11:50 PM, luohui20...@sina.com wrote: Hi grace, recently I am trying Hibench to evaluate my spark cluster, however I got a problem in building Hibench, would you help to take a look? thanks. It fails at building Sparkbench, and you may check the attched pic for more info. My spark version :1.3.1,hadoop version :2.7.0 and HiBench version:4.0, python 2.6.6. It is reported that failed for spark1.4 and MR1,which I didn't install in my cluster.Need I specify my spark version and hadoop version when I am running bin/build-all.sh? thanks. Thanksamp;Best regards! San.Luo - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
RE: Hibench build fail
Hi Hui, Could you please add more descriptions (about the failure) in HiBench github Issues? HiBench works with spark 1.2 and above. Thank you Best Regards, Grace (Huang Jie) From: Ted Yu [mailto:yuzhih...@gmail.com] Sent: Wednesday, July 8, 2015 12:50 AM To: 罗辉 Cc: user; Huang, Jie Subject: Re: Hibench build fail bq. Need I specify my spark version Looks like the build used 1.4.0 SNAPSHOT. Please use 1.4.0 release. Cheers On Mon, Jul 6, 2015 at 11:50 PM, luohui20...@sina.commailto:luohui20...@sina.com wrote: Hi grace, recently I am trying Hibench to evaluate my spark cluster, however I got a problem in building Hibench, would you help to take a look? thanks. It fails at building Sparkbench, and you may check the attched pic for more info. My spark version :1.3.1,hadoop version :2.7.0 and HiBench version:4.0, python 2.6.6. It is reported that failed for spark1.4 and MR1,which I didn't install in my cluster.Need I specify my spark version and hadoop version when I am running bin/build-all.sh? thanks. Thanksamp;Best regards! San.Luo - To unsubscribe, e-mail: user-unsubscr...@spark.apache.orgmailto:user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.orgmailto:user-h...@spark.apache.org