Re: setup spark engine to hive ,the hive version and spark build problem

2017-06-19 Thread Mich Talebzadeh
just to clarify you mean: Hive 2.1.1 works with Spark engine 2.X Thanks Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw *

Re: setup spark engine to hive ,the hive version and spark build problem

2017-06-18 Thread vergil
Hi,dear friend 1.After I try it and read the source code,I find that hive on spark2.X do works on hive 2.2.0 2.2.1 version and 2.4.x version which includes this commit history https://github.com/apache/hive/commit/ac977cc88757b49fbbd5c3bb236adcedcaae396c.I use the 2.2.0 version now. 2.Hive on

Re: setup spark engine to hive ,the hive version and spark build problem

2017-06-17 Thread Mich Talebzadeh
the only way I managed this work (and I have not tried newer build yet) was Hive. 2.0.1 on Spark 1.3.1 engine Connected to: Apache Hive (version 2.0.1 0: jdbc:hive2://rhes564:10099/default> select count(1) from passwd; INFO : Compiling

Re: setup spark engine to hive ,the hive version and spark build problem

2017-06-17 Thread Boris Lublinsky
You need to exlicitely build spark without Hive. Look at getting started doc Get Outlook for Android On Sat, Jun 17, 2017 at 5:26 AM -0400, "wuchang" <583424...@qq.com> wrote: I want to build hive and spark to make my hive based on spark engine.I choose Hive 2.3.0 and Spark

setup spark engine to hive ,the hive version and spark build problem

2017-06-17 Thread wuchang
I want to build hive and spark to make my hive based on spark engine. I choose Hive 2.3.0 and Spark 2.0.0, which is claimed to be compatible by hive official document. According to the hive officials document ,I have to build spark without hive profile to avoid the conflict between original

setup spark engine to hive ,the hive version and spark build problem

2017-06-17 Thread wuchang
I want to build hive and spark to make my hive based on spark engine. I choose Hive 2.3.0 and Spark 2.0.0, which is claimed to be compatible by hive official document. According to the hive officials document ,I have to build spark without hive profile to avoid the conflict between original