Re: spark-without-hive assembly for hive build/development purposes

2017-03-16 Thread Zoltan Haindrich
Hive uses spark-submit to launch the spark jobs - that's why the assembly is needed. On 03/16/2017 11:54 PM, Reynold Xin wrote: Why do you need an assembly? Is there something preventing Hive from depending on normal jars like all other applications? On Thu, Mar 16, 2017 at 3:42 PM, Z

spark-without-hive assembly for hive build/development purposes

2017-03-16 Thread Zoltan Haindrich
Hello, Hive needs a spark assembly to execute the HoS tests. Until now…this assembly have been downloaded from an S3 bucket - because this is not the best solution available, it sometimes causes troubles and inconveniences... We had a discussion about improving this; and the best option would