Re: Getting error when trying to start master node after building spark 1.3

That basically says that snappy isn't working properly on your box. You can forget about that for now by running: set spark.io.compression.codec=org.apache.spark.io.LZFCompressionCodec; On Sat, Dec 5, 2015 at 1:45 PM, Mich Talebzadeh wrote: > Great stuff. > > > > Built

Re: how to search the archive

On Fri, Dec 4, 2015 at 7:26 PM, Timothy Garza < timothy.ga...@collinsongroup.com> wrote: > > > > Q. What does that have to do with the text in the Subject line in your > email? > > > > > Yes sorry about that. That question is not related to the subject line of the mail. In any case could

Re: how to search the archive

On Fri, Dec 4, 2015 at 8:41 PM, Takahiko Saito wrote: > Could a table be an external table? > > > Yes. https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DDL#LanguageManualDDL-ExternalTables

The Hive shell and Spark issue

Hi, Sounds like the issue with Hive and Spark as Hive engine comes from the following lines in $HIVE_HOME/bin/hive which is # add Spark assembly jar to the classpath if [[ -n "$SPARK_HOME" ]] then sparkAssemblyPath=`ls ${SPARK_HOME}/lib/spark-assembly-*.jar`

RE: Managed to make Hive run on Spark engine

congrats! Link Qian Date: Sun, 6 Dec 2015 15:44:58 -0500 Subject: Re: Managed to make Hive run on Spark engine From: leftylever...@gmail.com To: user@hive.apache.org Congratulations!-- Lefty On Sun, Dec 6, 2015 at 3:32 PM, Mich Talebzadeh wrote: Thanks all especially to

Managed to make Hive run on Spark engine

Thanks all especially to Xuefu.for contributions. Finally it works, which means don’t give up until it works :) hduser@rhes564::/usr/lib/hive/lib> hive Logging initialized using configuration in jar:file:/usr/lib/hive/lib/hive-common-1.2.1.jar!/hive-log4j.properties hive> set spark.home=

Re: Managed to make Hive run on Spark engine

Congratulations! -- Lefty On Sun, Dec 6, 2015 at 3:32 PM, Mich Talebzadeh wrote: > Thanks all especially to Xuefu.for contributions. Finally it works, which > means don’t give up until it works J > > > > hduser@rhes564::/usr/lib/hive/lib> hive > > Logging initialized using

Re: how to search the archive

I've been hoping someone else would answer the question about searching the archives, but here's what I know: 1. The Apache archives linked from Hive's mailing lists page don't seem to be searchable. 2. Links to searchable MarkMail archives

Re: Storing the Hive Query Results into Variable

There are multiple ways of doing it. It will depend on your method of implementation as well. i.e. what is the platform you are using to fire the hive queries. Pig can do that for you (as already confirmed by another user) Shell scripts (unix based implementation) also supports it. A very crude