Working Hive--> Spark --> HDFS

Hi Guys Can somebody tell me a workin version of HoSoHDFS. So far I have tested: Hive1.2.1-->Spark-->1.6.3--> Hadoop 2.6 Hive 2.1 --> Spark2.0.2 --> Hadoop 2.7 And both of them give me varios exceptions. I have to say the first one creates the job in HDFS and finish it successfully but give

Need advice on tracing errors with batch mode

Hi, I want to run batch mode task like and i am using *hiveconf hive.cli.errors.ignore=true* hive -f file.txt hiveconf hive.cli.errors.ignore=true And my requirement is find what all queries failed after execution. Is that possible ? Neelima

Re: Need advice on tracing errors with batch mode

Hi, I want to run batch mode task like and i am using *hiveconf hive.cli.errors.ignore=true* hive -f file.txt hiveconf hive.cli.errors.ignore=true And my requirement is find what all queries failed after execution. Is that possible ? And i have create statements in the queries..it is DDL.

Re: Working Hive--> Spark --> HDFS

can you please share the stacktrace of excpetion you get . Thanks, Divya On 24 November 2016 at 06:33, Joaquin Alzola wrote: > Hi Guys > > > > Can somebody tell me a workin version of HoSoHDFS. > > > > So far I have tested: > > Hive1.2.1àSparkà1.6.3à Hadoop 2.6 > >

Re: hive union all

could you please explain the sql 在 2016年11月24日，下午1:01，C R > 写道： hi all, all I want to say is here: it is ok. I feel a little embarrassed According to my test,the same hive ql will be executed well in CDH version.

RE: import sql file

Hi Patcharee The question is not clear. Dudu -Original Message- From: patcharee [mailto:patcharee.thong...@uni.no] Sent: Wednesday, November 23, 2016 11:37 AM To: user@hive.apache.org Subject: import sql file Hi, How can I import .sql file into hive? Best, Patcharee

Re: import sql file

put the file into an hdfs directory. assuming to be some type of csv file from mssql or oracle, create an external table in hive looking at the hdfs directory where you put the sql file using LOCATION in Hive. there are multiple examples if you google it. It is pretty straight forward.

Re: Hive Serialization issues

Hey, Any leads? On Tue, Nov 22, 2016 at 5:35 PM, Dana Ram Meghwal wrote: > Hey All, > > I am using Hive 2.0 with external meta-store on EMR-5.0.0 and TEZ as > execution engine. > Our data are stored in json format so for serialization and > deserialization purpose we are

import sql file

Hi, How can I import .sql file into hive? Best, Patcharee

Re: import sql file

I exported sql table into .sql file and would like to import this into hive Best, Patcharee On 23. nov. 2016 10:40, Markovitz, Dudu wrote: Hi Patcharee The question is not clear. Dudu -Original Message- From: patcharee [mailto:patcharee.thong...@uni.no] Sent: Wednesday, November 23,

Interrogating a uniontype

Can anyone recommend a good approach for interrogating uniontype values in HQL? I note that the documentation states that the support for such types is limited to 'look-at-only' which I assume to mean that I may only dump out the value in its entirety, and extract sub-elements. Using the example

Re: Interrogating a uniontype

Ah, I see that this can't be done with an array as there is no type common to all union indexes. Perhaps a struct with one field per indexed type? On Wed, 23 Nov 2016 at 17:29, Elliot West wrote: > Can anyone recommend a good approach for interrogating uniontype values in >

Re: Hive Serialization issues

I believe json itself has encoding rules. What i suggest you do is build your own input format or serde and escape those fieds possibly by converting them to hex. On Wednesday, November 23, 2016, Dana Ram Meghwal wrote: > Hey, > Any leads? > > On Tue, Nov 22, 2016 at 5:35 PM,

Re: Interrogating a uniontype

Could you write a UDF that parses it and returns a json object. From there you can use the standard json support in Hive. I did something similar for Erlang structs about 3 years ago. I actually kept them on file and wrote a serde that exposed them as json objects. regards /Pelle On Wed, Nov 23,