Re: Hive on Tez

2014-05-15 Thread Ujjwal
Hi Briyan, It is integrated as per the release diagram from Hortonworks webpage. Source: http://hortonworks.com/wp-content/uploads/2014/04/asparagus_21.png Meanwhile I tried out Hive with Tez on the newest HDP 2.1 VMware image. Haven't had a chance to configure on a vanilla system yet but

i can create table use hive ,but can not submit query to MR cluster,why?

2014-05-15 Thread ch huang
run quey in hive get error 0: jdbc:hive2://localhost:1/default select count(*) from hive_test; Error: Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask (state=08S01,code=1) 0: jdbc:hive2://localhost:1/default select

AW: Insert into directory

2014-05-15 Thread Huynh, Chi-Hao
Hey Sreenath, If you are using version 0.8 of Hive or higher you can omit overwrite and just write ‘INSERT DIRECTORY’. This will simply append the results instead of overwriting. You can refer to the documentation for more details.

Metastore service

2014-05-15 Thread Dima Machlin
Hi, Starting the metastore (Hive 0.12) service there is a WARNING [main] WARN bonecp.BoneCPConfig: Max Connections 1. Setting to 20 What does this setting mean? Max connections from hive servers to the metastore? How can this be changed? Thanks.

Re: Tez HIve problems.

2014-05-15 Thread Archit Thakur
Hitesh: I have attached application logs. On Tue, May 13, 2014 at 8:43 PM, Carter Shanklin car...@hortonworks.comwrote: Archit, I have seen this problem on small sandbox environments with very little memory given to YARN. In those cases, the app master would consume enough memory that

Tez HIve problems.

2014-05-15 Thread Archit Thakur
Hi, I am facing few problems while using Tez on Hive. I am able to run Tez through YARN submitting independent MR procesing job. Also, when I run SELECT query on hive shell by setting *set hive.execution.engine=mr;* but setting *mapreduce.framework.name

Re: OrcOutputFormat

2014-05-15 Thread Thejas Nair
I am not familiar with https://github.com/mayanhui/hive-orc-mr/. But is there any reason why you are not using hcatalog input/output format for this ? https://cwiki.apache.org/confluence/display/Hive/HCatalog+InputOutput. On Wed, Apr 30, 2014 at 4:25 AM, Seema Datar sda...@yahoo-inc.com wrote:

java.lang.NoSuchFieldError: HIVE_ORC_FILE_MEMORY_POOL when inserting data to ORC table

2014-05-15 Thread John Zeng
Hi, All, I created a ORC table by doing this: add jar /home/dguser/hive-0.12.0/lib/hive-exec-0.12.0.jar; CREATE TABLE orc_UserDataTest2( PassportNumbers1 STRING, PassportNumbers2 STRING, TaxID STRING, CM11 STRING, CM13 STRING, CM15 STRING, Name STRING, EmailAddress STRING ) ROW FORMAT SERDE

Insert into directory

2014-05-15 Thread Sreenath
Hi all, Is there a way in hive by which i can redirect the output of a query to some folder that already has some data. I know 'INSERT OVERWRITE DIRECTORY' but this overwrites the existing content thanks