RE: Regarding removing double quotes

2017-03-23 Thread Brotanek, Jan
Hello, you can use SerDe which has double quotes as default quoting char CREATE TABLE a1.test (a string, b string ) ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.OpenCSVSerde' WITH SERDEPROPERTIES ( "separatorChar" = "," ) Regards Jan From: elango vaidyanathan [mailto:elango...@gmail.com]

hivevar in partition clause

2017-03-21 Thread Brotanek, Jan
Hi, I have following shell script: #!/bin/bash PNAME=20170320_203225 TNAME=tablea1 /usr/bin/hive -hiveconf hive.cli.errors.ignore=true -hivevar PNAME=$PNAME -hivevar TNAME=$TNAME -v -f ./query.hql Trying to pass PNAME hivevar to query.hql script: insert into table a1.${hivevar:TNAME}_orc

RE: beeline null pointer exception

2017-02-13 Thread Brotanek, Jan
...@hortonworks.com] Sent: sobota 17. prosince 2016 0:19 To: user@hive.apache.org<mailto:user@hive.apache.org> Subject: Re: beeline null pointer exception You probably need to take a look at the HiveServer2 logs which might have a stack trace for that error. From: Br

RE: tez session timesout?

2017-01-16 Thread Brotanek, Jan
: čtvrtek 12. ledna 2017 18:12 To: user@hive.apache.org Subject: Re: tez session timesout? That should only happen when InetAddress.getLocalHost().getHostName() throws UnknownHostException… do you have any other suspicious logs or activity around that time? On 17/1/12, 07:54, "Brotanek, Jan"

tez session timesout?

2017-01-12 Thread Brotanek, Jan
Hello, I am running insert statement via CLI interface under Hive on Tez on HDP 2.4.0.: hive -hiveconf hive.cli.errors.ignore=true -v -f hive_pl_new7.sql hive_pl_new7.sql consists of couple of insert into partition statements which take quite long time - about 1200s each. insert into

beeline null pointer exception

2016-12-16 Thread Brotanek, Jan
Hello, I have problem executing following statement in Beeline version 1.2.1000.2.4.0.0-169 by Apache Hive CLI (beeline being invoked with config: --fastConnect=true --hive.cli.errors.ignore=true): create table if not exists test.testorc STORED AS ORC as select * from test.testorc_e ;

RE: Hive Stored Textfile to Stored ORC taking long time

2016-12-09 Thread Brotanek, Jan
I have this problem as well. It takes forever to insert into ORC table. I have original table text files gzipped. Having 4nodes with each 64gb and 16cores From: Joaquin Alzola [mailto:joaquin.alz...@lebara.com] Sent: pátek 9. prosince 2016 12:34 To: user@hive.apache.org Subject: RE: Hive Stored

beeline query got stuck

2016-12-05 Thread Brotanek, Jan
Hello, when running quite big map-reduce job on Hive, I am unable to run queries (even simple show databases) via Beeline. Running query via Hive works fine. I checked Hive logs and it did not show any errors. Also setting beeline to verbose mode does not show any information. Seems beeline

RE: Need error logging advice on batch processing

2016-11-29 Thread Brotanek, Jan
w solution. Neelima On Mon, Nov 28, 2016 at 7:59 AM, Brotanek, Jan <jan.brota...@adastragrp.com<mailto:jan.brota...@adastragrp.com>> wrote: Hello, you can log like this: hive -f file.txt hiveconf hive.cli.errors.ignore=true 2&> file.log and then grep for keywords *Exception*

RE: Need error logging advice on batch processing

2016-11-28 Thread Brotanek, Jan
Hello, you can log like this: hive -f file.txt hiveconf hive.cli.errors.ignore=true 2&> file.log and then grep for keywords *Exception* From: neelima g [mailto:nling...@gmail.com] Sent: pondělí 28. listopadu 2016 16:15 To: user@hive.apache.org Subject: Need error logging advice on batch

Hive wrapping lines

2016-11-15 Thread Brotanek, Jan
Hello, I am executing hive command as follows: hive -hiveconf hive.cli.errors.ignore=true -v -S -f tables.sql 2&>tablesCZ.log inside tables.sql is simple sql as following: select min(INT_CURRENT_DATE), max(INT_CURRENT_DATE) from SYSTGXX.POS_T096132_STG_ORC_TMP;$ select min(INT_CURRENT_DATE),