Google ProtocolBufferException exception when using ORC file format

2013-10-17 Thread Zhang Xiaoyu
Hi, all, I am simply using ORC file to store the data and get below exception. Any idea what's wrong with it? create table test (f1 int) stored as orc tblproperties (orc.compress=NONE); load data local inpath '/home/athena/test.txt' into table test; select * from test; === Error:

Re: Google ProtocolBufferException exception when using ORC file format

2013-10-17 Thread Nitin Pawar
Hi Zhang, you can not load a text file as orc file as load command does not transform your txt file to orc. To write a orc file you will need to use hcatalog apis. What you can do is create a temp table and load the data there. then do a insert into table test select * from temptest On Thu,

Re: Google ProtocolBufferException exception when using ORC file format

2013-10-17 Thread Zhang Xiaoyu
Thanks, Nitin, I guess, as you suggested. I can use text format in temp table (staging table), and use final table as ORC format. So when I merge data from staging table to final table, data got re-formatted from text into ORC. Johnny On Wed, Oct 16, 2013 at 11:46 PM, Nitin Pawar

Re: Where clause position

2013-10-17 Thread Ed Soniat
Would it be possible to simply this query removing as much as possible keeping just enough to demonstrate the where issue. On Wed, Oct 16, 2013 at 2:22 PM, Xiu Guo xgu...@gmail.com wrote: The following query does not work: SELECT T1.ACCOUNT_NUM ,T1.ACCOUNT_MODIFIER_NUM

Re: Where clause position

2013-10-17 Thread Nitin Pawar
Echoing wat Ed said, its too hard to understand a 2 page query over an email .. so may be something like select * from (select blah from abc where condition)a join (select blah from xyz where condition)b on (blah) where condition may help to understand On Thu, Oct 17, 2013 at 2:51 PM, Ed Soniat

RE: Problem starting Hive

2013-10-17 Thread Martin, Nick
Hi Clay, Quick housekeeping/config check...is the URI in /etc/hive/conf/hive-site.xml pointing to the right place? From: Clay McDonald [mailto:stuart.mcdon...@bateswhite.com] Sent: Thursday, October 17, 2013 8:54 AM To: 'Eric Mizell'; Rommel Garcia; Yi Zhang; 'user@hive.apache.org' Cc: Chris

RE: Problem starting Hive

2013-10-17 Thread Clay McDonald
Thanks Eric! My Hive log is attached. From: Eric Mizell [mailto:emiz...@hortonworks.com] Sent: Thursday, October 17, 2013 8:59 AM To: Clay McDonald Cc: Rommel Garcia; Yi Zhang; user@hive.apache.org; Chris Hackett; Steve Puckett; Clay McDonald; Terry Padgett Subject: Re: Problem starting Hive

RE: Problem starting Hive

2013-10-17 Thread Clay McDonald
Nick, let me check... From: Martin, Nick [mailto:] Sent: Thursday, October 17, 2013 9:00 AM To: user@hive.apache.org Subject: RE: Problem starting Hive Hi Clay, Quick housekeeping/config check...is the URI in /etc/hive/conf/hive-site.xml pointing to the right place? From: Clay McDonald

RE: Problem starting Hive

2013-10-17 Thread Clay McDonald
It looks good to me... property namejavax.jdo.option.ConnectionURL/name valuejdbc:mysql://bigdata5.bateswhite.com:3306/hadoop/value descriptionJDBC connect string for a JDBC metastore/description /property property namejavax.jdo.option.ConnectionDriverName/name valuesqladmin/value

RE: Problem starting Hive

2013-10-17 Thread Clay McDonald
Yep.. [root@bigdata5 ~]# find / -type f -name mysql-connector-java* /usr/lib/hive/lib/mysql-connector-java-5.1.24-bin.jar /usr/share/java/mysql-connector-java-5.1.17.jar From: Rommel Garcia [mailto:rgar...@hortonworks.com] Sent: Thursday, October 17, 2013 9:24 AM To: Clay McDonald Cc: Eric

RE: Problem starting Hive

2013-10-17 Thread Garg, Rinku
Hi, Are you logged in using hive specific user or as root user. /tmp/hive/hive.log file may be created once root user and it can’t be updated by any other user so it says permission denied. Thanks Regards, Rinku Garg From: Clay McDonald [mailto:stuart.mcdon...@bateswhite.com] Sent: 17

RE: Problem starting Hive

2013-10-17 Thread Clay McDonald
Hi Rinku, I tried running hive as the root user and hdfs user, both failed. I didn’t create a hive user. I’m using the sqladmin user to connect to the metastore in the config file. From: Garg, Rinku [mailto:rinku.g...@fisglobal.com] Sent: Thursday, October 17, 2013 9:32 AM To:

RE: Problem starting Hive

2013-10-17 Thread Garg, Rinku
Remove this file /tmp/hive/hive.log and try again using hdfs user. Thanks Regards, Rinku Garg From: Clay McDonald [mailto:stuart.mcdon...@bateswhite.com] Sent: 17 October 2013 19:09 To: Garg, Rinku Cc: user@hive.apache.org Subject: RE: Problem starting Hive Hi Rinku, I tried running hive as

RE: Problem starting Hive

2013-10-17 Thread Garg, Rinku
Hi, Try this also in hive-site property namejavax.jdo.option.ConnectionDriverName/name value com.mysql.jdbc.Driver /value descriptionDriver class name for a JDBC metastore/description /property Thanks Regards, Rinku Garg From: Clay McDonald [mailto:stuart.mcdon...@bateswhite.com] Sent:

Re: Hive Query Questions - is null in WHERE

2013-10-17 Thread Krishnan K
For string columns, null will be interpreted as an empty string and for others, it will be interpreted as null... On Wednesday, October 16, 2013, Raj Hadoop wrote: All, When a query is executed like the below select field1 from table1 where field1 is null; I am getting the results

RE: Problem starting Hive

2013-10-17 Thread Clay McDonald
Thanks Rinku, Nick, Rommel, and Eric, I think I have other issues with MySQL.. Anyway, I've got another more important fire to put out. I'll take this up again later.. Clay McDonald From: Garg, Rinku [mailto:rinku.g...@fisglobal.com] Sent: Thursday, October 17, 2013 10:03 AM To:

Re: Hive Query Questions - is null in WHERE

2013-10-17 Thread Raj Hadoop
  Thanks. It worked for me now when i use it as an empty string. From: Krishnan K kkrishna...@gmail.com To: user@hive.apache.org user@hive.apache.org; Raj Hadoop hadoop...@yahoo.com Sent: Thursday, October 17, 2013 11:11 AM Subject: Re: Hive Query Questions -

Re: Problem starting Hive

2013-10-17 Thread Selvamohan Neethiraj
Hi: Check LOG4J log file (Usaually, it is in /tmp/hive/hive.log or /tmp/${LOGNAME}/hive.log) for more details on the reason for the failure to instantiate HiveMetaStore client. If the MySQLConnection was stale due to long pause, try adding 'autoReconnect=true' option to the MySQL url

Re: Where clause position

2013-10-17 Thread Xiu Guo
Sorry for the big bomb. I tried my best to simplify the query to this: *SELECT T1.a, T1.b FROM T1 LEFT SEMI JOIN T9 ON T1.a=T9.a AND T1.b=T9.b LEFT OUTER JOIN T10 ON T1.a = T10.a AND T1.b = T10.b WHERE T1.b '0202';* Basically, without the last where clause, everything is fine. But why does

request Hive wiki write access

2013-10-17 Thread Eric Hanson (SQL SERVER)
Hi, Can I please have write access to the Hive wiki? I'm writing per the instructions here: https://cwiki.apache.org/confluence/display/Hive/AboutThisWiki. Thanks, Eric