Re: hive ORC wrong number of index entries error

2015-09-24 Thread Patrick Duin
cool thanks, will try 2015-09-24 9:32 GMT+01:00 Prasanth Jayachandran < pjayachand...@hortonworks.com>: > With 650 columns you might need to reduce the compression buffer size to > 8KB (may be try decreasing it fails or increasing it if it succeeds to find > the right size) down from default

Re: Hive Query on Hbase snapshot error

2015-09-24 Thread Sandeep Nemuri
hbase org.apache.hadoop.hbase.snapshot.SnapshotInfo -snapshot test_snapshot -stats -schema On Thu, Sep 24, 2015 at 3:43 PM, Sandeep Nemuri wrote: > You can check snapshot state if it is healthy or not using below command. > > > On Thu, Sep 24, 2015 at 2:55 PM, 核弹头す

hive.aux.jars.path and add jar for storage handler

2015-09-24 Thread Lonikar, Kiran
Hi, We have an application that creates tables with our own storage handler. It works if I set the env variable HIVE_AUX_JARS_PATH pointing to the dir containing the jar of my storage handler class. This env var needs to be set before starting HiveServer2. The alternative is to change the

Re: hive ORC wrong number of index entries error

2015-09-24 Thread Patrick Duin
Thanks for the reply, My first thought was out of memory as well but the illegal argument exception happens before it is a separate entry in the log, The OOM exception is not the cause. So I am not sure where that OOM exception fits in. I've tried running it with more memory and got the same

Re: hive ORC wrong number of index entries error

2015-09-24 Thread Prasanth Jayachandran
With 650 columns you might need to reduce the compression buffer size to 8KB (may be try decreasing it fails or increasing it if it succeeds to find the right size) down from default 256KB. You can do that by setting orc.compress.size tblproperties. On Sep 24, 2015, at 3:27 AM, Patrick Duin

Hive Query on Hbase snapshot error

2015-09-24 Thread ????????
Hi all, I am using hive to query on base snapshot. But I got the following error: FAILED: IllegalArgumentException org.apache.hadoop.hbase.snapshot.CorruptedSnapshotException: Couldn't read snapshot info from:/tmp/hbase-huser/hbase/.hbase-snapshot/test_table_snap0/.snapshotinfo The

?????? Hive Query on Hbase snapshot error

2015-09-24 Thread ????????
It seems that the snapshotDir is not correctly set. I have set the hive.hbase.snapshot.restoredir. Is the hive.hbase.snapshot.restoredir to control the snapshotDir? if not, how can i set the snapshotDir when I use hive to query on hbase snapshot. --

Re: ORA-8177 with Hive transactions

2015-09-24 Thread Steve Howard
All, We continue to struggle with this. We *never* get the lock, and found one issue in which the retry logic gets in an infinite loop. We submitted a JIRA for that (https://issues.apache.org/jira/browse/HIVE-11934), and patched our version (HDP 2.3, Hive 1.2.1) with a fix in which the

RE: ORA-8177 with Hive transactions

2015-09-24 Thread Mich Talebzadeh
Yes I came across this back in April trying to load 1.7 million rows from an RDBMS via SAP replication server into Hive My notes were “Trying to sync a table from ASE--> RS --> to Hadoop via DIRECT LOAD. The source has 1.7 million rows and is populating Hive table. However, I only get