Re: [ANNOUNCE] New Hive Committer - Thejas Nair

Congrats Thejas! On Tue, Aug 20, 2013 at 3:31 AM, Carl Steinbach c...@apache.org wrote: The Apache Hive PMC has voted to make Thejas Nair a committer on the Apache Hive project. Please join me in congratulating Thejas! -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the

Re: hcatalog takes minutes talking to mysql metadata

perhaps HIVE-4914 relevant On Wed, Aug 28, 2013 at 3:11 AM, Michał Czerwiński mic...@qubitproducts.com wrote: Also what is worth mentioning I have tried running 0.4.0-cdh4.3.0-SNAPSHOT jars (from https://repository.cloudera.com/content/groups/public/org/apache/hcatalog/hcatalog-core/) with

Re: Using Hive with WebHCat

It may be worth looking in webhcat.log and using job tracker UI On Mon, Dec 2, 2013 at 6:21 AM, Jonathan Hodges hodg...@gmail.com wrote: Hi, I have setup WebHCat that is bundled with Hive 0.11.0. I am able to kick of map reduce jobs with the REST API successfully. However I am having

Re: Using Hive with WebHCat

', 'exitValue', and 'user' files. Could these missing files be the issue? If so, how do I ensure they are created? Thanks in advance for the assistance. -Jonathan On Wed, Dec 18, 2013 at 5:15 PM, Eugene Koifman ekoif...@hortonworks.com wrote: It may be worth looking in webhcat.log

Re: WebHCat MapReduce Job Syntax

have you tried adding -d arg=-P before -d arg=/tmp/properites On Mon, Dec 30, 2013 at 11:14 AM, Jonathan Hodges hodg...@gmail.com wrote: Sorry accidentally hit send before adding the lines from webhcat.log DEBUG | 30 Dec 2013 19:08:01,042 | org.apache.hcatalog.templeton.Server | queued

Re: WebHCat MapReduce Job Syntax

the TempletonControllerJob getting kicked off and ending successfully without the Camus job starting. I didn't see any errors in the jobtracker or tasktracker logs. It just seems to silently fail and I can't figure out why. On Mon, Dec 30, 2013 at 12:35 PM, Eugene Koifman ekoif

Re: WebHCat MapReduce Job Syntax

'TrivialExecService' output in the jobtracker or tasktracker logs. We are using hive 0.11 though so maybe not set to DEBUG? On Mon, Dec 30, 2013 at 2:11 PM, Eugene Koifman ekoif...@hortonworks.comwrote: Is there any output from TrivialExecService class in any hadoop logs? (it's DEBUG level log4j output

Re: [ANNOUNCE] New Hive Committer - Vikram Dixit

Congratulations! On Mon, Jan 6, 2014 at 9:44 AM, Gunther Hagleitner ghagleit...@hortonworks.com wrote: Congratulations Vikram! Thanks, Gunther. On Mon, Jan 6, 2014 at 9:33 AM, Hari Subramaniyan hsubramani...@hortonworks.com wrote: congrats Vikram!! On Mon, Jan 6, 2014 at 9:22

Re: [ANNOUNCE] New Hive Committers - Sergey Shelukhin and Jason Dere

Congratulations Sergey and Jason! On Mon, Jan 27, 2014 at 10:58 AM, Thejas Nair the...@hortonworks.comwrote: Congrats Jason and Sergey! Well deserved! Looking forward to your help in getting the patch available counts down (its at 225 now)! On Mon, Jan 27, 2014 at 10:55 AM, Vaibhav

Re: org.apache.hadoop.hive.metastore.HiveMetaStoreClient with webhcat REST

the URL to describe a table should be .../database/dbname/table/tablename? but your exception happens before the URL problem. Have you checked templeton.hive.properties property in webhat-site.xml? does hive.metastore.uris there point at the right location for your metastore?

Re: Writing to an ORCFile using MapReduce + HCatalog APIs

If you are writing from Pig using HCatStorer you don't need to create HCatSchema. https://cwiki.apache.org/confluence/display/Hive/HCatalog+LoadStore#HCatalogLoadStore-Usage.1has examples on how to do it. So if you create a Hive table that use ORC you should be able to write your Pig cursor to

Re: WebHCat and MapReduce JAR

*remy.dubois.talend *Talend* *SA *| 9, rue Pagès - 92150 Suresnes - France | +33 1 46 25 06 00 | www.talend.com *Global Leader in Open Source Integration* [image: http://www.talend.com/sites/default/files/logo-talend.jpg] http://www.talend.com/ *De :* Eugene Koifman [mailto:ekoif

Re: [ANNOUNCE] New Hive Committer - Eugene Koifman

has voted to make Eugene Koifman a committer on the Apache Hive Project. Please join me in congratulating Eugene! Thanks. - Carl -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain

Re: [ANNOUNCE] New Hive PMC Member - Alan Gates

Congratulations! On Mon, Oct 27, 2014 at 3:51 PM, Xiaobing Zhou xz...@hortonworks.com wrote: Alan, congrats! On Mon, Oct 27, 2014 at 3:45 PM, Xuefu Zhang xzh...@cloudera.com wrote: Congratulations, Alan! On Mon, Oct 27, 2014 at 3:43 PM, Matthew McCline mmccl...@hortonworks.com

Re: [ANNOUNCE] New Hive PMC Member - Prasad Mujumdar

Congratulations! On Wed, Dec 10, 2014 at 9:17 AM, Vikram Dixit vik...@hortonworks.com wrote: Congrats Prasad! On Dec 10, 2014 8:21 AM, Naveen Gangam ngan...@cloudera.com wrote: Congratulations Prasad. Way to go. On Wed, Dec 10, 2014 at 9:39 AM, Dapeng, Sun dapeng@intel.com wrote:

Re: Can WebHCat show non-MapReduce jobs?

https://cwiki.apache.org/confluence/display/Hive/WebHCat+Reference+Jobs should produce all jobs (assuming the calling user has permissions to see them). templeton.Server.showJobList() has detailed JavaDoc From: Xiaoyong Zhu xiaoy...@microsoft.commailto:xiaoy...@microsoft.com Reply-To:

Re: Submitting via WebHCat won't put hive log into ATS?

I'm working https://issues.apache.org/jira/browse/HIVE-10066 where I plan to make all of hive-site.xml be available to webhcat's LaunchMapper so that these settings don't have to be duplicated in templeton.hive.properties. From: Lefty Leverenz

Re: UDF cannot be found when the query is submitted via templeton

can you give the complete REST call you are making to submit the query? From: Xiaoyong Zhu xiaoy...@microsoft.commailto:xiaoy...@microsoft.com Reply-To: user@hive.apache.orgmailto:user@hive.apache.org user@hive.apache.orgmailto:user@hive.apache.org Date: Sunday, April 19, 2015 at 8:23 PM To:

Re: create statement is not working

@hive.apache.org Subject: Re: create statement is not working in my case it just appeared as a hang. I understood the problem now i want to know how i can avoid this. On Sat, Apr 25, 2015 at 3:24 AM, Eugene Koifman ekoif...@hortonworks.commailto:ekoif...@hortonworks.com wrote: No, I was suggesting

Re: create statement is not working

Do you have hive.support.concurrency=true and long running insert overwrite statements running concurrently? If so, you may be hitting something something like https://issues.apache.org/jira/browse/HIVE-10242 From: Mich Talebzadeh m...@peridale.co.ukmailto:m...@peridale.co.uk Reply-To:

Re: create statement is not working

expressly so stated. It is the responsibility of the recipient to ensure that this email is virus free, therefore neither Peridale Ltd, its subsidiaries nor their employees accept any responsibility. From: Eugene Koifman [mailto:ekoif...@hortonworks.com] Sent: 24 April 2015 22:39 To: user

Re: ACID ORC file reader issue with uncompacted data

Subject: Re: ACID ORC file reader issue with uncompacted data Thanks for the heads-up and use case validation. In the case of the file names, what function does the additional id perform (presuming the first two are still transaction id bounds)? On 29 April 2015 at 18:37, Eugene Koifman ekoif

Re: FAILED: LockException [Error 10280]: Error communicating with the metastore

looking at the code, TxnHandler.checkQFileTestHack should only do anything if hive.in.test or hive.in.tez.test is true which I think is only used by unit tests From: Grant Overby (groverby) grove...@cisco.commailto:grove...@cisco.com Reply-To: user@hive.apache.orgmailto:user@hive.apache.org

Re: java.lang.NullPointerException when using INSERT INTO ORC table with ACID property

Can you provide precise table definitions (DDL, describe formatted, etc and statements you are running (with explain plan)? (the simplest version that reproduces the issue) Also your hive-site.xml. Would be even better if you file a JIRA with the same. You are clearly hitting a bug but it's

Re: hive sql on tez run forever

This isn’t a valid rewrite. if a(x,y) has 1 row (1,2) and b(x,z) has 1 row (1,1) then the 1st query will produce 1 row but the 2nd query with subselects will not. On 5/11/15, 10:13 AM, Gopal Vijayaraghavan gop...@apache.org wrote: Hi, I change the sql where condition to (where t.update_time =

Re: [ANNOUNCE] New Hive Committer - Mithun Radhakrishnan

Congrats! From: Vaibhav Gumashta vgumas...@hortonworks.commailto:vgumas...@hortonworks.com Reply-To: user@hive.apache.orgmailto:user@hive.apache.org user@hive.apache.orgmailto:user@hive.apache.org Date: Wednesday, April 15, 2015 at 5:08 PM To: user@hive.apache.orgmailto:user@hive.apache.org

Re: Create tables is blocked while there are queries executing in a specific database in Hive

Do you have hive.txn.manager=org.apache.hadoop.hive.ql.lockmgr.DbTxnManager in addition to hive.support.concurrency=true? if so you may be hitting https://issues.apache.org/jira/browse/HIVE-10242. From: Guillermo Ortiz konstt2...@gmail.commailto:konstt2...@gmail.com Reply-To:

Re: Concurrency issue, Setting hive.txn.manager to org.apache.hadoop.hive.ql.lockmgr.DbTxnManager

can you check that the schema in your metastore db has transaction related tables? You can find the list of tables in hive-txn-schema-0.14.0.mysql.sql, for example. From: Mich Talebzadeh m...@peridale.co.ukmailto:m...@peridale.co.uk Reply-To: user@hive.apache.orgmailto:user@hive.apache.org

Re: hive -e run tez query error

perhaps deleteOnExit() is set somewhere From: Jeff Zhang zjf...@gmail.commailto:zjf...@gmail.com Reply-To: User user@hive.apache.orgmailto:user@hive.apache.org Date: Thursday, June 25, 2015 at 2:09 AM To: User user@hive.apache.orgmailto:user@hive.apache.org Subject: Re: hive -e run tez query

Re: delta file compact take no effect

Delta files that are no longer needed are deleted asynchronously. For example, you may have some query using delta_002_002. A minor compaction, for example, can run concurrently and create delta_001_003 but it will leave delta_001_001, delta_002_002,

Re: locks are held on tables even when no job running

Mich, how were you running/killing the job? was it ^C of CLI or something else? (The only time you’d get Exclusive lock is to drop an object. (With DbTxnManager which looks like what you are using)) The locks will timeout but https://issues.apache.org/jira/browse/HIVE-11317 may be relevant.

Re: Locking when using the Metastore/HCatalog APIs.

Wouldn't it make more sense for the api to acquire required locks automatically? That seems like a simpler user model. From: Alan Gates > Reply-To: "user@hive.apache.org"

Re: DML operations and transactions in Hive

https://cwiki.apache.org/confluence/display/Hive/Hive+Transactions describes this in detail Assuming all tables in the query are ACID tables, then reads are consistent. ACID is supported by MVCC architecture at the storage layer (ORC). Locking is at partition level. If one statement is trying

Re: hive transaction strange behaviour

see the Base file created in one of the partition, seems the Compactor kicked in and created it but it has not created base files in rest of the partition where delta files still exists.why compactor has not picked the other partition, when and how these partition will be picked up for c

Re: hive transaction strange behaviour

When Compaction process runs, it will create base directory. https://cwiki.apache.org/confluence/display/Hive/Hive+Transactions#HiveTransactions-Configuration at a minimum you need

Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan

Congrats! From: Pengcheng Xiong > Reply-To: "user@hive.apache.org" > Date: Wednesday, September 16, 2015 at 1:23 PM To: "user@hive.apache.org"

Re: UPDATE and DELETE fail due to Error 10122 on Hive 1.2.1

use 'transactional', I.e. lower case From: , Jian-bing > Reply-To: "user@hive.apache.org" > Date: Monday, September 7, 2015 at 11:58 PM To:

Re: Transaction deadlocks

could you file a Jira for this please? From: Eugene Koifman <ekoif...@hortonworks.com<mailto:ekoif...@hortonworks.com>> Reply-To: "user@hive.apache.org<mailto:user@hive.apache.org>" <user@hive.apache.org<mailto:user@hive.apache.org>> Date: Wednesday,

Re: Transaction deadlocks

What version of Hive are you running? In the current codebase at least, TxnHandler.checkRetryable() keeps track of how many retries it allowed – it will not retry forever. From: Steve Howard > Reply-To:

Re: Adding a new column to a table and updating it

Schema evolution is not supported for Acid tables. https://issues.apache.org/jira/browse/HIVE-11981 fixes it but hasn't been released yet. There is no quick way to recover data. You could write a script to use ORC FileDump utility to look at actual files in the table to group them into sets

Re: Adding a new column to a table and updating it

ould destroy it immediately. Any information in this message shall not be understood as given or endorsed by Peridale Technology Ltd, its subsidiaries or their employees, unless expressly so stated. It is the responsibility of the recipient to ensure that this email is virus free, therefore neithe

Re: Synchronizing Hive metastores across clusters

Metastore supports MetaStoreEventListener and MetaStorePreEventListener which may be useful here Eugene From: Elliot West > Reply-To: "user@hive.apache.org" > Date:

Re: Hive 1.2.1 and concurrency

This doesn't directly answer the question but may be useful. The tables in hive-txn.schema-* are only relevant if hive.txn.manager=org.apache.hadoop.hive.ql.lockmgr.DbTxnManager and hive.suport.concurrency=true. If you only set hive.suport.concurrency=true, you'll be using the lock manager set

Re: Connection between TempletonJob and Worker Nodes remains in FIN_WAIT_2 state for long time

https://cwiki.apache.org/confluence/display/Hive/WebHCat+Reference+Hive lets you submit a file with SQL statements Eugene On 12/11/15, 4:09 PM, "mahender bigdata" wrote: >Hi, >We have submitted too many jobs to webhcat (templeton) reason is our HQL >has multiple

Re: [ANNOUNCE] New PMC Member : John Pullokkaran

Congrats! From: Sergey Shelukhin > Reply-To: "user@hive.apache.org" > Date: Tuesday, November 24, 2015 at 3:13 PM To:

Re: Need you Expert inputs

instead of using " SET hive.txn.manager = org.apache.hadoop.hive.ql.lockmgr.DbTxnManager" can add these props to your hive-site.xml and try again? Eugene From: Mahender SNPC > Reply-To:

Re: hive transaction strange behaviour

unning on other tables/partitions, things must be configured properly. If you use Alter Table to launch compaction, it should just do it, w/o paying attention to thresholds. From: Eugene Koifman <ekoif...@hortonworks.com<mailto:ekoif...@hortonworks.com>> Reply-To: "user@hive

Re: Delete hive partition while executing query.

a lock true On Tue, Jun 7, 2016 at 9:01 PM, Alan Gates <alanfga...@gmail.com<mailto:alanfga...@gmail.com>> wrote: Eugene Koifman pointed out to me that there is one other possibility. If we ignore query 3 for a minute, I can explain this with the following timeline: 1) Query one requests and

Re: Creating a Hive table through Spark and potential locking issue (a bug)

in a single transaction i.e. --> create table A as select * from b HTH Dr Mich Talebzadeh LinkedIn https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw http://talebzadehmich.wordpress.com<http://talebzadehmich.wordpress.com/> On 8 June 2016 at 23:35,

Re: Creating a Hive table through Spark and potential locking issue (a bug)

ilto:user@hive.apache.org>> Cc: David Newberger <david.newber...@wandcorp.com<mailto:david.newber...@wandcorp.com>>, "user @spark" <u...@spark.apache.org<mailto:u...@spark.apache.org>> Subject: Re: Creating a Hive table through Spark and potential locking issue (a bug)

Re: Creating a Hive table through Spark and potential locking issue (a bug)

if you split “create table test.dummy as select * from oraclehadoop.dummy;” into create table statement, followed by insert into test.dummy as select… you should see the behavior you expect with Hive. Drop statement will block while insert is running. Eugene From: Mich Talebzadeh

Re: [ANNOUNCE] New Hive Committer - Wei Zheng

Congratulations! From: Hari Sivarama Subramaniyan > Reply-To: "user@hive.apache.org" > Date: Thursday, March 10, 2016 at 10:02 AM To:

Re: Error selecting from a Hive ORC table in Spark-sql

The system thinks t2 is an Acid table but the files on disk don’t follow the convention acid system would expect. Perhaps Xuefu Zhang would know more on Spark/Aicd integration. From: Mich Talebzadeh > Reply-To:

Re: Hive sink for Flume, hcatalog error: 'transactional' property is not set on Table

Perhaps you've already seen this https://cwiki.apache.org/confluence/display/Hive/Streaming+Data+Ingest and https://cwiki.apache.org/confluence/display/Hive/Hive+Transactions In order to configure Hive properly to stream

Re: Hive compaction didn't launch

I think Storm has some timeout parameter that will close the transaction if there are no events for a certain amount of time. How many transactions do you per transaction batch? Perhaps making the batches smaller will make them close sooner. Eugene On 7/28/16, 3:59 PM, "Alan Gates"

Re: Hive compaction didn't launch

ven if batch size is 1, after flushing the data Storm will get another transaction batch and will wait new messages, which may not come for a long time. I don't see any way to fix this problem with proper configuration, I need to make changes in Hive or Storm code. Question is where it more appropriate?

Re: Compactions doesn't launch on Hive 1.1.0

As Gopal said, you have to run a standalone metastore process for compactor to work. More on that in https://cwiki.apache.org/confluence/display/Hive/AdminManual+MetastoreAdmin#AdminManualMetastoreAdmin-RemoteMetastoreServer. Please note that the transaction specific configuration properties in

Re: Hive transaction doesn't release lock.

your query is "select * from HIVE_LOCKS" but the output is not from HIVE_LOCKS. What entries do you have in HIVE_LOCKS for this txn_id? If all you see is an entry in TXN table in 'a' state - that is OK. that just mean that this transaction was aborted. Eugene From: Igor Kuzmenko

Re: populating Hive table periodically from files on HDFS

Have you considered Hive Streaming? (https://cwiki.apache.org/confluence/display/Hive/Streaming+Data+Ingest) It's built for exactly such use case. Both Flume and Storm are integrated with it and write directly to your target table. Eugene From: Mich Talebzadeh

Re: Reading hive-site.xml

HiveConf.java From: Amit Bajpai > Reply-To: "user@hive.apache.org" > Date: Sunday, September 18, 2016 at 4:57 PM To:

Re: Concurrency support of Apache Hive for streaming data ingest at 7K RPS into multiple tables

Hive streaming API (which is what Storm uses) inserts multiple evens to a table per transaction. It has been designed for this but not quite ready for prime time in 0.14. Hive 1.3 has these metastore issues fixed as well as many others.

Re: Hive transaction doesn't release lock.

61824 db:default table:data_http partition:dt=20160821 state:WAITING type:SHARED_READ So I guess, that it's race condition between heartbeat thread and TxnReaper thread. Last heartbeat information in HIVE_LOCKS table differs from TXNS table. Full log here<https://drive.google.com/open?i

Re: populating Hive table periodically from files on HDFS

rise from relying on this email's technical content is explicitly disclaimed. The author will in no case be liable for any monetary damages arising from such loss, damage or destruction. On 26 September 2016 at 04:50, Eugene Koifman <ekoif...@hortonworks.com<mailto:ekoif...@hortonworks

Re: hive transactional table compaction fails

th all of them. > >Both manual/auto compactor fails. > >On Wed, Oct 26, 2016 at 12:52 AM, Eugene Koifman ><ekoif...@hortonworks.com> wrote: >> does this happen for 1 specific partition or all of them? >> >> On 10/25/16, 12:47 AM, "aft" <aft...@gma

Re: Error with flush_length File in Orc, in hive 2.1.0 and mr execution engine.

Which of your tables are are transactional? Can you provide the DDL? I don’t think “File does not exist” error is causing your queries to fail. It’s an INFO level msg. There should be some other error. Eugene From: satyajit vegesna

Re: hive transactional table compaction fails

can you check if the user that the metastore is running as has right to write to the table dir? On 10/26/16, 12:23 PM, "aft" <aft...@gmail.com> wrote: >On Thu, Oct 27, 2016 at 12:00 AM, Eugene Koifman ><ekoif...@hortonworks.com> wrote: >> could you provide ou

Re: hive transactional table compaction fails

does this happen for 1 specific partition or all of them? On 10/25/16, 12:47 AM, "aft" wrote: >Hi, > >Table created with this : > >$hive>create table syslog_staged (id string, facility string, >sender string, severity string, tstamp string, service string, msg >string)

Re: Error with flush_length File in Orc, in hive 2.1.0 and mr execution engine.

hive.apache.org<mailto:user@hive.apache.org>>, Eugene Koifman <ekoif...@hortonworks.com<mailto:ekoif...@hortonworks.com>> Cc: "d...@hive.apache.org<mailto:d...@hive.apache.org>" <d...@hive.apache.org<mailto:d...@hive.apache.org>> Subject: Re: E

Re: Problems with Hive Streaming. Compactions not working. Out of memory errors.

The OOM is most likely a side effect of not running compactions. W/o compactions you never reduce the number of delta file that need to be loaded to materialize the data set on read. On 11/29/16, 10:03 AM, "Alan Gates" wrote: >I¹m guessing that this is an issue in the

Re: Storm hive bolt

https://community.hortonworks.com/questions/59681/puthivestreaming-nifi-processor-various-errors.html has 2016-10-03 23:40:24,322 ERROR [pool-5-thread-114]: metastore.RetryingHMSHandler (RetryingHMSHandler.java:invokeInternal(195)) - java.lang.IllegalStateException: Unexpected

Re: Hive TxnHandler::lock method run into dead lock.

e.org> Subject: Re: Hive TxnHandler::lock method run into dead lock. I increased maxConnections up to 50 and recompiled metastore jar. Its gonna be enough for a while. Eugene, do you know is there any Jira item on this problem? On Sun, Mar 26, 2017 at 7:21 PM, Eugene Koifman

Re: Hive TxnHandler::lock method run into dead lock.

actionIsolation = -1; metricsTrackerClassName = "com.zaxxer.hikari.metrics.CodaHaleMetricsTracker"; customizer = new IConnectionCustomizer() { @Override public void customize(Connection connection) throws SQLException { } }; } On Thu, Mar 23, 2017 at 8:29 PM, Eugene Koifman <ekoif...@hortonw

Re: Storm hive bolt

It maybe because you are mixing artifacts from HDP/F and Apache when compiling the topology. Can you try using http://repo.hortonworks.com/content/groups/public/org/apache/storm/storm-hive/1.0.1.2.0.1.0-12/ Rather than  org.apache.storm storm-hive 1.0.3 Eugene On 3/29/17, 9:47 AM,

Re: Hive TxnHandler::lock method run into dead lock.

Can you try use “hikaricp” connection pool manager? It seems to be using default which is no limit. Eugene From: Igor Kuzmenko Reply-To: "user@hive.apache.org" Date: Monday, March 20, 2017 at 2:17 PM To: "user@hive.apache.org"

Re: Non-local session path expected to be non-null trying to write on Hive using storm-hive

DP 2.5) which shouldn't they be compatible? Any suggestion? 2017-07-10 20:02 GMT+02:00 Eugene Koifman <ekoif...@hortonworks.com<mailto:ekoif...@hortonworks.com>>: Are you able to write to Hive to an existing partition? (The stack trace shows that it’s being created) From: Federico D'Am

Re: Non-local session path expected to be non-null trying to write on Hive using storm-hive

Are you able to write to Hive to an existing partition? (The stack trace shows that it’s being created) From: Federico D'Ambrosio Reply-To: "d...@hive.apache.org" Date: Monday, July 10, 2017 at 7:38 AM To: "user@hive.apache.org"

Re: ORC Transaction Table - Spark

Could you do recursive “ls” in your table or partition that you are trying to read? Most likely you have files that don’t follow expected naming convention Eugene From: Aviral Agarwal Reply-To: "user@hive.apache.org" Date: Tuesday, August 22, 2017

Re: Hive locking mechanism on read partition.

; <user@hive.apache.org> Subject: Re: Hive locking mechanism on read partition. Hi, Eugene. Tables are not transactional and locks are backed by DbTxnManager. On Fri, Oct 13, 2017 at 2:30 AM, Eugene Koifman <ekoif...@hortonworks.com<mailto:ekoif...@hortonworks.com>> wrote:

Re: ORC Transaction Table - Spark

user@hive.apache.org" <user@hive.apache.org> Subject: Re: ORC Transaction Table - Spark Hi, Yes it caused by wrong naming convention of the delta directory : /apps/hive/warehouse/foo.db/bar/year=2017/month=5/delta_0645253_0645253_0001 How do I solve this ? Thanks ! Aviral Agarwal On

Re: Hive locking mechanism on read partition.

Which lock manager are you using? Do you have acid enabled and if so are these tables transactional? Eugene From: Igor Kuzmenko Reply-To: "user@hive.apache.org" Date: Thursday, October 12, 2017 at 3:58 AM To: "user@hive.apache.org"

Re: Hive beeline and ACID tables.

“This command is not allowed on an ACID table analytics_user_vws.liveramp_events with a non-ACID transaction manager.” Indicates that “hive.txn.manager=org.apache.hadoop.hive.ql.lockmgr.DbTxnManager” is not taking effect. When enabling acid you usually want to set this (and other relevant

Re: ORC ACID table returning Array Index Out of Bounds

What version of Hive is this? Can you isolate this to a specific partition? The table/partition you are reading should have a directory called base_x/ with several bucket_N files. (if you see more than 1 base_x, take one with highest x) Each bucket_N should have a

Re: Does MERGE feature works only on TEZ in Hive-2.3?

It works on MR as well. From: Oleksiy S Reply-To: "user@hive.apache.org" Date: Wednesday, April 18, 2018 at 5:24 AM To: "user@hive.apache.org" , "d...@hive.apache.org" Subject: Does MERGE feature

Re: Hive Compaction OOM

hive.compactor.max.num.delta This lets control how many deltas are opened at once. By default it’s 500 which may be too much. So the compactor will use this do exactly what Owen is suggesting. The current impl will do everything sequentially but better than OOM. Eugene From: Owen O'Malley