[GitHub] hive pull request #337: HIVE-19340 : Disable timeout of transactions opened ...

2018-04-26 Thread maheshk114
GitHub user maheshk114 opened a pull request: https://github.com/apache/hive/pull/337 HIVE-19340 : Disable timeout of transactions opened by replication ta… The transactions opened by applying EVENT_OPEN_TXN should never be aborted automatically due to time-out. Aborting of

[jira] [Created] (HIVE-19341) contrib qtest shows exception in the clean up scripts

2018-04-26 Thread Haifeng Chen (JIRA)
Haifeng Chen created HIVE-19341: --- Summary: contrib qtest shows exception in the clean up scripts Key: HIVE-19341 URL: https://issues.apache.org/jira/browse/HIVE-19341 Project: Hive Issue Type:

[jira] [Created] (HIVE-19340) Disable timeout of transactions opened by replication task at target cluster

2018-04-26 Thread mahesh kumar behera (JIRA)
mahesh kumar behera created HIVE-19340: -- Summary: Disable timeout of transactions opened by replication task at target cluster Key: HIVE-19340 URL: https://issues.apache.org/jira/browse/HIVE-19340

Re: Review Request 66567: Migrate to Murmur hash for shuffle and bucketing

2018-04-26 Thread Deepak Jaiswal
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/66567/ --- (Updated April 27, 2018, 1:14 a.m.) Review request for hive, Ashutosh Chauhan,

[jira] [Created] (HIVE-19339) Regenerate alltypesorc file with latest ORC

2018-04-26 Thread Jesus Camacho Rodriguez (JIRA)
Jesus Camacho Rodriguez created HIVE-19339: -- Summary: Regenerate alltypesorc file with latest ORC Key: HIVE-19339 URL: https://issues.apache.org/jira/browse/HIVE-19339 Project: Hive

switching HiveQA to manual submission?

2018-04-26 Thread Sergey Shelukhin
Given the constant cluster with HiveQA, namely queue constantly losing or not picking up patches for whatever reason (not limited to dedup - I uploaded some patches today where there’s only one attached to the JIRA and still it didn’t get in the queue or got removed) I wonder if we should

[GitHub] hive pull request #336: Hive19135

2018-04-26 Thread alanfgates
GitHub user alanfgates opened a pull request: https://github.com/apache/hive/pull/336 Hive19135 You can merge this pull request into a Git repository by running: $ git pull https://github.com/alanfgates/hive hive19135 Alternatively you can review and apply these changes as

[jira] [Created] (HIVE-19338) isExplicitAnalyze method may be incorrect in BasicStatsTask

2018-04-26 Thread Sergey Shelukhin (JIRA)
Sergey Shelukhin created HIVE-19338: --- Summary: isExplicitAnalyze method may be incorrect in BasicStatsTask Key: HIVE-19338 URL: https://issues.apache.org/jira/browse/HIVE-19338 Project: Hive

Re: Review Request 66645: HIVE-19211: New streaming ingest API and support for dynamic partitioning

2018-04-26 Thread j . prasanth . j
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/66645/ --- (Updated April 26, 2018, 10:55 p.m.) Review request for hive, Ashutosh Chauhan

Re: Review Request 66645: HIVE-19211: New streaming ingest API and support for dynamic partitioning

2018-04-26 Thread j . prasanth . j
> On April 26, 2018, 2:09 a.m., Eugene Koifman wrote: > > itests/hive-unit/src/test/java/org/apache/hadoop/hive/ql/txn/compactor/TestCompactor.java > > Lines 426 (patched) > > > > > > This seems to switch the test

[jira] [Created] (HIVE-19337) Partition whitelist regex doesn't work (and never did)

2018-04-26 Thread Alexander Kolbasov (JIRA)
Alexander Kolbasov created HIVE-19337: - Summary: Partition whitelist regex doesn't work (and never did) Key: HIVE-19337 URL: https://issues.apache.org/jira/browse/HIVE-19337 Project: Hive

[jira] [Created] (HIVE-19336) Disable SMB/Bucketmap join for external tables

2018-04-26 Thread Jason Dere (JIRA)
Jason Dere created HIVE-19336: - Summary: Disable SMB/Bucketmap join for external tables Key: HIVE-19336 URL: https://issues.apache.org/jira/browse/HIVE-19336 Project: Hive Issue Type: Sub-task

[jira] [Created] (HIVE-19335) Disable runtime filtering (semijoin reduction opt with bloomfilter) for external tables

2018-04-26 Thread Jason Dere (JIRA)
Jason Dere created HIVE-19335: - Summary: Disable runtime filtering (semijoin reduction opt with bloomfilter) for external tables Key: HIVE-19335 URL: https://issues.apache.org/jira/browse/HIVE-19335

[jira] [Created] (HIVE-19334) Use actual file size rather than stats for fetch task optimization with external tables

2018-04-26 Thread Jason Dere (JIRA)
Jason Dere created HIVE-19334: - Summary: Use actual file size rather than stats for fetch task optimization with external tables Key: HIVE-19334 URL: https://issues.apache.org/jira/browse/HIVE-19334

[jira] [Created] (HIVE-19333) Disable operator tree branch removal using stats

2018-04-26 Thread Jason Dere (JIRA)
Jason Dere created HIVE-19333: - Summary: Disable operator tree branch removal using stats Key: HIVE-19333 URL: https://issues.apache.org/jira/browse/HIVE-19333 Project: Hive Issue Type:

[jira] [Created] (HIVE-19332) Disable compute.query.using.stats for external table

2018-04-26 Thread Jason Dere (JIRA)
Jason Dere created HIVE-19332: - Summary: Disable compute.query.using.stats for external table Key: HIVE-19332 URL: https://issues.apache.org/jira/browse/HIVE-19332 Project: Hive Issue Type:

[jira] [Created] (HIVE-19330) multi_insert_partitioned.q fails with "src table does not exist" message.

2018-04-26 Thread Steve Yeom (JIRA)
Steve Yeom created HIVE-19330: - Summary: multi_insert_partitioned.q fails with "src table does not exist" message. Key: HIVE-19330 URL: https://issues.apache.org/jira/browse/HIVE-19330 Project: Hive

[jira] [Created] (HIVE-19331) Repl load config in "with" clause not pass to Context.getStagingDir

2018-04-26 Thread Daniel Dai (JIRA)
Daniel Dai created HIVE-19331: - Summary: Repl load config in "with" clause not pass to Context.getStagingDir Key: HIVE-19331 URL: https://issues.apache.org/jira/browse/HIVE-19331 Project: Hive

[jira] [Created] (HIVE-19329) Disallow some optimizations/behaviors for external tables

2018-04-26 Thread Jason Dere (JIRA)
Jason Dere created HIVE-19329: - Summary: Disallow some optimizations/behaviors for external tables Key: HIVE-19329 URL: https://issues.apache.org/jira/browse/HIVE-19329 Project: Hive Issue Type:

[jira] [Created] (HIVE-19328) Some error messages like "table not found" are printing to STDERR

2018-04-26 Thread Aihua Xu (JIRA)
Aihua Xu created HIVE-19328: --- Summary: Some error messages like "table not found" are printing to STDERR Key: HIVE-19328 URL: https://issues.apache.org/jira/browse/HIVE-19328 Project: Hive Issue

[jira] [Created] (HIVE-19327) qroupby_rollup_empty.q fails for insert-only transactional tables

2018-04-26 Thread Steve Yeom (JIRA)
Steve Yeom created HIVE-19327: - Summary: qroupby_rollup_empty.q fails for insert-only transactional tables Key: HIVE-19327 URL: https://issues.apache.org/jira/browse/HIVE-19327 Project: Hive

[jira] [Created] (HIVE-19326) union_fast_stats golden file has incorrect "accurate" stats

2018-04-26 Thread Sergey Shelukhin (JIRA)
Sergey Shelukhin created HIVE-19326: --- Summary: union_fast_stats golden file has incorrect "accurate" stats Key: HIVE-19326 URL: https://issues.apache.org/jira/browse/HIVE-19326 Project: Hive

[jira] [Created] (HIVE-19325) Custom Hive Patch - Remove beeline -n flag in Hive 0.13.1

2018-04-26 Thread Alejandro Fernandez (JIRA)
Alejandro Fernandez created HIVE-19325: -- Summary: Custom Hive Patch - Remove beeline -n flag in Hive 0.13.1 Key: HIVE-19325 URL: https://issues.apache.org/jira/browse/HIVE-19325 Project: Hive

[jira] [Created] (HIVE-19324) improve YARN queue check error message in Tez pool

2018-04-26 Thread Sergey Shelukhin (JIRA)
Sergey Shelukhin created HIVE-19324: --- Summary: improve YARN queue check error message in Tez pool Key: HIVE-19324 URL: https://issues.apache.org/jira/browse/HIVE-19324 Project: Hive Issue

[jira] [Created] (HIVE-19323) Create metastore SQL install and upgrade scripts for 3.1

2018-04-26 Thread Alan Gates (JIRA)
Alan Gates created HIVE-19323: - Summary: Create metastore SQL install and upgrade scripts for 3.1 Key: HIVE-19323 URL: https://issues.apache.org/jira/browse/HIVE-19323 Project: Hive Issue Type:

[jira] [Created] (HIVE-19322) broken test: TestNegativeMinimrCliDriver#testCliDriver[minimr_broken_pipe]

2018-04-26 Thread Eugene Koifman (JIRA)
Eugene Koifman created HIVE-19322: - Summary: broken test: TestNegativeMinimrCliDriver#testCliDriver[minimr_broken_pipe] Key: HIVE-19322 URL: https://issues.apache.org/jira/browse/HIVE-19322 Project:

[jira] [Created] (HIVE-19321) Dynamic Partitioning Integration with Hadoop's S3A OutputCommitter

2018-04-26 Thread Sahil Takiar (JIRA)
Sahil Takiar created HIVE-19321: --- Summary: Dynamic Partitioning Integration with Hadoop's S3A OutputCommitter Key: HIVE-19321 URL: https://issues.apache.org/jira/browse/HIVE-19321 Project: Hive

[jira] [Created] (HIVE-19320) MapRedLocalTask is printing child log to stderr and stdout

2018-04-26 Thread Aihua Xu (JIRA)
Aihua Xu created HIVE-19320: --- Summary: MapRedLocalTask is printing child log to stderr and stdout Key: HIVE-19320 URL: https://issues.apache.org/jira/browse/HIVE-19320 Project: Hive Issue Type:

[jira] [Created] (HIVE-19319) RuntimeStats fixes

2018-04-26 Thread Zoltan Haindrich (JIRA)
Zoltan Haindrich created HIVE-19319: --- Summary: RuntimeStats fixes Key: HIVE-19319 URL: https://issues.apache.org/jira/browse/HIVE-19319 Project: Hive Issue Type: Sub-task

[jira] [Created] (HIVE-19318) Improve Hive logging

2018-04-26 Thread Aihua Xu (JIRA)
Aihua Xu created HIVE-19318: --- Summary: Improve Hive logging Key: HIVE-19318 URL: https://issues.apache.org/jira/browse/HIVE-19318 Project: Hive Issue Type: Improvement Components:

Re: Metastore thrift client to get the table location on hdfs

2018-04-26 Thread Alexander Kolbasov
Do you need to do this from C/C++? I have a set of tools that you can use to talk to HMS via thrift using Java, Python or Go. On Thu, Apr 26, 2018 at 5:23 AM, 侯宗田 wrote: > Hi, > > I am writing a simple thrift HMS client to get table location on hdfs, I > generate the cpp

Re: Review Request 66800: HIVE-6980 Drop table by using direct sql

2018-04-26 Thread Peter Vary via Review Board
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/66800/ --- (Updated April 26, 2018, 3:58 p.m.) Review request for hive, Alexander

[VOTE] Should we release storage-api 2.6.0 rc0?

2018-04-26 Thread Owen O'Malley
All, I'd like to make a new release of the storage-api. Artifacts: tag: https://github.com/apache/hive/releases/tag/storage-release-2.6.0-rc0 tar ball: http://home.apache.org/~omalley/storage-2.6.0/ Thanks, Owen

Re: Metastore thrift client to get the table location on hdfs

2018-04-26 Thread Alan Gates
The calls you want are in ThriftHiveMetastore.h. You can use these to get lists of tables and objects representing each table. One of the fields in the Table object is a StorageDescriptor, which has a field called 'location'. If you are working with partitioned tables the location information

Re: Review Request 66290: HIVE-14388 : Add number of rows inserted message after insert command in Beeline

2018-04-26 Thread Sahil Takiar
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/66290/#review202009 --- jdbc/src/java/org/apache/hive/jdbc/HiveStatement.java Line 712

[jira] [Created] (HIVE-19317) Handle schema evolution from int like types to decimal

2018-04-26 Thread Janaki Lahorani (JIRA)
Janaki Lahorani created HIVE-19317: -- Summary: Handle schema evolution from int like types to decimal Key: HIVE-19317 URL: https://issues.apache.org/jira/browse/HIVE-19317 Project: Hive

Hive remote databases/tables proposal

2018-04-26 Thread Elliot West
Hello, At the 2018 DataWorks conference in Berlin, Hotels.com presented Waggle Dance , a tool for federating multiple Hive clusters and providing the illusion of a unified data catalog from disparate instances. We’ve been running Waggle Dance in

[jira] [Created] (HIVE-19316) StatsTask fails due to ClassCastException

2018-04-26 Thread Rui Li (JIRA)
Rui Li created HIVE-19316: - Summary: StatsTask fails due to ClassCastException Key: HIVE-19316 URL: https://issues.apache.org/jira/browse/HIVE-19316 Project: Hive Issue Type: Bug

[jira] [Created] (HIVE-19315) Test failure org.apache.hadoop.hive.ql.lockmgr.TestDbTxnManager2#testWriteSetTracking3

2018-04-26 Thread Pravin Dsilva (JIRA)
Pravin Dsilva created HIVE-19315: Summary: Test failure org.apache.hadoop.hive.ql.lockmgr.TestDbTxnManager2#testWriteSetTracking3 Key: HIVE-19315 URL: https://issues.apache.org/jira/browse/HIVE-19315

Metastore thrift client to get the table location on hdfs

2018-04-26 Thread 侯宗田
Hi, I am writing a simple thrift HMS client to get table location on hdfs, I generate the cpp code from hive_metastore.thrift, Can someone give me some guide of how to do it next, the info I searched on the internet is too abstract and not to my need precisely.

[jira] [Created] (HIVE-19314) Fix failures caused by HIVE-19137

2018-04-26 Thread Zoltan Haindrich (JIRA)
Zoltan Haindrich created HIVE-19314: --- Summary: Fix failures caused by HIVE-19137 Key: HIVE-19314 URL: https://issues.apache.org/jira/browse/HIVE-19314 Project: Hive Issue Type: Bug

Re: Review Request 66667: HIVE-19046: Refactor the common parts of the HiveMetastore add_partition_core and add_partitions_pspec_core methods

2018-04-26 Thread Marta Kuczora via Review Board
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/7/ --- (Updated April 26, 2018, 11:18 a.m.) Review request for hive, Peter Vary,

Re: Review Request 66667: HIVE-19046: Refactor the common parts of the HiveMetastore add_partition_core and add_partitions_pspec_core methods

2018-04-26 Thread Marta Kuczora via Review Board
> On April 18, 2018, 9:52 p.m., Alexander Kolbasov wrote: > > Thanks a lot Sasha for the review! > On April 18, 2018, 9:52 p.m., Alexander Kolbasov wrote: > > standalone-metastore/src/main/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java > > Lines 3303 (patched) > >

Re: Review Request 66774: HIVE-19285: Add logs to the subclasses of MetaDataOperation

2018-04-26 Thread Marta Kuczora via Review Board
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/66774/ --- (Updated April 26, 2018, 8:16 a.m.) Review request for hive and Peter Vary.