Re: Review Request 60289: HIVE-15665 LLAP: OrcFileMetadata objects in cache can impact heap usage

2017-09-12 Thread Sergey Shelukhin
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/60289/ --- (Updated Sept. 13, 2017, 1:58 a.m.) Review request for hive, Gopal V and

[jira] [Created] (HIVE-17525) get rid of types in EncodedReaderImpl in favor of TypeDescription

2017-09-12 Thread Sergey Shelukhin (JIRA)
Sergey Shelukhin created HIVE-17525: --- Summary: get rid of types in EncodedReaderImpl in favor of TypeDescription Key: HIVE-17525 URL: https://issues.apache.org/jira/browse/HIVE-17525 Project: Hive

Re: Review Request 60289: HIVE-15665 LLAP: OrcFileMetadata objects in cache can impact heap usage

2017-09-12 Thread Sergey Shelukhin
> On Sept. 8, 2017, 6:24 p.m., Prasanth_J wrote: > > llap-server/src/java/org/apache/hadoop/hive/llap/io/metadata/ParquetMetadataCacheImpl.java > > Lines 52 (patched) > > > > > > This file looks renamed from Parquet

[jira] [Created] (HIVE-17524) instrument LLAP metadata cache with separate counters by format

2017-09-12 Thread Sergey Shelukhin (JIRA)
Sergey Shelukhin created HIVE-17524: --- Summary: instrument LLAP metadata cache with separate counters by format Key: HIVE-17524 URL: https://issues.apache.org/jira/browse/HIVE-17524 Project: Hive

[GitHub] hive pull request #249: [HIVE-17523] Fix insert into bug

2017-09-12 Thread b-slim
GitHub user b-slim opened a pull request: https://github.com/apache/hive/pull/249 [HIVE-17523] Fix insert into bug https://issues.apache.org/jira/browse/HIVE-17523 You can merge this pull request into a Git repository by running: $ git pull https://github.com/b-slim/hive

[jira] [Created] (HIVE-17523) Insert into druid table hangs Hive server2 in an infinit loop

2017-09-12 Thread slim bouguerra (JIRA)
slim bouguerra created HIVE-17523: - Summary: Insert into druid table hangs Hive server2 in an infinit loop Key: HIVE-17523 URL: https://issues.apache.org/jira/browse/HIVE-17523 Project: Hive

Re: Review Request 62091: HIVE-17386 support LLAP workload management in HS2 (low level only)

2017-09-12 Thread Sergey Shelukhin
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/62091/ --- (Updated Sept. 13, 2017, 1:04 a.m.) Review request for hive, Zhiyuan Yang,

Re: Review Request 62091: HIVE-17386 support LLAP workload management in HS2 (low level only)

2017-09-12 Thread Sergey Shelukhin
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/62091/ --- (Updated Sept. 13, 2017, 12:59 a.m.) Review request for hive, Zhiyuan Yang,

[jira] [Created] (HIVE-17522) cleanup old 'repl dump' dirs

2017-09-12 Thread Tao Li (JIRA)
Tao Li created HIVE-17522: - Summary: cleanup old 'repl dump' dirs Key: HIVE-17522 URL: https://issues.apache.org/jira/browse/HIVE-17522 Project: Hive Issue Type: Bug Components: repl

Re: Review Request 62247: HIVE-17394: AvroSerde is regenerating TypeInfo objects for each nullable Avro field for every row

2017-09-12 Thread Anthony Hsu via Review Board
> On 九月 12, 2017, 5:02 p.m., Ratandeep Ratti wrote: > > serde/src/java/org/apache/hadoop/hive/serde2/avro/AvroDeserializer.java > > Line 305 (original), 305 (patched) > > > > > > This comment is misleading now and

Re: Review Request 62247: HIVE-17394: AvroSerde is regenerating TypeInfo objects for each nullable Avro field for every row

2017-09-12 Thread Anthony Hsu via Review Board
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/62247/ --- (Updated 九月 12, 2017, 10:43 p.m.) Review request for hive, Carl Steinbach and

Re: Review Request 62091: HIVE-17386 support LLAP workload management in HS2 (low level only)

2017-09-12 Thread Sergey Shelukhin
> On Sept. 12, 2017, 6:56 p.m., Zhiyuan Yang wrote: > > ql/src/java/org/apache/hadoop/hive/ql/exec/tez/GuaranteedTasksAllocator.java > > Lines 191 (patched) > > > > > > How would AM registry help in AM recovery? If

[jira] [Created] (HIVE-17521) Improve defaults for few runtime configs

2017-09-12 Thread Ashutosh Chauhan (JIRA)
Ashutosh Chauhan created HIVE-17521: --- Summary: Improve defaults for few runtime configs Key: HIVE-17521 URL: https://issues.apache.org/jira/browse/HIVE-17521 Project: Hive Issue Type: Task

Re: Review Request 62228: HIVE-17495: CachedStore: prewarm improvements, refactoring and caching some aggregate stats

2017-09-12 Thread Daniel Dai
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/62228/#review185229 ---

Re: Review Request 62091: HIVE-17386 support LLAP workload management in HS2 (low level only)

2017-09-12 Thread Zhiyuan Yang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/62091/#review185018 --- common/src/java/org/apache/hadoop/hive/conf/HiveConf.java Lines

[jira] [Created] (HIVE-17520) Temp table with CTAS tries to create staging directory in the actual database directory

2017-09-12 Thread Jason Dere (JIRA)
Jason Dere created HIVE-17520: - Summary: Temp table with CTAS tries to create staging directory in the actual database directory Key: HIVE-17520 URL: https://issues.apache.org/jira/browse/HIVE-17520

Re: Review Request 62247: HIVE-17394: AvroSerde is regenerating TypeInfo objects for each nullable Avro field for every row

2017-09-12 Thread Ratandeep Ratti
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/62247/#review185212 ---

Re: Review Request 62247: HIVE-17394: AvroSerde is regenerating TypeInfo objects for each nullable Avro field for every row

2017-09-12 Thread Ratandeep Ratti
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/62247/#review185210 --- Ship it! LGTM - Ratandeep Ratti On Sept. 12, 2017, 3:04

Re: Review Request 62247: HIVE-17394: AvroSerde is regenerating TypeInfo objects for each nullable Avro field for every row

2017-09-12 Thread Carl Steinbach
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/62247/#review185195 --- Ship it! +1 - Carl Steinbach On Sept. 12, 2017, 3:04 p.m.,

Review Request 62247: HIVE-17394: AvroSerde is regenerating TypeInfo objects for each nullable Avro field for every row

2017-09-12 Thread Anthony Hsu via Review Board
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/62247/ --- Review request for hive, Carl Steinbach and Ratandeep Ratti. Bugs: HIVE-17394

[GitHub] hive pull request #248: HIVE-17494: Bootstrap REPL DUMP throws exception if ...

2017-09-12 Thread sankarh
GitHub user sankarh opened a pull request: https://github.com/apache/hive/pull/248 HIVE-17494: Bootstrap REPL DUMP throws exception if a partitioned table is dropped while reading partitions. You can merge this pull request into a Git repository by running: $ git pull

[jira] [Created] (HIVE-17519) Transpose column stats display

2017-09-12 Thread Zoltan Haindrich (JIRA)
Zoltan Haindrich created HIVE-17519: --- Summary: Transpose column stats display Key: HIVE-17519 URL: https://issues.apache.org/jira/browse/HIVE-17519 Project: Hive Issue Type: Improvement

[jira] [Created] (HIVE-17518) Empty stages in index_auto_update.q.out

2017-09-12 Thread Zoltan Haindrich (JIRA)
Zoltan Haindrich created HIVE-17518: --- Summary: Empty stages in index_auto_update.q.out Key: HIVE-17518 URL: https://issues.apache.org/jira/browse/HIVE-17518 Project: Hive Issue Type:

[jira] [Created] (HIVE-17517) Order explain stages in plans by stage idx

2017-09-12 Thread Zoltan Haindrich (JIRA)
Zoltan Haindrich created HIVE-17517: --- Summary: Order explain stages in plans by stage idx Key: HIVE-17517 URL: https://issues.apache.org/jira/browse/HIVE-17517 Project: Hive Issue Type:

[jira] [Created] (HIVE-17516) There is something wrong that table data size don't obviously decrease when change rcfile to orc .

2017-09-12 Thread TODD (JIRA)
TODD created HIVE-17516: --- Summary: There is something wrong that table data size don't obviously decrease when change rcfile to orc . Key: HIVE-17516 URL: https://issues.apache.org/jira/browse/HIVE-17516

Skip rows while reading data from the table

2017-09-12 Thread Pavan Kumar Prakash Savanur
Hello, I am new to Hive. Is there a way to skip rows while reading a table. For example, when I use select * from mytable, I want it to output while skipping a few rows. Thanks

CustomRecordReader in Hive query

2017-09-12 Thread Pavan Kumar Prakash Savanur
I have written a CustomRecordReader which skips records randomly. I want to write a hive query which uses my CustomRecordReader. How do i do that?

[jira] [Created] (HIVE-17515) Use SHA-256 for GenericUDFMaskHash to improve security

2017-09-12 Thread Tao Li (JIRA)
Tao Li created HIVE-17515: - Summary: Use SHA-256 for GenericUDFMaskHash to improve security Key: HIVE-17515 URL: https://issues.apache.org/jira/browse/HIVE-17515 Project: Hive Issue Type: Sub-task

[jira] [Created] (HIVE-17514) Use SHA-256 for cookie signer to improve security

2017-09-12 Thread Tao Li (JIRA)
Tao Li created HIVE-17514: - Summary: Use SHA-256 for cookie signer to improve security Key: HIVE-17514 URL: https://issues.apache.org/jira/browse/HIVE-17514 Project: Hive Issue Type: Sub-task

[jira] [Created] (HIVE-17513) Refactor PathUtils to not contain state (instance fields)

2017-09-12 Thread Tao Li (JIRA)
Tao Li created HIVE-17513: - Summary: Refactor PathUtils to not contain state (instance fields) Key: HIVE-17513 URL: https://issues.apache.org/jira/browse/HIVE-17513 Project: Hive Issue Type:

Any hooks to invoke the custom database's statistics for aggregate hive queries

2017-09-12 Thread Amey Barve
Hi All, We have developed a custom storgeHandler implementing *HiveStorageHandler*. We also have Api's/statistics for totalCount, max, min etc. for the data stored in our database. See below example queries: 1. select count(*) from my_table; 2. select max(id_column) from my_table; So for above

Re: Review Request 62228: HIVE-17495: CachedStore: prewarm improvements, refactoring and caching some aggregate stats

2017-09-12 Thread Ashutosh Chauhan
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/62228/#review185136 ---

[jira] [Created] (HIVE-17512) Not use doAs if distcp privileged user same as user running hive

2017-09-12 Thread anishek (JIRA)
anishek created HIVE-17512: -- Summary: Not use doAs if distcp privileged user same as user running hive Key: HIVE-17512 URL: https://issues.apache.org/jira/browse/HIVE-17512 Project: Hive Issue