[jira] [Commented] (HIVE-15848) count or sum distinct incorrect when hive.optimize.reducededuplication set to true

2017-02-23 Thread Zoltan Haindrich (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15882170#comment-15882170 ] Zoltan Haindrich commented on HIVE-15848: - this bug is present on the current master branch >

[jira] [Assigned] (HIVE-15848) count or sum distinct incorrect when hive.optimize.reducededuplication set to true

2017-02-23 Thread Zoltan Haindrich (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoltan Haindrich reassigned HIVE-15848: --- Assignee: Zoltan Haindrich > count or sum distinct incorrect when

[jira] [Commented] (HIVE-15882) HS2 generating high memory pressure with many partitions and concurrent queries

2017-02-23 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15882157#comment-15882157 ] Rui Li commented on HIVE-15882: --- The patch looks good to me overall. I left some minor comments on the RB.

[jira] [Commented] (HIVE-6590) Hive does not work properly with boolean partition columns (wrong results and inserts to incorrect HDFS path)

2017-02-23 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15882155#comment-15882155 ] Ashutosh Chauhan commented on HIVE-6590: I looked the spec. Section 6.13 clearly says only strings

[jira] [Commented] (HIVE-14731) Use Tez cartesian product edge in Hive (unpartitioned case only)

2017-02-23 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15882138#comment-15882138 ] Hive QA commented on HIVE-14731: Here are the results of testing the latest attachment:

[jira] [Updated] (HIVE-15708) Upgrade calcite version to 1.12

2017-02-23 Thread Remus Rusanu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Remus Rusanu updated HIVE-15708: Attachment: HIVE-15708.10.patch 10.patch consumes CALCITE-1653 {{RexExecutor}} changes > Upgrade

[jira] [Commented] (HIVE-16014) HiveMetastoreChecker should use hive.metastore.fshandler.threads instead of hive.mv.files.thread for pool size

2017-02-23 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15882053#comment-15882053 ] Hive QA commented on HIVE-16014: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-15958) LLAP: IPC connections are not being reused for umbilical protocol

2017-02-23 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881998#comment-15881998 ] Hive QA commented on HIVE-15958: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-15879) Fix HiveMetaStoreChecker.checkPartitionDirs method

2017-02-23 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881994#comment-15881994 ] Hive QA commented on HIVE-15879: Here are the results of testing the latest attachment:

[jira] [Comment Edited] (HIVE-16006) Incremental REPL LOAD doesn't operate on the target database if name differs from source database.

2017-02-23 Thread Sushanth Sowmyan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881988#comment-15881988 ] Sushanth Sowmyan edited comment on HIVE-16006 at 2/24/17 5:24 AM: --

[jira] [Commented] (HIVE-16006) Incremental REPL LOAD doesn't operate on the target database if name differs from source database.

2017-02-23 Thread Sushanth Sowmyan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881988#comment-15881988 ] Sushanth Sowmyan commented on HIVE-16006: - [~sankarh], good catch on the issue for the target name

[jira] [Commented] (HIVE-15993) Hive REPL STATUS is not returning last event ID

2017-02-23 Thread Sankar Hariappan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881987#comment-15881987 ] Sankar Hariappan commented on HIVE-15993: - Thanks a lot [~sushanth]! > Hive REPL STATUS is not

[jira] [Updated] (HIVE-16006) Incremental REPL LOAD doesn't operate on the target database if name differs from source database.

2017-02-23 Thread Sushanth Sowmyan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sushanth Sowmyan updated HIVE-16006: Issue Type: Sub-task (was: Bug) Parent: HIVE-14841 > Incremental REPL LOAD doesn't

[jira] [Updated] (HIVE-15993) Hive REPL STATUS is not returning last event ID

2017-02-23 Thread Sushanth Sowmyan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sushanth Sowmyan updated HIVE-15993: Resolution: Fixed Fix Version/s: 2.2.0 Status: Resolved (was: Patch

[jira] [Commented] (HIVE-15993) Hive REPL STATUS is not returning last event ID

2017-02-23 Thread Sushanth Sowmyan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881962#comment-15881962 ] Sushanth Sowmyan commented on HIVE-15993: - Verified, HIVE-15333 fixed the same issue for REPL

[jira] [Updated] (HIVE-15993) Hive REPL STATUS is not returning last event ID

2017-02-23 Thread Sushanth Sowmyan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sushanth Sowmyan updated HIVE-15993: Issue Type: Sub-task (was: Bug) Parent: HIVE-14841 > Hive REPL STATUS is not

[jira] [Updated] (HIVE-16033) LLAP: Use PrintGCDateStamps for gc logging

2017-02-23 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-16033: - Status: Open (was: Patch Available) No unit tests are required for this > LLAP:

[jira] [Updated] (HIVE-16033) LLAP: Use PrintGCDateStamps for gc logging

2017-02-23 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-16033: - Status: Patch Available (was: Open) > LLAP: Use PrintGCDateStamps for gc logging

[jira] [Updated] (HIVE-16033) LLAP: Use PrintGCDateStamps for gc logging

2017-02-23 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-16033: - Attachment: HIVE-16033.1.patch [~sseth] can you please take a look? > LLAP: Use

[jira] [Assigned] (HIVE-16033) LLAP: Use PrintGCDateStamps for gc logging

2017-02-23 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran reassigned HIVE-16033: > LLAP: Use PrintGCDateStamps for gc logging >

[jira] [Commented] (HIVE-16028) Fail UPDATE/DELETE/MERGE queries when Ranger authorization manager is used

2017-02-23 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881901#comment-15881901 ] Hive QA commented on HIVE-16028: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-15903) Compute table stats when user computes column stats

2017-02-23 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881849#comment-15881849 ] Hive QA commented on HIVE-15903: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-16032) MM tables: encrypted/(minimr?) CLI driver + fetch optimizer => no results

2017-02-23 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881846#comment-15881846 ] Sergey Shelukhin commented on HIVE-16032: - Interestingly, even on master, runTasks when executing

[jira] [Assigned] (HIVE-16032) MM tables: encrypted/(minimr?) CLI driver + fetch optimizer => no results

2017-02-23 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin reassigned HIVE-16032: --- > MM tables: encrypted/(minimr?) CLI driver + fetch optimizer => no results >

[jira] [Updated] (HIVE-15668) change REPL DUMP syntax to use "LIMIT" instead of "BATCH" keyword

2017-02-23 Thread Sushanth Sowmyan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sushanth Sowmyan updated HIVE-15668: Resolution: Fixed Fix Version/s: 2.2.0 Status: Resolved (was: Patch

[jira] [Commented] (HIVE-15668) change REPL DUMP syntax to use "LIMIT" instead of "BATCH" keyword

2017-02-23 Thread Sushanth Sowmyan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881835#comment-15881835 ] Sushanth Sowmyan commented on HIVE-15668: - Thanks, Thejas. Committed to master. > change REPL

[jira] [Comment Edited] (HIVE-15879) Fix HiveMetaStoreChecker.checkPartitionDirs method

2017-02-23 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881827#comment-15881827 ] Rajesh Balamohan edited comment on HIVE-15879 at 2/24/17 2:53 AM: -- Thanks

[jira] [Commented] (HIVE-15879) Fix HiveMetaStoreChecker.checkPartitionDirs method

2017-02-23 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881827#comment-15881827 ] Rajesh Balamohan commented on HIVE-15879: - Thanks for sharing the details [~vihangk1]. I have a

[jira] [Updated] (HIVE-16004) OutOfMemory in SparkReduceRecordHandler with vectorization mode

2017-02-23 Thread Ferdinand Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ferdinand Xu updated HIVE-16004: Resolution: Fixed Fix Version/s: 2.2.0 Status: Resolved (was: Patch Available)

[jira] [Commented] (HIVE-16014) HiveMetastoreChecker should use hive.metastore.fshandler.threads instead of hive.mv.files.thread for pool size

2017-02-23 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881805#comment-15881805 ] Hive QA commented on HIVE-16014: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-15856) Hive export/import (hive.exim.uri.scheme.whitelist) to support s3a

2017-02-23 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881798#comment-15881798 ] John Zhuge commented on HIVE-15856: --- With [~stakiar]'s help, I was able to run {{hive-blobstore}} itests

[jira] [Commented] (HIVE-15882) HS2 generating high memory pressure with many partitions and concurrent queries

2017-02-23 Thread Misha Dmitriev (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881788#comment-15881788 ] Misha Dmitriev commented on HIVE-15882: --- [~lirui] sure - the RB for the first change (string

[jira] [Commented] (HIVE-13864) Beeline ignores the command that follows a semicolon and comment

2017-02-23 Thread Yongzhi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881784#comment-15881784 ] Yongzhi Chen commented on HIVE-13864: - The failures are not related. > Beeline ignores the command

[jira] [Commented] (HIVE-15743) vectorized text parsing: speed up double parse

2017-02-23 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881743#comment-15881743 ] Sergey Shelukhin commented on HIVE-15743: - Hmm... should this be committed? > vectorized text

[jira] [Issue Comment Deleted] (HIVE-15924) move ORC PPD failure message caused by a dynamic value to DEBUG level

2017-02-23 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-15924: Comment: was deleted (was: +1. is it necessary to log the exception? I noticed that for the

[jira] [Commented] (HIVE-15879) Fix HiveMetaStoreChecker.checkPartitionDirs method

2017-02-23 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881740#comment-15881740 ] Ashutosh Chauhan commented on HIVE-15879: - cc: [~rajesh.balamohan] [~pxiong] > Fix

[jira] [Commented] (HIVE-15924) move ORC PPD failure message caused by a dynamic value to DEBUG level

2017-02-23 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881741#comment-15881741 ] Sergey Shelukhin commented on HIVE-15924: - +1. is it necessary to log the exception? I noticed

[jira] [Updated] (HIVE-15924) move ORC PPD failure message caused by a dynamic value to DEBUG level

2017-02-23 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-15924: Status: Patch Available (was: Open) > move ORC PPD failure message caused by a dynamic

[jira] [Commented] (HIVE-15882) HS2 generating high memory pressure with many partitions and concurrent queries

2017-02-23 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881733#comment-15881733 ] Rui Li commented on HIVE-15882: --- Thanks [~mi...@cloudera.com] for the benchmark results. It looks promising.

[jira] [Commented] (HIVE-16022) BloomFilter check not showing up in MERGE statement queries

2017-02-23 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881719#comment-15881719 ] Hive QA commented on HIVE-16022: Here are the results of testing the latest attachment:

[jira] [Updated] (HIVE-14990) run all tests for MM tables and fix the issues that are found

2017-02-23 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-14990: Attachment: HIVE-14990.14.patch The patch again, after fixing a bug introduced during the

[jira] [Commented] (HIVE-15964) LLAP: Llap IO codepath not getting invoked due to file column id mismatch

2017-02-23 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881701#comment-15881701 ] Rajesh Balamohan commented on HIVE-15964: - committed the addendum patch in master. > LLAP: Llap

[jira] [Updated] (HIVE-14901) HiveServer2: Use user supplied fetch size to determine #rows serialized in tasks

2017-02-23 Thread Norris Lee (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Norris Lee updated HIVE-14901: -- Status: Patch Available (was: In Progress) > HiveServer2: Use user supplied fetch size to determine

[jira] [Updated] (HIVE-14901) HiveServer2: Use user supplied fetch size to determine #rows serialized in tasks

2017-02-23 Thread Norris Lee (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Norris Lee updated HIVE-14901: -- Status: In Progress (was: Patch Available) > HiveServer2: Use user supplied fetch size to determine

[jira] [Updated] (HIVE-14901) HiveServer2: Use user supplied fetch size to determine #rows serialized in tasks

2017-02-23 Thread Norris Lee (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Norris Lee updated HIVE-14901: -- Attachment: HIVE-14901.6.patch > HiveServer2: Use user supplied fetch size to determine #rows

[jira] [Assigned] (HIVE-16017) MM tables - many queries duplicate the data after master merge

2017-02-23 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin reassigned HIVE-16017: --- Assignee: Sergey Shelukhin > MM tables - many queries duplicate the data after

[jira] [Updated] (HIVE-16017) MM tables - many queries duplicate the data after master merge

2017-02-23 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-16017: Fix Version/s: hive-14535 > MM tables - many queries duplicate the data after master merge

[jira] [Resolved] (HIVE-16017) MM tables - many queries duplicate the data after master merge

2017-02-23 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin resolved HIVE-16017. - Resolution: Fixed Stupid merge issue in Utilities... > MM tables - many queries

[jira] [Commented] (HIVE-16029) COLLECT_SET and COLLECT_LIST does not return NULL in the result

2017-02-23 Thread Eric Lin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881671#comment-15881671 ] Eric Lin commented on HIVE-16029: - Review request sent: https://reviews.apache.org/r/57009/ > COLLECT_SET

[jira] [Updated] (HIVE-15964) LLAP: Llap IO codepath not getting invoked due to file column id mismatch

2017-02-23 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15964: Attachment: HIVE-15964.addendum.patch Yes [~prasanth_j]. Attaching the addendum patch for

[jira] [Updated] (HIVE-15935) ACL is not set in ATS data

2017-02-23 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated HIVE-15935: -- Attachment: HIVE-15935.4.patch Rebase after HIVE-15830. > ACL is not set in ATS data >

[jira] [Commented] (HIVE-13864) Beeline ignores the command that follows a semicolon and comment

2017-02-23 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881632#comment-15881632 ] Hive QA commented on HIVE-13864: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-16023) Wrong estimation for number of rows generated by IN expression

2017-02-23 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881601#comment-15881601 ] Ashutosh Chauhan commented on HIVE-16023: - +1 All the log messages should be at debug(). Also log

[jira] [Commented] (HIVE-16018) Add more information for DynamicPartitionPruningOptimization

2017-02-23 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881570#comment-15881570 ] Ashutosh Chauhan commented on HIVE-16018: - +1 > Add more information for

[jira] [Updated] (HIVE-16018) Add more information for DynamicPartitionPruningOptimization

2017-02-23 Thread Pengcheng Xiong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pengcheng Xiong updated HIVE-16018: --- Status: Patch Available (was: Open) address [~ashutoshc]'s comments. > Add more information

[jira] [Updated] (HIVE-16018) Add more information for DynamicPartitionPruningOptimization

2017-02-23 Thread Pengcheng Xiong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pengcheng Xiong updated HIVE-16018: --- Attachment: HIVE-16018.02.patch > Add more information for

[jira] [Updated] (HIVE-16018) Add more information for DynamicPartitionPruningOptimization

2017-02-23 Thread Pengcheng Xiong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pengcheng Xiong updated HIVE-16018: --- Status: Open (was: Patch Available) > Add more information for

[jira] [Commented] (HIVE-15944) The order of cols is error in ColumnPrunerReduceSinkProc because of sort operator

2017-02-23 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881555#comment-15881555 ] Hive QA commented on HIVE-15944: Here are the results of testing the latest attachment:

[jira] [Updated] (HIVE-15958) LLAP: IPC connections are not being reused for umbilical protocol

2017-02-23 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-15958: - Attachment: HIVE-15958.4.patch AMNodeInfo cleanup is done after sending kill for

[jira] [Assigned] (HIVE-16030) LLAP: All rolled over logs should be compressed

2017-02-23 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran reassigned HIVE-16030: > LLAP: All rolled over logs should be compressed >

[jira] [Commented] (HIVE-16018) Add more information for DynamicPartitionPruningOptimization

2017-02-23 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881531#comment-15881531 ] Ashutosh Chauhan commented on HIVE-16018: - Wrap these calls in

[jira] [Updated] (HIVE-16029) COLLECT_SET and COLLECT_LIST does not return NULL in the result

2017-02-23 Thread Eric Lin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Lin updated HIVE-16029: Attachment: HIVE-16029.patch Adding first patch. > COLLECT_SET and COLLECT_LIST does not return NULL in

[jira] [Updated] (HIVE-16029) COLLECT_SET and COLLECT_LIST does not return NULL in the result

2017-02-23 Thread Eric Lin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Lin updated HIVE-16029: Status: Patch Available (was: Open) > COLLECT_SET and COLLECT_LIST does not return NULL in the result >

[jira] [Commented] (HIVE-15964) LLAP: Llap IO codepath not getting invoked due to file column id mismatch

2017-02-23 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881528#comment-15881528 ] Prasanth Jayachandran commented on HIVE-15964: -- [~rajesh.balamohan] orc_ppd_schema_evol_3a.q

[jira] [Updated] (HIVE-16005) miscellaneous small fixes to help with llap debuggability

2017-02-23 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-16005: -- Attachment: HIVE-16005.03.patch Updated to fix the unit tests. > miscellaneous small fixes to

[jira] [Commented] (HIVE-16024) MSCK Repair Requires nonstrict hive.mapred.mode

2017-02-23 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881462#comment-15881462 ] Hive QA commented on HIVE-16024: Here are the results of testing the latest attachment:

[jira] [Updated] (HIVE-15951) Make sure base persist directory is unique and deleted

2017-02-23 Thread slim bouguerra (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] slim bouguerra updated HIVE-15951: -- Status: Patch Available (was: In Progress) > Make sure base persist directory is unique and

[jira] [Updated] (HIVE-16020) LLAP : Reduce IPC connection misses

2017-02-23 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-16020: Resolution: Fixed Fix Version/s: 2.2.0 Status: Resolved (was: Patch

[jira] [Updated] (HIVE-15830) Allow additional ACLs for tez jobs

2017-02-23 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-15830: -- Summary: Allow additional ACLs for tez jobs (was: Allow additional view ACLs for tez jobs) >

[jira] [Updated] (HIVE-15830) Allow additional ACLs for tez jobs

2017-02-23 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-15830: -- Resolution: Fixed Fix Version/s: 2.2.0 Status: Resolved (was: Patch

[jira] [Commented] (HIVE-15830) Allow additional view ACLs for tez jobs

2017-02-23 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881413#comment-15881413 ] Siddharth Seth commented on HIVE-15830: --- Thanks for the review. Committing. > Allow additional view

[jira] [Updated] (HIVE-15964) LLAP: Llap IO codepath not getting invoked due to file column id mismatch

2017-02-23 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15964: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.2.0 Status:

[jira] [Commented] (HIVE-16018) Add more information for DynamicPartitionPruningOptimization

2017-02-23 Thread Pengcheng Xiong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881403#comment-15881403 ] Pengcheng Xiong commented on HIVE-16018: [~ashutoshc], could u take a look? Thanks. > Add more

[jira] [Commented] (HIVE-16018) Add more information for DynamicPartitionPruningOptimization

2017-02-23 Thread Pengcheng Xiong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881402#comment-15881402 ] Pengcheng Xiong commented on HIVE-16018: Because the output file masks "DagId", we are not able to

[jira] [Updated] (HIVE-16029) COLLECT_SET and COLLECT_LIST does not return NULL in the result

2017-02-23 Thread Eric Lin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Lin updated HIVE-16029: Description: See the test case below: {code} 0: jdbc:hive2://localhost:1/default> select * from

[jira] [Assigned] (HIVE-16029) COLLECT_SET and COLLECT_LIST does not return NULL in the result

2017-02-23 Thread Eric Lin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Lin reassigned HIVE-16029: --- > COLLECT_SET and COLLECT_LIST does not return NULL in the result >

[jira] [Commented] (HIVE-15882) HS2 generating high memory pressure with many partitions and concurrent queries

2017-02-23 Thread Misha Dmitriev (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881399#comment-15881399 ] Misha Dmitriev commented on HIVE-15882: --- I've just measured the CPU performance impact of my changes

[jira] [Updated] (HIVE-16018) Add more information for DynamicPartitionPruningOptimization

2017-02-23 Thread Pengcheng Xiong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pengcheng Xiong updated HIVE-16018: --- Attachment: qfile.q.out qfile.q > Add more information for

[jira] [Updated] (HIVE-16018) Add more information for DynamicPartitionPruningOptimization

2017-02-23 Thread Pengcheng Xiong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pengcheng Xiong updated HIVE-16018: --- Status: Patch Available (was: Open) > Add more information for

[jira] [Updated] (HIVE-16018) Add more information for DynamicPartitionPruningOptimization

2017-02-23 Thread Pengcheng Xiong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pengcheng Xiong updated HIVE-16018: --- Attachment: HIVE-16018.01.patch > Add more information for

[jira] [Updated] (HIVE-16028) Fail UPDATE/DELETE/MERGE queries when Ranger authorization manager is used

2017-02-23 Thread Wei Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Zheng updated HIVE-16028: - Attachment: HIVE-16028.2.patch patch 2 added a test > Fail UPDATE/DELETE/MERGE queries when Ranger

[jira] [Updated] (HIVE-16028) Fail UPDATE/DELETE/MERGE queries when Ranger authorization manager is used

2017-02-23 Thread Wei Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Zheng updated HIVE-16028: - Component/s: Transactions > Fail UPDATE/DELETE/MERGE queries when Ranger authorization manager is used >

[jira] [Commented] (HIVE-15882) HS2 generating high memory pressure with many partitions and concurrent queries

2017-02-23 Thread Vihang Karajgaonkar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881337#comment-15881337 ] Vihang Karajgaonkar commented on HIVE-15882: 37% is a great improvement [~mi...@cloudera.com].

[jira] [Commented] (HIVE-15944) The order of cols is error in ColumnPrunerReduceSinkProc because of sort operator

2017-02-23 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881338#comment-15881338 ] Hive QA commented on HIVE-15944: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-16014) HiveMetastoreChecker should use hive.metastore.fshandler.threads instead of hive.mv.files.thread for pool size

2017-02-23 Thread Vihang Karajgaonkar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881319#comment-15881319 ] Vihang Karajgaonkar commented on HIVE-16014: I discussed with Sahil offline. It may be

[jira] [Updated] (HIVE-14731) Use Tez cartesian product edge in Hive (unpartitioned case only)

2017-02-23 Thread Zhiyuan Yang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhiyuan Yang updated HIVE-14731: Attachment: HIVE-14731.14.patch Patch rebased. Now we're detecting both SIMPLE_EDGE and

[jira] [Commented] (HIVE-15830) Allow additional view ACLs for tez jobs

2017-02-23 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881272#comment-15881272 ] Daniel Dai commented on HIVE-15830: --- +1 > Allow additional view ACLs for tez jobs >

[jira] [Commented] (HIVE-15882) HS2 generating high memory pressure with many partitions and concurrent queries

2017-02-23 Thread Misha Dmitriev (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881244#comment-15881244 ] Misha Dmitriev commented on HIVE-15882: --- I've measured how much memory is saved with my change. It

[jira] [Commented] (HIVE-16007) When the query does not complie the LogRunnable never stops

2017-02-23 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881235#comment-15881235 ] Hive QA commented on HIVE-16007: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-15882) HS2 generating high memory pressure with many partitions and concurrent queries

2017-02-23 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881203#comment-15881203 ] Sahil Takiar commented on HIVE-15882: - [~mi...@cloudera.com] you mentioned this earlier, but it would

[jira] [Commented] (HIVE-16014) HiveMetastoreChecker should use hive.metastore.fshandler.threads instead of hive.mv.files.thread for pool size

2017-02-23 Thread Vihang Karajgaonkar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881183#comment-15881183 ] Vihang Karajgaonkar commented on HIVE-16014: [~spena] Do you think we should rename the config

[jira] [Commented] (HIVE-16014) HiveMetastoreChecker should use hive.metastore.fshandler.threads instead of hive.mv.files.thread for pool size

2017-02-23 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881182#comment-15881182 ] Sahil Takiar commented on HIVE-16014: - [~vihangk1] - the config METASTORE_FS_HANDLER_THREADS_COUNT

[jira] [Commented] (HIVE-15958) LLAP: IPC connections are not being reused for umbilical protocol

2017-02-23 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881180#comment-15881180 ] Prasanth Jayachandran commented on HIVE-15958: -- Just noticed another race between cleanup and

[jira] [Updated] (HIVE-16014) HiveMetastoreChecker should use hive.metastore.fshandler.threads instead of hive.mv.files.thread for pool size

2017-02-23 Thread Vihang Karajgaonkar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vihang Karajgaonkar updated HIVE-16014: --- Attachment: HIVE-16014.02.patch > HiveMetastoreChecker should use

[jira] [Commented] (HIVE-16014) HiveMetastoreChecker should use hive.metastore.fshandler.threads instead of hive.mv.files.thread for pool size

2017-02-23 Thread Vihang Karajgaonkar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881178#comment-15881178 ] Vihang Karajgaonkar commented on HIVE-16014: Attached second version of the patch which adds

[jira] [Updated] (HIVE-15879) Fix HiveMetaStoreChecker.checkPartitionDirs method

2017-02-23 Thread Vihang Karajgaonkar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vihang Karajgaonkar updated HIVE-15879: --- Status: Patch Available (was: Open) > Fix HiveMetaStoreChecker.checkPartitionDirs

[jira] [Updated] (HIVE-15958) LLAP: IPC connections are not being reused for umbilical protocol

2017-02-23 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-15958: - Attachment: HIVE-15958.3.patch Addressed review comments. - Not stopping

[jira] [Updated] (HIVE-15879) Fix HiveMetaStoreChecker.checkPartitionDirs method

2017-02-23 Thread Vihang Karajgaonkar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vihang Karajgaonkar updated HIVE-15879: --- Attachment: HIVE-15879.01.patch Created a review board link as well > Fix

[jira] [Commented] (HIVE-16014) HiveMetastoreChecker should use hive.metastore.fshandler.threads instead of hive.mv.files.thread for pool size

2017-02-23 Thread JIRA
[ https://issues.apache.org/jira/browse/HIVE-16014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881142#comment-15881142 ] Sergio Peña commented on HIVE-16014: I agree that the METASTORE_FS_HANDLER_THREADS_COUNT variable

[jira] [Updated] (HIVE-15881) Use new thread count variable name instead of mapred.dfsclient.parallelism.max

2017-02-23 Thread JIRA
[ https://issues.apache.org/jira/browse/HIVE-15881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergio Peña updated HIVE-15881: --- Attachment: HIVE-15881.5.patch New patch that added a new unit tests & use SizeValidator on the

  1   2   >