[jira] [Updated] (HIVE-16969) Improvement performance of MapOperator for Parquet

2017-06-27 Thread Ferdinand Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ferdinand Xu updated HIVE-16969: Resolution: Fixed Status: Resolved (was: Patch Available) Committed to the upstream.

[jira] [Commented] (HIVE-16785) Ensure replication actions are idempotent if any series of events are applied again.

2017-06-27 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065947#comment-16065947 ] anishek commented on HIVE-16785: +1 for other changes except the test failures > Ensure replication

[jira] [Commented] (HIVE-16785) Ensure replication actions are idempotent if any series of events are applied again.

2017-06-27 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065946#comment-16065946 ] anishek commented on HIVE-16785: Tests failures for TestReplicationScenariosAcrossInstances needs to be

[jira] [Updated] (HIVE-16893) move replication dump related work in semantic analysis phase to execution phase using a task

2017-06-27 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-16893: --- Attachment: HIVE-16893.1.patch cannot submit this patch as it depends on HIVE-16892. So cant even run the

[jira] [Commented] (HIVE-16960) Hive throws an ugly error exception when HDFS sticky bit is set

2017-06-27 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065942#comment-16065942 ] Sahil Takiar commented on HIVE-16960: - [~janulatha] could you create a review board for the patch? >

[jira] [Commented] (HIVE-16222) add a setting to disable row.serde for specific formats; enable for others

2017-06-27 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065939#comment-16065939 ] Hive QA commented on HIVE-16222: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-16979) Cache UGI for metastore

2017-06-27 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065927#comment-16065927 ] Gopal V commented on HIVE-16979: [~taoli-hwx]: Does Guava's cache track the life time of a cache object?

[jira] [Commented] (HIVE-16892) Move creation of _files from ReplCopyTask to analysis phase for boostrap replication

2017-06-27 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065920#comment-16065920 ] anishek commented on HIVE-16892: [~sankarh]/[~sushanth]/[~thejas] please review. > Move creation of

[jira] [Commented] (HIVE-16892) Move creation of _files from ReplCopyTask to analysis phase for boostrap replication

2017-06-27 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065919#comment-16065919 ] anishek commented on HIVE-16892: all the failures are from previous builds except *

[jira] [Commented] (HIVE-16951) ACID Compactor, PartialScanTask, MergeFileTask, ColumnTruncateTask, HCatUtil don't close JobClient

2017-06-27 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065910#comment-16065910 ] Hive QA commented on HIVE-16951: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-16980) The partition of join is not divided evently in HOS

2017-06-27 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065908#comment-16065908 ] Xuefu Zhang commented on HIVE-16980: This is interesting. Have you checked your data for skew? In

[jira] [Updated] (HIVE-16981) hive.optimize.bucketingsorting should compare the schema before removing RS

2017-06-27 Thread Pengcheng Xiong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pengcheng Xiong updated HIVE-16981: --- Issue Type: Sub-task (was: Bug) Parent: HIVE-11160 > hive.optimize.bucketingsorting

[jira] [Assigned] (HIVE-16981) hive.optimize.bucketingsorting should compare the schema before removing RS

2017-06-27 Thread Pengcheng Xiong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pengcheng Xiong reassigned HIVE-16981: -- > hive.optimize.bucketingsorting should compare the schema before removing RS >

[jira] [Commented] (HIVE-16222) add a setting to disable row.serde for specific formats; enable for others

2017-06-27 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065872#comment-16065872 ] Hive QA commented on HIVE-16222: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-16972) FetchOperator: filter out inputSplits which length is zero

2017-06-27 Thread Chaozhong Yang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065870#comment-16065870 ] Chaozhong Yang commented on HIVE-16972: --- [~wzheng] Thanks for your reply :) I just simplify this

[jira] [Updated] (HIVE-16972) FetchOperator: filter out inputSplits which length is zero

2017-06-27 Thread Chaozhong Yang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chaozhong Yang updated HIVE-16972: -- Attachment: HIVE-16972.2.patch > FetchOperator: filter out inputSplits which length is zero >

[jira] [Commented] (HIVE-16926) LlapTaskUmbilicalExternalClient should not start new umbilical server for every fragment request

2017-06-27 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065837#comment-16065837 ] Hive QA commented on HIVE-16926: Here are the results of testing the latest attachment:

[jira] [Updated] (HIVE-16832) duplicate ROW__ID possible in multi insert into transactional table

2017-06-27 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-16832: -- Attachment: HIVE-16832.14.patch > duplicate ROW__ID possible in multi insert into transactional

[jira] [Commented] (HIVE-16969) Improvement performance of MapOperator for Parquet

2017-06-27 Thread Colin Ma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065783#comment-16065783 ] Colin Ma commented on HIVE-16969: - Check the failed test cases, they are not patch related. > Improvement

[jira] [Commented] (HIVE-16838) Improve plans for subqueries with non-equi co-related predicates

2017-06-27 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065782#comment-16065782 ] Ashutosh Chauhan commented on HIVE-16838: - +1 pending tests > Improve plans for subqueries with

[jira] [Updated] (HIVE-16972) FetchOperator: filter out inputSplits which length is zero

2017-06-27 Thread Chaozhong Yang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chaozhong Yang updated HIVE-16972: -- Attachment: (was: screenshot-1.png) > FetchOperator: filter out inputSplits which length is

[jira] [Commented] (HIVE-16960) Hive throws an ugly error exception when HDFS sticky bit is set

2017-06-27 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065737#comment-16065737 ] Hive QA commented on HIVE-16960: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-16979) Cache UGI for metastore

2017-06-27 Thread Tao Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065693#comment-16065693 ] Tao Li commented on HIVE-16979: --- cc [~thejas] > Cache UGI for metastore > --- > >

[jira] [Updated] (HIVE-16979) Cache UGI for metastore

2017-06-27 Thread Tao Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li updated HIVE-16979: -- Attachment: HIVE-16979.1.patch > Cache UGI for metastore > --- > > Key:

[jira] [Assigned] (HIVE-16979) Cache UGI for metastore

2017-06-27 Thread Tao Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li reassigned HIVE-16979: - Assignee: Tao Li > Cache UGI for metastore > --- > > Key: HIVE-16979

[jira] [Commented] (HIVE-16888) Upgrade Calcite to 1.13 and Avatica to 1.10

2017-06-27 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065671#comment-16065671 ] Hive QA commented on HIVE-16888: Here are the results of testing the latest attachment:

[jira] [Updated] (HIVE-16838) Improve plans for subqueries with non-equi co-related predicates

2017-06-27 Thread Vineet Garg (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-16838: --- Attachment: HIVE-16838.7.patch Patch 7 address review comments > Improve plans for subqueries with

[jira] [Updated] (HIVE-16838) Improve plans for subqueries with non-equi co-related predicates

2017-06-27 Thread Vineet Garg (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-16838: --- Status: Patch Available (was: Open) > Improve plans for subqueries with non-equi co-related

[jira] [Updated] (HIVE-16838) Improve plans for subqueries with non-equi co-related predicates

2017-06-27 Thread Vineet Garg (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-16838: --- Status: Open (was: Patch Available) > Improve plans for subqueries with non-equi co-related

[jira] [Commented] (HIVE-16886) HMS log notifications may have duplicated event IDs if multiple HMS are running concurrently

2017-06-27 Thread Alexander Kolbasov (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065643#comment-16065643 ] Alexander Kolbasov commented on HIVE-16886: --- [~anishek] What is the default isolation used by

[jira] [Updated] (HIVE-16978) HoS: add current thread ID to the log redirector for the RemoteDriver

2017-06-27 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HIVE-16978: Attachment: HIVE-16978.1.patch > HoS: add current thread ID to the log redirector for the RemoteDriver >

[jira] [Updated] (HIVE-16978) HoS: add current thread ID to the log redirector for the RemoteDriver

2017-06-27 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HIVE-16978: Status: Patch Available (was: Open) > HoS: add current thread ID to the log redirector for the

[jira] [Assigned] (HIVE-16978) HoS: add current thread ID to the log redirector for the RemoteDriver

2017-06-27 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun reassigned HIVE-16978: --- > HoS: add current thread ID to the log redirector for the RemoteDriver >

[jira] [Updated] (HIVE-14988) Support INSERT OVERWRITE into a partition on transactional tables

2017-06-27 Thread Wei Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Zheng updated HIVE-14988: - Attachment: HIVE-14988.06.patch > Support INSERT OVERWRITE into a partition on transactional tables >

[jira] [Updated] (HIVE-16369) Vectorization: Support PTF (Part 1: No Custom Window Framing -- Default Only)

2017-06-27 Thread Matt McCline (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt McCline updated HIVE-16369: Status: Patch Available (was: In Progress) > Vectorization: Support PTF (Part 1: No Custom Window

[jira] [Updated] (HIVE-16369) Vectorization: Support PTF (Part 1: No Custom Window Framing -- Default Only)

2017-06-27 Thread Matt McCline (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt McCline updated HIVE-16369: Attachment: HIVE-16369.0991.patch > Vectorization: Support PTF (Part 1: No Custom Window Framing --

[jira] [Updated] (HIVE-16369) Vectorization: Support PTF (Part 1: No Custom Window Framing -- Default Only)

2017-06-27 Thread Matt McCline (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt McCline updated HIVE-16369: Status: In Progress (was: Patch Available) > Vectorization: Support PTF (Part 1: No Custom Window

[jira] [Commented] (HIVE-16892) Move creation of _files from ReplCopyTask to analysis phase for boostrap replication

2017-06-27 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065629#comment-16065629 ] Hive QA commented on HIVE-16892: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-16947) Semijoin Reduction : Task cycle created due to multiple semijoins in conjunction with hashjoin

2017-06-27 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065579#comment-16065579 ] Jason Dere commented on HIVE-16947: --- +1 > Semijoin Reduction : Task cycle created due to multiple

[jira] [Commented] (HIVE-16892) Move creation of _files from ReplCopyTask to analysis phase for boostrap replication

2017-06-27 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065544#comment-16065544 ] Hive QA commented on HIVE-16892: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-16972) FetchOperator: filter out inputSplits which length is zero

2017-06-27 Thread Wei Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065520#comment-16065520 ] Wei Zheng commented on HIVE-16972: -- patch looks good to me. Although the change can be simplified a

[jira] [Updated] (HIVE-16793) Scalar sub-query: sq_count_check not required if gby keys are constant

2017-06-27 Thread Vineet Garg (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-16793: --- Status: Patch Available (was: Open) > Scalar sub-query: sq_count_check not required if gby keys are

[jira] [Updated] (HIVE-16793) Scalar sub-query: sq_count_check not required if gby keys are constant

2017-06-27 Thread Vineet Garg (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-16793: --- Attachment: HIVE-16793.4.patch > Scalar sub-query: sq_count_check not required if gby keys are

[jira] [Updated] (HIVE-16793) Scalar sub-query: sq_count_check not required if gby keys are constant

2017-06-27 Thread Vineet Garg (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-16793: --- Status: Open (was: Patch Available) > Scalar sub-query: sq_count_check not required if gby keys are

[jira] [Updated] (HIVE-16838) Improve plans for subqueries with non-equi co-related predicates

2017-06-27 Thread Vineet Garg (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-16838: --- Status: Patch Available (was: Open) > Improve plans for subqueries with non-equi co-related

[jira] [Updated] (HIVE-16838) Improve plans for subqueries with non-equi co-related predicates

2017-06-27 Thread Vineet Garg (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-16838: --- Status: Open (was: Patch Available) > Improve plans for subqueries with non-equi co-related

[jira] [Updated] (HIVE-16222) add a setting to disable row.serde for specific formats; enable for others

2017-06-27 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-16222: Attachment: HIVE-16222.04.patch Updated the patch... I guess for a contrived case where

[jira] [Updated] (HIVE-16951) ACID Compactor, PartialScanTask, MergeFileTask, ColumnTruncateTask, HCatUtil don't close JobClient

2017-06-27 Thread Vaibhav Gumashta (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vaibhav Gumashta updated HIVE-16951: Status: Patch Available (was: Open) > ACID Compactor, PartialScanTask, MergeFileTask,

[jira] [Updated] (HIVE-16951) ACID Compactor, PartialScanTask, MergeFileTask, ColumnTruncateTask, HCatUtil don't close JobClient

2017-06-27 Thread Vaibhav Gumashta (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vaibhav Gumashta updated HIVE-16951: Attachment: HIVE-16951.1.patch > ACID Compactor, PartialScanTask, MergeFileTask,

[jira] [Commented] (HIVE-6348) Order by/Sort by in subquery

2017-06-27 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065458#comment-16065458 ] Hive QA commented on HIVE-6348: --- Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-16222) add a setting to disable row.serde for specific formats; enable for others

2017-06-27 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065439#comment-16065439 ] Sergey Shelukhin commented on HIVE-16222: - Actually is this patch even relevant? Upon adding the

[jira] [Commented] (HIVE-16972) FetchOperator: filter out inputSplits which length is zero

2017-06-27 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065396#comment-16065396 ] Hive QA commented on HIVE-16972: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-16947) Semijoin Reduction : Task cycle created due to multiple semijoins in conjunction with hashjoin

2017-06-27 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065395#comment-16065395 ] Hive QA commented on HIVE-16947: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-16177) non Acid to acid conversion doesn't handle _copy_N files

2017-06-27 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065359#comment-16065359 ] Sergey Shelukhin commented on HIVE-16177: - +1 from me, some nits about comments can be fixed on

[jira] [Commented] (HIVE-16972) FetchOperator: filter out inputSplits which length is zero

2017-06-27 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065326#comment-16065326 ] Hive QA commented on HIVE-16972: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-16970) General Improvements To org.apache.hadoop.hive.metastore.cache.CacheUtils

2017-06-27 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065325#comment-16065325 ] Hive QA commented on HIVE-16970: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-16974) Change the sort key for the schema tool validator to be

2017-06-27 Thread Andrew Sherman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065322#comment-16065322 ] Andrew Sherman commented on HIVE-16974: --- [~ngangam] OK, thanks for thinking about it. Sounds like

[jira] [Commented] (HIVE-13390) HiveServer2: Add more test to ZK service discovery using MiniHS2

2017-06-27 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065297#comment-16065297 ] Thejas M Nair commented on HIVE-13390: -- [~call-fold] Yes, this addresses CVE-2016-3083 . >

[jira] [Commented] (HIVE-16974) Change the sort key for the schema tool validator to be

2017-06-27 Thread Naveen Gangam (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065288#comment-16065288 ] Naveen Gangam commented on HIVE-16974: -- [~asherman] Thank you for the suggestion. I have taken a

[jira] [Commented] (HIVE-16974) Change the sort key for the schema tool validator to be

2017-06-27 Thread Andrew Sherman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065263#comment-16065263 ] Andrew Sherman commented on HIVE-16974: --- Would it be possible to use 'order by nulls last' ? You

[jira] [Commented] (HIVE-16969) Improvement performance of MapOperator for Parquet

2017-06-27 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065242#comment-16065242 ] Hive QA commented on HIVE-16969: Here are the results of testing the latest attachment:

[jira] [Assigned] (HIVE-16974) Change the sort key for the schema tool validator to be

2017-06-27 Thread Naveen Gangam (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naveen Gangam reassigned HIVE-16974: > Change the sort key for the schema tool validator to be >

[jira] [Updated] (HIVE-16926) LlapTaskUmbilicalExternalClient should not start new umbilical server for every fragment request

2017-06-27 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-16926: -- Attachment: HIVE-16926.3.patch Those test results were unexpected. Re-attaching same patch to run

[jira] [Commented] (HIVE-16761) LLAP IO: SMB joins fail elevator

2017-06-27 Thread Deepak Jaiswal (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065221#comment-16065221 ] Deepak Jaiswal commented on HIVE-16761: --- Can you please create a Review request? It is easier to

[jira] [Updated] (HIVE-16942) INFORMATION_SCHEMA: schematool for setting it up is not idempotent

2017-06-27 Thread Gunther Hagleitner (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gunther Hagleitner updated HIVE-16942: -- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch

[jira] [Resolved] (HIVE-16862) Implement a similar feature like "hive.tez.dynamic.semijoin.reduction" in hive on spark

2017-06-27 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun resolved HIVE-16862. - Resolution: Duplicate This is a duplicate of HIVE-16739. > Implement a similar feature like

[jira] [Assigned] (HIVE-16973) Fetching of Delegation tokens (Kerberos) for AccumuloStorageHandler fails in HS2

2017-06-27 Thread Josh Elser (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Elser reassigned HIVE-16973: - > Fetching of Delegation tokens (Kerberos) for AccumuloStorageHandler fails in > HS2 >

[jira] [Commented] (HIVE-16942) INFORMATION_SCHEMA: schematool for setting it up is not idempotent

2017-06-27 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065081#comment-16065081 ] Hive QA commented on HIVE-16942: Here are the results of testing the latest attachment:

[jira] [Updated] (HIVE-16960) Hive throws an ugly error exception when HDFS sticky bit is set

2017-06-27 Thread Janaki Lahorani (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Janaki Lahorani updated HIVE-16960: --- Attachment: HIVE16960.1.patch > Hive throws an ugly error exception when HDFS sticky bit is

[jira] [Updated] (HIVE-16960) Hive throws an ugly error exception when HDFS sticky bit is set

2017-06-27 Thread Janaki Lahorani (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Janaki Lahorani updated HIVE-16960: --- Labels: newbie (was: ) Fix Version/s: 3.0.0 Affects Version/s: 3.0.0

[jira] [Comment Edited] (HIVE-16888) Upgrade Calcite to 1.13 and Avatica to 1.10

2017-06-27 Thread Jesus Camacho Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16064966#comment-16064966 ] Jesus Camacho Rodriguez edited comment on HIVE-16888 at 6/27/17 3:33 PM:

[jira] [Commented] (HIVE-16559) Parquet schema evolution for partitioned tables may break if table and partition serdes differ

2017-06-27 Thread JIRA
[ https://issues.apache.org/jira/browse/HIVE-16559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16064991#comment-16064991 ] Sergio Peña commented on HIVE-16559: I committed to master. > Parquet schema evolution for

[jira] [Updated] (HIVE-16559) Parquet schema evolution for partitioned tables may break if table and partition serdes differ

2017-06-27 Thread JIRA
[ https://issues.apache.org/jira/browse/HIVE-16559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergio Peña updated HIVE-16559: --- Resolution: Fixed Status: Resolved (was: Patch Available) > Parquet schema evolution for

[jira] [Updated] (HIVE-16888) Upgrade Calcite to 1.13 and Avatica to 1.10

2017-06-27 Thread Jesus Camacho Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-16888: --- Attachment: HIVE-16888.07.patch .07 picks up the final Calcite 1.13 release.

[jira] [Commented] (HIVE-15051) Test framework integration with findbugs, rat checks etc.

2017-06-27 Thread Peter Vary (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16064962#comment-16064962 ] Peter Vary commented on HIVE-15051: --- [~leftylev]: Could you please review the docs here:

[jira] [Updated] (HIVE-16888) Upgrade Calcite to 1.13 and Avatica to 1.10

2017-06-27 Thread Jesus Camacho Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-16888: --- Status: In Progress (was: Patch Available) > Upgrade Calcite to 1.13 and

[jira] [Assigned] (HIVE-16888) Upgrade Calcite to 1.13 and Avatica to 1.10

2017-06-27 Thread Jesus Camacho Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez reassigned HIVE-16888: -- Assignee: Jesus Camacho Rodriguez (was: Remus Rusanu) > Upgrade

[jira] [Updated] (HIVE-16888) Upgrade Calcite to 1.13 and Avatica to 1.10

2017-06-27 Thread Jesus Camacho Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-16888: --- Status: Patch Available (was: In Progress) > Upgrade Calcite to 1.13 and

[jira] [Updated] (HIVE-16972) FetchOperator: filter out inputSplits which length is zero

2017-06-27 Thread Chaozhong Yang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chaozhong Yang updated HIVE-16972: -- Description: * Background We can describe the basic work flow of common HQL query as

[jira] [Updated] (HIVE-16972) FetchOperator: filter out inputSplits which length is zero

2017-06-27 Thread Chaozhong Yang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chaozhong Yang updated HIVE-16972: -- Component/s: (was: HiveServer2) > FetchOperator: filter out inputSplits which length is

[jira] [Updated] (HIVE-16972) FetchOperator: filter out inputSplits which length is zero

2017-06-27 Thread Chaozhong Yang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chaozhong Yang updated HIVE-16972: -- Component/s: (was: Query Planning) > FetchOperator: filter out inputSplits which length is

[jira] [Updated] (HIVE-16869) Hive returns wrong result when predicates on non-existing columns are pushed down to Parquet reader

2017-06-27 Thread Yongzhi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongzhi Chen updated HIVE-16869: Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available)

[jira] [Updated] (HIVE-16970) General Improvements To org.apache.hadoop.hive.metastore.cache.CacheUtils

2017-06-27 Thread BELUGA BEHR (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BELUGA BEHR updated HIVE-16970: --- Status: Open (was: Patch Available) > General Improvements To

[jira] [Updated] (HIVE-16970) General Improvements To org.apache.hadoop.hive.metastore.cache.CacheUtils

2017-06-27 Thread BELUGA BEHR (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BELUGA BEHR updated HIVE-16970: --- Status: Patch Available (was: Open) > General Improvements To

[jira] [Updated] (HIVE-16888) Upgrade Calcite to 1.13 and Avatica to 1.10

2017-06-27 Thread Remus Rusanu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Remus Rusanu updated HIVE-16888: Attachment: HIVE-16888.06.patch Patch 06 rebased to current master, druid GF updated > Upgrade

[jira] [Updated] (HIVE-16892) Move creation of _files from ReplCopyTask to analysis phase for boostrap replication

2017-06-27 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-16892: --- Attachment: HIVE-16892.4.patch > Move creation of _files from ReplCopyTask to analysis phase for boostrap >

[jira] [Updated] (HIVE-16892) Move creation of _files from ReplCopyTask to analysis phase for boostrap replication

2017-06-27 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-16892: --- Attachment: (was: HIVE-16892.4.patch) > Move creation of _files from ReplCopyTask to analysis phase for

[jira] [Updated] (HIVE-16892) Move creation of _files from ReplCopyTask to analysis phase for boostrap replication

2017-06-27 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-16892: --- Attachment: HIVE-16892.4.patch fixing *

[jira] [Updated] (HIVE-16972) FetchOperator: filter out inputSplits which length is zero

2017-06-27 Thread Chaozhong Yang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chaozhong Yang updated HIVE-16972: -- Description: * Background We can describe the basic work flow of common HQL query as

[jira] [Commented] (HIVE-16958) Setting hive.merge.sparkfiles=true will retrun an error when generating parquet databases

2017-06-27 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16064513#comment-16064513 ] Rui Li commented on HIVE-16958: --- I think the cause is we need to set neededNestedColumnPaths in

[jira] [Assigned] (HIVE-16958) Setting hive.merge.sparkfiles=true will retrun an error when generating parquet databases

2017-06-27 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel reassigned HIVE-16958: --- Assignee: liyunzhang_intel > Setting hive.merge.sparkfiles=true will retrun an error

[jira] [Updated] (HIVE-6348) Order by/Sort by in subquery

2017-06-27 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HIVE-6348: - Attachment: HIVE-6348.4.patch Patch v4 updates the affected tests. # I modified {{input20_script.py}} so it

[jira] [Commented] (HIVE-16967) hive use tez engine occur org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing row (tag=0)

2017-06-27 Thread xujie (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16064439#comment-16064439 ] xujie commented on HIVE-16967: -- STAGE DEPENDENCIES: Stage-1 is a root stage Stage-0 depends on stages:

[jira] [Updated] (HIVE-16972) FetchOperator: filter out inputSplits which length is zero

2017-06-27 Thread Chaozhong Yang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chaozhong Yang updated HIVE-16972: -- Description: * Background We can describe the basic work flow of common HQL query as

[jira] [Updated] (HIVE-16972) FetchOperator: filter out inputSplits which length is zero

2017-06-27 Thread Chaozhong Yang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chaozhong Yang updated HIVE-16972: -- Attachment: screenshot-1.png > FetchOperator: filter out inputSplits which length is zero >

[jira] [Commented] (HIVE-13390) HiveServer2: Add more test to ZK service discovery using MiniHS2

2017-06-27 Thread Lingfeng Su (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16064432#comment-16064432 ] Lingfeng Su commented on HIVE-13390: [~vgumashta], is this the jira which solved the problem

[jira] [Comment Edited] (HIVE-16958) Setting hive.merge.sparkfiles=true will retrun an error when generating parquet databases

2017-06-27 Thread Liu Chunxiao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16064419#comment-16064419 ] Liu Chunxiao edited comment on HIVE-16958 at 6/27/17 7:55 AM: -- Hi [~lirui], I

[jira] [Comment Edited] (HIVE-16958) Setting hive.merge.sparkfiles=true will retrun an error when generating parquet databases

2017-06-27 Thread Liu Chunxiao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16064419#comment-16064419 ] Liu Chunxiao edited comment on HIVE-16958 at 6/27/17 7:53 AM: -- Hi @Rui Li, I

[jira] [Commented] (HIVE-16958) Setting hive.merge.sparkfiles=true will retrun an error when generating parquet databases

2017-06-27 Thread Liu Chunxiao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16064419#comment-16064419 ] Liu Chunxiao commented on HIVE-16958: - Hi Rui Li, I have added the DataGen mvn project file(Main.java,

[jira] [Updated] (HIVE-16958) Setting hive.merge.sparkfiles=true will retrun an error when generating parquet databases

2017-06-27 Thread Liu Chunxiao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liu Chunxiao updated HIVE-16958: Attachment: hive-site.xml > Setting hive.merge.sparkfiles=true will retrun an error when generating

  1   2   >