[jira] [Updated] (HIVE-17915) Enable VectorizedOrcAcidRowBatchReader to be used with LLAP IO elevator over original acid files

2017-11-06 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17915: -- Description: Since HIVE-12631, LLAP IO can support Acid tables but when reading "original"

[jira] [Resolved] (HIVE-17944) OrcSplit.canUseLlapIo() disables LLAP IO for non-vectorized acid reads

2017-11-06 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman resolved HIVE-17944. --- Resolution: Won't Fix subsumed by HIVE-17915 > OrcSplit.canUseLlapIo() disables LLAP IO for

[jira] [Updated] (HIVE-17990) Add Thrift and DB storage for Schema Registry objects

2017-11-06 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated HIVE-17990: -- Attachment: Adding-Schema-Registry-to-Metastore.pdf A design doc for the proposed approach. > Add

[jira] [Commented] (HIVE-17948) Hive 2.3.2 Release Planning

2017-11-06 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16240741#comment-16240741 ] Sahil Takiar commented on HIVE-17948: - I've cherry-picked them all onto branch-2.3 locally, put

[jira] [Commented] (HIVE-17856) MM tables - IOW is not ACID compliant

2017-11-06 Thread Steve Yeom (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16240628#comment-16240628 ] Steve Yeom commented on HIVE-17856: --- Hi [~sershe] can you review the 01.patch? Thank you, Steve. >

[jira] [Updated] (HIVE-16827) Merge stats task and column stats task into a single task

2017-11-06 Thread Zoltan Haindrich (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoltan Haindrich updated HIVE-16827: Attachment: HIVE-16827.05wip12.patch > Merge stats task and column stats task into a single

[jira] [Commented] (HIVE-17934) Merging Statistics are promoted to COMPLETE (most of the time)

2017-11-06 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16240729#comment-16240729 ] Hive QA commented on HIVE-17934: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-17948) Hive 2.3.2 Release Planning

2017-11-06 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16240626#comment-16240626 ] Sahil Takiar commented on HIVE-17948: - Thanks [~spena]. Was

[jira] [Updated] (HIVE-17915) Enable VectorizedOrcAcidRowBatchReader to be used with LLAP IO elevator over original acid files

2017-11-06 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17915: -- Priority: Critical (was: Minor) > Enable VectorizedOrcAcidRowBatchReader to be used with LLAP

[jira] [Assigned] (HIVE-17915) Enable VectorizedOrcAcidRowBatchReader to be used with LLAP IO elevator over original acid files

2017-11-06 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-17915: - Assignee: Teddy Choi > Enable VectorizedOrcAcidRowBatchReader to be used with LLAP IO

[jira] [Assigned] (HIVE-17989) Adding support for Schema Registry objects to standalone

2017-11-06 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates reassigned HIVE-17989: - > Adding support for Schema Registry objects to standalone >

[jira] [Commented] (HIVE-16827) Merge stats task and column stats task into a single task

2017-11-06 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16240640#comment-16240640 ] Hive QA commented on HIVE-16827: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-17948) Hive 2.3.2 Release Planning

2017-11-06 Thread JIRA
[ https://issues.apache.org/jira/browse/HIVE-17948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16240634#comment-16240634 ] Sergio Peña commented on HIVE-17948: I Build 7655 run with the patch on this jira. I triggered

[jira] [Assigned] (HIVE-17990) Add Thrift and DB storage for Schema Registry objects

2017-11-06 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates reassigned HIVE-17990: - > Add Thrift and DB storage for Schema Registry objects >

[jira] [Commented] (HIVE-17856) MM tables - IOW is not ACID compliant

2017-11-06 Thread Steve Yeom (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16240017#comment-16240017 ] Steve Yeom commented on HIVE-17856: --- patch01 has implemented the three items above for a regular and

[jira] [Updated] (HIVE-17976) HoS: don't set output collector if there's no data to process

2017-11-06 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HIVE-17976: -- Attachment: HIVE-17976.1.patch > HoS: don't set output collector if there's no data to process >

[jira] [Updated] (HIVE-17976) HoS: don't set output collector if there's no data to process

2017-11-06 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HIVE-17976: -- Status: Patch Available (was: Open) > HoS: don't set output collector if there's no data to process >

[jira] [Commented] (HIVE-17969) Metastore to alter table in batches of partitions when renaming table

2017-11-06 Thread Peter Vary (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16240084#comment-16240084 ] Peter Vary commented on HIVE-17969: --- +1 pending tests > Metastore to alter table in batches of

[jira] [Commented] (HIVE-17856) MM tables - IOW is not ACID compliant

2017-11-06 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16240887#comment-16240887 ] Sergey Shelukhin commented on HIVE-17856: - Is it possible to post a review board review

[jira] [Comment Edited] (HIVE-17856) MM tables - IOW is not ACID compliant

2017-11-06 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16240887#comment-16240887 ] Sergey Shelukhin edited comment on HIVE-17856 at 11/6/17 9:01 PM: -- Is it

[jira] [Comment Edited] (HIVE-17856) MM tables - IOW is not ACID compliant

2017-11-06 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16240887#comment-16240887 ] Sergey Shelukhin edited comment on HIVE-17856 at 11/6/17 9:02 PM: -- Is it

[jira] [Commented] (HIVE-17993) llap_acid_fast seems to be sensitive to something

2017-11-06 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16240966#comment-16240966 ] Sergey Shelukhin commented on HIVE-17993: - cc [~teddy.choi] I think I already opened a JIRA for

[jira] [Commented] (HIVE-17856) MM tables - IOW is not ACID compliant

2017-11-06 Thread Steve Yeom (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16240929#comment-16240929 ] Steve Yeom commented on HIVE-17856: --- I am also carefully checking all the test failures to find any

[jira] [Updated] (HIVE-15016) Run tests with Hadoop 3.0.0-beta1

2017-11-06 Thread Aihua Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aihua Xu updated HIVE-15016: Status: In Progress (was: Patch Available) > Run tests with Hadoop 3.0.0-beta1 >

[jira] [Updated] (HIVE-16917) HiveServer2 guard rails - Limit concurrent connections from user

2017-11-06 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-16917: - Attachment: HIVE-16917.5.patch Fixes test > HiveServer2 guard rails - Limit

[jira] [Updated] (HIVE-17767) Rewrite correlated EXISTS/IN subqueries into LEFT SEMI JOIN

2017-11-06 Thread Vineet Garg (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-17767: --- Attachment: HIVE-17767.5.patch > Rewrite correlated EXISTS/IN subqueries into LEFT SEMI JOIN >

[jira] [Updated] (HIVE-17767) Rewrite correlated EXISTS/IN subqueries into LEFT SEMI JOIN

2017-11-06 Thread Vineet Garg (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-17767: --- Status: Patch Available (was: Open) > Rewrite correlated EXISTS/IN subqueries into LEFT SEMI JOIN >

[jira] [Updated] (HIVE-17953) Metrics should move to destination atomically

2017-11-06 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-17953: Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available)

[jira] [Commented] (HIVE-17856) MM tables - IOW is not ACID compliant

2017-11-06 Thread Steve Yeom (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16240925#comment-16240925 ] Steve Yeom commented on HIVE-17856: --- Hey [~sershe] Thank you for the great review. I can create a

[jira] [Updated] (HIVE-17961) NPE during initialization of VectorizedParquetRecordReader when input split is null

2017-11-06 Thread Vihang Karajgaonkar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vihang Karajgaonkar updated HIVE-17961: --- Attachment: HIVE-17961.02.patch The test failures were caused due to a separate

[jira] [Commented] (HIVE-17993) llap_acid_fast seems to be sensitive to something

2017-11-06 Thread Zoltan Haindrich (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16240949#comment-16240949 ] Zoltan Haindrich commented on HIVE-17993: - FYI: [~sershe] > llap_acid_fast seems to be sensitive

[jira] [Updated] (HIVE-17921) Aggregation with struct in LLAP produces wrong result

2017-11-06 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17921: -- Description: Consider {noformat} select ROW__ID, count(*) from over10k_orc_bucketed group by

[jira] [Updated] (HIVE-15016) Run tests with Hadoop 3.0.0-beta1

2017-11-06 Thread Aihua Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aihua Xu updated HIVE-15016: Status: Patch Available (was: In Progress) > Run tests with Hadoop 3.0.0-beta1 >

[jira] [Updated] (HIVE-15016) Run tests with Hadoop 3.0.0-beta1

2017-11-06 Thread Aihua Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aihua Xu updated HIVE-15016: Attachment: HIVE-15016.10.patch patch-10: fix more test failures. > Run tests with Hadoop 3.0.0-beta1 >

[jira] [Updated] (HIVE-17907) enable and apply resource plan commands in HS2

2017-11-06 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-17907: Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch

[jira] [Updated] (HIVE-17767) Rewrite correlated EXISTS/IN subqueries into LEFT SEMI JOIN

2017-11-06 Thread Vineet Garg (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-17767: --- Status: Open (was: Patch Available) > Rewrite correlated EXISTS/IN subqueries into LEFT SEMI JOIN >

[jira] [Updated] (HIVE-17942) HiveAlterHandler not using conf from threadlocal

2017-11-06 Thread Janaki Lahorani (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Janaki Lahorani updated HIVE-17942: --- Attachment: HIVE-17942.2.patch Incorporated comments from Vihang. > HiveAlterHandler not

[jira] [Updated] (HIVE-17926) Support triggers for non-pool sessions

2017-11-06 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-17926: - Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was:

[jira] [Commented] (HIVE-17908) LLAP External client not correctly handling killTask for pending requests

2017-11-06 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16240793#comment-16240793 ] Sergey Shelukhin commented on HIVE-17908: - Hmm... new retry is only called from taskKilled. Is

[jira] [Commented] (HIVE-16827) Merge stats task and column stats task into a single task

2017-11-06 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16240838#comment-16240838 ] Hive QA commented on HIVE-16827: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-17954) Implement pool, user, group and trigger to pool management API's.

2017-11-06 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16240841#comment-16240841 ] Sergey Shelukhin commented on HIVE-17954: - Can you post a RB of the patch without generated

[jira] [Updated] (HIVE-17993) llap_acid_fast seems to be sensitive to something

2017-11-06 Thread Zoltan Haindrich (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoltan Haindrich updated HIVE-17993: Description: from time-to-time it seems like this test is failing...

[jira] [Commented] (HIVE-17969) Metastore to alter table in batches of partitions when renaming table

2017-11-06 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16240953#comment-16240953 ] Hive QA commented on HIVE-17969: Here are the results of testing the latest attachment:

[jira] [Updated] (HIVE-17987) Certain metastore operation should use iterators of partitions over lists

2017-11-06 Thread Adam Szita (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Szita updated HIVE-17987: -- Environment: (was: In HS2 side we have a PartitionIterable class to reduce memory load and use

[jira] [Assigned] (HIVE-17987) Certain metastore operation should use iterators of partitions over lists

2017-11-06 Thread Adam Szita (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Szita reassigned HIVE-17987: - Assignee: Adam Szita > Certain metastore operation should use iterators of partitions over lists

[jira] [Updated] (HIVE-17987) Certain metastore operation should use iterators of partitions over lists

2017-11-06 Thread Adam Szita (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Szita updated HIVE-17987: -- Description: In HS2 side we have a PartitionIterable class to reduce memory load and use iterators of

[jira] [Commented] (HIVE-17985) When check the partitions size in the partitioned table, it will throw NullPointerException

2017-11-06 Thread Zoltan Haindrich (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16240441#comment-16240441 ] Zoltan Haindrich commented on HIVE-17985: - HIVE-17965 will remove this option from master for

[jira] [Updated] (HIVE-17954) Implement pool, user, group and trigger to pool management API's.

2017-11-06 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish Jaiprakash updated HIVE-17954: - Description: Implement the following commands: -- Pool management. CREATE POOL

[jira] [Updated] (HIVE-17954) Implement pool, user, group and trigger to pool management API's.

2017-11-06 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish Jaiprakash updated HIVE-17954: - Attachment: HIVE-17954.01.patch Draft changes, some APIs are not implemented in

[jira] [Commented] (HIVE-17990) Add Thrift and DB storage for Schema Registry objects

2017-11-06 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16240991#comment-16240991 ] Alan Gates commented on HIVE-17990: --- Committed patch for this to standalone-metastore branch. > Add

[jira] [Commented] (HIVE-17983) Make the standalone metastore generate tarballs etc.

2017-11-06 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16241135#comment-16241135 ] Thejas M Nair commented on HIVE-17983: -- bq. On the installation and upgrade scripts I have only

[jira] [Commented] (HIVE-17954) Implement pool, user, group and trigger to pool management API's.

2017-11-06 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16241137#comment-16241137 ] Hive QA commented on HIVE-17954: Here are the results of testing the latest attachment:

[jira] [Updated] (HIVE-16827) Merge stats task and column stats task into a single task

2017-11-06 Thread Zoltan Haindrich (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoltan Haindrich updated HIVE-16827: Attachment: HIVE-16827.05wip12.patch > Merge stats task and column stats task into a single

[jira] [Updated] (HIVE-16827) Merge stats task and column stats task into a single task

2017-11-06 Thread Zoltan Haindrich (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoltan Haindrich updated HIVE-16827: Attachment: HIVE-16827.05.patch > Merge stats task and column stats task into a single task

[jira] [Updated] (HIVE-16827) Merge stats task and column stats task into a single task

2017-11-06 Thread Zoltan Haindrich (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoltan Haindrich updated HIVE-16827: Attachment: (was: HIVE-16827.05wip12.patch) > Merge stats task and column stats task

[jira] [Updated] (HIVE-17904) handle internal Tez AM restart in registry and WM

2017-11-06 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-17904: Attachment: HIVE-17904.patch The patch. Actually, onDestroy was doing an entirely wrong

[jira] [Commented] (HIVE-16827) Merge stats task and column stats task into a single task

2017-11-06 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16241209#comment-16241209 ] Hive QA commented on HIVE-16827: Here are the results of testing the latest attachment:

[jira] [Updated] (HIVE-17979) Tez: Improve ReduceRecordSource passDownKey copying

2017-11-06 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-17979: --- Attachment: HIVE-17979.2.patch > Tez: Improve ReduceRecordSource passDownKey copying >

[jira] [Updated] (HIVE-17967) Move HiveMetaStore class

2017-11-06 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated HIVE-17967: -- Attachment: HIVE-17967.3.patch Third patch that addresses one of the earlier unit test failures. >

[jira] [Comment Edited] (HIVE-17856) MM tables - IOW is not ACID compliant

2017-11-06 Thread Steve Yeom (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16241344#comment-16241344 ] Steve Yeom edited comment on HIVE-17856 at 11/7/17 2:08 AM: 4) is actually a

[jira] [Commented] (HIVE-17942) HiveAlterHandler not using conf from threadlocal

2017-11-06 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16241431#comment-16241431 ] Hive QA commented on HIVE-17942: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-15016) Run tests with Hadoop 3.0.0-beta1

2017-11-06 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16241531#comment-16241531 ] Ashutosh Chauhan commented on HIVE-15016: - +1 > Run tests with Hadoop 3.0.0-beta1 >

[jira] [Commented] (HIVE-16827) Merge stats task and column stats task into a single task

2017-11-06 Thread Zoltan Haindrich (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16241610#comment-16241610 ] Zoltan Haindrich commented on HIVE-16827: - bucketmapjoin7 have missed the q.out update; other test

[jira] [Commented] (HIVE-17229) HiveMetastore HMSHandler locks during initialization, even though its static variable threadPool is not null

2017-11-06 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16241438#comment-16241438 ] Rajesh Balamohan commented on HIVE-17229: - Patch lgtm in terms of reducing the locking contention

[jira] [Commented] (HIVE-16827) Merge stats task and column stats task into a single task

2017-11-06 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16241591#comment-16241591 ] Hive QA commented on HIVE-16827: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-17856) MM tables - IOW is not ACID compliant

2017-11-06 Thread Steve Yeom (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16241344#comment-16241344 ] Steve Yeom commented on HIVE-17856: --- 4) is actually a good comment. The current patch 1 has not

[jira] [Commented] (HIVE-17376) Upgrade snappy version to 1.1.4

2017-11-06 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16241343#comment-16241343 ] Ashutosh Chauhan commented on HIVE-17376: - +1 > Upgrade snappy version to 1.1.4 >

[jira] [Commented] (HIVE-17767) Rewrite correlated EXISTS/IN subqueries into LEFT SEMI JOIN

2017-11-06 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16241362#comment-16241362 ] Hive QA commented on HIVE-17767: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-17259) Hive JDBC does not recognize UNIONTYPE columns

2017-11-06 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16241359#comment-16241359 ] Ashutosh Chauhan commented on HIVE-17259: - [~pvillard] Patch is incorrectly generated. It deletes

[jira] [Commented] (HIVE-17714) move custom SerDe schema considerations into metastore from QL

2017-11-06 Thread Vihang Karajgaonkar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16241398#comment-16241398 ] Vihang Karajgaonkar commented on HIVE-17714: Hi [~sershe] I am still looking at the AvroSerDe

[jira] [Commented] (HIVE-17767) Rewrite correlated EXISTS/IN subqueries into LEFT SEMI JOIN

2017-11-06 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16241527#comment-16241527 ] Ashutosh Chauhan commented on HIVE-17767: - +1 > Rewrite correlated EXISTS/IN subqueries into LEFT

[jira] [Commented] (HIVE-17856) MM tables - IOW is not ACID compliant

2017-11-06 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16241341#comment-16241341 ] Eugene Koifman commented on HIVE-17856: --- 2) Everything in Acid relies on AcidUtils.getAcidState() -

[jira] [Updated] (HIVE-17902) add a notions of default pool and unmanaged mapping part 1

2017-11-06 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-17902: Attachment: HIVE-17902.08.patch Rebasing again. > add a notions of default pool and

[jira] [Updated] (HIVE-17767) Rewrite correlated EXISTS/IN subqueries into LEFT SEMI JOIN

2017-11-06 Thread Vineet Garg (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-17767: --- Status: Open (was: Patch Available) > Rewrite correlated EXISTS/IN subqueries into LEFT SEMI JOIN >

[jira] [Commented] (HIVE-17961) NPE during initialization of VectorizedParquetRecordReader when input split is null

2017-11-06 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16241470#comment-16241470 ] Hive QA commented on HIVE-17961: Here are the results of testing the latest attachment:

[jira] [Updated] (HIVE-17994) Vectorization: Serialization bottlenecked on irrelevant hashmap lookup

2017-11-06 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-17994: --- Priority: Minor (was: Major) > Vectorization: Serialization bottlenecked on irrelevant hashmap lookup >

[jira] [Updated] (HIVE-17994) Vectorization: Serialization bottlenecked on irrelevant hashmap lookup

2017-11-06 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-17994: --- Attachment: vec-serialize-hashmap.png > Vectorization: Serialization bottlenecked on irrelevant hashmap

[jira] [Updated] (HIVE-17994) Vectorization: Serialization bottlenecked on irrelevant hashmap lookup

2017-11-06 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-17994: --- Description: On machines with slower NUMA, the hashmap lookup for TypeInfo::getPrimitiveCategory is the

[jira] [Commented] (HIVE-17229) HiveMetastore HMSHandler locks during initialization, even though its static variable threadPool is not null

2017-11-06 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16241364#comment-16241364 ] Ashutosh Chauhan commented on HIVE-17229: - [~rajesh.balamohan] Can you please take a look? >

[jira] [Commented] (HIVE-17767) Rewrite correlated EXISTS/IN subqueries into LEFT SEMI JOIN

2017-11-06 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16241503#comment-16241503 ] Ashutosh Chauhan commented on HIVE-17767: - seems like there are unrelated changes in latest patch.

[jira] [Commented] (HIVE-17902) add a notions of default pool and unmanaged mapping part 1

2017-11-06 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16241414#comment-16241414 ] Sergey Shelukhin commented on HIVE-17902: - [~prasanth_j] can you take a look at

[jira] [Updated] (HIVE-17767) Rewrite correlated EXISTS/IN subqueries into LEFT SEMI JOIN

2017-11-06 Thread Vineet Garg (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-17767: --- Status: Open (was: Patch Available) > Rewrite correlated EXISTS/IN subqueries into LEFT SEMI JOIN >

[jira] [Commented] (HIVE-15016) Run tests with Hadoop 3.0.0-beta1

2017-11-06 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16241522#comment-16241522 ] Hive QA commented on HIVE-15016: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-17963) Fix for HIVE-17113 can be improved for non-blobstore filesystems

2017-11-06 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16241521#comment-16241521 ] Ashutosh Chauhan commented on HIVE-17963: - +1 Thanks for detailed comments. > Fix for HIVE-17113

[jira] [Commented] (HIVE-17985) When check the partitions size in the partitioned table, it will throw NullPointerException

2017-11-06 Thread wan kun (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16241425#comment-16241425 ] wan kun commented on HIVE-17985: Hi [~kgyrtkirk] ,thank you for you reply! I have reproduce this issue

[jira] [Updated] (HIVE-17767) Rewrite correlated EXISTS/IN subqueries into LEFT SEMI JOIN

2017-11-06 Thread Vineet Garg (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-17767: --- Attachment: HIVE-17767.6.patch > Rewrite correlated EXISTS/IN subqueries into LEFT SEMI JOIN >

[jira] [Updated] (HIVE-17767) Rewrite correlated EXISTS/IN subqueries into LEFT SEMI JOIN

2017-11-06 Thread Vineet Garg (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-17767: --- Status: Patch Available (was: Open) > Rewrite correlated EXISTS/IN subqueries into LEFT SEMI JOIN >

[jira] [Commented] (HIVE-17767) Rewrite correlated EXISTS/IN subqueries into LEFT SEMI JOIN

2017-11-06 Thread Vineet Garg (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16241519#comment-16241519 ] Vineet Garg commented on HIVE-17767: Removed those unwanted changes in latest patch. > Rewrite

[jira] [Updated] (HIVE-17767) Rewrite correlated EXISTS/IN subqueries into LEFT SEMI JOIN

2017-11-06 Thread Vineet Garg (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-17767: --- Attachment: HIVE-17767.7.patch > Rewrite correlated EXISTS/IN subqueries into LEFT SEMI JOIN >

[jira] [Updated] (HIVE-17767) Rewrite correlated EXISTS/IN subqueries into LEFT SEMI JOIN

2017-11-06 Thread Vineet Garg (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-17767: --- Status: Patch Available (was: Open) > Rewrite correlated EXISTS/IN subqueries into LEFT SEMI JOIN >

[jira] [Updated] (HIVE-17767) Rewrite correlated EXISTS/IN subqueries into LEFT SEMI JOIN

2017-11-06 Thread Vineet Garg (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-17767: --- Resolution: Fixed Status: Resolved (was: Patch Available) Pushed it to master. Thanks for

[jira] [Commented] (HIVE-16917) HiveServer2 guard rails - Limit concurrent connections from user

2017-11-06 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16241277#comment-16241277 ] Hive QA commented on HIVE-16917: Here are the results of testing the latest attachment:

[jira] [Updated] (HIVE-16917) HiveServer2 guard rails - Limit concurrent connections from user

2017-11-06 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-16917: - Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was:

[jira] [Updated] (HIVE-17904) handle internal Tez AM restart in registry and WM

2017-11-06 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-17904: Attachment: HIVE-17904.patch > handle internal Tez AM restart in registry and WM >

[jira] [Commented] (HIVE-17908) LLAP External client not correctly handling killTask for pending requests

2017-11-06 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16241001#comment-16241001 ] Jason Dere commented on HIVE-17908: --- I believe that was the case - cc [~sseth] to confirm. I'll try to

[jira] [Updated] (HIVE-17874) Parquet vectorization fails on tables with complex columns when there are no projected columns

2017-11-06 Thread Vihang Karajgaonkar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vihang Karajgaonkar updated HIVE-17874: --- Resolution: Fixed Status: Resolved (was: Patch Available) > Parquet

[jira] [Commented] (HIVE-17874) Parquet vectorization fails on tables with complex columns when there are no projected columns

2017-11-06 Thread Vihang Karajgaonkar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16241009#comment-16241009 ] Vihang Karajgaonkar commented on HIVE-17874: Failures are unrelated. Committed to branch-2 >

[jira] [Commented] (HIVE-17947) Concurrent inserts might fail for ACID table since HIVE-17526 on branch-1

2017-11-06 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16241136#comment-16241136 ] Hive QA commented on HIVE-17947: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-17984) getMaxLength is not returning the previously set length in ORC file

2017-11-06 Thread Syam (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16240406#comment-16240406 ] Syam commented on HIVE-17984: - The mentioned issue was not seen while reading the ORC file from local file

[jira] [Updated] (HIVE-17984) getMaxLength is not returning the correct lengths for Char/Varchar types while reading the ORC file from WebHDFS file system

2017-11-06 Thread Syam (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Syam updated HIVE-17984: Summary: getMaxLength is not returning the correct lengths for Char/Varchar types while reading the ORC file from

  1   2   >