[jira] [Updated] (HIVE-15417) Glitches using ACID's row__id hidden column

2016-12-13 Thread Jesus Camacho Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-15417: --- Resolution: Fixed Fix Version/s: 2.2.0 Status: Resolved

[jira] [Commented] (HIVE-15335) Fast Decimal

2016-12-13 Thread Matt McCline (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15744545#comment-15744545 ] Matt McCline commented on HIVE-15335: - I haven't created a pull request before. But, do you mean a

[jira] [Updated] (HIVE-14496) Enable Calcite rewriting with materialized views

2016-12-13 Thread Jesus Camacho Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-14496: --- Attachment: (was: HIVE-14496.06.patch) > Enable Calcite rewriting with

[jira] [Commented] (HIVE-15422) HiveInputFormat::pushProjectionsAndFilters paths comparison generates huge number of objects for partitioned dataset

2016-12-13 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15744614#comment-15744614 ] Hive QA commented on HIVE-15422: Here are the results of testing the latest attachment:

[jira] [Updated] (HIVE-14496) Enable Calcite rewriting with materialized views

2016-12-13 Thread Jesus Camacho Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-14496: --- Attachment: HIVE-14496.07.patch Rebasing patch. > Enable Calcite rewriting

[jira] [Updated] (HIVE-15426) Fix order guarantee of event executions for REPL LOAD

2016-12-13 Thread Sushanth Sowmyan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sushanth Sowmyan updated HIVE-15426: Attachment: HIVE-15426.patch Attached patch to fix order guarantee of event executions.

[jira] [Updated] (HIVE-15426) Fix order guarantee of event executions for REPL LOAD

2016-12-13 Thread Sushanth Sowmyan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sushanth Sowmyan updated HIVE-15426: Status: Patch Available (was: Open) > Fix order guarantee of event executions for REPL

[jira] [Commented] (HIVE-15410) WebHCat supports get/set table property with its name containing period and hyphen

2016-12-13 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15746407#comment-15746407 ] Thejas M Nair commented on HIVE-15410: -- +1 Thanks for the update and explanation. > WebHCat supports

[jira] [Assigned] (HIVE-6365) Alter a partition to be of a different fileformat than the Table's fileformat. Use insert overwrite to write data to this partition. The partition fileformat is converted

2016-12-13 Thread Anthony Hsu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anthony Hsu reassigned HIVE-6365: - Assignee: Anthony Hsu > Alter a partition to be of a different fileformat than the Table's >

[jira] [Commented] (HIVE-15376) Improve heartbeater scheduling for transactions

2016-12-13 Thread Wei Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15746678#comment-15746678 ] Wei Zheng commented on HIVE-15376: -- [~ekoifman] Can you take another look please? > Improve heartbeater

[jira] [Commented] (HIVE-15426) Fix order guarantee of event executions for REPL LOAD

2016-12-13 Thread Sushanth Sowmyan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15746687#comment-15746687 ] Sushanth Sowmyan commented on HIVE-15426: - None of the test failures are relted. [~vgumashta],

[jira] [Commented] (HIVE-15422) HiveInputFormat::pushProjectionsAndFilters paths comparison generates huge number of objects for partitioned dataset

2016-12-13 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15746753#comment-15746753 ] Hive QA commented on HIVE-15422: Here are the results of testing the latest attachment:

[jira] [Assigned] (HIVE-15422) HiveInputFormat::pushProjectionsAndFilters paths comparison generates huge number of objects for partitioned dataset

2016-12-13 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan reassigned HIVE-15422: --- Assignee: Rajesh Balamohan > HiveInputFormat::pushProjectionsAndFilters paths

[jira] [Commented] (HIVE-15353) Metastore throws NPE if StorageDescriptor.cols is null

2016-12-13 Thread Anthony Hsu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15746685#comment-15746685 ] Anthony Hsu commented on HIVE-15353: Test failures look unrelated. > Metastore throws NPE if

[jira] [Commented] (HIVE-15376) Improve heartbeater scheduling for transactions

2016-12-13 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15746720#comment-15746720 ] Eugene Koifman commented on HIVE-15376: --- patch 6 Why do you need to expose the "delay" to the

[jira] [Assigned] (HIVE-13278) Many redundant 'File not found' messages appeared in container log during query execution with Hive on Spark

2016-12-13 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun reassigned HIVE-13278: --- Assignee: Chao Sun (was: Sahil Takiar) > Many redundant 'File not found' messages appeared in

[jira] [Updated] (HIVE-15422) HiveInputFormat::pushProjectionsAndFilters paths comparison generates huge number of objects for partitioned dataset

2016-12-13 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-15422: Attachment: HIVE-15422.2.patch Thanks [~sershe]. Addressed the review comments in latest

[jira] [Commented] (HIVE-15294) Capture additional metadata to replicate a simple insert at destination

2016-12-13 Thread Vaibhav Gumashta (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15746605#comment-15746605 ] Vaibhav Gumashta commented on HIVE-15294: - [~thejas] I'll also need to create a copy of

[jira] [Commented] (HIVE-14948) properly handle special characters in identifiers

2016-12-13 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15746710#comment-15746710 ] Eugene Koifman commented on HIVE-14948: --- They were moved to TestTxnCommands to make runtime of the

[jira] [Commented] (HIVE-15426) Fix order guarantee of event executions for REPL LOAD

2016-12-13 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15746614#comment-15746614 ] Hive QA commented on HIVE-15426: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-14948) properly handle special characters in identifiers

2016-12-13 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15746699#comment-15746699 ] Alan Gates commented on HIVE-14948: --- +1. Were the tests removed from TestTxnCommands2 superseded by

[jira] [Updated] (HIVE-15192) Use Calcite to de-correlate and plan subqueries

2016-12-13 Thread Vineet Garg (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-15192: --- Status: Patch Available (was: Open) > Use Calcite to de-correlate and plan subqueries >

[jira] [Commented] (HIVE-13278) Many redundant 'File not found' messages appeared in container log during query execution with Hive on Spark

2016-12-13 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15747588#comment-15747588 ] Hive QA commented on HIVE-13278: Here are the results of testing the latest attachment:

[jira] [Updated] (HIVE-15192) Use Calcite to de-correlate and plan subqueries

2016-12-13 Thread Vineet Garg (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-15192: --- Status: Open (was: Patch Available) > Use Calcite to de-correlate and plan subqueries >

[jira] [Updated] (HIVE-15192) Use Calcite to de-correlate and plan subqueries

2016-12-13 Thread Vineet Garg (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vineet Garg updated HIVE-15192: --- Attachment: HIVE-15192.9.patch Addressed review comments > Use Calcite to de-correlate and plan

[jira] [Commented] (HIVE-15357) Fix and re-enable the spark-only tests

2016-12-13 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15747039#comment-15747039 ] Rui Li commented on HIVE-15357: --- Hi [~csun], I created HIVE-15428 for it. > Fix and re-enable the

[jira] [Comment Edited] (HIVE-13278) Many redundant 'File not found' messages appeared in container log during query execution with Hive on Spark

2016-12-13 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15747241#comment-15747241 ] Chao Sun edited comment on HIVE-13278 at 12/14/16 4:59 AM: --- Thanks [~xuefuz] and

[jira] [Commented] (HIVE-13278) Many redundant 'File not found' messages appeared in container log during query execution with Hive on Spark

2016-12-13 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15747376#comment-15747376 ] Sahil Takiar commented on HIVE-13278: - [~csun], [~xuefuz] yes feel free to move this patch forward.

[jira] [Updated] (HIVE-13278) Many redundant 'File not found' messages appeared in container log during query execution with Hive on Spark

2016-12-13 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HIVE-13278: Assignee: Sahil Takiar (was: Chao Sun) > Many redundant 'File not found' messages appeared in container

[jira] [Commented] (HIVE-13278) Many redundant 'File not found' messages appeared in container log during query execution with Hive on Spark

2016-12-13 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15747021#comment-15747021 ] Hive QA commented on HIVE-13278: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-13278) Many redundant 'File not found' messages appeared in container log during query execution with Hive on Spark

2016-12-13 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15747301#comment-15747301 ] Chao Sun commented on HIVE-13278: - Actually for HoS besides {{checkOutputSpecs}} I can't think of any case

[jira] [Commented] (HIVE-15425) Eliminate conflicting output from schematool's table validator.

2016-12-13 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15747380#comment-15747380 ] Hive QA commented on HIVE-15425: Here are the results of testing the latest attachment:

[jira] [Updated] (HIVE-13278) Many redundant 'File not found' messages appeared in container log during query execution with Hive on Spark

2016-12-13 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HIVE-13278: Attachment: (was: HIVE-13278.2.patch) > Many redundant 'File not found' messages appeared in container

[jira] [Commented] (HIVE-13278) Many redundant 'File not found' messages appeared in container log during query execution with Hive on Spark

2016-12-13 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15747409#comment-15747409 ] Chao Sun commented on HIVE-13278: - Thanks [~stakiar] :) > Many redundant 'File not found' messages

[jira] [Updated] (HIVE-13278) Many redundant 'File not found' messages appeared in container log during query execution with Hive on Spark

2016-12-13 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HIVE-13278: Attachment: HIVE-13278.2.patch > Many redundant 'File not found' messages appeared in container log during

[jira] [Commented] (HIVE-15378) clean up HADOOP_USER_CLASSPATH_FIRST in bin scripts

2016-12-13 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15746995#comment-15746995 ] Fei Hui commented on HIVE-15378: hi [~spena] There is no errors, but HADOOP_USER_CLASSPATH_FIRST is

[jira] [Updated] (HIVE-15428) HoS DPP doesn't remove cyclic dependency

2016-12-13 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HIVE-15428: -- Description: More details in HIVE-15357 > HoS DPP doesn't remove cyclic dependency >

[jira] [Comment Edited] (HIVE-13278) Many redundant 'File not found' messages appeared in container log during query execution with Hive on Spark

2016-12-13 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15747241#comment-15747241 ] Chao Sun edited comment on HIVE-13278 at 12/14/16 4:39 AM: --- Thanks [~xuefuz] and

[jira] [Updated] (HIVE-15425) Eliminate conflicting output from schematool's table validator.

2016-12-13 Thread Naveen Gangam (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naveen Gangam updated HIVE-15425: - Status: Patch Available (was: Open) > Eliminate conflicting output from schematool's table

[jira] [Commented] (HIVE-13278) Many redundant 'File not found' messages appeared in container log during query execution with Hive on Spark

2016-12-13 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15747467#comment-15747467 ] Hive QA commented on HIVE-13278: Here are the results of testing the latest attachment:

[jira] [Assigned] (HIVE-13278) Many redundant 'File not found' messages appeared in container log during query execution with Hive on Spark

2016-12-13 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun reassigned HIVE-13278: --- Assignee: Chao Sun (was: Sahil Takiar) > Many redundant 'File not found' messages appeared in

[jira] [Updated] (HIVE-13278) Many redundant 'File not found' messages appeared in container log during query execution with Hive on Spark

2016-12-13 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HIVE-13278: Status: Patch Available (was: Open) > Many redundant 'File not found' messages appeared in container log

[jira] [Updated] (HIVE-13278) Many redundant 'File not found' messages appeared in container log during query execution with Hive on Spark

2016-12-13 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HIVE-13278: Attachment: HIVE-13278.1.patch I'm also working on this issue and I think it's better to avoid unnecessary

[jira] [Commented] (HIVE-15357) Fix and re-enable the spark-only tests

2016-12-13 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15746826#comment-15746826 ] Chao Sun commented on HIVE-15357: - [~ruili] I don't remember exactly why we didn't include the cycle

[jira] [Updated] (HIVE-15277) Teach Hive how to create/delete Druid segments

2016-12-13 Thread slim bouguerra (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] slim bouguerra updated HIVE-15277: -- Attachment: HIVE-15277.patch > Teach Hive how to create/delete Druid segments >

[jira] [Commented] (HIVE-13278) Many redundant 'File not found' messages appeared in container log during query execution with Hive on Spark

2016-12-13 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15747031#comment-15747031 ] Rui Li commented on HIVE-13278: --- [~csun], thanks for the patch. I think Xuefu's concerns are valid. In

[jira] [Commented] (HIVE-15277) Teach Hive how to create/delete Druid segments

2016-12-13 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15747102#comment-15747102 ] Hive QA commented on HIVE-15277: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-13278) Many redundant 'File not found' messages appeared in container log during query execution with Hive on Spark

2016-12-13 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15747344#comment-15747344 ] Xuefu Zhang commented on HIVE-13278: [~csun], please feel free to address MR case first if we need

[jira] [Commented] (HIVE-13278) Many redundant 'File not found' messages appeared in container log during query execution with Hive on Spark

2016-12-13 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15747342#comment-15747342 ] Xuefu Zhang commented on HIVE-13278: [~csun], please feel free to address MR case first if we need

[jira] [Commented] (HIVE-13278) Many redundant 'File not found' messages appeared in container log during query execution with Hive on Spark

2016-12-13 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15747436#comment-15747436 ] Rui Li commented on HIVE-13278: --- [~csun], I think the error is found in container's log. SparkPlanGenerator

[jira] [Updated] (HIVE-13278) Many redundant 'File not found' messages appeared in container log during query execution with Hive on Spark

2016-12-13 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HIVE-13278: Attachment: (was: HIVE-13278.2.patch) > Many redundant 'File not found' messages appeared in container

[jira] [Updated] (HIVE-13278) Many redundant 'File not found' messages appeared in container log during query execution with Hive on Spark

2016-12-13 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HIVE-13278: Attachment: HIVE-13278.2.patch > Many redundant 'File not found' messages appeared in container log during

[jira] [Updated] (HIVE-13278) Many redundant 'File not found' messages appeared in container log during query execution with Hive on Spark

2016-12-13 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HIVE-13278: Assignee: Sahil Takiar (was: Chao Sun) > Many redundant 'File not found' messages appeared in container

[jira] [Updated] (HIVE-15427) Hadoop3 support

2016-12-13 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-15427: Attachment: HIVE-15427.WIP.patch Preliminary patch to make it build (somewhat, I didn't

[jira] [Commented] (HIVE-13278) Many redundant 'File not found' messages appeared in container log during query execution with Hive on Spark

2016-12-13 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15746850#comment-15746850 ] Xuefu Zhang commented on HIVE-13278: [~stakiar], let us know if you like to work on this. Otherwise,

[jira] [Commented] (HIVE-13278) Many redundant 'File not found' messages appeared in container log during query execution with Hive on Spark

2016-12-13 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15747241#comment-15747241 ] Chao Sun commented on HIVE-13278: - Thanks [~xuefuz] and [~ruili], I think you are right. Let me revise the

[jira] [Updated] (HIVE-15425) Eliminate conflicting output from schematool's table validator.

2016-12-13 Thread Naveen Gangam (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naveen Gangam updated HIVE-15425: - Attachment: HIVE-15425.patch Attaching a patch that will only print info about missing tables

[jira] [Assigned] (HIVE-13278) Many redundant 'File not found' messages appeared in container log during query execution with Hive on Spark

2016-12-13 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun reassigned HIVE-13278: --- Assignee: Chao Sun (was: Sahil Takiar) > Many redundant 'File not found' messages appeared in

[jira] [Updated] (HIVE-13278) Many redundant 'File not found' messages appeared in container log during query execution with Hive on Spark

2016-12-13 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HIVE-13278: Attachment: HIVE-13278.2.patch > Many redundant 'File not found' messages appeared in container log during

[jira] [Commented] (HIVE-15297) Hive should not split semicolon within quoted string literals

2016-12-13 Thread Pengcheng Xiong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15747394#comment-15747394 ] Pengcheng Xiong commented on HIVE-15297: [~ashutoshc]. The query string is set in Driver.java L532

[jira] [Commented] (HIVE-15347) LLAP: Executor memory and Xmx should have some headroom for other services

2016-12-13 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15744882#comment-15744882 ] Hive QA commented on HIVE-15347: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-14496) Enable Calcite rewriting with materialized views

2016-12-13 Thread Jesus Camacho Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15744797#comment-15744797 ] Jesus Camacho Rodriguez commented on HIVE-14496: [~ashutoshc], fails are unrelated. Could

[jira] [Commented] (HIVE-15347) LLAP: Executor memory and Xmx should have some headroom for other services

2016-12-13 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15744713#comment-15744713 ] Prasanth Jayachandran commented on HIVE-15347: -- [~sershe]/[~gopalv] can someone please review

[jira] [Commented] (HIVE-15424) Hive dropped table during table creation if table already exists

2016-12-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15744680#comment-15744680 ] ASF GitHub Bot commented on HIVE-15424: --- GitHub user subahugu opened a pull request:

[jira] [Commented] (HIVE-14496) Enable Calcite rewriting with materialized views

2016-12-13 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15744765#comment-15744765 ] Hive QA commented on HIVE-14496: Here are the results of testing the latest attachment:

[jira] [Updated] (HIVE-15347) LLAP: Executor memory and Xmx should have some headroom for other services

2016-12-13 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-15347: - Status: Patch Available (was: Open) > LLAP: Executor memory and Xmx should have

[jira] [Updated] (HIVE-15347) LLAP: Executor memory and Xmx should have some headroom for other services

2016-12-13 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-15347: - Attachment: HIVE-15347.1.patch > LLAP: Executor memory and Xmx should have some

[jira] [Updated] (HIVE-15335) Fast Decimal

2016-12-13 Thread Matt McCline (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt McCline updated HIVE-15335: Status: Patch Available (was: In Progress) > Fast Decimal > > > Key:

[jira] [Updated] (HIVE-15335) Fast Decimal

2016-12-13 Thread Matt McCline (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt McCline updated HIVE-15335: Attachment: HIVE-15335.08.patch > Fast Decimal > > > Key: HIVE-15335 >

[jira] [Updated] (HIVE-15335) Fast Decimal

2016-12-13 Thread Matt McCline (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt McCline updated HIVE-15335: Status: In Progress (was: Patch Available) > Fast Decimal > > > Key:

[jira] [Commented] (HIVE-15076) Improve scalability of LDAP authentication provider group filter

2016-12-13 Thread Illya Yalovyy (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15745376#comment-15745376 ] Illya Yalovyy commented on HIVE-15076: -- [~aihuaxu] I have addressed your concerns. Please see my

[jira] [Commented] (HIVE-15357) Fix and re-enable the spark-only tests

2016-12-13 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15745110#comment-15745110 ] Rui Li commented on HIVE-15357: --- When I tried to re-enable these tests, I found this issue with DPP. Running

[jira] [Updated] (HIVE-15391) Location validation for table should ignore the values for view.

2016-12-13 Thread Yongzhi Chen (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongzhi Chen updated HIVE-15391: Resolution: Fixed Fix Version/s: 2.2.0 Status: Resolved (was: Patch Available)

[jira] [Commented] (HIVE-15335) Fast Decimal

2016-12-13 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15745172#comment-15745172 ] Hive QA commented on HIVE-15335: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-13278) Many redundant 'File not found' messages appeared in container log during query execution with Hive on Spark

2016-12-13 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15745219#comment-15745219 ] Xuefu Zhang commented on HIVE-13278: [~lirui], thanks for the summary. Following your idea, can we

[jira] [Updated] (HIVE-15424) Hive dropped table during table creation if table already exists

2016-12-13 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-15424: Status: Patch Available (was: Open) +1 > Hive dropped table during table creation if

[jira] [Commented] (HIVE-14735) Build Infra: Spark artifacts download takes a long time

2016-12-13 Thread JIRA
[ https://issues.apache.org/jira/browse/HIVE-14735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15745569#comment-15745569 ] Sergio Peña commented on HIVE-14735: - is skipSparkTests or skipSparkAssemblyDeploy? - can we use

[jira] [Commented] (HIVE-15378) clean up HADOOP_USER_CLASSPATH_FIRST in bin scripts

2016-12-13 Thread JIRA
[ https://issues.apache.org/jira/browse/HIVE-15378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15745590#comment-15745590 ] Sergio Peña commented on HIVE-15378: what's the problem with this variable on the scripts? Are there

[jira] [Updated] (HIVE-15384) Compressor plugin

2016-12-13 Thread Kevin Liew (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Liew updated HIVE-15384: -- Description: Splitting compressor into separate JIRA from server framework (was: Splitting server

[jira] [Commented] (HIVE-15421) Assumption in exception handling can be wrong in DagUtils.localizeResource

2016-12-13 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15745885#comment-15745885 ] Daniel Dai commented on HIVE-15421: --- +1 > Assumption in exception handling can be wrong in

[jira] [Updated] (HIVE-15339) Batch metastore calls to get column stats for fields needed in FilterSelectivityEstimator

2016-12-13 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thejas M Nair updated HIVE-15339: - Summary: Batch metastore calls to get column stats for fields needed in

[jira] [Assigned] (HIVE-15384) Compressor plugin

2016-12-13 Thread Kevin Liew (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Liew reassigned HIVE-15384: - Assignee: Kevin Liew > Compressor plugin > - > > Key: HIVE-15384

[jira] [Updated] (HIVE-15421) Assumption in exception handling can be wrong in DagUtils.localizeResource

2016-12-13 Thread Wei Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Zheng updated HIVE-15421: - Attachment: HIVE-15421.2.patch > Assumption in exception handling can be wrong in

[jira] [Updated] (HIVE-15421) Assumption in exception handling can be wrong in DagUtils.localizeResource

2016-12-13 Thread Wei Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Zheng updated HIVE-15421: - Attachment: HIVE-15421.3.patch > Assumption in exception handling can be wrong in

[jira] [Commented] (HIVE-15339) Batch metastore calls to get column stats for fields needed in FilterSelectivityEstimator

2016-12-13 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15745794#comment-15745794 ] Thejas M Nair commented on HIVE-15339: -- Updated jira summary to clarify what the patch does as

[jira] [Updated] (HIVE-15384) Snappy Compressor plugin

2016-12-13 Thread Kevin Liew (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Liew updated HIVE-15384: -- Summary: Snappy Compressor plugin (was: Compressor plugin) > Snappy Compressor plugin >

[jira] [Commented] (HIVE-15421) Assumption in exception handling can be wrong in DagUtils.localizeResource

2016-12-13 Thread Wei Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15745850#comment-15745850 ] Wei Zheng commented on HIVE-15421: -- [~daijy] patch 2 added HADOOP ticket number and fix version. Test

[jira] [Commented] (HIVE-15421) Assumption in exception handling can be wrong in DagUtils.localizeResource

2016-12-13 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15745863#comment-15745863 ] Daniel Dai commented on HIVE-15421: --- Also we'd better retain the exception chain in the new IOException:

[jira] [Updated] (HIVE-15353) Metastore throws NPE if StorageDescriptor.cols is null

2016-12-13 Thread Anthony Hsu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anthony Hsu updated HIVE-15353: --- Status: Open (was: Patch Available) > Metastore throws NPE if StorageDescriptor.cols is null >

[jira] [Updated] (HIVE-15421) Assumption in exception handling can be wrong in DagUtils.localizeResource

2016-12-13 Thread Wei Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Zheng updated HIVE-15421: - Resolution: Fixed Fix Version/s: 2.2.0 Status: Resolved (was: Patch Available)

[jira] [Commented] (HIVE-15347) LLAP: Executor memory and Xmx should have some headroom for other services

2016-12-13 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15746073#comment-15746073 ] Sergey Shelukhin commented on HIVE-15347: - +1 > LLAP: Executor memory and Xmx should have some

[jira] [Commented] (HIVE-15386) Expose Spark task counts and stage Ids information in SparkTask from SparkJobMonitor

2016-12-13 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15745988#comment-15745988 ] zhihai xu commented on HIVE-15386: -- Thanks [~xuefuz] for the review! Thanks [~lirui] for the review and

[jira] [Commented] (HIVE-15422) HiveInputFormat::pushProjectionsAndFilters paths comparison generates huge number of objects for partitioned dataset

2016-12-13 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15746089#comment-15746089 ] Sergey Shelukhin commented on HIVE-15422: - Nit: is linkedhashset needed? Doesn't seem to rely on

[jira] [Commented] (HIVE-15351) Disable vectorized VectorUDFAdaptor usage with non-column or constant parameters

2016-12-13 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15746087#comment-15746087 ] Thejas M Nair commented on HIVE-15351: -- Setting fix version to 2.2.0 for master commit. > Disable

[jira] [Updated] (HIVE-14948) properly handle special characters in identifiers

2016-12-13 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-14948: -- Status: Patch Available (was: In Progress) > properly handle special characters in identifiers

[jira] [Updated] (HIVE-14948) properly handle special characters in identifiers

2016-12-13 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-14948: -- Attachment: HIVE-14948.03.patch > properly handle special characters in identifiers >

[jira] [Updated] (HIVE-15353) Metastore throws NPE if StorageDescriptor.cols is null

2016-12-13 Thread Anthony Hsu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anthony Hsu updated HIVE-15353: --- Attachment: HIVE-15353.4.patch > Metastore throws NPE if StorageDescriptor.cols is null >

[jira] [Updated] (HIVE-15353) Metastore throws NPE if StorageDescriptor.cols is null

2016-12-13 Thread Anthony Hsu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anthony Hsu updated HIVE-15353: --- Status: Patch Available (was: Open) Reuploaded the same patch as HIVE-15353.4.patch to try to

[jira] [Commented] (HIVE-15421) Assumption in exception handling can be wrong in DagUtils.localizeResource

2016-12-13 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15746070#comment-15746070 ] Hive QA commented on HIVE-15421: Here are the results of testing the latest attachment:

[jira] [Updated] (HIVE-15351) Disable vectorized VectorUDFAdaptor usage with non-column or constant parameters

2016-12-13 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thejas M Nair updated HIVE-15351: - Fix Version/s: 2.2.0 > Disable vectorized VectorUDFAdaptor usage with non-column or constant >

  1   2   >