[jira] [Updated] (HIVE-17108) Parquet file does not gather statistic such as "RAW DATA SIZE" automatically

2017-07-19 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated HIVE-17108: Attachment: HIVE-17018.wip.patch > Parquet file does not gather statistic such as "RAW DATA

[jira] [Updated] (HIVE-17108) Parquet file does not gather statistic such as "RAW DATA SIZE" automatically

2017-07-19 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated HIVE-17108: Attachment: (was: HIVE-17018.patch) > Parquet file does not gather statistic such as

[jira] [Updated] (HIVE-17108) Parquet file does not gather statistic such as "RAW DATA SIZE" automatically

2017-07-19 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated HIVE-17108: Attachment: HIVE-17018.patch > Parquet file does not gather statistic such as "RAW DATA

[jira] [Assigned] (HIVE-17108) Parquet file does not gather statistic such as "RAW DATA SIZE" automatically

2017-07-19 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel reassigned HIVE-17108: --- Assignee: liyunzhang_intel > Parquet file does not gather statistic such as "RAW

[jira] [Updated] (HIVE-16964) _orc_acid_version file is missing

2017-07-19 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-16964: -- Summary: _orc_acid_version file is missing (was: _orc_acid_version file is missin) >

[jira] [Commented] (HIVE-17108) Parquet file does not gather statistic such as "RAW DATA SIZE" automatically

2017-07-19 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094128#comment-16094128 ] liyunzhang_intel commented on HIVE-17108: - the detail reason why parquet file does not gather

[jira] [Commented] (HIVE-17131) Add InterfaceAudience and InterfaceStability annotations for SerDe APIs

2017-07-19 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094111#comment-16094111 ] Hive QA commented on HIVE-17131: Here are the results of testing the latest attachment:

[jira] [Updated] (HIVE-17099) Update golden files for spark.only.query.files

2017-07-19 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HIVE-17099: -- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available) Pushed to

[jira] [Updated] (HIVE-16964) _orc_acid_version file is missin

2017-07-19 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-16964: -- Summary: _orc_acid_version file is missin (was: Compactor is not writing _orc_acid_version

[jira] [Updated] (HIVE-16964) Compactor is not writing _orc_acid_version file

2017-07-19 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-16964: -- Description: OrcRecordUpdater creates OrcRecordUpdater.ACID_FORMAT in the dir that it creates

[jira] [Commented] (HIVE-16759) Add table type information to HMS log notifications

2017-07-19 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094079#comment-16094079 ] Hive QA commented on HIVE-16759: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-17122) spark_vectorized_dynamic_partition_pruning.q is continuously failing

2017-07-19 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094071#comment-16094071 ] liyunzhang_intel commented on HIVE-17122: - [~stakiar]: I also found the same problem on

[jira] [Commented] (HIVE-17122) spark_vectorized_dynamic_partition_pruning.q is continuously failing

2017-07-19 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094041#comment-16094041 ] Sahil Takiar commented on HIVE-17122: - All I've found out so far is that when I revert HIVE-16273

[jira] [Commented] (HIVE-16997) Extend object store to store bit vectors

2017-07-19 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094026#comment-16094026 ] Hive QA commented on HIVE-16997: Here are the results of testing the latest attachment:

[jira] [Updated] (HIVE-17132) Add InterfaceAudience and InterfaceStability annotations of UDF APIs

2017-07-19 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-17132: Description: Add InterfaceAudience and InterfaceStability annotations for UDF APIs. UDFs are a

[jira] [Updated] (HIVE-17129) Increase usage of InterfaceAudience and InterfaceStability annotations

2017-07-19 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-17129: Summary: Increase usage of InterfaceAudience and InterfaceStability annotations (was: Increase

[jira] [Updated] (HIVE-17131) Add InterfaceAudience annotations for SerDe APIs

2017-07-19 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-17131: Status: Patch Available (was: Open) > Add InterfaceAudience annotations for SerDe APIs >

[jira] [Updated] (HIVE-17131) Add InterfaceAudience and InterfaceStability annotations for SerDe APIs

2017-07-19 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-17131: Summary: Add InterfaceAudience and InterfaceStability annotations for SerDe APIs (was: Add

[jira] [Assigned] (HIVE-17132) Add InterfaceAudience and InterfaceStability annotations of UDF APIs

2017-07-19 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar reassigned HIVE-17132: --- > Add InterfaceAudience and InterfaceStability annotations of UDF APIs >

[jira] [Updated] (HIVE-17131) Add InterfaceAudience annotations for SerDe APIs

2017-07-19 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-17131: Description: Adding InterfaceAudience and InterfaceStability annotations for the core SerDe APIs.

[jira] [Updated] (HIVE-17131) Add InterfaceAudience annotations for SerDe APIs

2017-07-19 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-17131: Attachment: (was: HIVE-17131.1.patch) > Add InterfaceAudience annotations for SerDe APIs >

[jira] [Updated] (HIVE-17131) Add InterfaceAudience annotations for SerDe APIs

2017-07-19 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-17131: Attachment: HIVE-17131.1.patch > Add InterfaceAudience annotations for SerDe APIs >

[jira] [Updated] (HIVE-17131) Add InterfaceAudience annotations for SerDe APIs

2017-07-19 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-17131: Attachment: HIVE-17131.1.patch > Add InterfaceAudience annotations for SerDe APIs >

[jira] [Updated] (HIVE-17130) Add automated tests to check backwards compatibility of core APIs

2017-07-19 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-17130: Issue Type: Test (was: Bug) > Add automated tests to check backwards compatibility of core APIs >

[jira] [Updated] (HIVE-17129) Increase usage of InterfaceAudience annotations

2017-07-19 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-17129: Issue Type: Improvement (was: Bug) > Increase usage of InterfaceAudience annotations >

[jira] [Commented] (HIVE-16787) Fix itests in branch-2.2

2017-07-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16093995#comment-16093995 ] ASF GitHub Bot commented on HIVE-16787: --- GitHub user omalley opened a pull request:

[jira] [Commented] (HIVE-17115) MetaStoreUtils.getDeserializer doesn't catch the java.lang.ClassNotFoundException

2017-07-19 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16093985#comment-16093985 ] Daniel Dai commented on HIVE-17115: --- I think what [~erik.fang] hit is thrift call does not return as it

[jira] [Updated] (HIVE-16759) Add table type information to HMS log notifications

2017-07-19 Thread Janaki Lahorani (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Janaki Lahorani updated HIVE-16759: --- Attachment: HIVE16759.2.patch JSON message includes the table type for create table, alter

[jira] [Updated] (HIVE-16997) Extend object store to store bit vectors

2017-07-19 Thread Pengcheng Xiong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pengcheng Xiong updated HIVE-16997: --- Description: This patch includes: (1) a new serde for FMSketch (2) change of schema for derby

[jira] [Updated] (HIVE-16997) Extend object store to store bit vectors

2017-07-19 Thread Pengcheng Xiong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pengcheng Xiong updated HIVE-16997: --- Status: Patch Available (was: Open) > Extend object store to store bit vectors >

[jira] [Updated] (HIVE-16997) Extend object store to store bit vectors

2017-07-19 Thread Pengcheng Xiong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pengcheng Xiong updated HIVE-16997: --- Attachment: HIVE-16997.01.patch > Extend object store to store bit vectors >

[jira] [Commented] (HIVE-17090) spark.only.query.files are not being run by ptest

2017-07-19 Thread JIRA
[ https://issues.apache.org/jira/browse/HIVE-17090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16093918#comment-16093918 ] Sergio Peña commented on HIVE-17090: Thanks. Feel free to commit this then. > spark.only.query.files

[jira] [Commented] (HIVE-17090) spark.only.query.files are not being run by ptest

2017-07-19 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16093912#comment-16093912 ] Sahil Takiar commented on HIVE-17090: - [~spena], yes I already applied this profile to the ptest

[jira] [Commented] (HIVE-16369) Vectorization: Support PTF (Part 1: No Custom Window Framing -- Default Only)

2017-07-19 Thread Matt McCline (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16093910#comment-16093910 ] Matt McCline commented on HIVE-16369: - Thank you Ashutosh for the code review. > Vectorization:

[jira] [Updated] (HIVE-17125) Lineage: Generate lineage information on need basis when atlas hook is enabled

2017-07-19 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-17125: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0 Status:

[jira] [Updated] (HIVE-15880) Allow insert overwrite and truncate table query to use auto.purge table property

2017-07-19 Thread Lefty Leverenz (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lefty Leverenz updated HIVE-15880: -- Labels: (was: TODOC2.3) > Allow insert overwrite and truncate table query to use auto.purge

[jira] [Commented] (HIVE-15880) Allow insert overwrite and truncate table query to use auto.purge table property

2017-07-19 Thread Lefty Leverenz (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16093903#comment-16093903 ] Lefty Leverenz commented on HIVE-15880: --- (Blush.) My bad -- I meant to review your docs, then

[jira] [Commented] (HIVE-17090) spark.only.query.files are not being run by ptest

2017-07-19 Thread JIRA
[ https://issues.apache.org/jira/browse/HIVE-17090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16093904#comment-16093904 ] Sergio Peña commented on HIVE-17090: I forgot this patch is not executed. [~stakiar] YOu already

[jira] [Commented] (HIVE-17090) spark.only.query.files are not being run by ptest

2017-07-19 Thread JIRA
[ https://issues.apache.org/jira/browse/HIVE-17090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16093900#comment-16093900 ] Sergio Peña commented on HIVE-17090: I see some spark failures. Are those related to this change? >

[jira] [Updated] (HIVE-15844) Make ReduceSinkOperator independent of Acid

2017-07-19 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-15844: -- Description: # both FileSinkDesk and ReduceSinkDesk have special code path for Update/Delete

[jira] [Updated] (HIVE-15844) Make ReduceSinkOperator independent of Acid

2017-07-19 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-15844: -- Description: # both FileSinkDesk and ReduceSinkDesk have special code path for Update/Delete

[jira] [Assigned] (HIVE-17130) Add automated tests to check backwards compatibility of core APIs

2017-07-19 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar reassigned HIVE-17130: --- > Add automated tests to check backwards compatibility of core APIs >

[jira] [Updated] (HIVE-17129) Increase usage of InterfaceAudience annotations

2017-07-19 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-17129: Description: The {{InterfaceAudience}} and {{InterfaceStability}} annotations were added a while

[jira] [Assigned] (HIVE-17131) Add InterfaceAudience annotations for SerDe APIs

2017-07-19 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar reassigned HIVE-17131: --- > Add InterfaceAudience annotations for SerDe APIs >

[jira] [Commented] (HIVE-16077) UPDATE/DELETE fails with numBuckets > numReducers

2017-07-19 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16093881#comment-16093881 ] Hive QA commented on HIVE-16077: Here are the results of testing the latest attachment:

[jira] [Assigned] (HIVE-17129) Increase usage of InterfaceAudience annotations

2017-07-19 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar reassigned HIVE-17129: --- > Increase usage of InterfaceAudience annotations >

[jira] [Reopened] (HIVE-17088) HS2 WebUI throws a NullPointerException when opened

2017-07-19 Thread JIRA
[ https://issues.apache.org/jira/browse/HIVE-17088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergio Peña reopened HIVE-17088: This is still failing when running the HS2 from the hiveserver2.sh script. I will revert the patch

[jira] [Commented] (HIVE-17037) Extend join algorithm selection to avoid unnecessary input data shuffle

2017-07-19 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16093768#comment-16093768 ] Ashutosh Chauhan commented on HIVE-17037: - +1 > Extend join algorithm selection to avoid

[jira] [Work started] (HIVE-16077) UPDATE/DELETE fails with numBuckets > numReducers

2017-07-19 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HIVE-16077 started by Eugene Koifman. - > UPDATE/DELETE fails with numBuckets > numReducers >

[jira] [Updated] (HIVE-16077) UPDATE/DELETE fails with numBuckets > numReducers

2017-07-19 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-16077: -- Status: Patch Available (was: In Progress) > UPDATE/DELETE fails with numBuckets > numReducers

[jira] [Work stopped] (HIVE-16077) UPDATE/DELETE fails with numBuckets > numReducers

2017-07-19 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HIVE-16077 stopped by Eugene Koifman. - > UPDATE/DELETE fails with numBuckets > numReducers >

[jira] [Work started] (HIVE-16077) UPDATE/DELETE fails with numBuckets > numReducers

2017-07-19 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HIVE-16077 started by Eugene Koifman. - > UPDATE/DELETE fails with numBuckets > numReducers >

[jira] [Updated] (HIVE-16077) UPDATE/DELETE fails with numBuckets > numReducers

2017-07-19 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-16077: -- Attachment: HIVE-16077.01.patch > UPDATE/DELETE fails with numBuckets > numReducers >

[jira] [Updated] (HIVE-17128) Operation Logging leaks file descriptors as the log4j Appender is never closed

2017-07-19 Thread Andrew Sherman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Sherman updated HIVE-17128: -- Description: [HIVE-16061] and [HIVE-16400] changed operation logging to use the Log4j2

[jira] [Assigned] (HIVE-17128) Operation Logging leaks file descriptors as the log4j Appender is never closed

2017-07-19 Thread Andrew Sherman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Sherman reassigned HIVE-17128: - > Operation Logging leaks file descriptors as the log4j Appender is never closed >

[jira] [Updated] (HIVE-17095) Long chain repl loads do not complete in a timely fashion

2017-07-19 Thread Sushanth Sowmyan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sushanth Sowmyan updated HIVE-17095: Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch

[jira] [Commented] (HIVE-16369) Vectorization: Support PTF (Part 1: No Custom Window Framing -- Default Only)

2017-07-19 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16093619#comment-16093619 ] Ashutosh Chauhan commented on HIVE-16369: - +1 > Vectorization: Support PTF (Part 1: No Custom

[jira] [Commented] (HIVE-10567) partial scan for rcfile table doesn't work for dynamic partition

2017-07-19 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16093572#comment-16093572 ] Ashutosh Chauhan commented on HIVE-10567: - yes.. i also tested the patch uploaded and found it

[jira] [Updated] (HIVE-17124) PlanUtils: Rand() is not a failure-tolerant distribution column

2017-07-19 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-17124: --- Status: Patch Available (was: Open) > PlanUtils: Rand() is not a failure-tolerant distribution column >

[jira] [Commented] (HIVE-17125) Lineage: Generate lineage information on need basis when atlas hook is enabled

2017-07-19 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16093566#comment-16093566 ] Ashutosh Chauhan commented on HIVE-17125: - +1 > Lineage: Generate lineage information on need

[jira] [Commented] (HIVE-17114) HoS: Possible skew in shuffling when data is not really skewed

2017-07-19 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16093563#comment-16093563 ] Gopal V commented on HIVE-17114: Yes, the bucketed table fix was taken out of that patch and parked in

[jira] [Commented] (HIVE-10567) partial scan for rcfile table doesn't work for dynamic partition

2017-07-19 Thread Bing Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16093552#comment-16093552 ] Bing Li commented on HIVE-10567: [~ashutoshc] and [~tfriedr] I tried to apply the current patch to master

[jira] [Updated] (HIVE-16960) Hive throws an ugly error exception when HDFS sticky bit is set

2017-07-19 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-16960: Resolution: Fixed Status: Resolved (was: Patch Available) Thanks for the contribution

[jira] [Commented] (HIVE-15758) Allow correlated scalar subqueries with aggregates which has non-equi join predicates

2017-07-19 Thread Vineet Garg (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16093530#comment-16093530 ] Vineet Garg commented on HIVE-15758: I think it makes sense to document this since we disallowed this

[jira] [Assigned] (HIVE-17127) delete_deleta_x_x cannot modify delta_x_x

2017-07-19 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-17127: - > delete_deleta_x_x cannot modify delta_x_x > - > >

[jira] [Work started] (HIVE-17118) Clean up of HIVE-14309 to move the orc source code to org.apache.hive.orc

2017-07-19 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HIVE-17118 started by Owen O'Malley. > Clean up of HIVE-14309 to move the orc source code to org.apache.hive.orc >

[jira] [Resolved] (HIVE-17118) Clean up of HIVE-14309 to move the orc source code to org.apache.hive.orc

2017-07-19 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley resolved HIVE-17118. -- Resolution: Fixed I committed this. Thanks for the review, Alan. > Clean up of HIVE-14309 to

[jira] [Commented] (HIVE-17118) Clean up of HIVE-14309 to move the orc source code to org.apache.hive.orc

2017-07-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16093403#comment-16093403 ] ASF GitHub Bot commented on HIVE-17118: --- Github user asfgit closed the pull request at:

[jira] [Commented] (HIVE-16973) Fetching of Delegation tokens (Kerberos) for AccumuloStorageHandler fails in HS2

2017-07-19 Thread Josh Elser (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16093328#comment-16093328 ] Josh Elser commented on HIVE-16973: --- Thanks so much, [~sushanth]! No clue why that other plexus-utils

[jira] [Commented] (HIVE-15880) Allow insert overwrite and truncate table query to use auto.purge table property

2017-07-19 Thread Vihang Karajgaonkar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16093316#comment-16093316 ] Vihang Karajgaonkar commented on HIVE-15880: Hi [~leftylev] Isnt the documentation provided

[jira] [Commented] (HIVE-17019) Add support to download debugging information as an archive.

2017-07-19 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16092968#comment-16092968 ] Hive QA commented on HIVE-17019: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-17125) Lineage: Generate lineage information on need basis when atlas hook is enabled

2017-07-19 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16092920#comment-16092920 ] Hive QA commented on HIVE-17125: Here are the results of testing the latest attachment:

[jira] [Updated] (HIVE-17019) Add support to download debugging information as an archive.

2017-07-19 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish Jaiprakash updated HIVE-17019: - Attachment: HIVE-17019.03.patch > Add support to download debugging information as an

[jira] [Updated] (HIVE-17019) Add support to download debugging information as an archive.

2017-07-19 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish Jaiprakash updated HIVE-17019: - Attachment: (was: HIVE-17019.03.patch) > Add support to download debugging

[jira] [Updated] (HIVE-17019) Add support to download debugging information as an archive.

2017-07-19 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish Jaiprakash updated HIVE-17019: - Attachment: HIVE-17019.03.patch Downgrading guice version to 3.0. > Add support to

[jira] [Commented] (HIVE-16369) Vectorization: Support PTF (Part 1: No Custom Window Framing -- Default Only)

2017-07-19 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16092876#comment-16092876 ] Hive QA commented on HIVE-16369: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-17114) HoS: Possible skew in shuffling when data is not really skewed

2017-07-19 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16092860#comment-16092860 ] Rui Li commented on HIVE-17114: --- Hi [~kellyzly], 1. It's spark code. You can look at {{HashPartitioner}}

[jira] [Commented] (HIVE-17125) Lineage: Generate lineage information on need basis when atlas hook is enabled

2017-07-19 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16092818#comment-16092818 ] Rajesh Balamohan commented on HIVE-17125: - RB: https://reviews.apache.org/r/60962/diff/1/ >

[jira] [Updated] (HIVE-17125) Lineage: Generate lineage information on need basis when atlas hook is enabled

2017-07-19 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-17125: Status: Patch Available (was: Open) > Lineage: Generate lineage information on need basis

[jira] [Updated] (HIVE-17125) Lineage: Generate lineage information on need basis when atlas hook is enabled

2017-07-19 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-17125: Attachment: HIVE-17125.1.patch > Lineage: Generate lineage information on need basis when

[jira] [Assigned] (HIVE-17125) Lineage: Generate lineage information on need basis when atlas hook is enabled

2017-07-19 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan reassigned HIVE-17125: --- > Lineage: Generate lineage information on need basis when atlas hook is enabled >

[jira] [Commented] (HIVE-16369) Vectorization: Support PTF (Part 1: No Custom Window Framing -- Default Only)

2017-07-19 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16092802#comment-16092802 ] Hive QA commented on HIVE-16369: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-17114) HoS: Possible skew in shuffling when data is not really skewed

2017-07-19 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16092780#comment-16092780 ] liyunzhang_intel commented on HIVE-17114: - [~lirui]: several questions: 1.{quote} Spark decides

[jira] [Updated] (HIVE-16369) Vectorization: Support PTF (Part 1: No Custom Window Framing -- Default Only)

2017-07-19 Thread Matt McCline (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt McCline updated HIVE-16369: Attachment: HIVE-16369.0993.patch > Vectorization: Support PTF (Part 1: No Custom Window Framing --

[jira] [Updated] (HIVE-17124) PlanUtils: Rand() is not a failure-tolerant distribution column

2017-07-19 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-17124: --- Attachment: HIVE-17124.1.patch > PlanUtils: Rand() is not a failure-tolerant distribution column >

[jira] [Assigned] (HIVE-17124) PlanUtils: Rand() is not a failure-tolerant distribution column

2017-07-19 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V reassigned HIVE-17124: -- Assignee: Gopal V > PlanUtils: Rand() is not a failure-tolerant distribution column >

[jira] [Commented] (HIVE-17123) Vectorization: Wrong results for vector_groupby_cube1.q

2017-07-19 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16092723#comment-16092723 ] Gopal V commented on HIVE-17123: {code} Reduce Output Operator

[jira] [Updated] (HIVE-16369) Vectorization: Support PTF (Part 1: No Custom Window Framing -- Default Only)

2017-07-19 Thread Matt McCline (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt McCline updated HIVE-16369: Status: In Progress (was: Patch Available) > Vectorization: Support PTF (Part 1: No Custom Window

[jira] [Updated] (HIVE-16369) Vectorization: Support PTF (Part 1: No Custom Window Framing -- Default Only)

2017-07-19 Thread Matt McCline (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt McCline updated HIVE-16369: Status: Patch Available (was: In Progress) > Vectorization: Support PTF (Part 1: No Custom Window

[jira] [Updated] (HIVE-16369) Vectorization: Support PTF (Part 1: No Custom Window Framing -- Default Only)

2017-07-19 Thread Matt McCline (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt McCline updated HIVE-16369: Attachment: HIVE-16369.0992.patch > Vectorization: Support PTF (Part 1: No Custom Window Framing --

[jira] [Updated] (HIVE-16369) Vectorization: Support PTF (Part 1: No Custom Window Framing -- Default Only)

2017-07-19 Thread Matt McCline (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt McCline updated HIVE-16369: Description: Vectorize a submit of current PTFOperator window function support. The first phase

[jira] [Assigned] (HIVE-17123) Vectorization: Wrong results for vector_groupby_cube1.q

2017-07-19 Thread Matt McCline (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt McCline reassigned HIVE-17123: --- > Vectorization: Wrong results for vector_groupby_cube1.q >

[jira] [Commented] (HIVE-17111) TestSparkCliDriver does not use LocalHiveSparkClient

2017-07-19 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16092672#comment-16092672 ] Rui Li commented on HIVE-17111: --- Hi [~stakiar], [~csun], there was some issue specific to yarn-cluster mode,

[jira] [Commented] (HIVE-17099) Update golden files for spark.only.query.files

2017-07-19 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16092652#comment-16092652 ] Rui Li commented on HIVE-17099: --- +1, thanks for the update > Update golden files for spark.only.query.files

[jira] [Commented] (HIVE-17114) HoS: Possible skew in shuffling when data is not really skewed

2017-07-19 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16092647#comment-16092647 ] Rui Li commented on HIVE-17114: --- Hi [~kellyzly], I have an example in the description. Basically, Spark

[jira] [Commented] (HIVE-17095) Long chain repl loads do not complete in a timely fashion

2017-07-19 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16092644#comment-16092644 ] Daniel Dai commented on HIVE-17095: --- +1 > Long chain repl loads do not complete in a timely fashion >