[jira] [Commented] (HIVE-17399) Do not remove semijoin branch if it feeds to TS->DPP_EVENT

2017-08-30 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146827#comment-16146827 ] Gopal V commented on HIVE-17399: LGTM - +1 tests pending. One minor nit - "assert false;" should be

[jira] [Commented] (HIVE-15467) escape1.q hangs in TestMiniLlapLocalCliDriver

2017-08-30 Thread Zoltan Haindrich (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146880#comment-16146880 ] Zoltan Haindrich commented on HIVE-15467: - the same issue happened again for me...I've looked into

[jira] [Commented] (HIVE-17225) HoS DPP pruning sink ops can target parallel work objects

2017-08-30 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146875#comment-16146875 ] Hive QA commented on HIVE-17225: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-17410) repl load task during subsequent DAG generation does not start from the last partition processed

2017-08-30 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146685#comment-16146685 ] Hive QA commented on HIVE-17410: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-17411) LLAP IO may incorrectly release a refcount in some rare cases

2017-08-30 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146796#comment-16146796 ] Hive QA commented on HIVE-17411: Here are the results of testing the latest attachment:

[jira] [Comment Edited] (HIVE-17385) Fix incremental repl error for non-native tables

2017-08-30 Thread Tao Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147485#comment-16147485 ] Tao Li edited comment on HIVE-17385 at 8/30/17 3:56 PM: [~daijy] Regarding the

[jira] [Commented] (HIVE-17183) Disable rename operations during bootstrap dump

2017-08-30 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147507#comment-16147507 ] Hive QA commented on HIVE-17183: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-17382) Change startsWith relation introduced in HIVE-17316

2017-08-30 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147619#comment-16147619 ] Hive QA commented on HIVE-17382: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-16886) HMS log notifications may have duplicated event IDs if multiple HMS are running concurrently

2017-08-30 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147667#comment-16147667 ] anishek commented on HIVE-16886: * org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[transform_acid]

[jira] [Updated] (HIVE-17276) Check max shuffle size when converting to dynamically partitioned hash join

2017-08-30 Thread Jesus Camacho Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-17276: --- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved

[jira] [Updated] (HIVE-16886) HMS log notifications may have duplicated event IDs if multiple HMS are running concurrently

2017-08-30 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-16886: --- Attachment: HIVE-16886.7.patch fixing log comments > HMS log notifications may have duplicated event IDs if

[jira] [Commented] (HIVE-17385) Fix incremental repl error for non-native tables

2017-08-30 Thread Tao Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147485#comment-16147485 ] Tao Li commented on HIVE-17385: --- [~daijy] Regarding the exception, I am sticking with the old logic, i.e.

[jira] [Commented] (HIVE-17307) Change the metastore to not use the metrics code in hive/common

2017-08-30 Thread Vihang Karajgaonkar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147715#comment-16147715 ] Vihang Karajgaonkar commented on HIVE-17307: +1 LGTM. I added one minor comment on the PR and

[jira] [Commented] (HIVE-17412) Add "-- SORT_QUERY_RESULTS" for spark_vectorized_dynamic_partition_pruning.q

2017-08-30 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147582#comment-16147582 ] Sahil Takiar commented on HIVE-17412: - LGTM +1 > Add "-- SORT_QUERY_RESULTS" for

[jira] [Commented] (HIVE-16886) HMS log notifications may have duplicated event IDs if multiple HMS are running concurrently

2017-08-30 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147592#comment-16147592 ] anishek commented on HIVE-16886: [~akolb] {{SQLGenerator}} is a artifact of the ACID implementation and we

[jira] [Commented] (HIVE-17225) HoS DPP pruning sink ops can target parallel work objects

2017-08-30 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147670#comment-16147670 ] Sahil Takiar commented on HIVE-17225: - [~janulatha], [~asherman] addressed your review comments. >

[jira] [Commented] (HIVE-17280) Data loss in CONCATENATE ORC created by Spark

2017-08-30 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146914#comment-16146914 ] Prasanth Jayachandran commented on HIVE-17280: -- That is certainly not the format that hive

[jira] [Work stopped] (HIVE-17183) Disable rename operations during bootstrap dump

2017-08-30 Thread Sankar Hariappan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HIVE-17183 stopped by Sankar Hariappan. --- > Disable rename operations during bootstrap dump >

[jira] [Commented] (HIVE-17276) Check max shuffle size when converting to dynamically partitioned hash join

2017-08-30 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146950#comment-16146950 ] Hive QA commented on HIVE-17276: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-17280) Data loss in CONCATENATE ORC created by Spark

2017-08-30 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146933#comment-16146933 ] Marco Gaido commented on HIVE-17280: I see, but this won't fix the problem with files written by

[jira] [Updated] (HIVE-17183) Disable rename operations during bootstrap dump

2017-08-30 Thread Sankar Hariappan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sankar Hariappan updated HIVE-17183: Status: Patch Available (was: Open) > Disable rename operations during bootstrap dump >

[jira] [Commented] (HIVE-17323) Improve upon HIVE-16260

2017-08-30 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147038#comment-16147038 ] Hive QA commented on HIVE-17323: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-17280) Data loss in CONCATENATE ORC created by Spark

2017-08-30 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146882#comment-16146882 ] Marco Gaido commented on HIVE-17280: The names of the files are: {noformat}

[jira] [Updated] (HIVE-17183) Disable rename operations during bootstrap dump

2017-08-30 Thread Sankar Hariappan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sankar Hariappan updated HIVE-17183: Attachment: HIVE-17183.04.patch Added 04.patch with below updates. - Added UUID to the key

[jira] [Commented] (HIVE-2526) "lastAceesTime" is always zero when executed through "describe extended " unlike "show table extende like " where lastAccessTime is updated.

2017-08-30 Thread Dmytro Sen (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146944#comment-16146944 ] Dmytro Sen commented on HIVE-2526: -- I you want lastAccessTime updated, just set {code} set

[jira] [Updated] (HIVE-17382) Change startsWith relation introduced in HIVE-17316

2017-08-30 Thread Barna Zsombor Klara (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Barna Zsombor Klara updated HIVE-17382: --- Attachment: HIVE-17382.02.patch Fixed BeeLine tests. > Change startsWith relation

[jira] [Commented] (HIVE-17410) repl load task during subsequent DAG generation does not start from the last partition processed

2017-08-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147783#comment-16147783 ] ASF GitHub Bot commented on HIVE-17410: --- GitHub user anishek opened a pull request:

[jira] [Commented] (HIVE-17307) Change the metastore to not use the metrics code in hive/common

2017-08-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147949#comment-16147949 ] ASF GitHub Bot commented on HIVE-17307: --- Github user asfgit closed the pull request at:

[jira] [Commented] (HIVE-17216) Additional qtests for HoS DPP

2017-08-30 Thread JIRA
[ https://issues.apache.org/jira/browse/HIVE-17216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147726#comment-16147726 ] Sergio Peña commented on HIVE-17216: LGTM +1 > Additional qtests for HoS DPP >

[jira] [Commented] (HIVE-15711) Flaky TestEmbeddedThriftBinaryCLIService.testTaskStatus

2017-08-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147788#comment-16147788 ] ASF GitHub Bot commented on HIVE-15711: --- Github user anishek closed the pull request at:

[jira] [Commented] (HIVE-15550) fix arglist logging in schematool

2017-08-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147787#comment-16147787 ] ASF GitHub Bot commented on HIVE-15550: --- Github user anishek closed the pull request at:

[jira] [Commented] (HIVE-15712) new HiveConf in SQLOperation.getSerDe() impacts CPU on hiveserver2

2017-08-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147789#comment-16147789 ] ASF GitHub Bot commented on HIVE-15712: --- Github user anishek closed the pull request at:

[jira] [Commented] (HIVE-16895) Multi-threaded execution of bootstrap dump of partitions

2017-08-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147807#comment-16147807 ] ASF GitHub Bot commented on HIVE-16895: --- Github user anishek closed the pull request at:

[jira] [Commented] (HIVE-17144) export of temporary tables not working and it seems to be using distcp rather than filesystem copy

2017-08-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147806#comment-16147806 ] ASF GitHub Bot commented on HIVE-17144: --- Github user anishek closed the pull request at:

[jira] [Commented] (HIVE-15473) Progress Bar on Beeline client

2017-08-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147785#comment-16147785 ] ASF GitHub Bot commented on HIVE-15473: --- Github user anishek closed the pull request at:

[jira] [Commented] (HIVE-16268) enable incremental repl dump to handle functions metadata

2017-08-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147797#comment-16147797 ] ASF GitHub Bot commented on HIVE-16268: --- Github user anishek closed the pull request at:

[jira] [Commented] (HIVE-16267) Enable bootstrap function metadata to be loaded in repl load

2017-08-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147798#comment-16147798 ] ASF GitHub Bot commented on HIVE-16267: --- Github user anishek closed the pull request at:

[jira] [Commented] (HIVE-16892) Move creation of _files from ReplCopyTask to analysis phase for boostrap replication

2017-08-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147804#comment-16147804 ] ASF GitHub Bot commented on HIVE-16892: --- Github user anishek closed the pull request at:

[jira] [Commented] (HIVE-16591) DR for function Binaries on HDFS

2017-08-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147800#comment-16147800 ] ASF GitHub Bot commented on HIVE-16591: --- Github user anishek closed the pull request at:

[jira] [Commented] (HIVE-16269) enable incremental function dump to be loaded via repl load

2017-08-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147799#comment-16147799 ] ASF GitHub Bot commented on HIVE-16269: --- Github user anishek closed the pull request at:

[jira] [Commented] (HIVE-16893) move replication dump related work in semantic analysis phase to execution phase using a task

2017-08-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147805#comment-16147805 ] ASF GitHub Bot commented on HIVE-16893: --- Github user anishek closed the pull request at:

[jira] [Commented] (HIVE-16866) existing available UDF is used in TestReplicationScenariosAcrossInstances#testDropFunctionIncrementalReplication

2017-08-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147801#comment-16147801 ] ASF GitHub Bot commented on HIVE-16866: --- Github user anishek closed the pull request at:

[jira] [Commented] (HIVE-16823) "ArrayIndexOutOfBoundsException" in spark_vectorized_dynamic_partition_pruning.q

2017-08-30 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147825#comment-16147825 ] Sahil Takiar commented on HIVE-16823: - So HIVE-15269 doesn't actually remove the call to constant

[jira] [Updated] (HIVE-17411) LLAP IO may incorrectly release a refcount in some rare cases

2017-08-30 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-17411: Resolution: Fixed Fix Version/s: 2.4.0 3.0.0

[jira] [Updated] (HIVE-17307) Change the metastore to not use the metrics code in hive/common

2017-08-30 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated HIVE-17307: -- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available) Patch

[jira] [Commented] (HIVE-17410) repl load task during subsequent DAG generation does not start from the last partition processed

2017-08-30 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147734#comment-16147734 ] anishek commented on HIVE-17410: *

[jira] [Commented] (HIVE-15713) add ldap authentication related configuration to restricted list

2017-08-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147790#comment-16147790 ] ASF GitHub Bot commented on HIVE-15713: --- Github user anishek closed the pull request at:

[jira] [Commented] (HIVE-16115) Stop printing progress info from operation logs with beeline progress bar

2017-08-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147795#comment-16147795 ] ASF GitHub Bot commented on HIVE-16115: --- Github user anishek closed the pull request at:

[jira] [Commented] (HIVE-16219) metastore notification_log contains serialized message with non functional fields

2017-08-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147796#comment-16147796 ] ASF GitHub Bot commented on HIVE-16219: --- Github user anishek closed the pull request at:

[jira] [Commented] (HIVE-16045) Print progress bar along with operation log

2017-08-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147794#comment-16147794 ] ASF GitHub Bot commented on HIVE-16045: --- Github user anishek closed the pull request at:

[jira] [Commented] (HIVE-15906) thrift code regeneration to include new protocol version

2017-08-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147791#comment-16147791 ] ASF GitHub Bot commented on HIVE-15906: --- Github user anishek closed the pull request at:

[jira] [Commented] (HIVE-16886) HMS log notifications may have duplicated event IDs if multiple HMS are running concurrently

2017-08-30 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147865#comment-16147865 ] Hive QA commented on HIVE-16886: Here are the results of testing the latest attachment:

[jira] [Updated] (HIVE-17307) Change the metastore to not use the metrics code in hive/common

2017-08-30 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated HIVE-17307: -- Attachment: HIVE-17307.5.patch Final version of the patch. This differs from patch 4 only in that I

[jira] [Commented] (HIVE-17415) Hit error "SemanticException View xxx is corresponding to LIMIT, rather than a SelectOperator." in Hive queries

2017-08-30 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148224#comment-16148224 ] Ashutosh Chauhan commented on HIVE-17415: - +1 > Hit error "SemanticException View xxx is

[jira] [Commented] (HIVE-17381) When we enable Parquet Writer Version V2, hive throws an exception: Unsupported encoding: DELTA_BYTE_ARRAY.

2017-08-30 Thread Ferdinand Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148320#comment-16148320 ] Ferdinand Xu commented on HIVE-17381: - Thanks [~colinma] for the patch. LGTM +1. > When we enable

[jira] [Updated] (HIVE-17415) Hit error "SemanticException View xxx is corresponding to LIMIT, rather than a SelectOperator." in Hive queries

2017-08-30 Thread Deepak Jaiswal (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak Jaiswal updated HIVE-17415: -- Attachment: HIVE-17415.1.patch [~ashutoshc] can you please review? > Hit error

[jira] [Commented] (HIVE-16904) during repl load for large number of partitions the metadata file can be huge and can lead to out of memory

2017-08-30 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148234#comment-16148234 ] anishek commented on HIVE-16904: On internal runs we saw that for 1 partitions with one file each it

[jira] [Updated] (HIVE-17408) replication distcp should only be invoked if number of files AND file size cross configured limits

2017-08-30 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thejas M Nair updated HIVE-17408: - Resolution: Fixed Status: Resolved (was: Patch Available) Patch committed to master. I

[jira] [Assigned] (HIVE-17415) Hit error "SemanticException View xxx is corresponding to LIMIT, rather than a SelectOperator." in Hive queries

2017-08-30 Thread Deepak Jaiswal (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak Jaiswal reassigned HIVE-17415: - > Hit error "SemanticException View xxx is corresponding to LIMIT, rather than > a

[jira] [Work started] (HIVE-17415) Hit error "SemanticException View xxx is corresponding to LIMIT, rather than a SelectOperator." in Hive queries

2017-08-30 Thread Deepak Jaiswal (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HIVE-17415 started by Deepak Jaiswal. - > Hit error "SemanticException View xxx is corresponding to LIMIT, rather than

[jira] [Updated] (HIVE-17006) LLAP: Parquet caching

2017-08-30 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-17006: Attachment: HIVE-17006.03.patch Addressing CR feedback, fixing some bugs > LLAP: Parquet

[jira] [Commented] (HIVE-16823) "ArrayIndexOutOfBoundsException" in spark_vectorized_dynamic_partition_pruning.q

2017-08-30 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148179#comment-16148179 ] Sahil Takiar commented on HIVE-16823: - [~kellyzly] sounds good. I attached a new patch to HIVE-17405

[jira] [Commented] (HIVE-17361) Support LOAD DATA for transactional tables

2017-08-30 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148191#comment-16148191 ] Hive QA commented on HIVE-17361: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-17006) LLAP: Parquet caching

2017-08-30 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148242#comment-16148242 ] Hive QA commented on HIVE-17006: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-17100) Improve HS2 operation logs for REPL commands.

2017-08-30 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148247#comment-16148247 ] Thejas M Nair commented on HIVE-17100: -- +1 > Improve HS2 operation logs for REPL commands. >

[jira] [Updated] (HIVE-17367) IMPORT table doesn't load from data dump if a metadata-only dump was already imported.

2017-08-30 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thejas M Nair updated HIVE-17367: - Resolution: Fixed Status: Resolved (was: Patch Available) Patch committed to master.

[jira] [Assigned] (HIVE-17417) Lazy Timestamp and Date serialization is very expensive

2017-08-30 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran reassigned HIVE-17417: > Lazy Timestamp and Date serialization is very expensive >

[jira] [Updated] (HIVE-17417) Lazy Timestamp and Date serialization is very expensive

2017-08-30 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-17417: - Attachment: date-serialize.png timestamp-serialize.png > Lazy

[jira] [Commented] (HIVE-17414) HoS DPP + Vectorization generates invalid explain plan due to CombineEquivalentWorkResolver

2017-08-30 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148118#comment-16148118 ] Sahil Takiar commented on HIVE-17414: - CC: [~lirui], [~kellyzly] - its probably because the patch in

[jira] [Commented] (HIVE-16823) "ArrayIndexOutOfBoundsException" in spark_vectorized_dynamic_partition_pruning.q

2017-08-30 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148125#comment-16148125 ] liyunzhang_intel commented on HIVE-16823: - let's fix spark_vectorized_dynamic_partition_pruning.q

[jira] [Assigned] (HIVE-17414) HoS DPP + Vectorization generates invalid explain plan due to CombineEquivalentWorkResolver

2017-08-30 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel reassigned HIVE-17414: --- Assignee: liyunzhang_intel > HoS DPP + Vectorization generates invalid explain plan

[jira] [Commented] (HIVE-17405) HoS DPP ConstantPropagate should use ConstantPropagateOption.SHORTCUT

2017-08-30 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148178#comment-16148178 ] Sahil Takiar commented on HIVE-17405: - Attaching an updated patch with the call to constant

[jira] [Commented] (HIVE-17408) replication distcp should only be invoked if number of files AND file size cross configured limits

2017-08-30 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148023#comment-16148023 ] anishek commented on HIVE-17408: *

[jira] [Issue Comment Deleted] (HIVE-16923) Hive-on-Spark DPP Improvements

2017-08-30 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-16923: Comment: was deleted (was: Will post a design doc soon. Two of the biggest limitations of the

[jira] [Updated] (HIVE-17415) Hit error "SemanticException View xxx is corresponding to LIMIT, rather than a SelectOperator." in Hive queries

2017-08-30 Thread Deepak Jaiswal (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak Jaiswal updated HIVE-17415: -- Status: Patch Available (was: In Progress) > Hit error "SemanticException View xxx is

[jira] [Commented] (HIVE-17193) HoS: don't combine map works that are targets of different DPPs

2017-08-30 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147645#comment-16147645 ] Sahil Takiar commented on HIVE-17193: - [~lirui] is this a bug with {{CombineEquivalentWorkResolver}}?

[jira] [Updated] (HIVE-17361) Support LOAD DATA for transactional tables

2017-08-30 Thread Wei Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Zheng updated HIVE-17361: - Attachment: HIVE-17361.2.patch patch 2 with a different approach > Support LOAD DATA for transactional

[jira] [Commented] (HIVE-16823) "ArrayIndexOutOfBoundsException" in spark_vectorized_dynamic_partition_pruning.q

2017-08-30 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148105#comment-16148105 ] liyunzhang_intel commented on HIVE-16823: - [~stakiar]: {quote} Maybe a follow up JIRA would be to

[jira] [Commented] (HIVE-15104) Hive on Spark generate more shuffle data than hive on mr

2017-08-30 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148174#comment-16148174 ] Xuefu Zhang commented on HIVE-15104: The patch looks good to me. My only concern is about the

[jira] [Updated] (HIVE-17405) HoS DPP ConstantPropagate should use ConstantPropagateOption.SHORTCUT

2017-08-30 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-17405: Attachment: HIVE-17405.4.patch > HoS DPP ConstantPropagate should use

[jira] [Commented] (HIVE-11548) HCatLoader should support predicate pushdown.

2017-08-30 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148073#comment-16148073 ] Mithun Radhakrishnan commented on HIVE-11548: - Hey, [~thejas]. Could I bug you for a review on

[jira] [Commented] (HIVE-17412) Add "-- SORT_QUERY_RESULTS" for spark_vectorized_dynamic_partition_pruning.q

2017-08-30 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147276#comment-16147276 ] Xuefu Zhang commented on HIVE-17412: +1 > Add "-- SORT_QUERY_RESULTS" for

[jira] [Commented] (HIVE-17100) Improve HS2 operation logs for REPL commands.

2017-08-30 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147253#comment-16147253 ] Hive QA commented on HIVE-17100: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-17366) Constraint replication in bootstrap

2017-08-30 Thread Sankar Hariappan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147135#comment-16147135 ] Sankar Hariappan commented on HIVE-17366: - [~daijy], I submitted my review comments in the pull

[jira] [Commented] (HIVE-17399) Do not remove semijoin branch if it feeds to TS->DPP_EVENT

2017-08-30 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147098#comment-16147098 ] Hive QA commented on HIVE-17399: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-17405) HoS DPP ConstantPropagate should use ConstantPropagateOption.SHORTCUT

2017-08-30 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147160#comment-16147160 ] Hive QA commented on HIVE-17405: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-17399) Do not remove semijoin branch if it feeds to TS->DPP_EVENT

2017-08-30 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147374#comment-16147374 ] Hive QA commented on HIVE-17399: Here are the results of testing the latest attachment:

[jira] [Assigned] (HIVE-17383) ArrayIndexOutOfBoundsException in VectorGroupByOperator

2017-08-30 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li reassigned HIVE-17383: - Assignee: Rui Li > ArrayIndexOutOfBoundsException in VectorGroupByOperator >

[jira] [Commented] (HIVE-17412) Add "-- SORT_QUERY_RESULTS" for spark_vectorized_dynamic_partition_pruning.q

2017-08-30 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148336#comment-16148336 ] liyunzhang_intel commented on HIVE-17412: - [~Ferd]: As Xuefu and Sahil finished review, can you

[jira] [Commented] (HIVE-17417) Lazy Timestamp and Date serialization is very expensive

2017-08-30 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148384#comment-16148384 ] Sergey Shelukhin commented on HIVE-17417: - That seems like a schema problem in addition to

[jira] [Reopened] (HIVE-17367) IMPORT table doesn't load from data dump if a metadata-only dump was already imported.

2017-08-30 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thejas M Nair reopened HIVE-17367: -- Resolved wrong jira, reopening! This is not committed. > IMPORT table doesn't load from data dump

[jira] [Commented] (HIVE-17405) HoS DPP ConstantPropagate should use ConstantPropagateOption.SHORTCUT

2017-08-30 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148302#comment-16148302 ] Hive QA commented on HIVE-17405: Here are the results of testing the latest attachment:

[jira] [Updated] (HIVE-17415) Hit error "SemanticException View xxx is corresponding to LIMIT, rather than a SelectOperator." in Hive queries

2017-08-30 Thread Deepak Jaiswal (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak Jaiswal updated HIVE-17415: -- Attachment: HIVE-17415.2.patch Forgot to add the test in testconfiguration. > Hit error

[jira] [Commented] (HIVE-17405) HoS DPP ConstantPropagate should use ConstantPropagateOption.SHORTCUT

2017-08-30 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148476#comment-16148476 ] Sahil Takiar commented on HIVE-17405: - Updated patch + RB with updated golden files for the skewjoin

[jira] [Updated] (HIVE-17405) HoS DPP ConstantPropagate should use ConstantPropagateOption.SHORTCUT

2017-08-30 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-17405: Attachment: HIVE-17405.5.patch > HoS DPP ConstantPropagate should use

[jira] [Commented] (HIVE-15104) Hive on Spark generate more shuffle data than hive on mr

2017-08-30 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148485#comment-16148485 ] Rui Li commented on HIVE-15104: --- [~xuefuz], I'll try if that's feasible. Do you think it's OK to create a

[jira] [Updated] (HIVE-17414) HoS DPP + Vectorization generates invalid explain plan due to CombineEquivalentWorkResolver

2017-08-30 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated HIVE-17414: Attachment: HIVE-17414.patch [~stakiar],[~lirui]: please help review, Before we restrict

[jira] [Updated] (HIVE-17414) HoS DPP + Vectorization generates invalid explain plan due to CombineEquivalentWorkResolver

2017-08-30 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated HIVE-17414: Status: Patch Available (was: Open) > HoS DPP + Vectorization generates invalid explain

[jira] [Commented] (HIVE-15104) Hive on Spark generate more shuffle data than hive on mr

2017-08-30 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148340#comment-16148340 ] Rui Li commented on HIVE-15104: --- [~xuefuz], my previous

[jira] [Commented] (HIVE-17193) HoS: don't combine map works that are targets of different DPPs

2017-08-30 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148344#comment-16148344 ] Rui Li commented on HIVE-17193: --- Yes I think so. We don't consider DPP when we combine map works in

  1   2   >