[jira] [Created] (HIVE-17565) NullPointerException occurs when hive.optimize.skewjoin and hive.auto.convert.join are switched on at the same time

2017-09-20 Thread Xin Hao (JIRA)
Xin Hao created HIVE-17565: -- Summary: NullPointerException occurs when hive.optimize.skewjoin and hive.auto.convert.join are switched on at the same time Key: HIVE-17565 URL:

[jira] [Created] (HIVE-13764) NullPointerException issue with MR engine when map-join is enabled and hive.exec.submit.local.task.via.child=true

2016-05-15 Thread Xin Hao (JIRA)
Xin Hao created HIVE-13764: -- Summary: NullPointerException issue with MR engine when map-join is enabled and hive.exec.submit.local.task.via.child=true Key: HIVE-13764 URL:

[jira] [Created] (HIVE-13634) Hive-on-Spark performed worse than Hive-on-MR, for queries with external scripts

2016-04-27 Thread Xin Hao (JIRA)
Xin Hao created HIVE-13634: -- Summary: Hive-on-Spark performed worse than Hive-on-MR, for queries with external scripts Key: HIVE-13634 URL: https://issues.apache.org/jira/browse/HIVE-13634 Project: Hive

[jira] [Created] (HIVE-13292) Different DOUBLE type precision issue between Spark and MR engine

2016-03-15 Thread Xin Hao (JIRA)
Xin Hao created HIVE-13292: -- Summary: Different DOUBLE type precision issue between Spark and MR engine Key: HIVE-13292 URL: https://issues.apache.org/jira/browse/HIVE-13292 Project: Hive Issue

[jira] [Created] (HIVE-13278) Many redundant 'File not found' messages appeared in container log during query execution with Hive on Spark

2016-03-14 Thread Xin Hao (JIRA)
Xin Hao created HIVE-13278: -- Summary: Many redundant 'File not found' messages appeared in container log during query execution with Hive on Spark Key: HIVE-13278 URL: https://issues.apache.org/jira/browse/HIVE-13278

[jira] [Created] (HIVE-13277) Exception "Unable to create serializer 'org.apache.hive.com.esotericsoftware.kryo.serializers.FieldSerializer' " occurred during query execution on spark engine when vect

2016-03-14 Thread Xin Hao (JIRA)
Xin Hao created HIVE-13277: -- Summary: Exception "Unable to create serializer 'org.apache.hive.com.esotericsoftware.kryo.serializers.FieldSerializer' " occurred during query execution on spark engine when vectorized execution is switched on

[jira] [Created] (HIVE-12089) HiveException (Failed to close AbstractFileMergeOperator) occurs during loading data to ORC file, when hive.merge.sparkfiles is set to true. [Spark Branch]

2015-10-12 Thread Xin Hao (JIRA)
Xin Hao created HIVE-12089: -- Summary: HiveException (Failed to close AbstractFileMergeOperator) occurs during loading data to ORC file, when hive.merge.sparkfiles is set to true. [Spark Branch] Key: HIVE-12089 URL:

[jira] [Created] (HIVE-12091) HiveException (Failed to close AbstractFileMergeOperator) occurs during loading data to ORC file, when hive.merge.sparkfiles is set to true. [Spark Branch]

2015-10-12 Thread Xin Hao (JIRA)
Xin Hao created HIVE-12091: -- Summary: HiveException (Failed to close AbstractFileMergeOperator) occurs during loading data to ORC file, when hive.merge.sparkfiles is set to true. [Spark Branch] Key: HIVE-12091 URL:

[jira] [Created] (HIVE-9794) java.lang.NoSuchMethodError occurs during hive query execution which has 'ADD FILE XXXX.jar' sentence

2015-02-25 Thread Xin Hao (JIRA)
Xin Hao created HIVE-9794: - Summary: java.lang.NoSuchMethodError occurs during hive query execution which has 'ADD FILE .jar' sentence Key: HIVE-9794 URL: https://issues.apache.org/jira/browse/HIVE-9794

[jira] [Created] (HIVE-9697) Hive on Spark is not as aggressive as MR on map join

2015-02-15 Thread Xin Hao (JIRA)
Xin Hao created HIVE-9697: - Summary: Hive on Spark is not as aggressive as MR on map join Key: HIVE-9697 URL: https://issues.apache.org/jira/browse/HIVE-9697 Project: Hive Issue Type: Sub-task

[jira] [Updated] (HIVE-9697) Hive on Spark is not as aggressive as MR on map join [Spark Branch]

2015-02-15 Thread Xin Hao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xin Hao updated HIVE-9697: -- Description: We have a finding during running some Big-Bench cases: when the same small table size threshold is

[jira] [Updated] (HIVE-9697) Hive on Spark is not as aggressive as MR on map join [Spark Branch]

2015-02-15 Thread Xin Hao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xin Hao updated HIVE-9697: -- Description: We have a finding during running some Big-Bench cases: when the same small table size threshold is

[jira] [Created] (HIVE-9659) 'Error while trying to create table container' occurs during hive query case execution when hive.optimize.skewjoin set to 'true' [Spark Branch]

2015-02-11 Thread Xin Hao (JIRA)
Xin Hao created HIVE-9659: - Summary: 'Error while trying to create table container' occurs during hive query case execution when hive.optimize.skewjoin set to 'true' [Spark Branch] Key: HIVE-9659 URL:

[jira] [Commented] (HIVE-9586) Too verbose log can hurt performance, we should always check log level first

2015-02-08 Thread Xin Hao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14311827#comment-14311827 ] Xin Hao commented on HIVE-9586: --- Thank you Xuefu. Too verbose log can hurt performance, we

[jira] [Commented] (HIVE-9586) Too verbose log can hurt performance, we should always check log level first

2015-02-08 Thread Xin Hao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14311709#comment-14311709 ] Xin Hao commented on HIVE-9586: --- Hi, Xuefu, could you please consider also commit it to Spark

[jira] [Commented] (HIVE-9560) When hive.stats.collect.rawdatasize=true, 'rawDataSize' for an ORC table will result in value '0' after running 'analyze table TABLE_NAME compute statistics;'

2015-02-03 Thread Xin Hao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14304473#comment-14304473 ] Xin Hao commented on HIVE-9560: --- Thanks Prasanth for the comment! We can resolve it in our

[jira] [Commented] (HIVE-9560) When hive.stats.collect.rawdatasize=true, 'rawDataSize' for an ORC table will result in value '0' after running 'analyze table TABLE_NAME compute statistics;'

2015-02-02 Thread Xin Hao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14302891#comment-14302891 ] Xin Hao commented on HIVE-9560: --- For example, we have an ORC table named 'item'. (a) Before

[jira] [Created] (HIVE-9560) When hive.stats.collect.rawdatasize=true, 'rawDataSize' for an ORC table will result in value '0' after running 'analyze table TABLE_NAME compute statistics;'

2015-02-02 Thread Xin Hao (JIRA)
Xin Hao created HIVE-9560: - Summary: When hive.stats.collect.rawdatasize=true, 'rawDataSize' for an ORC table will result in value '0' after running 'analyze table TABLE_NAME compute statistics;' Key: HIVE-9560 URL:

[jira] [Commented] (HIVE-9409) Avoid ser/de loggers as logging framework can be incompatible on driver and workers

2015-01-29 Thread Xin Hao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14298093#comment-14298093 ] Xin Hao commented on HIVE-9409: --- Hi, shall we also consider to merge this patch to spark

[jira] [Commented] (HIVE-9410) ClassNotFoundException occurs during hive query case execution with UDF defined [Spark Branch]

2015-01-22 Thread Xin Hao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14287130#comment-14287130 ] Xin Hao commented on HIVE-9410: --- After offline communication with Chengxiang, current patch

[jira] [Commented] (HIVE-9425) External Function Jar files are not available for Driver when running with yarn-cluster mode [Spark Branch]

2015-01-22 Thread Xin Hao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14288666#comment-14288666 ] Xin Hao commented on HIVE-9425: --- Double checked with Big-Bench Q1 case (includes the hql ‘ADD

[jira] [Commented] (HIVE-9410) ClassNotFoundException occurs during hive query case execution with UDF defined [Spark Branch]

2015-01-22 Thread Xin Hao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14288554#comment-14288554 ] Xin Hao commented on HIVE-9410: --- Chengxiang, I used patch HIVE-9410.3-spark.patch to validate

[jira] [Commented] (HIVE-9410) Spark branch, ClassNotFoundException occurs during hive query case execution with UDF defined [Spark Branch]

2015-01-21 Thread Xin Hao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14285710#comment-14285710 ] Xin Hao commented on HIVE-9410: --- Chengxiang, tried to verify this patch while found that the

[jira] [Commented] (HIVE-9409) Avoid ser/de loggers as logging framework can be incompatible on driver and workers

2015-01-21 Thread Xin Hao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14285627#comment-14285627 ] Xin Hao commented on HIVE-9409: --- Rui,the problem here can be solved with the patch, and those

[jira] [Created] (HIVE-9409) Spark branch, ClassNotFoundException: org.apache.commons.logging.impl.SLF4JLocationAwareLog occurs during some hive query case execution [Spark Branch]

2015-01-18 Thread Xin Hao (JIRA)
Xin Hao created HIVE-9409: - Summary: Spark branch, ClassNotFoundException: org.apache.commons.logging.impl.SLF4JLocationAwareLog occurs during some hive query case execution [Spark Branch] Key: HIVE-9409 URL:

[jira] [Created] (HIVE-9410) Spark branch, ClassNotFoundException occurs during hive query case execution with UDF defined [Spark Branch]

2015-01-18 Thread Xin Hao (JIRA)
Xin Hao created HIVE-9410: - Summary: Spark branch, ClassNotFoundException occurs during hive query case execution with UDF defined [Spark Branch] Key: HIVE-9410 URL: https://issues.apache.org/jira/browse/HIVE-9410

[jira] [Updated] (HIVE-9409) Spark branch, ClassNotFoundException: org.apache.commons.logging.impl.SLF4JLocationAwareLog occurs during some hive query case execution [Spark Branch]

2015-01-18 Thread Xin Hao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xin Hao updated HIVE-9409: -- Description: When we use current [Spark Branch] to build hive package. deploy it on our cluster and execute