[jira] [Updated] (HIVE-12205) Spark: unify spark statististics aggregation between local and remote spark client

2016-02-17 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-12205: - Resolution: Fixed Status: Resolved (was: Patch Available) > Spark: unify spark statistist

[jira] [Commented] (HIVE-12205) Spark: unify spark statististics aggregation between local and remote spark client

2016-02-17 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15150268#comment-15150268 ] Chengxiang Li commented on HIVE-12205: -- Merged to Spark branch, thanks Chinna for thi

[jira] [Commented] (HIVE-12205) Spark: unify spark statististics aggregation between local and remote spark client

2016-02-13 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15146312#comment-15146312 ] Chengxiang Li commented on HIVE-12205: -- +1 > Spark: unify spark statististics aggreg

[jira] [Commented] (HIVE-12205) Spark: unify spark statististics aggregation between local and remote spark client

2016-02-06 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15135777#comment-15135777 ] Chengxiang Li commented on HIVE-12205: -- Thanks, Chinna, I'm on vocation now, I would

[jira] [Commented] (HIVE-12205) Spark: unify spark statististics aggregation between local and remote spark client

2016-02-06 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15135776#comment-15135776 ] Chengxiang Li commented on HIVE-12205: -- Thanks, Chinna, i'k 发自我的 iPhone > Spark:

[jira] [Commented] (HIVE-7142) Hive multi serialization encoding support

2016-02-01 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127486#comment-15127486 ] Chengxiang Li commented on HIVE-7142: - If you want to store data in {{UTF-16}} or {{UTF

[jira] [Updated] (HIVE-12888) TestSparkNegativeCliDriver does not run in Spark mode[Spark Branch]

2016-01-20 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-12888: - Attachment: HIVE-12888.1-spark.patch TestSparkNegativeCliDriver does not add test hive conf dir in

[jira] [Updated] (HIVE-12736) It seems that result of Hive on Spark be mistaken and result of Hive and Hive on Spark are not the same

2016-01-19 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-12736: - Attachment: HIVE-12736.5-spark.patch I can't reproduce the failed mapjoin_memcheck.q locally, uplo

[jira] [Commented] (HIVE-12736) It seems that result of Hive on Spark be mistaken and result of Hive and Hive on Spark are not the same

2016-01-19 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15106575#comment-15106575 ] Chengxiang Li commented on HIVE-12736: -- Besides, during test, i found TestSparkNegati

[jira] [Updated] (HIVE-12736) It seems that result of Hive on Spark be mistaken and result of Hive and Hive on Spark are not the same

2016-01-19 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-12736: - Attachment: HIVE-12736.5-spark.patch [~xuefuz], Yes, it's related, i miss something here. Group By

[jira] [Updated] (HIVE-12736) It seems that result of Hive on Spark be mistaken and result of Hive and Hive on Spark are not the same

2016-01-18 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-12736: - Attachment: HIVE-12736.4-spark.patch > It seems that result of Hive on Spark be mistaken and resul

[jira] [Updated] (HIVE-12736) It seems that result of Hive on Spark be mistaken and result of Hive and Hive on Spark are not the same

2016-01-18 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-12736: - Attachment: HIVE-12736.3-spark.patch Yes, [~xuefuz], {{Operator::opAllowedBeforeMapJoin()}} and {

[jira] [Commented] (HIVE-12736) It seems that result of Hive on Spark be mistaken and result of Hive and Hive on Spark are not the same

2016-01-17 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15104080#comment-15104080 ] Chengxiang Li commented on HIVE-12736: -- [~xuefuz], would you help to review this patc

[jira] [Updated] (HIVE-12736) It seems that result of Hive on Spark be mistaken and result of Hive and Hive on Spark are not the same

2016-01-12 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-12736: - Attachment: HIVE-12736.2-spark.patch > It seems that result of Hive on Spark be mistaken and resul

[jira] [Updated] (HIVE-12736) It seems that result of Hive on Spark be mistaken and result of Hive and Hive on Spark are not the same

2016-01-11 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-12736: - Attachment: HIVE-12736.1-spark.patch {{SparkMapJoinProcessor}} miss some validation during {{conve

[jira] [Commented] (HIVE-12205) Spark: unify spark statististics aggregation between local and remote spark client

2016-01-07 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15088795#comment-15088795 ] Chengxiang Li commented on HIVE-12205: -- [~chinnalalam], thanks working on this. In y

[jira] [Commented] (HIVE-12736) It seems that result of Hive on Spark be mistaken and result of Hive and Hive on Spark are not the same

2016-01-07 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15088702#comment-15088702 ] Chengxiang Li commented on HIVE-12736: -- I would work on this issue. > It seems that

[jira] [Assigned] (HIVE-12736) It seems that result of Hive on Spark be mistaken and result of Hive and Hive on Spark are not the same

2016-01-07 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li reassigned HIVE-12736: Assignee: Chengxiang Li (was: Xuefu Zhang) > It seems that result of Hive on Spark be mist

[jira] [Commented] (HIVE-12569) Excessive console message from SparkClientImpl [Spark Branch]

2015-12-02 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15037299#comment-15037299 ] Chengxiang Li commented on HIVE-12569: -- Actually, it's not a exactly issue, although

[jira] [Commented] (HIVE-12569) Excessive console message from SparkClientImpl [Spark Branch]

2015-12-02 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15037187#comment-15037187 ] Chengxiang Li commented on HIVE-12569: -- As [~nemon] analyzed, the message comes from

[jira] [Commented] (HIVE-12515) Clean the SparkCounters related code after remove counter based stats collection[Spark Branch]

2015-12-02 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15037160#comment-15037160 ] Chengxiang Li commented on HIVE-12515: -- LGTM BTW, if i recall this right, the operato

[jira] [Commented] (HIVE-12515) Clean the SparkCounters related code after remove counter based stats collection[Spark Branch]

2015-11-27 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15029680#comment-15029680 ] Chengxiang Li commented on HIVE-12515: -- {{SparkCounters}} is referred in lots of clas

[jira] [Commented] (HIVE-12515) Clean the SparkCounters related code after remove counter based stats collection[Spark Branch]

2015-11-26 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15029540#comment-15029540 ] Chengxiang Li commented on HIVE-12515: -- [~lirui], the {{org.apache.hadoop.hive.ql.sta

[jira] [Commented] (HIVE-12466) SparkCounter not initialized error

2015-11-24 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15026089#comment-15026089 ] Chengxiang Li commented on HIVE-12466: -- HIVE-12515 is created for the following clean

[jira] [Updated] (HIVE-12515) Clean the SparkCounters related code after remove counter based stats collection[Spark Branch]

2015-11-24 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-12515: - Description: As SparkCounters is only used to collection stats, after HIVE-12411, we does not need

[jira] [Commented] (HIVE-12466) SparkCounter not initialized error

2015-11-24 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15026081#comment-15026081 ] Chengxiang Li commented on HIVE-12466: -- Committed to spark branch, thanks Rui for thi

[jira] [Commented] (HIVE-12466) SparkCounter not initialized error

2015-11-24 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15026034#comment-15026034 ] Chengxiang Li commented on HIVE-12466: -- Yes, it does, at least at the time i implemen

[jira] [Commented] (HIVE-12466) SparkCounter not initialized error

2015-11-24 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15025999#comment-15025999 ] Chengxiang Li commented on HIVE-12466: -- SparkCounters is only used for stats collecti

[jira] [Commented] (HIVE-12466) SparkCounter not initialized error

2015-11-24 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15024042#comment-15024042 ] Chengxiang Li commented on HIVE-12466: -- LGTM, wait for the testing. > SparkCounter n

[jira] [Commented] (HIVE-12466) SparkCounter not initialized error

2015-11-23 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15023574#comment-15023574 ] Chengxiang Li commented on HIVE-12466: -- Yes, [~lirui], the suffix is available in the

[jira] [Commented] (HIVE-12466) SparkCounter not initialized error

2015-11-22 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15021611#comment-15021611 ] Chengxiang Li commented on HIVE-12466: -- [~xuefuz], due to the limitation of Spark acc

[jira] [Updated] (HIVE-11533) Loop optimization for SIMD in integer comparisons

2015-10-13 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-11533: - Fix Version/s: 2.0.0 > Loop optimization for SIMD in integer comparisons > ---

[jira] [Commented] (HIVE-11533) Loop optimization for SIMD in integer comparisons

2015-10-13 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14954723#comment-14954723 ] Chengxiang Li commented on HIVE-11533: -- Committed to master branch, thanks for the co

[jira] [Commented] (HIVE-11533) Loop optimization for SIMD in integer comparisons

2015-10-11 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14952519#comment-14952519 ] Chengxiang Li commented on HIVE-11533: -- +1 > Loop optimization for SIMD in integer c

[jira] [Commented] (HIVE-11533) Loop optimization for SIMD in integer comparisons

2015-10-07 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14947998#comment-14947998 ] Chengxiang Li commented on HIVE-11533: -- Very nice job, the patch looks good, just one

[jira] [Commented] (HIVE-10238) Loop optimization for SIMD in IfExprColumnColumn.txt

2015-08-20 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14706287#comment-14706287 ] Chengxiang Li commented on HIVE-10238: -- +1 > Loop optimization for SIMD in IfExprCol

[jira] [Commented] (HIVE-10238) Loop optimization for SIMD in IfExprColumnColumn.txt

2015-08-11 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14692798#comment-14692798 ] Chengxiang Li commented on HIVE-10238: -- Hi, [~teddy.choi], could you upload the patch

[jira] [Commented] (HIVE-10179) Optimization for SIMD instructions in Hive

2015-08-11 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14681520#comment-14681520 ] Chengxiang Li commented on HIVE-10179: -- Yes, [~teddy.choi], it's welcome, feel free t

[jira] [Commented] (HIVE-10238) Loop optimization for SIMD in IfExprColumnColumn.txt

2015-08-11 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14681506#comment-14681506 ] Chengxiang Li commented on HIVE-10238: -- Thanks for looking at this, [~teddy.choi]. I

[jira] [Commented] (HIVE-11276) Optimization around job submission and adding jars [Spark Branch]

2015-07-16 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630791#comment-14630791 ] Chengxiang Li commented on HIVE-11276: -- That make sense to me, launch the spark clust

[jira] [Commented] (HIVE-11276) Optimization around job submission and adding jars [Spark Branch]

2015-07-16 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630689#comment-14630689 ] Chengxiang Li commented on HIVE-11276: -- Besides, for the case of dynamic allocation,

[jira] [Commented] (HIVE-11276) Optimization around job submission and adding jars [Spark Branch]

2015-07-16 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630682#comment-14630682 ] Chengxiang Li commented on HIVE-11276: -- [~xuefuz], I review the the code in RemoteHiv

[jira] [Assigned] (HIVE-11276) Optimization around job submission and adding jars [Spark Branch]

2015-07-16 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li reassigned HIVE-11276: Assignee: Chengxiang Li > Optimization around job submission and adding jars [Spark Branch]

[jira] [Updated] (HIVE-11082) Support multi edge between nodes in SparkPlan[Spark Branch]

2015-07-15 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-11082: - Fix Version/s: spark-branch > Support multi edge between nodes in SparkPlan[Spark Branch] > --

[jira] [Updated] (HIVE-11082) Support multi edge between nodes in SparkPlan[Spark Branch]

2015-07-15 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-11082: - Attachment: HIVE-11082.3-spark.patch fix nit format issue. > Support multi edge between nodes in

[jira] [Commented] (HIVE-11267) Combine equavilent leaf works in SparkWork[Spark Branch]

2015-07-15 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14629069#comment-14629069 ] Chengxiang Li commented on HIVE-11267: -- [~xuefuz], I took a look at the FileSinkOpera

[jira] [Commented] (HIVE-11204) Research on recent failed qtests[Spark Branch]

2015-07-15 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14627641#comment-14627641 ] Chengxiang Li commented on HIVE-11204: -- Ok, I would left this issue open until next m

[jira] [Updated] (HIVE-11082) Support multi edge between nodes in SparkPlan[Spark Branch]

2015-07-15 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-11082: - Attachment: HIVE-11082.2-spark.patch update related qtest output. > Support multi edge between no

[jira] [Commented] (HIVE-11082) Support multi edge between nodes in SparkPlan[Spark Branch]

2015-07-14 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14627414#comment-14627414 ] Chengxiang Li commented on HIVE-11082: -- There seems some failed test, [~xuefuz], i wo

[jira] [Commented] (HIVE-11204) Research on recent failed qtests[Spark Branch]

2015-07-14 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14627413#comment-14627413 ] Chengxiang Li commented on HIVE-11204: -- [~xuefuz], all the above initializationError

[jira] [Commented] (HIVE-11082) Support multi edge between nodes in SparkPlan[Spark Branch]

2015-07-14 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14627405#comment-14627405 ] Chengxiang Li commented on HIVE-11082: -- It's easy to ignore the alias name during the

[jira] [Updated] (HIVE-11204) Research on recent failed qtests[Spark Branch]

2015-07-13 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-11204: - Attachment: HIVE-11204.1-spark.patch > Research on recent failed qtests[Spark Branch] > --

[jira] [Updated] (HIVE-11082) Support multi edge between nodes in SparkPlan[Spark Branch]

2015-07-13 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-11082: - Attachment: HIVE-11082.1-spark.patch SparkPlan support multi edges between nodes in default, just

[jira] [Assigned] (HIVE-11082) Support multi edge between nodes in SparkPlan[Spark Branch]

2015-07-12 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li reassigned HIVE-11082: Assignee: Chengxiang Li > Support multi edge between nodes in SparkPlan[Spark Branch] > ---

[jira] [Updated] (HIVE-11204) Research on recent failed qtests[Spark Branch]

2015-07-12 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-11204: - Attachment: HIVE-11204.1-spark.patch Can not reproduce locally now, just upload an empty patch to

[jira] [Assigned] (HIVE-11204) Research on recent failed qtests[Spark Branch]

2015-07-12 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li reassigned HIVE-11204: Assignee: Chengxiang Li > Research on recent failed qtests[Spark Branch] >

[jira] [Updated] (HIVE-11053) Add more tests for HIVE-10844[Spark Branch]

2015-07-08 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-11053: - Fix Version/s: spark-branch > Add more tests for HIVE-10844[Spark Branch] > --

[jira] [Commented] (HIVE-11053) Add more tests for HIVE-10844[Spark Branch]

2015-07-08 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14618401#comment-14618401 ] Chengxiang Li commented on HIVE-11053: -- Committed to spark branch, thanks [~gallenvar

[jira] [Commented] (HIVE-11053) Add more tests for HIVE-10844[Spark Branch]

2015-07-08 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14618235#comment-14618235 ] Chengxiang Li commented on HIVE-11053: -- The failed spark tests should not related to

[jira] [Commented] (HIVE-11053) Add more tests for HIVE-10844[Spark Branch]

2015-07-08 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14618236#comment-14618236 ] Chengxiang Li commented on HIVE-11053: -- +1 > Add more tests for HIVE-10844[Spark Bra

[jira] [Updated] (HIVE-11053) Add more tests for HIVE-10844[Spark Branch]

2015-07-07 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-11053: - Attachment: HIVE-11053.5-spark.patch upload the patch to relaunch unit test. > Add more tests for

[jira] [Updated] (HIVE-10850) Followup for HIVE-10550, check performance w.r.t. persistence level [Spark Branch]

2015-07-07 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-10850: - Assignee: GaoLun (was: Chengxiang Li) > Followup for HIVE-10550, check performance w.r.t. persist

[jira] [Commented] (HIVE-11095) SerDeUtils another bug ,when Text is reused

2015-06-29 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14607606#comment-14607606 ] Chengxiang Li commented on HIVE-11095: -- Hi, [~xiaowei], After get +1, it need wait 24

[jira] [Commented] (HIVE-11095) SerDeUtils another bug ,when Text is reused

2015-06-29 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14607607#comment-14607607 ] Chengxiang Li commented on HIVE-11095: -- Hi, [~xiaowei], After get +1, it need wait 24

[jira] [Commented] (HIVE-11138) Query fails when there isn't a comparator for an operator [Spark Branch]

2015-06-29 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14607574#comment-14607574 ] Chengxiang Li commented on HIVE-11138: -- +1, patch LGTM. > Query fails when there isn

[jira] [Commented] (HIVE-11095) SerDeUtils another bug ,when Text is reused

2015-06-26 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14602714#comment-14602714 ] Chengxiang Li commented on HIVE-11095: -- [~xiaowei], this should be the same issue as

[jira] [Commented] (HIVE-10983) SerDeUtils bug ,when Text is reused

2015-06-26 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14602637#comment-14602637 ] Chengxiang Li commented on HIVE-10983: -- Great, [~xiaowei], let's wait for the unit te

[jira] [Commented] (HIVE-10983) SerDeUtils bug ,when Text is reused

2015-06-26 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14602551#comment-14602551 ] Chengxiang Li commented on HIVE-10983: -- Nice found, thanks for working on this issue,

[jira] [Commented] (HIVE-10999) Upgrade Spark dependency to 1.4 [Spark Branch]

2015-06-23 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14598935#comment-14598935 ] Chengxiang Li commented on HIVE-10999: -- The classpath update code change looks good t

[jira] [Commented] (HIVE-10999) Upgrade Spark dependency to 1.4 [Spark Branch]

2015-06-23 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14598762#comment-14598762 ] Chengxiang Li commented on HIVE-10999: -- Does anyone know why we get org.apache.hadoo

[jira] [Updated] (HIVE-11053) Add more tests for HIVE-10844[Spark Branch]

2015-06-23 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-11053: - Assignee: GAOLUN > Add more tests for HIVE-10844[Spark Branch] > -

[jira] [Commented] (HIVE-10999) Upgrade Spark dependency to 1.4 [Spark Branch]

2015-06-23 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14598755#comment-14598755 ] Chengxiang Li commented on HIVE-10999: -- Seems the latest upload patch pass all the te

[jira] [Updated] (HIVE-11053) Add more tests for HIVE-10844[Spark Branch]

2015-06-23 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-11053: - Assignee: (was: GAOLUN) > Add more tests for HIVE-10844[Spark Branch] > --

[jira] [Updated] (HIVE-11053) Add more tests for HIVE-10844[Spark Branch]

2015-06-23 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-11053: - Assignee: GAOLUN > Add more tests for HIVE-10844[Spark Branch] > -

[jira] [Updated] (HIVE-10844) Combine equivalent Works for HoS[Spark Branch]

2015-06-23 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-10844: - Attachment: HIVE-10844.3-spark.patch > Combine equivalent Works for HoS[Spark Branch] > --

[jira] [Commented] (HIVE-10844) Combine equivalent Works for HoS[Spark Branch]

2015-06-18 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14592847#comment-14592847 ] Chengxiang Li commented on HIVE-10844: -- sure, attended the RB link. > Combine equiva

[jira] [Commented] (HIVE-10844) Combine equivalent Works for HoS[Spark Branch]

2015-06-17 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14591169#comment-14591169 ] Chengxiang Li commented on HIVE-10844: -- The failed test should be irrelevant, [~xuefu

[jira] [Updated] (HIVE-10844) Combine equivalent Works for HoS[Spark Branch]

2015-06-17 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-10844: - Attachment: HIVE-10844.2-spark.patch > Combine equivalent Works for HoS[Spark Branch] > --

[jira] [Commented] (HIVE-9370) SparkJobMonitor timeout as sortByKey would launch extra Spark job before original job get submitted [Spark Branch]

2015-06-01 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14567055#comment-14567055 ] Chengxiang Li commented on HIVE-9370: - Thanks for asking, [~leftylev]. We have printed

[jira] [Updated] (HIVE-10844) Combine equivalent Works for HoS[Spark Branch]

2015-05-27 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-10844: - Attachment: HIVE-10844.1-spark.patch > Combine equivalent Works for HoS[Spark Branch] > --

[jira] [Commented] (HIVE-10550) Dynamic RDD caching optimization for HoS.[Spark Branch]

2015-05-27 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14562312#comment-14562312 ] Chengxiang Li commented on HIVE-10550: -- Committed to spark branch, thanks [~xuefuz] f

[jira] [Commented] (HIVE-10550) Dynamic RDD caching optimization for HoS.[Spark Branch]

2015-05-27 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14562241#comment-14562241 ] Chengxiang Li commented on HIVE-10550: -- Note: these configurations has been removed i

[jira] [Updated] (HIVE-10550) Dynamic RDD caching optimization for HoS.[Spark Branch]

2015-05-27 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-10550: - Attachment: HIVE-10550.6-spark.patch > Dynamic RDD caching optimization for HoS.[Spark Branch] > -

[jira] [Updated] (HIVE-10550) Dynamic RDD caching optimization for HoS.[Spark Branch]

2015-05-26 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-10550: - Attachment: HIVE-10550.5-spark.patch > Dynamic RDD caching optimization for HoS.[Spark Branch] > -

[jira] [Updated] (HIVE-10550) Dynamic RDD caching optimization for HoS.[Spark Branch]

2015-05-21 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-10550: - Attachment: HIVE-10550.4-spark.patch > Dynamic RDD caching optimization for HoS.[Spark Branch] > -

[jira] [Updated] (HIVE-10550) Dynamic RDD caching optimization for HoS.[Spark Branch]

2015-05-19 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-10550: - Attachment: HIVE-10550.3-spark.patch After discussed with Xuefu, this patch just cache the RDD whi

[jira] [Commented] (HIVE-10550) Dynamic RDD caching optimization for HoS.[Spark Branch]

2015-05-18 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14547807#comment-14547807 ] Chengxiang Li commented on HIVE-10550: -- I'm not sure why, but i keep failed to upload

[jira] [Updated] (HIVE-10550) Dynamic RDD caching optimization for HoS.[Spark Branch]

2015-05-18 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-10550: - Attachment: (was: HIVE-10550.2-spark.patch) > Dynamic RDD caching optimization for HoS.[Spark

[jira] [Updated] (HIVE-10550) Dynamic RDD caching optimization for HoS.[Spark Branch]

2015-05-18 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-10550: - Attachment: HIVE-10550.2-spark.patch > Dynamic RDD caching optimization for HoS.[Spark Branch] > -

[jira] [Updated] (HIVE-10550) Dynamic RDD caching optimization for HoS.[Spark Branch]

2015-05-18 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-10550: - Attachment: HIVE-10550.2-spark.patch > Dynamic RDD caching optimization for HoS.[Spark Branch] > -

[jira] [Commented] (HIVE-10721) SparkSessionManagerImpl leaks SparkSessions [Spark Branch]

2015-05-17 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14547467#comment-14547467 ] Chengxiang Li commented on HIVE-10721: -- LGTM, +1. I just left some minor comments on

[jira] [Commented] (HIVE-10671) yarn-cluster mode offers a degraded performance from yarn-client [Spark Branch]

2015-05-13 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543222#comment-14543222 ] Chengxiang Li commented on HIVE-10671: -- LGTM, +1 > yarn-cluster mode offers a degrad

[jira] [Commented] (HIVE-10550) Dynamic RDD caching optimization for HoS.[Spark Branch]

2015-05-13 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14541662#comment-14541662 ] Chengxiang Li commented on HIVE-10550: -- New added configuration: ||name||default valu

[jira] [Updated] (HIVE-10550) Dynamic RDD caching optimization for HoS.[Spark Branch]

2015-05-13 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-10550: - Attachment: HIVE-10550.1.patch > Dynamic RDD caching optimization for HoS.[Spark Branch] > ---

[jira] [Commented] (HIVE-10548) Remove dependency to s3 repository in root pom

2015-05-12 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14541373#comment-14541373 ] Chengxiang Li commented on HIVE-10548: -- Committed to master, thanks Szehon for review

[jira] [Updated] (HIVE-10548) Remove dependency to s3 repository in root pom

2015-05-06 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-10548: - Attachment: HIVE-10548.2.patch > Remove dependency to s3 repository in root pom >

[jira] [Assigned] (HIVE-10550) Dynamic RDD caching optimization for HoS.[Spark Branch]

2015-05-06 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li reassigned HIVE-10550: Assignee: Chengxiang Li > Dynamic RDD caching optimization for HoS.[Spark Branch] > ---

[jira] [Updated] (HIVE-10548) Remove dependency to s3 repository in root pom

2015-05-06 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-10548: - Attachment: HIVE-10548.2.patch > Remove dependency to s3 repository in root pom >

[jira] [Commented] (HIVE-10235) Loop optimization for SIMD in ColumnDivideColumn.txt

2015-04-29 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520702#comment-14520702 ] Chengxiang Li commented on HIVE-10235: -- Committed to master, thanks Gopal V for revie

[jira] [Updated] (HIVE-10235) Loop optimization for SIMD in ColumnDivideColumn.txt

2015-04-29 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-10235: - Fix Version/s: 1.3.0 > Loop optimization for SIMD in ColumnDivideColumn.txt >

  1   2   >