[jira] [Updated] (HIVE-12205) Spark: unify spark statististics aggregation between local and remote spark client

[ https://issues.apache.org/jira/browse/HIVE-12205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-12205: - Resolution: Fixed Status: Resolved (was: Patch Available) > Spark: unify spark

[jira] [Commented] (HIVE-12205) Spark: unify spark statististics aggregation between local and remote spark client

[ https://issues.apache.org/jira/browse/HIVE-12205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15150268#comment-15150268 ] Chengxiang Li commented on HIVE-12205: -- Merged to Spark branch, thanks Chinna for this contribution.

[jira] [Commented] (HIVE-12205) Spark: unify spark statististics aggregation between local and remote spark client

[ https://issues.apache.org/jira/browse/HIVE-12205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15146312#comment-15146312 ] Chengxiang Li commented on HIVE-12205: -- +1 > Spark: unify spark statististics aggregation between

[jira] [Commented] (HIVE-12205) Spark: unify spark statististics aggregation between local and remote spark client

[ https://issues.apache.org/jira/browse/HIVE-12205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15135776#comment-15135776 ] Chengxiang Li commented on HIVE-12205: -- Thanks, Chinna, i'k 发自我的 iPhone > Spark: unify spark

[jira] [Commented] (HIVE-12205) Spark: unify spark statististics aggregation between local and remote spark client

[ https://issues.apache.org/jira/browse/HIVE-12205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15135777#comment-15135777 ] Chengxiang Li commented on HIVE-12205: -- Thanks, Chinna, I'm on vocation now, I would review this when

[jira] [Commented] (HIVE-7142) Hive multi serialization encoding support

[ https://issues.apache.org/jira/browse/HIVE-7142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127486#comment-15127486 ] Chengxiang Li commented on HIVE-7142: - If you want to store data in {{UTF-16}} or {{UTF-32}}, you

[jira] [Updated] (HIVE-12888) TestSparkNegativeCliDriver does not run in Spark mode[Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-12888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-12888: - Attachment: HIVE-12888.1-spark.patch TestSparkNegativeCliDriver does not add test hive conf dir

[jira] [Updated] (HIVE-12736) It seems that result of Hive on Spark be mistaken and result of Hive and Hive on Spark are not the same

[ https://issues.apache.org/jira/browse/HIVE-12736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-12736: - Attachment: HIVE-12736.5-spark.patch [~xuefuz], Yes, it's related, i miss something here. Group

[jira] [Commented] (HIVE-12736) It seems that result of Hive on Spark be mistaken and result of Hive and Hive on Spark are not the same

[ https://issues.apache.org/jira/browse/HIVE-12736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15106575#comment-15106575 ] Chengxiang Li commented on HIVE-12736: -- Besides, during test, i found TestSparkNegativeCliDriver run

[jira] [Updated] (HIVE-12736) It seems that result of Hive on Spark be mistaken and result of Hive and Hive on Spark are not the same

[ https://issues.apache.org/jira/browse/HIVE-12736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-12736: - Attachment: HIVE-12736.5-spark.patch I can't reproduce the failed mapjoin_memcheck.q locally,

[jira] [Updated] (HIVE-12736) It seems that result of Hive on Spark be mistaken and result of Hive and Hive on Spark are not the same

[ https://issues.apache.org/jira/browse/HIVE-12736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-12736: - Attachment: HIVE-12736.3-spark.patch Yes, [~xuefuz], {{Operator::opAllowedBeforeMapJoin()}} and

[jira] [Updated] (HIVE-12736) It seems that result of Hive on Spark be mistaken and result of Hive and Hive on Spark are not the same

[ https://issues.apache.org/jira/browse/HIVE-12736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-12736: - Attachment: HIVE-12736.4-spark.patch > It seems that result of Hive on Spark be mistaken and

[jira] [Commented] (HIVE-12736) It seems that result of Hive on Spark be mistaken and result of Hive and Hive on Spark are not the same

[ https://issues.apache.org/jira/browse/HIVE-12736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15104080#comment-15104080 ] Chengxiang Li commented on HIVE-12736: -- [~xuefuz], would you help to review this patch? > It seems

[jira] [Updated] (HIVE-12736) It seems that result of Hive on Spark be mistaken and result of Hive and Hive on Spark are not the same

[ https://issues.apache.org/jira/browse/HIVE-12736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-12736: - Attachment: HIVE-12736.2-spark.patch > It seems that result of Hive on Spark be mistaken and

[jira] [Updated] (HIVE-12736) It seems that result of Hive on Spark be mistaken and result of Hive and Hive on Spark are not the same

[ https://issues.apache.org/jira/browse/HIVE-12736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-12736: - Attachment: HIVE-12736.1-spark.patch {{SparkMapJoinProcessor}} miss some validation during

[jira] [Commented] (HIVE-12736) It seems that result of Hive on Spark be mistaken and result of Hive and Hive on Spark are not the same

[ https://issues.apache.org/jira/browse/HIVE-12736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088702#comment-15088702 ] Chengxiang Li commented on HIVE-12736: -- I would work on this issue. > It seems that result of Hive

[jira] [Assigned] (HIVE-12736) It seems that result of Hive on Spark be mistaken and result of Hive and Hive on Spark are not the same

[ https://issues.apache.org/jira/browse/HIVE-12736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li reassigned HIVE-12736: Assignee: Chengxiang Li (was: Xuefu Zhang) > It seems that result of Hive on Spark be

[jira] [Commented] (HIVE-12205) Spark: unify spark statististics aggregation between local and remote spark client

[ https://issues.apache.org/jira/browse/HIVE-12205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088795#comment-15088795 ] Chengxiang Li commented on HIVE-12205: -- [~chinnalalam], thanks working on this. In your patch, the

[jira] [Commented] (HIVE-12569) Excessive console message from SparkClientImpl [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-12569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15037187#comment-15037187 ] Chengxiang Li commented on HIVE-12569: -- As [~nemon] analyzed, the message comes from Spark side, it

[jira] [Commented] (HIVE-12515) Clean the SparkCounters related code after remove counter based stats collection[Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-12515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15037160#comment-15037160 ] Chengxiang Li commented on HIVE-12515: -- LGTM BTW, if i recall this right, the operator level stats is

[jira] [Commented] (HIVE-12569) Excessive console message from SparkClientImpl [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-12569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15037299#comment-15037299 ] Chengxiang Li commented on HIVE-12569: -- Actually, it's not a exactly issue, although the spark job

[jira] [Commented] (HIVE-12515) Clean the SparkCounters related code after remove counter based stats collection[Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-12515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15029680#comment-15029680 ] Chengxiang Li commented on HIVE-12515: -- {{SparkCounters}} is referred in lots of classes in HoS, not

[jira] [Commented] (HIVE-12515) Clean the SparkCounters related code after remove counter based stats collection[Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-12515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15029540#comment-15029540 ] Chengxiang Li commented on HIVE-12515: -- [~lirui], the

[jira] [Commented] (HIVE-12466) SparkCounter not initialized error

[ https://issues.apache.org/jira/browse/HIVE-12466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15025999#comment-15025999 ] Chengxiang Li commented on HIVE-12466: -- SparkCounters is only used for stats collection now, so yes,

[jira] [Commented] (HIVE-12466) SparkCounter not initialized error

[ https://issues.apache.org/jira/browse/HIVE-12466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15026034#comment-15026034 ] Chengxiang Li commented on HIVE-12466: -- Yes, it does, at least at the time i implemented the

[jira] [Commented] (HIVE-12466) SparkCounter not initialized error

[ https://issues.apache.org/jira/browse/HIVE-12466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15026081#comment-15026081 ] Chengxiang Li commented on HIVE-12466: -- Committed to spark branch, thanks Rui for this contribution.

[jira] [Commented] (HIVE-12466) SparkCounter not initialized error

[ https://issues.apache.org/jira/browse/HIVE-12466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15026089#comment-15026089 ] Chengxiang Li commented on HIVE-12466: -- HIVE-12515 is created for the following cleanup work. >

[jira] [Commented] (HIVE-12466) SparkCounter not initialized error

[ https://issues.apache.org/jira/browse/HIVE-12466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15024042#comment-15024042 ] Chengxiang Li commented on HIVE-12466: -- LGTM, wait for the testing. > SparkCounter not initialized

[jira] [Commented] (HIVE-12466) SparkCounter not initialized error

[ https://issues.apache.org/jira/browse/HIVE-12466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15023574#comment-15023574 ] Chengxiang Li commented on HIVE-12466: -- Yes, [~lirui], the suffix is available in the operator conf.

[jira] [Commented] (HIVE-12466) SparkCounter not initialized error

[ https://issues.apache.org/jira/browse/HIVE-12466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021611#comment-15021611 ] Chengxiang Li commented on HIVE-12466: -- [~xuefuz], due to the limitation of Spark accumulator, the

[jira] [Commented] (HIVE-11533) Loop optimization for SIMD in integer comparisons

[ https://issues.apache.org/jira/browse/HIVE-11533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14954723#comment-14954723 ] Chengxiang Li commented on HIVE-11533: -- Committed to master branch, thanks for the contribution,

[jira] [Updated] (HIVE-11533) Loop optimization for SIMD in integer comparisons

[ https://issues.apache.org/jira/browse/HIVE-11533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-11533: - Fix Version/s: 2.0.0 > Loop optimization for SIMD in integer comparisons >

[jira] [Commented] (HIVE-11533) Loop optimization for SIMD in integer comparisons

[ https://issues.apache.org/jira/browse/HIVE-11533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14952519#comment-14952519 ] Chengxiang Li commented on HIVE-11533: -- +1 > Loop optimization for SIMD in integer comparisons >

[jira] [Commented] (HIVE-11533) Loop optimization for SIMD in integer comparisons

[ https://issues.apache.org/jira/browse/HIVE-11533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14947998#comment-14947998 ] Chengxiang Li commented on HIVE-11533: -- Very nice job, the patch looks good, just one thing to

[jira] [Commented] (HIVE-10238) Loop optimization for SIMD in IfExprColumnColumn.txt

[ https://issues.apache.org/jira/browse/HIVE-10238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14706287#comment-14706287 ] Chengxiang Li commented on HIVE-10238: -- +1 Loop optimization for SIMD in

[jira] [Commented] (HIVE-10179) Optimization for SIMD instructions in Hive

[ https://issues.apache.org/jira/browse/HIVE-10179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14681520#comment-14681520 ] Chengxiang Li commented on HIVE-10179: -- Yes, [~teddy.choi], it's welcome, feel free

[jira] [Commented] (HIVE-10238) Loop optimization for SIMD in IfExprColumnColumn.txt

[ https://issues.apache.org/jira/browse/HIVE-10238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14681506#comment-14681506 ] Chengxiang Li commented on HIVE-10238: -- Thanks for looking at this, [~teddy.choi]. I

[jira] [Commented] (HIVE-10238) Loop optimization for SIMD in IfExprColumnColumn.txt

[ https://issues.apache.org/jira/browse/HIVE-10238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14692798#comment-14692798 ] Chengxiang Li commented on HIVE-10238: -- Hi, [~teddy.choi], could you upload the patch

[jira] [Commented] (HIVE-11276) Optimization around job submission and adding jars [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-11276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14630682#comment-14630682 ] Chengxiang Li commented on HIVE-11276: -- [~xuefuz], I review the the code in

[jira] [Commented] (HIVE-11276) Optimization around job submission and adding jars [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-11276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14630791#comment-14630791 ] Chengxiang Li commented on HIVE-11276: -- That make sense to me, launch the spark

[jira] [Assigned] (HIVE-11276) Optimization around job submission and adding jars [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-11276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li reassigned HIVE-11276: Assignee: Chengxiang Li Optimization around job submission and adding jars [Spark Branch]

[jira] [Commented] (HIVE-11276) Optimization around job submission and adding jars [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-11276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14630689#comment-14630689 ] Chengxiang Li commented on HIVE-11276: -- Besides, for the case of dynamic allocation,

[jira] [Commented] (HIVE-11267) Combine equavilent leaf works in SparkWork[Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-11267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14629069#comment-14629069 ] Chengxiang Li commented on HIVE-11267: -- [~xuefuz], I took a look at the

[jira] [Updated] (HIVE-11082) Support multi edge between nodes in SparkPlan[Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-11082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-11082: - Attachment: HIVE-11082.3-spark.patch fix nit format issue. Support multi edge between nodes in

[jira] [Updated] (HIVE-11082) Support multi edge between nodes in SparkPlan[Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-11082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-11082: - Fix Version/s: spark-branch Support multi edge between nodes in SparkPlan[Spark Branch]

[jira] [Commented] (HIVE-11204) Research on recent failed qtests[Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-11204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14627641#comment-14627641 ] Chengxiang Li commented on HIVE-11204: -- Ok, I would left this issue open until next

[jira] [Updated] (HIVE-11082) Support multi edge between nodes in SparkPlan[Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-11082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-11082: - Attachment: HIVE-11082.2-spark.patch update related qtest output. Support multi edge between

[jira] [Updated] (HIVE-11204) Research on recent failed qtests[Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-11204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-11204: - Attachment: HIVE-11204.1-spark.patch Research on recent failed qtests[Spark Branch]

[jira] [Updated] (HIVE-11082) Support multi edge between nodes in SparkPlan[Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-11082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-11082: - Attachment: HIVE-11082.1-spark.patch SparkPlan support multi edges between nodes in default, just

[jira] [Commented] (HIVE-11082) Support multi edge between nodes in SparkPlan[Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-11082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14627414#comment-14627414 ] Chengxiang Li commented on HIVE-11082: -- There seems some failed test, [~xuefuz], i

[jira] [Commented] (HIVE-11204) Research on recent failed qtests[Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-11204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14627413#comment-14627413 ] Chengxiang Li commented on HIVE-11204: -- [~xuefuz], all the above initializationError

[jira] [Commented] (HIVE-11082) Support multi edge between nodes in SparkPlan[Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-11082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14627405#comment-14627405 ] Chengxiang Li commented on HIVE-11082: -- It's easy to ignore the alias name during the

[jira] [Assigned] (HIVE-11204) Research on recent failed qtests[Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-11204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li reassigned HIVE-11204: Assignee: Chengxiang Li Research on recent failed qtests[Spark Branch]

[jira] [Updated] (HIVE-11204) Research on recent failed qtests[Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-11204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-11204: - Attachment: HIVE-11204.1-spark.patch Can not reproduce locally now, just upload an empty patch to

[jira] [Assigned] (HIVE-11082) Support multi edge between nodes in SparkPlan[Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-11082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li reassigned HIVE-11082: Assignee: Chengxiang Li Support multi edge between nodes in SparkPlan[Spark Branch]

[jira] [Commented] (HIVE-11053) Add more tests for HIVE-10844[Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14618401#comment-14618401 ] Chengxiang Li commented on HIVE-11053: -- Committed to spark branch, thanks

[jira] [Updated] (HIVE-11053) Add more tests for HIVE-10844[Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-11053: - Fix Version/s: spark-branch Add more tests for HIVE-10844[Spark Branch]

[jira] [Commented] (HIVE-11053) Add more tests for HIVE-10844[Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14618235#comment-14618235 ] Chengxiang Li commented on HIVE-11053: -- The failed spark tests should not related to

[jira] [Commented] (HIVE-11053) Add more tests for HIVE-10844[Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14618236#comment-14618236 ] Chengxiang Li commented on HIVE-11053: -- +1 Add more tests for HIVE-10844[Spark

[jira] [Updated] (HIVE-10850) Followup for HIVE-10550, check performance w.r.t. persistence level [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-10850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-10850: - Assignee: GaoLun (was: Chengxiang Li) Followup for HIVE-10550, check performance w.r.t.

[jira] [Updated] (HIVE-11053) Add more tests for HIVE-10844[Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-11053: - Attachment: HIVE-11053.5-spark.patch upload the patch to relaunch unit test. Add more tests for

[jira] [Commented] (HIVE-11095) SerDeUtils another bug ,when Text is reused

[ https://issues.apache.org/jira/browse/HIVE-11095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14607606#comment-14607606 ] Chengxiang Li commented on HIVE-11095: -- Hi, [~xiaowei], After get +1, it need wait 24

[jira] [Commented] (HIVE-11095) SerDeUtils another bug ,when Text is reused

[ https://issues.apache.org/jira/browse/HIVE-11095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14607607#comment-14607607 ] Chengxiang Li commented on HIVE-11095: -- Hi, [~xiaowei], After get +1, it need wait 24

[jira] [Commented] (HIVE-11138) Query fails when there isn't a comparator for an operator [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-11138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14607574#comment-14607574 ] Chengxiang Li commented on HIVE-11138: -- +1, patch LGTM. Query fails when there

[jira] [Commented] (HIVE-10983) SerDeUtils bug ,when Text is reused

[ https://issues.apache.org/jira/browse/HIVE-10983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14602551#comment-14602551 ] Chengxiang Li commented on HIVE-10983: -- Nice found, thanks for working on this issue,

[jira] [Commented] (HIVE-10983) SerDeUtils bug ,when Text is reused

[ https://issues.apache.org/jira/browse/HIVE-10983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14602637#comment-14602637 ] Chengxiang Li commented on HIVE-10983: -- Great, [~xiaowei], let's wait for the unit

[jira] [Commented] (HIVE-11095) SerDeUtils another bug ,when Text is reused

[ https://issues.apache.org/jira/browse/HIVE-11095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14602714#comment-14602714 ] Chengxiang Li commented on HIVE-11095: -- [~xiaowei], this should be the same issue as

[jira] [Commented] (HIVE-10999) Upgrade Spark dependency to 1.4 [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14598935#comment-14598935 ] Chengxiang Li commented on HIVE-10999: -- The classpath update code change looks good

[jira] [Updated] (HIVE-10844) Combine equivalent Works for HoS[Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-10844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-10844: - Attachment: HIVE-10844.3-spark.patch Combine equivalent Works for HoS[Spark Branch]

[jira] [Updated] (HIVE-11053) Add more tests for HIVE-10844[Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-11053: - Assignee: GAOLUN Add more tests for HIVE-10844[Spark Branch]

[jira] [Commented] (HIVE-10999) Upgrade Spark dependency to 1.4 [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14598755#comment-14598755 ] Chengxiang Li commented on HIVE-10999: -- Seems the latest upload patch pass all the

[jira] [Updated] (HIVE-11053) Add more tests for HIVE-10844[Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-11053: - Assignee: GAOLUN Add more tests for HIVE-10844[Spark Branch]

[jira] [Updated] (HIVE-11053) Add more tests for HIVE-10844[Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-11053: - Assignee: (was: GAOLUN) Add more tests for HIVE-10844[Spark Branch]

[jira] [Commented] (HIVE-10844) Combine equivalent Works for HoS[Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-10844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14591169#comment-14591169 ] Chengxiang Li commented on HIVE-10844: -- The failed test should be irrelevant,

[jira] [Updated] (HIVE-10844) Combine equivalent Works for HoS[Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-10844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-10844: - Attachment: HIVE-10844.2-spark.patch Combine equivalent Works for HoS[Spark Branch]

[jira] [Commented] (HIVE-9370) SparkJobMonitor timeout as sortByKey would launch extra Spark job before original job get submitted [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567055#comment-14567055 ] Chengxiang Li commented on HIVE-9370: - Thanks for asking, [~leftylev]. We have printed

[jira] [Updated] (HIVE-10844) Combine equivalent Works for HoS[Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-10844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-10844: - Attachment: HIVE-10844.1-spark.patch Combine equivalent Works for HoS[Spark Branch]

[jira] [Commented] (HIVE-10550) Dynamic RDD caching optimization for HoS.[Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-10550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14562312#comment-14562312 ] Chengxiang Li commented on HIVE-10550: -- Committed to spark branch, thanks [~xuefuz]

[jira] [Commented] (HIVE-10550) Dynamic RDD caching optimization for HoS.[Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-10550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14562241#comment-14562241 ] Chengxiang Li commented on HIVE-10550: -- Note: these configurations has been removed

[jira] [Updated] (HIVE-10550) Dynamic RDD caching optimization for HoS.[Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-10550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-10550: - Attachment: HIVE-10550.6-spark.patch Dynamic RDD caching optimization for HoS.[Spark Branch]

[jira] [Updated] (HIVE-10550) Dynamic RDD caching optimization for HoS.[Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-10550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-10550: - Attachment: HIVE-10550.5-spark.patch Dynamic RDD caching optimization for HoS.[Spark Branch]

[jira] [Updated] (HIVE-10550) Dynamic RDD caching optimization for HoS.[Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-10550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-10550: - Attachment: HIVE-10550.4-spark.patch Dynamic RDD caching optimization for HoS.[Spark Branch]

[jira] [Updated] (HIVE-10550) Dynamic RDD caching optimization for HoS.[Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-10550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-10550: - Attachment: HIVE-10550.2-spark.patch Dynamic RDD caching optimization for HoS.[Spark Branch]

[jira] [Updated] (HIVE-10550) Dynamic RDD caching optimization for HoS.[Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-10550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-10550: - Attachment: (was: HIVE-10550.2-spark.patch) Dynamic RDD caching optimization for HoS.[Spark

[jira] [Updated] (HIVE-10550) Dynamic RDD caching optimization for HoS.[Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-10550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-10550: - Attachment: HIVE-10550.2-spark.patch Dynamic RDD caching optimization for HoS.[Spark Branch]

[jira] [Commented] (HIVE-10550) Dynamic RDD caching optimization for HoS.[Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-10550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14547807#comment-14547807 ] Chengxiang Li commented on HIVE-10550: -- I'm not sure why, but i keep failed to upload

[jira] [Commented] (HIVE-10550) Dynamic RDD caching optimization for HoS.[Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-10550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14541662#comment-14541662 ] Chengxiang Li commented on HIVE-10550: -- New added configuration: ||name||default

[jira] [Updated] (HIVE-10550) Dynamic RDD caching optimization for HoS.[Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-10550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-10550: - Attachment: HIVE-10550.1.patch Dynamic RDD caching optimization for HoS.[Spark Branch]

[jira] [Commented] (HIVE-10671) yarn-cluster mode offers a degraded performance from yarn-client [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-10671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14543222#comment-14543222 ] Chengxiang Li commented on HIVE-10671: -- LGTM, +1 yarn-cluster mode offers a

[jira] [Commented] (HIVE-10548) Remove dependency to s3 repository in root pom

[ https://issues.apache.org/jira/browse/HIVE-10548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14541373#comment-14541373 ] Chengxiang Li commented on HIVE-10548: -- Committed to master, thanks Szehon for

[jira] [Updated] (HIVE-10548) Remove dependency to s3 repository in root pom

[ https://issues.apache.org/jira/browse/HIVE-10548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-10548: - Attachment: HIVE-10548.2.patch Remove dependency to s3 repository in root pom

[jira] [Updated] (HIVE-10548) Remove dependency to s3 repository in root pom

[ https://issues.apache.org/jira/browse/HIVE-10548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-10548: - Attachment: HIVE-10548.2.patch Remove dependency to s3 repository in root pom

[jira] [Commented] (HIVE-10235) Loop optimization for SIMD in ColumnDivideColumn.txt

[ https://issues.apache.org/jira/browse/HIVE-10235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14495522#comment-14495522 ] Chengxiang Li commented on HIVE-10235: -- Environment: java version 1.8.0_40 Java(TM)

[jira] [Commented] (HIVE-10235) Loop optimization for SIMD in ColumnDivideColumn.txt

[ https://issues.apache.org/jira/browse/HIVE-10235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14495524#comment-14495524 ] Chengxiang Li commented on HIVE-10235: -- The failed test is irrelevant, [~gopalv],

[jira] [Commented] (HIVE-10180) Loop optimization for SIMD in ColumnArithmeticColumn.txt

[ https://issues.apache.org/jira/browse/HIVE-10180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14491819#comment-14491819 ] Chengxiang Li commented on HIVE-10180: -- Committed to trunk, thanks Gopal for review.

[jira] [Updated] (HIVE-10235) Loop optimization for SIMD in ColumnDivideColumn.txt

[ https://issues.apache.org/jira/browse/HIVE-10235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-10235: - Attachment: HIVE-10235.1.patch Test with Jmh VectorizationBench by the following command:

[jira] [Commented] (HIVE-10189) Create a micro benchmark tool for vectorization to evaluate the performance gain after SIMD optimization

[ https://issues.apache.org/jira/browse/HIVE-10189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14491822#comment-14491822 ] Chengxiang Li commented on HIVE-10189: -- Committed to the trunk, thanks Ferdinad for

[jira] [Commented] (HIVE-10189) Create a micro benchmark tool for vectorization to evaluate the performance gain after SIMD optimization

[ https://issues.apache.org/jira/browse/HIVE-10189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14485243#comment-14485243 ] Chengxiang Li commented on HIVE-10189: -- +1 Create a micro benchmark tool for

[jira] [Commented] (HIVE-10180) Loop optimization for SIMD in ColumnArithmeticColumn.txt

[ https://issues.apache.org/jira/browse/HIVE-10180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14482759#comment-14482759 ] Chengxiang Li commented on HIVE-10180: -- Is your machine support AVX2 instruction set?

[jira] [Updated] (HIVE-10180) Loop optimization for SIMD in ColumnArithmeticColumn.txt

[ https://issues.apache.org/jira/browse/HIVE-10180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-10180: - Attachment: HIVE-10180.2.patch Set new variables to final. Loop optimization for SIMD in

  1   2   >