[
https://issues.apache.org/jira/browse/HIVE-8852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-8852:
-
Attachment: HIVE-8852.2-spark.patch
Seems we're still picking up the old spark jar. Add clear library cache and
[
https://issues.apache.org/jira/browse/HIVE-8852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-8852:
-
Attachment: HIVE-8852.1-spark.patch
Update new spark progress API for local submitted job monitoring[Spark
[
https://issues.apache.org/jira/browse/HIVE-8852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-8852:
-
Attachment: HIVE-8852.2-spark.patch
Address some RB comments.
Thanks [~chengxiang li] for the review!
Update new
[
https://issues.apache.org/jira/browse/HIVE-8841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-8841:
-
Attachment: HIVE-8841.1-spark.patch
I think this patch shall serve the purpose.
[~xuefuz] - do you know how I can
[
https://issues.apache.org/jira/browse/HIVE-8841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-8841:
-
Status: Patch Available (was: Open)
Make RDD caching work for multi-insert after HIVE-8793 when map join is
[
https://issues.apache.org/jira/browse/HIVE-8841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14211680#comment-14211680
]
Rui Li commented on HIVE-8841:
--
I see, thanks [~xuefuz] for clarifying.
Make RDD caching
[
https://issues.apache.org/jira/browse/HIVE-8793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14207790#comment-14207790
]
Rui Li commented on HIVE-8793:
--
Hi [~xuefuz],
The failed tests are because I changed how
[
https://issues.apache.org/jira/browse/HIVE-8793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-8793:
-
Attachment: HIVE-8793.2-spark.patch
Revert changes to ExplainTask.
Make sure multi-insert works with map join
[
https://issues.apache.org/jira/browse/HIVE-8793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14207983#comment-14207983
]
Rui Li commented on HIVE-8793:
--
Now the result seems better.
Another thing I want to clarify
[
https://issues.apache.org/jira/browse/HIVE-8536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14209083#comment-14209083
]
Rui Li commented on HIVE-8536:
--
Runtime skew join should be processed by two resolvers:
[
https://issues.apache.org/jira/browse/HIVE-8793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14209056#comment-14209056
]
Rui Li commented on HIVE-8793:
--
Thank you [~xuefuz] for the review!
Refactor to make
[
https://issues.apache.org/jira/browse/HIVE-8840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14209061#comment-14209061
]
Rui Li commented on HIVE-8840:
--
I think two things need to be done to achieve this purpose:
1.
[
https://issues.apache.org/jira/browse/HIVE-8841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li reassigned HIVE-8841:
Assignee: Rui Li
Make RDD caching work for multi-insert after HIVE-8793 when map join is
involved [Spark
[
https://issues.apache.org/jira/browse/HIVE-7333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14209297#comment-14209297
]
Rui Li commented on HIVE-7333:
--
Hi [~klonikar],
Thanks for your interest. When I did the
[
https://issues.apache.org/jira/browse/HIVE-8852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li reassigned HIVE-8852:
Assignee: Rui Li
Update new spark progress API for local submitted job monitoring[Spark Branch]
[
https://issues.apache.org/jira/browse/HIVE-7333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14209330#comment-14209330
]
Rui Li commented on HIVE-7333:
--
Hi Xuefu Reynold,
Thanks a lot for the explanations!
Hi
[
https://issues.apache.org/jira/browse/HIVE-8793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-8793:
-
Attachment: HIVE-8793.1-spark.patch
Refactor to make split spark work as a physical resolver.
Make sure
[
https://issues.apache.org/jira/browse/HIVE-8793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-8793:
-
Status: Patch Available (was: Open)
Make sure multi-insert works with map join [Spark Branch]
[
https://issues.apache.org/jira/browse/HIVE-8542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-8542:
-
Attachment: HIVE-8542.5-spark.patch
Update patch according to RB comments.
Golden file for {{optimize_nullscan.q}}
[
https://issues.apache.org/jira/browse/HIVE-8542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-8542:
-
Attachment: HIVE-8542.6-spark.patch
Cannot reproduce the failed tests on my side. Upload the same patch to run the
[
https://issues.apache.org/jira/browse/HIVE-8793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14204700#comment-14204700
]
Rui Li commented on HIVE-8793:
--
Hi [~xuefuz], do you mean the job here is just to make
[
https://issues.apache.org/jira/browse/HIVE-8542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14205838#comment-14205838
]
Rui Li commented on HIVE-8542:
--
I still can't reproduce the failed tests.
[~xuefuz] - do you
[
https://issues.apache.org/jira/browse/HIVE-8793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li reassigned HIVE-8793:
Assignee: Rui Li
Make sure multi-insert works with map join [Spark Branch]
[
https://issues.apache.org/jira/browse/HIVE-8793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14205846#comment-14205846
]
Rui Li commented on HIVE-8793:
--
Thanks [~xuefuz], I'll give it a try.
Make sure multi-insert
[
https://issues.apache.org/jira/browse/HIVE-8542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14205872#comment-14205872
]
Rui Li commented on HIVE-8542:
--
[~xuefuz] - thanks for taking care of this. But did you forget
[
https://issues.apache.org/jira/browse/HIVE-8542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14205966#comment-14205966
]
Rui Li commented on HIVE-8542:
--
Thank you [~xuefuz]!
What's your opinion about
[
https://issues.apache.org/jira/browse/HIVE-8542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14206001#comment-14206001
]
Rui Li commented on HIVE-8542:
--
[~xuefuz] - I tried SORT_QUERY_RESULTS but it doesn't help.
[
https://issues.apache.org/jira/browse/HIVE-8542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14206027#comment-14206027
]
Rui Li commented on HIVE-8542:
--
Thanks [~xuefuz] for the review!
Enable groupby_map_ppr.q
[
https://issues.apache.org/jira/browse/HIVE-8542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14204230#comment-14204230
]
Rui Li commented on HIVE-8542:
--
Hi [~xuefuz], yeah I'll do that once I figured out the failed
[
https://issues.apache.org/jira/browse/HIVE-8542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-8542:
-
Attachment: HIVE-8542.4-spark.patch
Rebase the patch to let the test run again.
I cannot reproduce
[
https://issues.apache.org/jira/browse/HIVE-8542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14204254#comment-14204254
]
Rui Li commented on HIVE-8542:
--
Hi [~xuefuz], I added the RB entry.
One thing I'm not quite
[
https://issues.apache.org/jira/browse/HIVE-8542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14204255#comment-14204255
]
Rui Li commented on HIVE-8542:
--
Hi [~csun], thanks for the clarifications!
Enable
[
https://issues.apache.org/jira/browse/HIVE-8542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-8542:
-
Attachment: HIVE-8542.2-spark.patch
Fix some bugs and update golden files.
Most of the changes made to the golden
[
https://issues.apache.org/jira/browse/HIVE-8542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-8542:
-
Attachment: HIVE-8542.3-spark.patch
Rebase patch.
Enable groupby_map_ppr.q and groupby_map_ppr_multi_distinct.q
[
https://issues.apache.org/jira/browse/HIVE-8542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-8542:
-
Attachment: HIVE-8542.1-spark.patch
Submit a patch to let the tests run. I expect many to fail.
Enable
[
https://issues.apache.org/jira/browse/HIVE-8542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-8542:
-
Issue Type: Bug (was: Test)
Enable groupby_map_ppr.q and groupby_map_ppr_multi_distinct.q [Spark Branch]
[
https://issues.apache.org/jira/browse/HIVE-8542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-8542:
-
Status: Patch Available (was: Open)
Enable groupby_map_ppr.q and groupby_map_ppr_multi_distinct.q [Spark Branch]
[
https://issues.apache.org/jira/browse/HIVE-8073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14200023#comment-14200023
]
Rui Li commented on HIVE-8073:
--
Hi [~xuefuz], I've investigated all the optimizations in
[
https://issues.apache.org/jira/browse/HIVE-8542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li reassigned HIVE-8542:
Assignee: Rui Li
Enable groupby_map_ppr.q and groupby_map_ppr_multi_distinct.q [Spark Branch]
[
https://issues.apache.org/jira/browse/HIVE-8542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14200162#comment-14200162
]
Rui Li commented on HIVE-8542:
--
Hi [~csun], let me take this one. As it seems to be a bug in
[
https://issues.apache.org/jira/browse/HIVE-8542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14201691#comment-14201691
]
Rui Li commented on HIVE-8542:
--
I think the problem is that the sorting keys and partition
[
https://issues.apache.org/jira/browse/HIVE-8073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li reassigned HIVE-8073:
Assignee: Rui Li
Go thru all operator plan optimizations and disable those that are not
suitable for
[
https://issues.apache.org/jira/browse/HIVE-8610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-8610:
-
Attachment: HIVE-8610.3.patch
Update patch according to RB comments.
Compile time skew join optimization doesn't
[
https://issues.apache.org/jira/browse/HIVE-8610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-8610:
-
Attachment: HIVE-8610.4.patch
Update patch. Thanks [~xuefuz] for review.
Compile time skew join optimization
[
https://issues.apache.org/jira/browse/HIVE-8535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-8535:
-
Attachment: HIVE-8535.5-spark.patch
Hi [~xuefuz], I didn't see any conflicts rebasing the patch. The new patch
[
https://issues.apache.org/jira/browse/HIVE-8616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14188117#comment-14188117
]
Rui Li commented on HIVE-8616:
--
Hi [~ssatish], forgive my ignorance, but why do we need two
[
https://issues.apache.org/jira/browse/HIVE-8616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14188120#comment-14188120
]
Rui Li commented on HIVE-8616:
--
Oh sorry for the my last comment. I checked the task plan
[
https://issues.apache.org/jira/browse/HIVE-8610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-8610:
-
Status: Patch Available (was: Open)
Compile time skew join optimization doesn't work with auto map join
[
https://issues.apache.org/jira/browse/HIVE-8610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-8610:
-
Attachment: HIVE-8610.1.patch
This patch adds QBJoinTree and colExprMap for the cloned join operator tree in
[
https://issues.apache.org/jira/browse/HIVE-8610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14186853#comment-14186853
]
Rui Li commented on HIVE-8610:
--
Hi [~xuefuz], do I have to add something to
[
https://issues.apache.org/jira/browse/HIVE-8535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14187884#comment-14187884
]
Rui Li commented on HIVE-8535:
--
Hi [~xuefuz], the failed test vectorization_13 doesn't seem to
[
https://issues.apache.org/jira/browse/HIVE-8610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-8610:
-
Attachment: HIVE-8610.2.patch
Thanks [~xuefuz] for the review.
The failed test is because I didn't sync with
[
https://issues.apache.org/jira/browse/HIVE-8535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14188013#comment-14188013
]
Rui Li commented on HIVE-8535:
--
[~xuefuz] - no problem. I'll do the rebase now.
Enable
[
https://issues.apache.org/jira/browse/HIVE-8610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li reassigned HIVE-8610:
Assignee: Rui Li
Compile time skew join optimization doesn't work with auto map join
[
https://issues.apache.org/jira/browse/HIVE-8535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14186216#comment-14186216
]
Rui Li commented on HIVE-8535:
--
[~xuefuz] - Sorry I forgot to update this one. I'll rebase the
[
https://issues.apache.org/jira/browse/HIVE-8535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-8535:
-
Attachment: HIVE-8535.4-spark.patch
Rebase patch.
Enable compile time skew join optimization for spark [Spark
[
https://issues.apache.org/jira/browse/HIVE-8602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14184752#comment-14184752
]
Rui Li commented on HIVE-8602:
--
Thank you [~xuefuz] for the review. Could you please also
Rui Li created HIVE-8610:
Summary: Compile time skew join optimization doesn't work with
auto map join
Key: HIVE-8610
URL: https://issues.apache.org/jira/browse/HIVE-8610
Project: Hive
Issue Type:
[
https://issues.apache.org/jira/browse/HIVE-8535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14182755#comment-14182755
]
Rui Li commented on HIVE-8535:
--
The failed test is because I added SORT_QUERY_RESULTS label to
[
https://issues.apache.org/jira/browse/HIVE-8406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-8406:
-
Attachment: Skew join background.pdf
Upload the doc so it may help people get a better understand how skew join is
Rui Li created HIVE-8602:
Summary: Add SORT_QUERY_RESULTS for skewjoinopt2
Key: HIVE-8602
URL: https://issues.apache.org/jira/browse/HIVE-8602
Project: Hive
Issue Type: Test
Components:
[
https://issues.apache.org/jira/browse/HIVE-8602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-8602:
-
Status: Patch Available (was: Open)
Add SORT_QUERY_RESULTS for skewjoinopt2
[
https://issues.apache.org/jira/browse/HIVE-8602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-8602:
-
Attachment: HIVE-8602.1.patch
Add SORT_QUERY_RESULTS for skewjoinopt2
---
[
https://issues.apache.org/jira/browse/HIVE-8602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14183854#comment-14183854
]
Rui Li commented on HIVE-8602:
--
cc [~xuefuz]
Add SORT_QUERY_RESULTS for skewjoinopt2
[
https://issues.apache.org/jira/browse/HIVE-8535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-8535:
-
Attachment: HIVE-8535.1-spark.patch
Since compile time optimization runs in logical layer and is quite independent
[
https://issues.apache.org/jira/browse/HIVE-8535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-8535:
-
Status: Patch Available (was: Open)
Enable compile time skew join optimization for spark [Spark Branch]
[
https://issues.apache.org/jira/browse/HIVE-8535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-8535:
-
Attachment: HIVE-8535.2-spark.patch
Enable more tests.
Enable compile time skew join optimization for spark
[
https://issues.apache.org/jira/browse/HIVE-8528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14179644#comment-14179644
]
Rui Li commented on HIVE-8528:
--
Forgive my ignorance, just some high level questions:
* Why
[
https://issues.apache.org/jira/browse/HIVE-8528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14180919#comment-14180919
]
Rui Li commented on HIVE-8528:
--
[~xuefuz] - thanks for pointing me to the detailed info. I
[
https://issues.apache.org/jira/browse/HIVE-8528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14180931#comment-14180931
]
Rui Li commented on HIVE-8528:
--
Yep, I see. Thanks for explaining :-)
Add remote Spark
Rui Li created HIVE-8537:
Summary: Update to use the stable TaskContext API [Spark Branch]
Key: HIVE-8537
URL: https://issues.apache.org/jira/browse/HIVE-8537
Project: Hive
Issue Type: Bug
[
https://issues.apache.org/jira/browse/HIVE-8537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-8537:
-
Issue Type: Task (was: Bug)
Update to use the stable TaskContext API [Spark Branch]
[
https://issues.apache.org/jira/browse/HIVE-8537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li reassigned HIVE-8537:
Assignee: Rui Li
Update to use the stable TaskContext API [Spark Branch]
[
https://issues.apache.org/jira/browse/HIVE-8537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-8537:
-
Attachment: HIVE-8537-spark.patch
Update to use the stable TaskContext API [Spark Branch]
[
https://issues.apache.org/jira/browse/HIVE-8537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-8537:
-
Status: Patch Available (was: Open)
Update to use the stable TaskContext API [Spark Branch]
[
https://issues.apache.org/jira/browse/HIVE-8537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14178157#comment-14178157
]
Rui Li commented on HIVE-8537:
--
[~chengxiang li] - I created this because it breaks the build
[
https://issues.apache.org/jira/browse/HIVE-8537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li reassigned HIVE-8537:
Assignee: Chengxiang Li (was: Rui Li)
Assign this to you [~chengxiang li], as it's related to HIVE-8520.
[
https://issues.apache.org/jira/browse/HIVE-8518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14179446#comment-14179446
]
Rui Li commented on HIVE-8518:
--
Thank you [~xuefuz] for the review!
Could you also merge this
[
https://issues.apache.org/jira/browse/HIVE-8518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14179483#comment-14179483
]
Rui Li commented on HIVE-8518:
--
OK got it.
Compile time skew join optimization returns
[
https://issues.apache.org/jira/browse/HIVE-8518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14179517#comment-14179517
]
Rui Li commented on HIVE-8518:
--
Thanks [~xuefuz] and [~brocknoland]! Everything seems fine
Rui Li created HIVE-8518:
Summary: Compile time skew join optimization returns duplicated
results
Key: HIVE-8518
URL: https://issues.apache.org/jira/browse/HIVE-8518
Project: Hive
Issue Type: Bug
[
https://issues.apache.org/jira/browse/HIVE-8518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li reassigned HIVE-8518:
Assignee: Rui Li
Compile time skew join optimization returns duplicated results
[
https://issues.apache.org/jira/browse/HIVE-8518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-8518:
-
Attachment: HIVE-8518.1.patch
Compile time skew join optimization returns duplicated results
[
https://issues.apache.org/jira/browse/HIVE-8518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li updated HIVE-8518:
-
Status: Patch Available (was: Open)
Compile time skew join optimization returns duplicated results
[
https://issues.apache.org/jira/browse/HIVE-8518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14176755#comment-14176755
]
Rui Li commented on HIVE-8518:
--
cc [~xuefuz]
Compile time skew join optimization returns
[
https://issues.apache.org/jira/browse/HIVE-8518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14177807#comment-14177807
]
Rui Li commented on HIVE-8518:
--
Hi [~xuefuz], I find there're already several unit tests for
Rui Li created HIVE-8535:
Summary: Enable compile time skew join optimization for spark
[Spark Branch]
Key: HIVE-8535
URL: https://issues.apache.org/jira/browse/HIVE-8535
Project: Hive
Issue Type:
Rui Li created HIVE-8536:
Summary: Enable runtime skew join optimization for spark [Spark
Branch]
Key: HIVE-8536
URL: https://issues.apache.org/jira/browse/HIVE-8536
Project: Hive
Issue Type:
[
https://issues.apache.org/jira/browse/HIVE-8406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14177960#comment-14177960
]
Rui Li commented on HIVE-8406:
--
Created and linked two sub tasks for compile-time and runtime
[
https://issues.apache.org/jira/browse/HIVE-7893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li resolved HIVE-7893.
--
Resolution: Fixed
Fixed via HIVE-7439
Find a way to get a job identifier when submitting a spark job [Spark
[
https://issues.apache.org/jira/browse/HIVE-8456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14173414#comment-14173414
]
Rui Li commented on HIVE-8456:
--
[~chengxiang li] - thanks for the explanation!
I agree we
[
https://issues.apache.org/jira/browse/HIVE-8456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14173443#comment-14173443
]
Rui Li commented on HIVE-8456:
--
I see. That makes sense.
+1 The patch looks good to me.
[
https://issues.apache.org/jira/browse/HIVE-8406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14173449#comment-14173449
]
Rui Li commented on HIVE-8406:
--
Skew join optimization depends on map join.
Research on
[
https://issues.apache.org/jira/browse/HIVE-8456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14173247#comment-14173247
]
Rui Li commented on HIVE-8456:
--
I'm not familiar how the counter/accumulator works. Just a few
[
https://issues.apache.org/jira/browse/HIVE-7467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14171844#comment-14171844
]
Rui Li commented on HIVE-7467:
--
[~jxiang] - thanks for the update!
I know there's workarounds
[
https://issues.apache.org/jira/browse/HIVE-7893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14170353#comment-14170353
]
Rui Li commented on HIVE-7893:
--
Thanks [~joshrosen]. Yes I've seen your PR and really
[
https://issues.apache.org/jira/browse/HIVE-7439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14170387#comment-14170387
]
Rui Li commented on HIVE-7439:
--
The async APIs are stabilized in SPARK-3902.
Spark job
[
https://issues.apache.org/jira/browse/HIVE-7439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14170417#comment-14170417
]
Rui Li commented on HIVE-7439:
--
+1 patch looks good to me.
Only a minor point: can we print
[
https://issues.apache.org/jira/browse/HIVE-7439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14170426#comment-14170426
]
Rui Li commented on HIVE-7439:
--
[~brocknoland] - Yep, that'll be fine.
Spark job monitoring
[
https://issues.apache.org/jira/browse/HIVE-8406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rui Li reassigned HIVE-8406:
Assignee: Rui Li
Research on skewed join [Spark Branch]
--
401 - 500 of 670 matches
Mail list logo
