[jira] [Commented] (FLINK-23687) Introduce partitioned lookup join to enforce input of LookupJoin to hash shuffle by lookup keys
[ https://issues.apache.org/jira/browse/FLINK-23687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17808433#comment-17808433 ] Benchao Li commented on FLINK-23687: [~yunfanfight...@foxmail.com] Thanks for taking it, I've assigned to you. > Introduce partitioned lookup join to enforce input of LookupJoin to hash > shuffle by lookup keys > --- > > Key: FLINK-23687 > URL: https://issues.apache.org/jira/browse/FLINK-23687 > Project: Flink > Issue Type: Sub-task > Components: Table SQL / Planner >Reporter: Jing Zhang >Assignee: yunfan >Priority: Major > Labels: pull-request-available, stale-assigned > > Add Sql query hint to enable LookupJoin shuffle by join key of left input -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (FLINK-23687) Introduce partitioned lookup join to enforce input of LookupJoin to hash shuffle by lookup keys
[ https://issues.apache.org/jira/browse/FLINK-23687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17801104#comment-17801104 ] yunfan commented on FLINK-23687: Hello, [~jingzhang] . Are you still working on this issue? If not, I can complete the left work. > Introduce partitioned lookup join to enforce input of LookupJoin to hash > shuffle by lookup keys > --- > > Key: FLINK-23687 > URL: https://issues.apache.org/jira/browse/FLINK-23687 > Project: Flink > Issue Type: Sub-task > Components: Table SQL / Planner >Reporter: Jing Zhang >Assignee: Jing Zhang >Priority: Major > Labels: pull-request-available, stale-assigned > > Add Sql query hint to enable LookupJoin shuffle by join key of left input -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (FLINK-23687) Introduce partitioned lookup join to enforce input of LookupJoin to hash shuffle by lookup keys
[ https://issues.apache.org/jira/browse/FLINK-23687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17638049#comment-17638049 ] Jianhui Dong commented on FLINK-23687: -- Hello, I found one issue https://issues.apache.org/jira/browse/FLINK-28568 that integrates keyed state to eliminate the non-determinism, and it has done something similar to keyby, and I wound the FILP-204 will be followed up and completed? > Introduce partitioned lookup join to enforce input of LookupJoin to hash > shuffle by lookup keys > --- > > Key: FLINK-23687 > URL: https://issues.apache.org/jira/browse/FLINK-23687 > Project: Flink > Issue Type: Sub-task > Components: Table SQL / Planner >Reporter: Jing Zhang >Assignee: Jing Zhang >Priority: Major > Labels: pull-request-available, stale-assigned > > Add Sql query hint to enable LookupJoin shuffle by join key of left input -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (FLINK-23687) Introduce partitioned lookup join to enforce input of LookupJoin to hash shuffle by lookup keys
[
https://issues.apache.org/jira/browse/FLINK-23687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17623631#comment-17623631
]
Jianhui Dong commented on FLINK-23687:
--
Hello [~jingzhang] .
I was trying to implement hash lookup join for our internal flink, and found
the FLIP-204. I'd like to ensure compatibility with the flink community as much
as possible, so I wonder if we have decided to use /*+
SHUFFLE_HASH('DIM_TABLE') */ hint as a final solution.
Thanks!
> Introduce partitioned lookup join to enforce input of LookupJoin to hash
> shuffle by lookup keys
> ---
>
> Key: FLINK-23687
> URL: https://issues.apache.org/jira/browse/FLINK-23687
> Project: Flink
> Issue Type: Sub-task
> Components: Table SQL / Planner
>Reporter: Jing Zhang
>Assignee: Jing Zhang
>Priority: Major
> Labels: pull-request-available, stale-assigned
>
> Add Sql query hint to enable LookupJoin shuffle by join key of left input
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Commented] (FLINK-23687) Introduce partitioned lookup join to enforce input of LookupJoin to hash shuffle by lookup keys
[ https://issues.apache.org/jira/browse/FLINK-23687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17484491#comment-17484491 ] WilliamSong commented on FLINK-23687: - hi [~jingzhang] , Happy Spring Festival , May I ask if you are in charge of blink related development work now . Can I get involved, the current Flip or the related Flink later . Can we communicate on wechat . wechat / _DingTalk_ : 13521869069 > Introduce partitioned lookup join to enforce input of LookupJoin to hash > shuffle by lookup keys > --- > > Key: FLINK-23687 > URL: https://issues.apache.org/jira/browse/FLINK-23687 > Project: Flink > Issue Type: Sub-task > Components: Table SQL / Planner >Reporter: Jing Zhang >Assignee: Jing Zhang >Priority: Major > Labels: pull-request-available > > Add Sql query hint to enable LookupJoin shuffle by join key of left input -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Commented] (FLINK-23687) Introduce partitioned lookup join to enforce input of LookupJoin to hash shuffle by lookup keys
[ https://issues.apache.org/jira/browse/FLINK-23687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17464325#comment-17464325 ] Jing Zhang commented on FLINK-23687: [~lincoln.86xy] and [~lzljs3620320] Thanks a lot for your advices. I would create a FLIP on those improvements ASAP. > Introduce partitioned lookup join to enforce input of LookupJoin to hash > shuffle by lookup keys > --- > > Key: FLINK-23687 > URL: https://issues.apache.org/jira/browse/FLINK-23687 > Project: Flink > Issue Type: Sub-task > Components: Table SQL / Planner >Reporter: Jing Zhang >Assignee: Jing Zhang >Priority: Major > Labels: pull-request-available > > Add Sql query hint to enable LookupJoin shuffle by join key of left input -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Commented] (FLINK-23687) Introduce partitioned lookup join to enforce input of LookupJoin to hash shuffle by lookup keys
[ https://issues.apache.org/jira/browse/FLINK-23687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17464226#comment-17464226 ] Jingsong Lee commented on FLINK-23687: -- [~jingzhang] Thanks for your proposal. +1 to start a FLIP before the pull request. This involves the user's SQL API. > Introduce partitioned lookup join to enforce input of LookupJoin to hash > shuffle by lookup keys > --- > > Key: FLINK-23687 > URL: https://issues.apache.org/jira/browse/FLINK-23687 > Project: Flink > Issue Type: Sub-task > Components: Table SQL / Planner >Reporter: Jing Zhang >Assignee: Jing Zhang >Priority: Major > Labels: pull-request-available > > Add Sql query hint to enable LookupJoin shuffle by join key of left input -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Commented] (FLINK-23687) Introduce partitioned lookup join to enforce input of LookupJoin to hash shuffle by lookup keys
[ https://issues.apache.org/jira/browse/FLINK-23687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17464219#comment-17464219 ] lincoln lee commented on FLINK-23687: - [~jingzhang] [~HunterHunter] [~straw] Glad to see the active contribution for enhancing the commonly used lookup-join! I'd like to share some thoughts of this: 1. Since this is a series of related improvements and include sql syntax change, I think it's worth starting a new flip discussion. 2. Flink has always taken stream & batch unification as a design principle, so our improvements in such a join hint also need to consider the batch scenario, yes, we should consider the unity and applicability of the new hints on both stream and batch, so we may need to consider whether there is a better hint name outside of 'partitioned join' Btw, I know that the improvements mentioned above have been in service for years on some vendors including Alibaba's enterprise version, so we'd better hear to more feedback. Looking forward all these exciting improvements! > Introduce partitioned lookup join to enforce input of LookupJoin to hash > shuffle by lookup keys > --- > > Key: FLINK-23687 > URL: https://issues.apache.org/jira/browse/FLINK-23687 > Project: Flink > Issue Type: Sub-task > Components: Table SQL / Planner >Reporter: Jing Zhang >Assignee: Jing Zhang >Priority: Major > Labels: pull-request-available > > Add Sql query hint to enable LookupJoin shuffle by join key of left input -- This message was sent by Atlassian Jira (v8.20.1#820001)
