[jira] [Comment Edited] (FLINK-26548) the source parallelism is not set correctly with AdaptiveBatchScheduler

2022-03-15 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17507075#comment-17507075 ] Zhu Zhu edited comment on FLINK-26548 at 3/15/22, 5:19 PM: --- As discussed in

[jira] [Commented] (FLINK-26548) the source parallelism is not set correctly with AdaptiveBatchScheduler

2022-03-15 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17507075#comment-17507075 ] Zhu Zhu commented on FLINK-26548: - As discussed in #19040, a proper fix of this problem would be to

[jira] [Updated] (FLINK-26548) the source parallelism is not set correctly with AdaptiveBatchScheduler

2022-03-15 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-26548: Priority: Critical (was: Blocker) > the source parallelism is not set correctly with

[jira] [Updated] (FLINK-26548) the source parallelism is not set correctly with AdaptiveBatchScheduler

2022-03-15 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-26548: Fix Version/s: 1.16.0 (was: 1.15.0) > the source parallelism is not set correctly

[jira] [Commented] (FLINK-26548) the source parallelism is not set correctly with AdaptiveBatchScheduler

2022-03-10 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17504192#comment-17504192 ] Zhu Zhu commented on FLINK-26548: - Thanks for reporting this issue and offering to fix it! [~Leo Zhou] I

[jira] [Assigned] (FLINK-26548) the source parallelism is not set correctly with AdaptiveBatchScheduler

2022-03-10 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-26548: --- Assignee: zl > the source parallelism is not set correctly with AdaptiveBatchScheduler >

[jira] [Closed] (FLINK-26579) The default source parallelism configuration in adaptive batch scheduling does not take effect

2022-03-10 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-26579. --- Fix Version/s: (was: 1.15.0) Resolution: Duplicate > The default source parallelism

[jira] [Closed] (FLINK-26517) Normalize the decided parallelism to power of 2 when using adaptive batch scheduler

2022-03-09 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-26517. --- Resolution: Fixed master/release-1.15: 4d42c642cc3c45acf25d41172f6a2132d4c6c60b > Normalize the decided

[jira] [Commented] (FLINK-26437) Cannot discover a connector using option: 'connector'='jdbc'

2022-03-08 Thread Yuan Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17503331#comment-17503331 ] Yuan Zhu commented on FLINK-26437: -- [~jark] Thanks for your advice. [~arindbha], you can try as [~jark]

[jira] [Updated] (FLINK-26517) Normalize the decided parallelism to power of 2 when using adaptive batch scheduler

2022-03-07 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-26517: Affects Version/s: 1.15.0 > Normalize the decided parallelism to power of 2 when using adaptive batch >

[jira] [Assigned] (FLINK-26517) Normalize the decided parallelism to power of 2 when using adaptive batch scheduler

2022-03-07 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-26517: --- Assignee: Lijie Wang > Normalize the decided parallelism to power of 2 when using adaptive batch

[jira] [Comment Edited] (FLINK-26400) Release Testing: Explicit shutdown signalling from TaskManager to JobManager

2022-03-02 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17500466#comment-17500466 ] Zhu Zhu edited comment on FLINK-26400 at 3/3/22, 2:44 AM: -- Here's what I see on

[jira] [Commented] (FLINK-26400) Release Testing: Explicit shutdown signalling from TaskManager to JobManager

2022-03-02 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17500466#comment-17500466 ] Zhu Zhu commented on FLINK-26400: - Here's what I see on the page "Limited integration with Flink’s Web

[jira] [Updated] (FLINK-26400) Release Testing: Explicit shutdown signalling from TaskManager to JobManager

2022-03-02 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-26400: Attachment: errors_on_opening_job_page_when_job_gets_no_resources.png > Release Testing: Explicit

[jira] [Commented] (FLINK-26437) Cannot discover a connector using option: 'connector'='jdbc'

2022-03-02 Thread Yuan Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17500459#comment-17500459 ] Yuan Zhu commented on FLINK-26437: -- In my local env(wsl-ubuntu-20.04), I can run "sql-client.sh

[jira] [Updated] (FLINK-26437) Cannot discover a connector using option: 'connector'='jdbc'

2022-03-02 Thread Yuan Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Zhu updated FLINK-26437: - Attachment: image-2022-03-03-10-03-50-763.png > Cannot discover a connector using option:

[jira] [Commented] (FLINK-26437) Cannot discover a connector using option: 'connector'='jdbc'

2022-03-02 Thread Yuan Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17500215#comment-17500215 ] Yuan Zhu commented on FLINK-26437: -- How do you submit your sql? Are you using sql client locally? >

[jira] [Commented] (FLINK-26437) Cannot discover a connector using option: 'connector'='jdbc'

2022-03-02 Thread Yuan Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17500105#comment-17500105 ] Yuan Zhu commented on FLINK-26437: -- You can try add [hadoop

[jira] [Comment Edited] (FLINK-26437) Cannot discover a connector using option: 'connector'='jdbc'

2022-03-02 Thread Yuan Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17500105#comment-17500105 ] Yuan Zhu edited comment on FLINK-26437 at 3/2/22, 12:28 PM: You can try

[jira] [Comment Edited] (FLINK-26400) Release Testing: Explicit shutdown signalling from TaskManager to JobManager

2022-03-02 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1740#comment-1740 ] Zhu Zhu edited comment on FLINK-26400 at 3/2/22, 9:09 AM: -- I have done the test

[jira] [Commented] (FLINK-26400) Release Testing: Explicit shutdown signalling from TaskManager to JobManager

2022-03-02 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1740#comment-1740 ] Zhu Zhu commented on FLINK-26400: - I have done the test and the result looks good. The stopped

[jira] [Commented] (FLINK-26437) Cannot discover a connector using option: 'connector'='jdbc'

2022-03-01 Thread Yuan Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17499843#comment-17499843 ] Yuan Zhu commented on FLINK-26437: -- Do you have

[jira] [Commented] (FLINK-26400) Release Testing: Explicit shutdown signalling from TaskManager to JobManager

2022-02-28 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17499370#comment-17499370 ] Zhu Zhu commented on FLINK-26400: - I'd like to take this ticket if no one else already plans to take it.

[jira] [Commented] (FLINK-26052) Update chinese documentation regarding FLIP-203

2022-02-27 Thread Shen Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17498670#comment-17498670 ] Shen Zhu commented on FLINK-26052: -- Hi [~dwysakowicz] , I'm interested in translating these commits to

[jira] [Comment Edited] (FLINK-26358) Operator maxParallelism is lost during chaining

2022-02-26 Thread Shen Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17498532#comment-17498532 ] Shen Zhu edited comment on FLINK-26358 at 2/27/22, 6:38 AM: Hi Fabian, I

[jira] [Commented] (FLINK-26358) Operator maxParallelism is lost during chaining

2022-02-26 Thread Shen Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17498532#comment-17498532 ] Shen Zhu commented on FLINK-26358: -- Hi Fabian, I did some investigations about this issue and seems

[jira] [Commented] (FLINK-26217) Introduce manifest.merge-min-count in commit

2022-02-21 Thread Shen Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17495884#comment-17495884 ] Shen Zhu commented on FLINK-26217: -- Hey [~lzljs3620320] , I'm interested in working on this ticket,

[jira] [Closed] (FLINK-25225) Add e2e TPCDS tests to run against the AdaptiveBatchScheduler

2022-02-18 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-25225. --- Resolution: Done master/release-1.15: 5c7a432778f2f8494e104fa89ea08a71e83978b1 > Add e2e TPCDS tests to

[jira] [Updated] (FLINK-26168) The judgment of chainable ignores StreamExchangeMode when partitioner is ForwardForConsecutiveHashPartitioner

2022-02-16 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-26168: Component/s: Runtime / Coordination > The judgment of chainable ignores StreamExchangeMode when

[jira] [Closed] (FLINK-26168) The judgment of chainable ignores StreamExchangeMode when partitioner is ForwardForConsecutiveHashPartitioner

2022-02-16 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-26168. --- Resolution: Done master/release-1.15: 8f3a0251d195ed2532abc31e602029dfcbf7bc77 > The judgment of chainable

[jira] [Comment Edited] (FLINK-25409) Add cache metric to LookupFunction

2022-02-16 Thread Yuan Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493621#comment-17493621 ] Yuan Zhu edited comment on FLINK-25409 at 2/17/22, 3:08 AM: Hi, all. Sorry

[jira] [Commented] (FLINK-25409) Add cache metric to LookupFunction

2022-02-16 Thread Yuan Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493621#comment-17493621 ] Yuan Zhu commented on FLINK-25409: -- Hi, all. Sorry for my late reply. As discussion before, I make a

[jira] [Commented] (FLINK-26148) Change the format of adaptive batch scheduler config option to "jobmanager.adaptive-batch-scheduler.XXX"

2022-02-16 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493154#comment-17493154 ] Zhu Zhu commented on FLINK-26148: - [~wanglijie95] would you update FLIP-187 for the configuration name

[jira] [Closed] (FLINK-26148) Change the format of adaptive batch scheduler config option to "jobmanager.adaptive-batch-scheduler.XXX"

2022-02-16 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-26148. --- Resolution: Done master/release-1.15: 4f20772ca2e36358f51d656b78e45a3e966d6f9e > Change the format of

[jira] [Assigned] (FLINK-26168) The judgment of chainable ignores StreamExchangeMode when partitioner is ForwardForConsecutiveHashPartitioner

2022-02-15 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-26168: --- Assignee: Lijie Wang > The judgment of chainable ignores StreamExchangeMode when partitioner is >

[jira] [Updated] (FLINK-26168) The judgment of chainable ignores StreamExchangeMode when partitioner is ForwardForConsecutiveHashPartitioner

2022-02-15 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-26168: Fix Version/s: 1.15.0 > The judgment of chainable ignores StreamExchangeMode when partitioner is >

[jira] [Updated] (FLINK-26148) Change the format of adaptive batch scheduler config option to "jobmanager.adaptive-batch-scheduler.XXX"

2022-02-15 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-26148: Fix Version/s: 1.15.0 > Change the format of adaptive batch scheduler config option to >

[jira] [Assigned] (FLINK-26148) Change the format of adaptive batch scheduler config option to "jobmanager.adaptive-batch-scheduler.XXX"

2022-02-15 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-26148: --- Assignee: Lijie Wang > Change the format of adaptive batch scheduler config option to >

[jira] [Assigned] (FLINK-25225) Add e2e TPCDS tests to run against the AdaptiveBatchScheduler

2022-02-14 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-25225: --- Assignee: Lijie Wang > Add e2e TPCDS tests to run against the AdaptiveBatchScheduler >

[jira] [Assigned] (FLINK-25226) Add documentation about the AdaptiveBatchScheduler

2022-02-14 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-25226: --- Assignee: Lijie Wang > Add documentation about the AdaptiveBatchScheduler >

[jira] [Closed] (FLINK-25046) Convert unspecified edge to rescale when using adapive batch scheduler

2022-02-14 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-25046. --- Resolution: Done master/release-1.15: d0859f6a74e883a9f3123d2e83b154568e202f7a > Convert unspecified edge

[jira] [Assigned] (FLINK-25046) Convert unspecified edge to rescale when using adapive batch scheduler

2022-02-14 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-25046: --- Assignee: Lijie Wang > Convert unspecified edge to rescale when using adapive batch scheduler >

[jira] [Updated] (FLINK-25046) Convert unspecified edge to rescale when using adapive batch scheduler

2022-02-14 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-25046: Fix Version/s: 1.15.0 > Convert unspecified edge to rescale when using adapive batch scheduler >

[jira] [Commented] (FLINK-25529) java.lang.ClassNotFoundException: org.apache.orc.PhysicalWriter when write bulkly into hive-2.1.1 orc table

2022-02-14 Thread Yuan Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17491959#comment-17491959 ] Yuan Zhu commented on FLINK-25529: -- Replacing orc-core-1.5.6 with orc-core-1.5.6-nohive will invoke

[jira] [Commented] (FLINK-25529) java.lang.ClassNotFoundException: org.apache.orc.PhysicalWriter when write bulkly into hive-2.1.1 orc table

2022-02-13 Thread Yuan Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17491547#comment-17491547 ] Yuan Zhu commented on FLINK-25529: -- [~luoyuxia] You are right that there is no orc-core classes in

[jira] [Closed] (FLINK-26004) Introduce ForwardForConsecutiveHashPartitioner

2022-02-10 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-26004. --- Fix Version/s: 1.15.0 Resolution: Done master/release-1.15: b4d5b66df4066ab9d97e9263714c3a8bcc3063a2

[jira] [Closed] (FLINK-25996) Introduce job property isDynamicGraph to ExecutionConfig

2022-02-10 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-25996. --- Resolution: Done master/release-1.15: 90159f4c7f364f9264e0373c0b1ffa7cafa04cbc > Introduce job property

[jira] [Assigned] (FLINK-26004) Introduce ForwardForConsecutiveHashPartitioner

2022-02-10 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-26004: --- Assignee: Lijie Wang > Introduce ForwardForConsecutiveHashPartitioner >

[jira] [Assigned] (FLINK-25996) Introduce job property isDynamicGraph to ExecutionConfig

2022-02-10 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-25996: --- Assignee: Lijie Wang > Introduce job property isDynamicGraph to ExecutionConfig >

[jira] [Updated] (FLINK-25995) Make implicit assumption of SQL local hash explicit

2022-02-10 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-25995: Summary: Make implicit assumption of SQL local hash explicit (was: Make implicit assumption of SQL local

[jira] [Updated] (FLINK-25995) Make implicit assumption of SQL local hash explicit

2022-02-10 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-25995: Description: If there are multiple consecutive and the same hash shuffles, SQL planner will change them

[jira] [Updated] (FLINK-26004) Introduce ForwardForConsecutiveHashPartitioner

2022-02-09 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-26004: Description: If there are multiple consecutive and the same hash shuffles, SQL planner will change them

[jira] [Updated] (FLINK-26004) Introduce ForwardForConsecutiveHashPartitioner

2022-02-09 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-26004: Description: If there are multiple consecutive the same hash shuffle(i.e. keyBy), SQL planner will

[jira] [Updated] (FLINK-25996) Introduce job property isDynamicGraph to ExecutionConfig

2022-02-08 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-25996: Description: To enable FLINK-25995 and FLINK-25046 only in dynamic graph scenario, we need a property

[jira] [Commented] (FLINK-25529) java.lang.ClassNotFoundException: org.apache.orc.PhysicalWriter when write bulkly into hive-2.1.1 orc table

2022-02-08 Thread Yuan Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17488779#comment-17488779 ] Yuan Zhu commented on FLINK-25529: -- [~luoyuxia] I try hive-exec-2.2.0.jar. It will cause Exception:

[jira] [Updated] (FLINK-25995) Make implicit assumption of SQL local keyBy/groupBy explicit

2022-02-08 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-25995: Description: If there are multiple consecutive the same groupBy(i.e. keyBy), SQL planner will change

[jira] [Updated] (FLINK-25995) Make implicit assumption of SQL local keyBy/groupBy explicit

2022-02-07 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-25995: Description: If there are multiple consecutive the same groupBy(i.e. keyBy), SQL planner will change

[jira] [Created] (FLINK-25996) Introduce job property isDynamicGraph to ExecutionConfig

2022-02-07 Thread Zhu Zhu (Jira)
Zhu Zhu created FLINK-25996: --- Summary: Introduce job property isDynamicGraph to ExecutionConfig Key: FLINK-25996 URL: https://issues.apache.org/jira/browse/FLINK-25996 Project: Flink Issue Type:

[jira] [Created] (FLINK-25995) Make implicit assumption of SQL local keyBy/groupBy explicit

2022-02-07 Thread Zhu Zhu (Jira)
Zhu Zhu created FLINK-25995: --- Summary: Make implicit assumption of SQL local keyBy/groupBy explicit Key: FLINK-25995 URL: https://issues.apache.org/jira/browse/FLINK-25995 Project: Flink Issue

[jira] [Commented] (FLINK-18779) Support the SupportsFilterPushDown interface for LookupTableSource

2022-02-04 Thread Yuan Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17487402#comment-17487402 ] Yuan Zhu commented on FLINK-18779: -- Hi [~godfreyhe] , I have fixed the conflicts of this pr. Since it

[jira] [Commented] (FLINK-25529) java.lang.ClassNotFoundException: org.apache.orc.PhysicalWriter when write bulkly into hive-2.1.1 orc table

2022-02-03 Thread Yuan Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17486799#comment-17486799 ] Yuan Zhu commented on FLINK-25529: -- [~luoyuxia] If I add the hive-exec-2.1.1.jar and

[jira] [Closed] (FLINK-25045) Introduce AdaptiveBatchScheduler

2022-01-29 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-25045. --- Fix Version/s: 1.15.0 Resolution: Done master/release-1.15: f42a92ccfbace9871834dd039a4e2025926b190c

[jira] [Closed] (FLINK-25035) Shuffle Service Supports Consuming Subpartition Range

2022-01-27 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-25035. --- Fix Version/s: 1.15.0 Resolution: Done master/release-1.15: f4fd4f8bb66867821cb0f171218d85f8386b0897

[jira] [Commented] (FLINK-25649) Scheduling jobs fails with org.apache.flink.runtime.jobmanager.scheduler.NoResourceAvailableException

2022-01-26 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17482848#comment-17482848 ] Zhu Zhu commented on FLINK-25649: - Yes, your Flink session uses kubernetes to serve as its HA service,

[jira] [Commented] (FLINK-25649) Scheduling jobs fails with org.apache.flink.runtime.jobmanager.scheduler.NoResourceAvailableException

2022-01-25 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17482307#comment-17482307 ] Zhu Zhu commented on FLINK-25649: - I took a look at the logs. Looks to me the problem is the slow leader

[jira] [Comment Edited] (FLINK-25649) Scheduling jobs fails with org.apache.flink.runtime.jobmanager.scheduler.NoResourceAvailableException

2022-01-25 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17482307#comment-17482307 ] Zhu Zhu edited comment on FLINK-25649 at 1/26/22, 7:40 AM: --- I took a look at

[jira] [Closed] (FLINK-25668) Support calcuate network memory for dynamic graph.

2022-01-25 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-25668. --- Fix Version/s: 1.15.0 Resolution: Done master/release-1.15: 7962a5d9c47f49f435f822a1af2c4141c42a849b

[jira] [Closed] (FLINK-25669) Support register operator coordinators for newly initialized ExecutionJobVertex.

2022-01-24 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-25669. --- Fix Version/s: 1.15.0 Resolution: Done master/release-1.5: 8fc657b899ec740a348c84a6f387c3806584f999

[jira] [Closed] (FLINK-25036) Introduce vertex wise scheduling strategy

2022-01-24 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-25036. --- Fix Version/s: 1.15.0 Resolution: Done master/release-1.15: e5c1e67e2169534d5e837e5690360b075b66dd75

[jira] [Closed] (FLINK-25033) Let some scheduler components updatable

2022-01-19 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-25033. --- Fix Version/s: 1.15.0 Resolution: Done master/release-1.15: 82b07035719ac25c9256a1f273019410ee3ca4e7

[jira] [Comment Edited] (FLINK-25649) Scheduling jobs fails with org.apache.flink.runtime.jobmanager.scheduler.NoResourceAvailableException

2022-01-19 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17479064#comment-17479064 ] Zhu Zhu edited comment on FLINK-25649 at 1/20/22, 4:25 AM: --- You can also send

[jira] [Commented] (FLINK-25649) Scheduling jobs fails with org.apache.flink.runtime.jobmanager.scheduler.NoResourceAvailableException

2022-01-19 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17479064#comment-17479064 ] Zhu Zhu commented on FLINK-25649: - You can also send the logs to me (reed...@gmail.com). > Scheduling

[jira] [Commented] (FLINK-25529) java.lang.ClassNotFoundException: org.apache.orc.PhysicalWriter when write bulkly into hive-2.1.1 orc table

2022-01-19 Thread Yuan Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17478638#comment-17478638 ] Yuan Zhu commented on FLINK-25529: -- Hi, [~luoyuxia] , thanks for your attention. My hive version is

[jira] [Commented] (FLINK-25649) Scheduling jobs fails with org.apache.flink.runtime.jobmanager.scheduler.NoResourceAvailableException

2022-01-18 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17478365#comment-17478365 ] Zhu Zhu commented on FLINK-25649: - >> Would it make sens to say that we encounter this issue because 2

[jira] [Commented] (FLINK-25649) Scheduling jobs fails with org.apache.flink.runtime.jobmanager.scheduler.NoResourceAvailableException

2022-01-17 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17477072#comment-17477072 ] Zhu Zhu commented on FLINK-25649: - >From your description, it's possible that your cluster does not have

[jira] [Assigned] (FLINK-25668) Support calcuate network memory for dynamic graph.

2022-01-17 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-25668: --- Assignee: Lijie Wang > Support calcuate network memory for dynamic graph. >

[jira] [Assigned] (FLINK-25669) Support register operator coordinators for newly initialized ExecutionJobVertex.

2022-01-17 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-25669: --- Assignee: Lijie Wang > Support register operator coordinators for newly initialized >

[jira] [Comment Edited] (FLINK-25649) Scheduling jobs fails with org.apache.flink.runtime.jobmanager.scheduler.NoResourceAvailableException

2022-01-17 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17476945#comment-17476945 ] Zhu Zhu edited comment on FLINK-25649 at 1/17/22, 8:19 AM: --- Hi [~gdegrove],

[jira] [Commented] (FLINK-25649) Scheduling jobs fails with org.apache.flink.runtime.jobmanager.scheduler.NoResourceAvailableException

2022-01-16 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17476945#comment-17476945 ] Zhu Zhu commented on FLINK-25649: - Hi Gil, just to confirm the scenario, 1. are all the jobs unbounded

[jira] [Comment Edited] (FLINK-25649) Scheduling jobs fails with org.apache.flink.runtime.jobmanager.scheduler.NoResourceAvailableException

2022-01-16 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17476945#comment-17476945 ] Zhu Zhu edited comment on FLINK-25649 at 1/17/22, 3:59 AM: --- Hi [~gdegrove],

[jira] [Closed] (FLINK-25034) Support flexible number of subpartitions in IntermediateResultPartition

2022-01-14 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-25034. --- Fix Version/s: 1.15.0 Resolution: Done master/release-1.15: 856652435b2b65933c0b09e780a6229c62a854e4

[jira] [Updated] (FLINK-24892) FLIP-187: Adaptive Batch Scheduler

2022-01-10 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-24892: Fix Version/s: 1.15.0 > FLIP-187: Adaptive Batch Scheduler > -- > >

[jira] [Closed] (FLINK-25032) Allow to create execution vertices and execution edges lazily

2022-01-10 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-25032. --- Fix Version/s: 1.15.0 Resolution: Done master/1.15: d2bfe404e199f98115df419232399bcc11b59e5a

[jira] [Created] (FLINK-25529) java.lang.ClassNotFoundException: org.apache.orc.PhysicalWriter when write bulkly into hive-2.1.1 orc table

2022-01-05 Thread Yuan Zhu (Jira)
Yuan Zhu created FLINK-25529: Summary: java.lang.ClassNotFoundException: org.apache.orc.PhysicalWriter when write bulkly into hive-2.1.1 orc table Key: FLINK-25529 URL:

[jira] [Closed] (FLINK-18295) Remove the hack logics of result consumers

2021-12-30 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-18295. --- Fix Version/s: 1.15.0 Resolution: Fixed master/1.15: 15255565ad1ec6261db4e1c9211fe9b85ca77ac3

[jira] [Assigned] (FLINK-18295) Remove the hack logics of result consumers

2021-12-30 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-18295: --- Assignee: Zhu Zhu > Remove the hack logics of result consumers >

[jira] [Updated] (FLINK-18295) Remove the hack logics of result consumers

2021-12-28 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-18295: Description: Currently an {{IntermediateDataSet}} can have multiple consumer {{JobEdge}}. That's why the

[jira] [Updated] (FLINK-18295) Remove the hack logics of result consumers

2021-12-28 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-18295: Description: Currently an {{IntermediateDataSet}} can have multiple consumer {{JobEdge}}. That's why the

[jira] [Comment Edited] (FLINK-25409) Add cache metric to LookupFunction

2021-12-21 Thread Yuan Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17463553#comment-17463553 ] Yuan Zhu edited comment on FLINK-25409 at 12/22/21, 3:06 AM: - In 1.14.2,

[jira] [Commented] (FLINK-25409) Add cache metric to LookupFunction

2021-12-21 Thread Yuan Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17463553#comment-17463553 ] Yuan Zhu commented on FLINK-25409: -- In 1.14.2, neglecting some private LookupFunctions outside of

[jira] [Created] (FLINK-25409) Add cache metric to LookupFunction

2021-12-21 Thread Yuan Zhu (Jira)
Yuan Zhu created FLINK-25409: Summary: Add cache metric to LookupFunction Key: FLINK-25409 URL: https://issues.apache.org/jira/browse/FLINK-25409 Project: Flink Issue Type: Improvement

[jira] [Commented] (FLINK-23687) Add Sql query hint to enable LookupJoin shuffle by join key of left input

2021-12-21 Thread Yuan Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17463526#comment-17463526 ] Yuan Zhu commented on FLINK-23687: -- [~jingzhang]  {quote}Could you add the cache metric in connector of

[jira] [Closed] (FLINK-25336) Kafka connector compatible problem in Flink sql

2021-12-16 Thread Yuan Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Zhu closed FLINK-25336. Resolution: Not A Bug > Kafka connector compatible problem in Flink sql >

[jira] [Commented] (FLINK-25336) Kafka connector compatible problem in Flink sql

2021-12-16 Thread Yuan Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17460562#comment-17460562 ] Yuan Zhu commented on FLINK-25336: -- [~MartijnVisser]  [~JasonLee] Thanks for your help. I get it. >

[jira] [Commented] (FLINK-25336) Kafka connector compatible problem in Flink sql

2021-12-16 Thread Yuan Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17460493#comment-17460493 ] Yuan Zhu commented on FLINK-25336: -- [~MartijnVisser] Thanks. Then what you provided is the

[jira] [Commented] (FLINK-25336) Kafka connector compatible problem in Flink sql

2021-12-15 Thread Yuan Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17460431#comment-17460431 ] Yuan Zhu commented on FLINK-25336: -- [~JasonLee] Why not make it configurable to support more versions?

[jira] [Updated] (FLINK-25336) Kafka connector compatible problem in Flink sql

2021-12-15 Thread Yuan Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Zhu updated FLINK-25336: - Docs Text: (was: Kafka connector compatible problem in Flink sql) > Kafka connector compatible

[jira] [Commented] (FLINK-25336) Kafka connector compatible problem in Flink sql

2021-12-15 Thread Yuan Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17460391#comment-17460391 ] Yuan Zhu commented on FLINK-25336: -- Hi, [~becket_qin]. What's the purpose here? Can we make

[jira] [Commented] (FLINK-25336) Kafka connector compatible problem in Flink sql

2021-12-15 Thread Yuan Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17460387#comment-17460387 ] Yuan Zhu commented on FLINK-25336: -- The cause of this exception is invoked by the logic in 

[jira] [Created] (FLINK-25336) Kafka connector compatible problem in Flink sql

2021-12-15 Thread Yuan Zhu (Jira)
Yuan Zhu created FLINK-25336: Summary: Kafka connector compatible problem in Flink sql Key: FLINK-25336 URL: https://issues.apache.org/jira/browse/FLINK-25336 Project: Flink Issue Type: Bug

<    3   4   5   6   7   8   9   10   11   12   >