[jira] [Commented] (FLINK-20220) DataSet.collect() uses TaskExecutionState for transferring user-payload

2020-11-21 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17236700#comment-17236700 ] Zhu Zhu commented on FLINK-20220: - Thanks for sharing the log [~rmetzger]. I checked it and the fatal

[jira] [Assigned] (FLINK-20220) DataSet.collect() uses TaskExecutionState for transferring user-payload

2020-11-21 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-20220: --- Assignee: Zhu Zhu > DataSet.collect() uses TaskExecutionState for transferring user-payload >

[jira] [Comment Edited] (FLINK-20220) DataSet.collect() uses TaskExecutionState for transferring user-payload

2020-11-20 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17236606#comment-17236606 ] Zhu Zhu edited comment on FLINK-20220 at 11/21/20, 7:32 AM: I guess the

[jira] [Commented] (FLINK-20220) DataSet.collect() uses TaskExecutionState for transferring user-payload

2020-11-20 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17236606#comment-17236606 ] Zhu Zhu commented on FLINK-20220: - I guess the reason is that the status of a vertex to schedule was

[jira] [Commented] (FLINK-20246) Add documentation on Python worker memory tuning in the memory tuning page

2020-11-19 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17235865#comment-17235865 ] Zhu Zhu commented on FLINK-20246: - Thanks for firing and taking this task! [~dian.fu] Link it to

[jira] [Assigned] (FLINK-20122) Test Small file compaction

2020-11-18 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-20122: --- Assignee: Yun Gao (was: Guowei Ma) > Test Small file compaction > -- > >

[jira] [Comment Edited] (FLINK-19177) FLIP-141: Intra-Slot Managed Memory Sharing

2020-11-18 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17235216#comment-17235216 ] Zhu Zhu edited comment on FLINK-19177 at 11/19/20, 7:16 AM: [~xintongsong]

[jira] [Commented] (FLINK-19177) FLIP-141: Intra-Slot Managed Memory Sharing

2020-11-18 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17235216#comment-17235216 ] Zhu Zhu commented on FLINK-19177: - [~xintongsong] [~dian.fu] Do you think we should introduce a section

[jira] [Comment Edited] (FLINK-19181) Make python processes respect the calculated managed memory fraction

2020-11-18 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17235210#comment-17235210 ] Zhu Zhu edited comment on FLINK-19181 at 11/19/20, 7:01 AM: [~dian.fu] shall

[jira] [Commented] (FLINK-19181) Make python processes respect the calculated managed memory fraction

2020-11-18 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17235210#comment-17235210 ] Zhu Zhu commented on FLINK-19181: - [~dian.fu] shall we announce in release notes that the config options

[jira] [Closed] (FLINK-19806) Job may try to leave SUSPENDED state in ExecutionGraph#failJob()

2020-11-17 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-19806. --- Resolution: Fixed Fixed via: 1.12: 1538e5695c561d10c4e92fed9d0cf561b3125f0a 1.11:

[jira] [Updated] (FLINK-19806) Job may try to leave SUSPENDED state in ExecutionGraph#failJob()

2020-11-16 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-19806: Fix Version/s: 1.11.3 > Job may try to leave SUSPENDED state in ExecutionGraph#failJob() >

[jira] [Updated] (FLINK-19806) Job may try to leave SUSPENDED state in ExecutionGraph#failJob()

2020-11-16 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-19806: Affects Version/s: 1.10.0 > Job may try to leave SUSPENDED state in ExecutionGraph#failJob() >

[jira] [Updated] (FLINK-19806) Job may try to leave SUSPENDED state in ExecutionGraph#failJob()

2020-11-16 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-19806: Fix Version/s: 1.12.0 > Job may try to leave SUSPENDED state in ExecutionGraph#failJob() >

[jira] [Closed] (FLINK-19994) All vertices in an DataSet iteration job will be eagerly scheduled

2020-11-10 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-19994. --- Resolution: Fixed Fixed via: 0b0a6d90c7819be3b31e64e8aba83ee8ae2d757c

[jira] [Commented] (FLINK-20013) BoundedBlockingSubpartition may leak network buffer if task is failed or canceled

2020-11-08 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17228387#comment-17228387 ] Zhu Zhu commented on FLINK-20013: - Hi [~nicholasjiang], I can see that [~pnowojski] has assigned this

[jira] [Comment Edited] (FLINK-19964) Gelly ITCase stuck on Azure in HITSITCase.testPrintWithRMatGraph

2020-11-08 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17228381#comment-17228381 ] Zhu Zhu edited comment on FLINK-19964 at 11/9/20, 7:37 AM: --- The change

[jira] [Commented] (FLINK-19964) Gelly ITCase stuck on Azure in HITSITCase.testPrintWithRMatGraph

2020-11-08 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17228381#comment-17228381 ] Zhu Zhu commented on FLINK-19964: - The change FLINK-19189 to "enable pipelined region scheduling by

[jira] [Commented] (FLINK-19699) PrometheusReporterEndToEndITCase crashes with exit code 143

2020-11-07 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17227911#comment-17227911 ] Zhu Zhu commented on FLINK-19699: - Another instance:

[jira] [Commented] (FLINK-19882) E2E: SQLClientHBaseITCase crash

2020-11-07 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17227910#comment-17227910 ] Zhu Zhu commented on FLINK-19882: - Another instance:

[jira] [Closed] (FLINK-10240) Pluggable scheduling strategy for batch jobs

2020-11-06 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-10240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-10240. --- Resolution: Later > Pluggable scheduling strategy for batch jobs >

[jira] [Commented] (FLINK-10240) Pluggable scheduling strategy for batch jobs

2020-11-06 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-10240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17227751#comment-17227751 ] Zhu Zhu commented on FLINK-10240: - Let's close this ticket because the pluggable scheduling strategy it

[jira] [Comment Edited] (FLINK-20013) BoundedBlockingSubpartition may leak network buffer if task is failed or canceled

2020-11-06 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17227228#comment-17227228 ] Zhu Zhu edited comment on FLINK-20013 at 11/6/20, 8:23 AM: --- [~nicholasjiang]

[jira] [Commented] (FLINK-20013) BoundedBlockingSubpartition may leak network buffer if task is failed or canceled

2020-11-06 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17227228#comment-17227228 ] Zhu Zhu commented on FLINK-20013: - [~nicholasjiang] Sorry but I do not know much about this issue. cc

[jira] [Commented] (FLINK-19964) Gelly ITCase stuck on Azure in HITSITCase.testPrintWithRMatGraph

2020-11-05 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17227153#comment-17227153 ] Zhu Zhu commented on FLINK-19964: - We recently noticed the issue FLINK-19994 that pipelined region

[jira] [Assigned] (FLINK-19994) All vertices in an DataSet iteration job will be eagerly scheduled

2020-11-05 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-19994: --- Assignee: Zhu Zhu > All vertices in an DataSet iteration job will be eagerly scheduled >

[jira] [Commented] (FLINK-19994) All vertices in an DataSet iteration job will be eagerly scheduled

2020-11-05 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17226799#comment-17226799 ] Zhu Zhu commented on FLINK-19994: - [~azagrebin] {{computeStronglyConnectedComponents}} does not see

[jira] [Commented] (FLINK-19994) All vertices in an DataSet iteration job will be eagerly scheduled

2020-11-05 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17226604#comment-17226604 ] Zhu Zhu commented on FLINK-19994: - cc [~trohrmann][~azagrebin] WDYT? Correct me if I missed anything

[jira] [Comment Edited] (FLINK-19994) All vertices in an DataSet iteration job will be eagerly scheduled

2020-11-05 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17226604#comment-17226604 ] Zhu Zhu edited comment on FLINK-19994 at 11/5/20, 9:33 AM: --- cc [~trohrmann]

[jira] [Created] (FLINK-19994) All vertices in an DataSet iteration job will be eagerly scheduled

2020-11-05 Thread Zhu Zhu (Jira)
Zhu Zhu created FLINK-19994: --- Summary: All vertices in an DataSet iteration job will be eagerly scheduled Key: FLINK-19994 URL: https://issues.apache.org/jira/browse/FLINK-19994 Project: Flink

[jira] [Commented] (FLINK-15325) Input location preference which affects task distribution may make certain job performance worse

2020-11-04 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17226074#comment-17226074 ] Zhu Zhu commented on FLINK-15325: - Maybe a better option is to ignore the input location preferences

[jira] [Commented] (FLINK-15325) Input location preference which affects task distribution may make certain job performance worse

2020-11-02 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17224723#comment-17224723 ] Zhu Zhu commented on FLINK-15325: - I'd like to resume this discussion because it has been the cause of

[jira] [Closed] (FLINK-19703) A result partition is not untracked after its producer task failed in TaskManager

2020-11-02 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-19703. --- Resolution: Fixed Fixed via: dc50a2a84100441e6003df57e2ad667d275e5e3c

[jira] [Assigned] (FLINK-19921) Remove legacy RestartStrategy

2020-11-02 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-19921: --- Assignee: Zhu Zhu > Remove legacy RestartStrategy > - > >

[jira] [Assigned] (FLINK-19920) Remove legacy FailoverStrategy

2020-11-02 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-19920: --- Assignee: Zhu Zhu > Remove legacy FailoverStrategy > -- > >

[jira] [Assigned] (FLINK-19919) Remove legacy scheduling in ExecutionGraph components

2020-11-02 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-19919: --- Assignee: Zhu Zhu > Remove legacy scheduling in ExecutionGraph components >

[jira] [Created] (FLINK-19922) Remove SlotProvider from SchedulerNG

2020-11-02 Thread Zhu Zhu (Jira)
Zhu Zhu created FLINK-19922: --- Summary: Remove SlotProvider from SchedulerNG Key: FLINK-19922 URL: https://issues.apache.org/jira/browse/FLINK-19922 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-19921) Remove legacy RestartStrategy

2020-11-02 Thread Zhu Zhu (Jira)
Zhu Zhu created FLINK-19921: --- Summary: Remove legacy RestartStrategy Key: FLINK-19921 URL: https://issues.apache.org/jira/browse/FLINK-19921 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-19920) Remove legacy FailoverStrategy

2020-11-02 Thread Zhu Zhu (Jira)
Zhu Zhu created FLINK-19920: --- Summary: Remove legacy FailoverStrategy Key: FLINK-19920 URL: https://issues.apache.org/jira/browse/FLINK-19920 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-19919) Remove legacy scheduling in ExecutionGraph components

2020-11-02 Thread Zhu Zhu (Jira)
Zhu Zhu created FLINK-19919: --- Summary: Remove legacy scheduling in ExecutionGraph components Key: FLINK-19919 URL: https://issues.apache.org/jira/browse/FLINK-19919 Project: Flink Issue Type:

[jira] [Comment Edited] (FLINK-19853) BulkSlotProviderImplTest.testFailedBulkSlotAllocationReleasesAllocatedSlot failed in azure

2020-11-02 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17224519#comment-17224519 ] Zhu Zhu edited comment on FLINK-19853 at 11/2/20, 9:11 AM: --- The failure cause

[jira] [Commented] (FLINK-19853) BulkSlotProviderImplTest.testFailedBulkSlotAllocationReleasesAllocatedSlot failed in azure

2020-11-02 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17224519#comment-17224519 ] Zhu Zhu commented on FLINK-19853: - The failure cause is the concurrency of the released slot check and

[jira] [Created] (FLINK-19806) Job may try to leave SUSPENDED state in ExecutionGraph#failJob()

2020-10-26 Thread Zhu Zhu (Jira)
Zhu Zhu created FLINK-19806: --- Summary: Job may try to leave SUSPENDED state in ExecutionGraph#failJob() Key: FLINK-19806 URL: https://issues.apache.org/jira/browse/FLINK-19806 Project: Flink

[jira] [Commented] (FLINK-19703) A result partition is not untracked after its producer task failed in TaskManager

2020-10-23 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17219622#comment-17219622 ] Zhu Zhu commented on FLINK-19703: - The problem can be exposed by reworking

[jira] [Commented] (FLINK-19703) A result partition is not untracked after its producer task failed in TaskManager

2020-10-23 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17219608#comment-17219608 ] Zhu Zhu commented on FLINK-19703: - [~chesnay] It can happen in code path

[jira] [Closed] (FLINK-14606) Simplify params of Execution#processFail

2020-10-23 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-14606. --- Resolution: Won't Do Closed because the value of {{inCallback}} and {{releasePartitions}} are not exactly

[jira] [Commented] (FLINK-19712) Pipelined region failover should skip restarting tasks in CREATED

2020-10-19 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17216683#comment-17216683 ] Zhu Zhu commented on FLINK-19712: - cc [~trohrmann] [~azagrebin] > Pipelined region failover should skip

[jira] [Commented] (FLINK-19714) Assign different logical pipelined regions of a DataSet job to different slot sharing group

2020-10-19 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17216682#comment-17216682 ] Zhu Zhu commented on FLINK-19714: - cc [~trohrmann] [~azagrebin] > Assign different logical pipelined

[jira] [Updated] (FLINK-19714) Assign different logical pipelined regions of a DataSet job to different slot sharing group

2020-10-19 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-19714: Description: Currently, job vertices of a DataSet job will be put into the same SlotSharingGroup. It

[jira] [Updated] (FLINK-19714) Assign different logical pipelined regions of a DataSet job to different slot sharing group

2020-10-19 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-19714: Description: Currently, job vertices of a DataSet job will be put into the same SlotSharingGroup. It

[jira] [Created] (FLINK-19714) Assign different logical pipelined regions of a DataSet job to different slot sharing group

2020-10-19 Thread Zhu Zhu (Jira)
Zhu Zhu created FLINK-19714: --- Summary: Assign different logical pipelined regions of a DataSet job to different slot sharing group Key: FLINK-19714 URL: https://issues.apache.org/jira/browse/FLINK-19714

[jira] [Created] (FLINK-19712) Pipelined region failover should skip restarting tasks in CREATED

2020-10-19 Thread Zhu Zhu (Jira)
Zhu Zhu created FLINK-19712: --- Summary: Pipelined region failover should skip restarting tasks in CREATED Key: FLINK-19712 URL: https://issues.apache.org/jira/browse/FLINK-19712 Project: Flink

[jira] [Commented] (FLINK-19671) Update EditorConfig file to be useful

2020-10-19 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17216583#comment-17216583 ] Zhu Zhu commented on FLINK-19671: - I agree that we should have a rule which is easy to apply

[jira] [Commented] (FLINK-19671) Update EditorConfig file to be useful

2020-10-19 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17216516#comment-17216516 ] Zhu Zhu commented on FLINK-19671: - Hi [~aljoscha], I found the continuation indentation is set to 8,

[jira] [Created] (FLINK-19703) A result partition is not untracked after its producer task failed in TaskManager

2020-10-19 Thread Zhu Zhu (Jira)
Zhu Zhu created FLINK-19703: --- Summary: A result partition is not untracked after its producer task failed in TaskManager Key: FLINK-19703 URL: https://issues.apache.org/jira/browse/FLINK-19703 Project:

[jira] [Closed] (FLINK-19669) PipelinedRegionSchedulingStrategy#init ResultPartitionType blocking check should use isBlocking method

2020-10-18 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-19669. --- Resolution: Fixed Fixed via 8133c0662c94d1d7dc225166130e4838b9361e04 >

[jira] [Updated] (FLINK-19669) PipelinedRegionSchedulingStrategy#init ResultPartitionType blocking check should use isBlocking method

2020-10-16 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-19669: Affects Version/s: (was: 1.11.0) 1.12.0 >

[jira] [Updated] (FLINK-19669) PipelinedRegionSchedulingStrategy#init ResultPartitionType blocking check should use isBlocking method

2020-10-16 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-19669: Fix Version/s: (was: 1.11.3) > PipelinedRegionSchedulingStrategy#init ResultPartitionType blocking

[jira] [Updated] (FLINK-19669) PipelinedRegionSchedulingStrategy#init ResultPartitionType blocking check should use isBlocking method

2020-10-15 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-19669: Fix Version/s: 1.11.3 1.12.0 > PipelinedRegionSchedulingStrategy#init

[jira] [Updated] (FLINK-19669) PipelinedRegionSchedulingStrategy#init ResultPartitionType blocking check should use isBlocking method

2020-10-15 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-19669: Component/s: Runtime / Coordination > PipelinedRegionSchedulingStrategy#init ResultPartitionType blocking

[jira] [Updated] (FLINK-19669) PipelinedRegionSchedulingStrategy#init ResultPartitionType blocking check should use isBlocking method

2020-10-15 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-19669: Affects Version/s: 1.11.0 > PipelinedRegionSchedulingStrategy#init ResultPartitionType blocking check >

[jira] [Commented] (FLINK-19669) PipelinedRegionSchedulingStrategy#init ResultPartitionType blocking check should use isBlocking method

2020-10-15 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17215134#comment-17215134 ] Zhu Zhu commented on FLINK-19669: - Thanks for reporting this issue [~xuannan]. You are right that it

[jira] [Assigned] (FLINK-19669) PipelinedRegionSchedulingStrategy#init ResultPartitionType blocking check should use isBlocking method

2020-10-15 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-19669: --- Assignee: Xuannan Su > PipelinedRegionSchedulingStrategy#init ResultPartitionType blocking check

[jira] [Commented] (FLINK-19552) JobManager dies with IllegalStateException SharedSlot (physical request SlotRequestId{%}) has been released

2020-10-14 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17213685#comment-17213685 ] Zhu Zhu commented on FLINK-19552: - The root cause is that `MergingSharedSlotProfileRetrieverFactory`

[jira] [Closed] (FLINK-19570) Execution graph related tests are possibly broken due to registering duplicated ExecutionAttemptID

2020-10-13 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-19570. --- Resolution: Fixed Fixed via f2d70c85b659074342db93bd903b2c9e91cfb749

[jira] [Assigned] (FLINK-19552) JobManager dies with IllegalStateException SharedSlot (physical request SlotRequestId{%}) has been released

2020-10-13 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-19552: --- Assignee: Zhu Zhu (was: Andrey Zagrebin) > JobManager dies with IllegalStateException SharedSlot

[jira] [Created] (FLINK-19598) E2E test Kerberized YARN application on Docker test (default input) fails on CI

2020-10-13 Thread Zhu Zhu (Jira)
Zhu Zhu created FLINK-19598: --- Summary: E2E test Kerberized YARN application on Docker test (default input) fails on CI Key: FLINK-19598 URL: https://issues.apache.org/jira/browse/FLINK-19598 Project: Flink

[jira] [Commented] (FLINK-19570) Execution graph related tests are possibly broken due to registering duplicated ExecutionAttemptID

2020-10-12 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17212219#comment-17212219 ] Zhu Zhu commented on FLINK-19570: - cc [~karmagyz] [~trohrmann] [~mapohl] > Execution graph related

[jira] [Updated] (FLINK-19570) Execution graph related tests are possibly broken due to registering duplicated ExecutionAttemptID

2020-10-12 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-19570: Description: Since FLINK-17295, many tests encounters unexpected global failure due to registering

[jira] [Updated] (FLINK-19570) Execution graph related tests are possibly broken due to registering duplicated ExecutionAttemptID

2020-10-12 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-19570: Description: Since FLINK-17295, many tests encounters unexpected global failure due to registering

[jira] [Created] (FLINK-19570) Execution graph related tests are possibly broken due to registering duplicated ExecutionAttemptID

2020-10-12 Thread Zhu Zhu (Jira)
Zhu Zhu created FLINK-19570: --- Summary: Execution graph related tests are possibly broken due to registering duplicated ExecutionAttemptID Key: FLINK-19570 URL: https://issues.apache.org/jira/browse/FLINK-19570

[jira] [Commented] (FLINK-17726) Scheduler should take care of tasks directly canceled by TaskManager

2020-10-09 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17210780#comment-17210780 ] Zhu Zhu commented on FLINK-17726: - Hi [~nicholasjiang], is there any updates? Or do you still like to

[jira] [Commented] (FLINK-19552) JobManager dies with IllegalStateException SharedSlot (physical request SlotRequestId{%}) has been released

2020-10-09 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17210701#comment-17210701 ] Zhu Zhu commented on FLINK-19552: - Thanks for reporting this issue! [~rmetzger] We will take a look. cc

[jira] [Closed] (FLINK-16430) FLIP-119 Pipelined Region Scheduling

2020-10-08 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-16430. --- Release Note: Beginning from Flink 1.12, jobs will be scheduled in the unit of pipelined regions. A

[jira] [Closed] (FLINK-19264) Jobs with identical graph shapes cannot be run concurrently

2020-10-01 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-19264. --- Resolution: Fixed Fixed via 6e5240f8ac24974826a07b5370908a85bd874ce1 > Jobs with identical graph shapes

[jira] [Comment Edited] (FLINK-16430) FLIP-119 Pipelined Region Scheduling

2020-09-28 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17203129#comment-17203129 ] Zhu Zhu edited comment on FLINK-16430 at 9/28/20, 9:46 AM: --- Yes, I will

[jira] [Commented] (FLINK-16430) FLIP-119 Pipelined Region Scheduling

2020-09-28 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17203129#comment-17203129 ] Zhu Zhu commented on FLINK-16430: - Yes, I will prepare a release not and close it [~trohrmann] >

[jira] [Updated] (FLINK-15467) Should wait for the end of the source thread during the Task cancellation

2020-09-24 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-15467: Fix Version/s: (was: 1.11.3) 1.11.2 > Should wait for the end of the source thread

[jira] [Closed] (FLINK-19189) Enable pipelined scheduling by default

2020-09-23 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-19189. --- Resolution: Fixed Done via: 773dc111782db70bef07473755e95b10b32ef8e2

[jira] [Closed] (FLINK-19286) Improve pipelined region scheduling performance

2020-09-23 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-19286. --- Resolution: Fixed Done via: 6045da062d30fcaea1b2eaf5fb879fd89b7e920e

[jira] [Commented] (FLINK-19264) Jobs with identical graph shapes cannot be run concurrently

2020-09-22 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17200020#comment-17200020 ] Zhu Zhu commented on FLINK-19264: - Thanks for doing the experiment [~karmagyz] I checked your previous

[jira] [Assigned] (FLINK-19264) Jobs with identical graph shapes cannot be run concurrently

2020-09-22 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-19264: --- Assignee: Yangze Guo > Jobs with identical graph shapes cannot be run concurrently >

[jira] [Closed] (FLINK-19287) Fix minor version in flink docs

2020-09-21 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-19287. --- Resolution: Fixed Fixed via release-1.11: a2ab22e771ddd5feedb873d901a047e0bcb9e297 release-1.10:

[jira] [Assigned] (FLINK-19189) Enable pipelined scheduling by default

2020-09-20 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-19189: --- Assignee: Zhu Zhu > Enable pipelined scheduling by default >

[jira] [Created] (FLINK-19287) Fix minor version in flink docs

2020-09-18 Thread Zhu Zhu (Jira)
Zhu Zhu created FLINK-19287: --- Summary: Fix minor version in flink docs Key: FLINK-19287 URL: https://issues.apache.org/jira/browse/FLINK-19287 Project: Flink Issue Type: Bug Components:

[jira] [Created] (FLINK-19286) Improve pipelined region scheduling performance

2020-09-17 Thread Zhu Zhu (Jira)
Zhu Zhu created FLINK-19286: --- Summary: Improve pipelined region scheduling performance Key: FLINK-19286 URL: https://issues.apache.org/jira/browse/FLINK-19286 Project: Flink Issue Type: Sub-task

[jira] [Closed] (FLINK-18114) Expose more details in logs for debugging bulk slot allocation failures

2020-09-17 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-18114. --- Resolution: Won't Do > Expose more details in logs for debugging bulk slot allocation failures >

[jira] [Commented] (FLINK-19264) Jobs with identical graph shapes cannot be run concurrently

2020-09-17 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17198094#comment-17198094 ] Zhu Zhu commented on FLINK-19264: - [~aljoscha] yes the {{StreamNode}} hash is, if not specified by

[jira] [Commented] (FLINK-19264) Identical jobs cannot be run concurrently

2020-09-16 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17197360#comment-17197360 ] Zhu Zhu commented on FLINK-19264: - Thanks for reporting and investigating this issue! I had wrongly

[jira] [Updated] (FLINK-15467) Should wait for the end of the source thread during the Task cancellation

2020-09-11 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-15467: Fix Version/s: (was: 1.11.2) 1.11.3 > Should wait for the end of the source thread

[jira] [Closed] (FLINK-17016) Integrate pipelined region scheduling

2020-09-11 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-17016. --- Resolution: Fixed Done via: d918cc3e660d9cdbb84a175c8bb93ce6a14e38dc

[jira] [Closed] (FLINK-14870) Remove nullable assumption of task slot sharing group

2020-09-10 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-14870. --- Resolution: Fixed > Remove nullable assumption of task slot sharing group >

[jira] [Commented] (FLINK-14870) Remove nullable assumption of task slot sharing group

2020-09-10 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17193478#comment-17193478 ] Zhu Zhu commented on FLINK-14870: - Merged via 455ab3d0fea08295447ad690b39ff0d743230bea

[jira] [Updated] (FLINK-17016) Integrate pipelined region scheduling

2020-09-10 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-17016: Description: This task is to integrate PipelinedRegionSchedulingStrategy with DefaultScheduler. A config

[jira] [Created] (FLINK-19189) Enable pipelined scheduling by default

2020-09-10 Thread Zhu Zhu (Jira)
Zhu Zhu created FLINK-19189: --- Summary: Enable pipelined scheduling by default Key: FLINK-19189 URL: https://issues.apache.org/jira/browse/FLINK-19189 Project: Flink Issue Type: Sub-task

[jira] [Updated] (FLINK-17016) Integrate pipelined region scheduling

2020-09-10 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-17016: Summary: Integrate pipelined region scheduling (was: Enable PipelinedRegionSchedulingStrategy) >

[jira] [Closed] (FLINK-19166) StreamingFileWriter should register Listener before the initialization of buckets

2020-09-09 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-19166. --- Fix Version/s: 1.12.0 Resolution: Fixed Fixed via master: 03fd81937a77d4952a49d53891880b0489485c0c

[jira] [Updated] (FLINK-19148) Table crashed in Flink Table API & SQL Docs

2020-09-09 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-19148: Fix Version/s: (was: 1.11.3) 1.11.2 > Table crashed in Flink Table API & SQL Docs

[jira] [Updated] (FLINK-19094) Revise the description of watermark strategy in Flink Table document

2020-09-09 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu updated FLINK-19094: Fix Version/s: (was: 1.11.3) 1.11.2 > Revise the description of watermark strategy

[jira] [Commented] (FLINK-17329) Quickstarts Scala nightly e2e test failed on travis

2020-09-08 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17191975#comment-17191975 ] Zhu Zhu commented on FLINK-17329: - Another instance:

<    7   8   9   10   11   12   13   14   15   16   >