[jira] [Commented] (FLINK-12122) Spread out tasks evenly across all available registered TaskManagers

2021-08-12 Thread Till Rohrmann (Jira)
[ https://issues.apache.org/jira/browse/FLINK-12122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17397959#comment-17397959 ] Till Rohrmann commented on FLINK-12122: --- There is currently not plan to address this problem. To

[jira] [Commented] (FLINK-12122) Spread out tasks evenly across all available registered TaskManagers

2021-08-11 Thread xuliantao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-12122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17397814#comment-17397814 ] xuliantao commented on FLINK-12122: --- [~trohrmann] Hi, thanks for your reply. I understand the reason

[jira] [Commented] (FLINK-12122) Spread out tasks evenly across all available registered TaskManagers

2021-08-11 Thread Till Rohrmann (Jira)
[ https://issues.apache.org/jira/browse/FLINK-12122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17397357#comment-17397357 ] Till Rohrmann commented on FLINK-12122: --- Hi [~xuliantao], currently, this feature won't work

[jira] [Commented] (FLINK-12122) Spread out tasks evenly across all available registered TaskManagers

2021-08-11 Thread xuliantao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-12122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17397323#comment-17397323 ] xuliantao commented on FLINK-12122: --- [~trohrmann] Hi, this issue does not work  on yarn。How can we

[jira] [Commented] (FLINK-12122) Spread out tasks evenly across all available registered TaskManagers

2020-02-18 Thread Yangze Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-12122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17038890#comment-17038890 ] Yangze Guo commented on FLINK-12122: [~huwh], We have some discussion in FLINK-15959. > Spread out

[jira] [Commented] (FLINK-12122) Spread out tasks evenly across all available registered TaskManagers

2020-02-18 Thread huweihua (Jira)
[ https://issues.apache.org/jira/browse/FLINK-12122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17038886#comment-17038886 ] huweihua commented on FLINK-12122: -- [~trohrmann] I think the minimum number of TaskExecutors is

[jira] [Commented] (FLINK-12122) Spread out tasks evenly across all available registered TaskManagers

2020-02-09 Thread Till Rohrmann (Jira)
[ https://issues.apache.org/jira/browse/FLINK-12122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17033420#comment-17033420 ] Till Rohrmann commented on FLINK-12122: --- I guess this depends a bit on how fast you can acquire

[jira] [Commented] (FLINK-12122) Spread out tasks evenly across all available registered TaskManagers

2020-02-06 Thread YufeiLiu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-12122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17031591#comment-17031591 ] YufeiLiu commented on FLINK-12122: -- [~trohrmann]I think should not start execution before

[jira] [Commented] (FLINK-12122) Spread out tasks evenly across all available registered TaskManagers

2020-01-30 Thread Ethan Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-12122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17026777#comment-17026777 ] Ethan Li commented on FLINK-12122: -- bq. there are no plan to backport this feature to 1.8. Thanks

[jira] [Commented] (FLINK-12122) Spread out tasks evenly across all available registered TaskManagers

2020-01-17 Thread Till Rohrmann (Jira)
[ https://issues.apache.org/jira/browse/FLINK-12122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17018197#comment-17018197 ] Till Rohrmann commented on FLINK-12122: --- I think it could help in this situation. What I am a bit

[jira] [Commented] (FLINK-12122) Spread out tasks evenly across all available registered TaskManagers

2020-01-15 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-12122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015892#comment-17015892 ] Xintong Song commented on FLINK-12122: -- [~trohrmann], Do you think the approach we mentioned by

[jira] [Commented] (FLINK-12122) Spread out tasks evenly across all available registered TaskManagers

2020-01-15 Thread huweihua (Jira)
[ https://issues.apache.org/jira/browse/FLINK-12122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015832#comment-17015832 ] huweihua commented on FLINK-12122: -- [~trohrmann] I have the same issue with [~liuyufei].  We run Flink

[jira] [Commented] (FLINK-12122) Spread out tasks evenly across all available registered TaskManagers

2020-01-14 Thread Till Rohrmann (Jira)
[ https://issues.apache.org/jira/browse/FLINK-12122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015258#comment-17015258 ] Till Rohrmann commented on FLINK-12122: --- At the moment, the behaviour you are describing is not

[jira] [Commented] (FLINK-12122) Spread out tasks evenly across all available registered TaskManagers

2020-01-11 Thread YufeiLiu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-12122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17013533#comment-17013533 ] YufeiLiu commented on FLINK-12122: -- [~trohrmann] Thanks for reply. I‘ve found load balance issue

[jira] [Commented] (FLINK-12122) Spread out tasks evenly across all available registered TaskManagers

2020-01-10 Thread Till Rohrmann (Jira)
[ https://issues.apache.org/jira/browse/FLINK-12122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17013089#comment-17013089 ] Till Rohrmann commented on FLINK-12122: --- [~ethanli] there are no plan to backport this feature to

[jira] [Commented] (FLINK-12122) Spread out tasks evenly across all available registered TaskManagers

2020-01-09 Thread YufeiLiu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-12122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17011666#comment-17011666 ] YufeiLiu commented on FLINK-12122: -- [~trohrmann] I noticed that this feature is evenly across available

[jira] [Commented] (FLINK-12122) Spread out tasks evenly across all available registered TaskManagers

2019-12-23 Thread Ethan Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-12122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17002369#comment-17002369 ] Ethan Li commented on FLINK-12122: -- Is there any plan to backport this to 1.8? > Spread out tasks

[jira] [Commented] (FLINK-12122) Spread out tasks evenly across all available registered TaskManagers

2019-11-11 Thread Shahid Chohan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-12122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16971832#comment-16971832 ] Shahid Chohan commented on FLINK-12122: --- [~trohrmann] I noticed that you implemented

[jira] [Commented] (FLINK-12122) Spread out tasks evenly across all available registered TaskManagers

2019-10-23 Thread Antonio Verardi (Jira)
[ https://issues.apache.org/jira/browse/FLINK-12122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16957758#comment-16957758 ] Antonio Verardi commented on FLINK-12122: - [~trohrmann] thanks for looking into this. We haven't

[jira] [Commented] (FLINK-12122) Spread out tasks evenly across all available registered TaskManagers

2019-10-17 Thread Till Rohrmann (Jira)
[ https://issues.apache.org/jira/browse/FLINK-12122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16953801#comment-16953801 ] Till Rohrmann commented on FLINK-12122: --- I've opened a PR to fix this problem in Flink 1.9 and

[jira] [Commented] (FLINK-12122) Spread out tasks evenly across all available registered TaskManagers

2019-09-23 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-12122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16935797#comment-16935797 ] Jingsong Lee commented on FLINK-12122: -- +1 to fix this issue,  In our batch job testing, slots

[jira] [Commented] (FLINK-12122) Spread out tasks evenly across all available registered TaskManagers

2019-09-18 Thread Till Rohrmann (Jira)
[ https://issues.apache.org/jira/browse/FLINK-12122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16932389#comment-16932389 ] Till Rohrmann commented on FLINK-12122: --- Yes, this is something we should have fixed much faster.

[jira] [Commented] (FLINK-12122) Spread out tasks evenly across all available registered TaskManagers

2019-09-17 Thread Elias Levy (Jira)
[ https://issues.apache.org/jira/browse/FLINK-12122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931611#comment-16931611 ] Elias Levy commented on FLINK-12122: Till, that is a welcomed development. I am surprised this

[jira] [Commented] (FLINK-12122) Spread out tasks evenly across all available registered TaskManagers

2019-09-17 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-12122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931510#comment-16931510 ] Xintong Song commented on FLINK-12122: -- Hi [~anton_ryabtsev], The community is currently working

[jira] [Commented] (FLINK-12122) Spread out tasks evenly across all available registered TaskManagers

2019-09-17 Thread Anton Ryabtsev (Jira)
[ https://issues.apache.org/jira/browse/FLINK-12122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931435#comment-16931435 ] Anton Ryabtsev commented on FLINK-12122: [~till.rohrmann] , could you link a corresponding Jira

[jira] [Commented] (FLINK-12122) Spread out tasks evenly across all available registered TaskManagers

2019-09-17 Thread Till Rohrmann (Jira)
[ https://issues.apache.org/jira/browse/FLINK-12122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931425#comment-16931425 ] Till Rohrmann commented on FLINK-12122: --- Hi Elias, the plan is to make the {{SlotManager}}

[jira] [Commented] (FLINK-12122) Spread out tasks evenly across all available registered TaskManagers

2019-09-16 Thread Elias Levy (Jira)
[ https://issues.apache.org/jira/browse/FLINK-12122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930672#comment-16930672 ] Elias Levy commented on FLINK-12122: What is the status of this issue?  It's has a serious negative

[jira] [Commented] (FLINK-12122) Spread out tasks evenly across all available registered TaskManagers

2019-09-05 Thread Anton Ryabtsev (Jira)
[ https://issues.apache.org/jira/browse/FLINK-12122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923086#comment-16923086 ] Anton Ryabtsev commented on FLINK-12122: [~NicoK] For GC I mean:  more threads -> more GC roots

[jira] [Commented] (FLINK-12122) Spread out tasks evenly across all available registered TaskManagers

2019-09-04 Thread Nico Kruber (Jira)
[ https://issues.apache.org/jira/browse/FLINK-12122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16922710#comment-16922710 ] Nico Kruber commented on FLINK-12122: - [~anton_ryabtsev] true, memory could become an issue in

[jira] [Commented] (FLINK-12122) Spread out tasks evenly across all available registered TaskManagers

2019-09-03 Thread Anton Ryabtsev (Jira)
[ https://issues.apache.org/jira/browse/FLINK-12122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16921347#comment-16921347 ] Anton Ryabtsev commented on FLINK-12122: [~NicoK], the issue with the setting the same

[jira] [Commented] (FLINK-12122) Spread out tasks evenly across all available registered TaskManagers

2019-08-14 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907062#comment-16907062 ] Till Rohrmann commented on FLINK-12122: --- Yes, I didn't find time to continue working on this

[jira] [Commented] (FLINK-12122) Spread out tasks evenly across all available registered TaskManagers

2019-08-12 Thread Ben La Monica (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905243#comment-16905243 ] Ben La Monica commented on FLINK-12122: --- [~till.rohrmann], I realize that you're busy, is there

[jira] [Commented] (FLINK-12122) Spread out tasks evenly across all available registered TaskManagers

2019-08-09 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903998#comment-16903998 ] Tzu-Li (Gordon) Tai commented on FLINK-12122: - I've removed the fix version values. Please

[jira] [Commented] (FLINK-12122) Spread out tasks evenly across all available registered TaskManagers

2019-06-16 Thread sunjincheng (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16865244#comment-16865244 ] sunjincheng commented on FLINK-12122: - Due to the release of 1.8.1, I change the fix version from

[jira] [Commented] (FLINK-12122) Spread out tasks evenly across all available registered TaskManagers

2019-06-11 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16860775#comment-16860775 ] Till Rohrmann commented on FLINK-12122: --- Hi [~poros], I still intend to complete this feature for

[jira] [Commented] (FLINK-12122) Spread out tasks evenly across all available registered TaskManagers

2019-06-10 Thread Antonio Verardi (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16860329#comment-16860329 ] Antonio Verardi commented on FLINK-12122: - [~till.rohrmann]: Thanks for picking this feature up!

[jira] [Commented] (FLINK-12122) Spread out tasks evenly across all available registered TaskManagers

2019-06-01 Thread Ben La Monica (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16853806#comment-16853806 ] Ben La Monica commented on FLINK-12122: --- I am able to get even distribution as long as everything

[jira] [Commented] (FLINK-12122) Spread out tasks evenly across all available registered TaskManagers

2019-05-22 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16845716#comment-16845716 ] Till Rohrmann commented on FLINK-12122: --- Thanks for reporting this issue [~mstar_benl]. I think

[jira] [Commented] (FLINK-12122) Spread out tasks evenly across all available registered TaskManagers

2019-05-22 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16845683#comment-16845683 ] Nico Kruber commented on FLINK-12122: - Since every subtask gets its own thread (not every slot /

[jira] [Commented] (FLINK-12122) Spread out tasks evenly across all available registered TaskManagers

2019-05-21 Thread Ben La Monica (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16845115#comment-16845115 ] Ben La Monica commented on FLINK-12122: --- It actually does a worse job. Let's stuff everything onto

[jira] [Commented] (FLINK-12122) Spread out tasks evenly across all available registered TaskManagers

2019-05-21 Thread Ben La Monica (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16845095#comment-16845095 ] Ben La Monica commented on FLINK-12122: --- I think the thing that is throwing everything off is that

[jira] [Commented] (FLINK-12122) Spread out tasks evenly across all available registered TaskManagers

2019-05-21 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16845090#comment-16845090 ] Nico Kruber commented on FLINK-12122: - I guess, as a workaround, you could have your memory

[jira] [Commented] (FLINK-12122) Spread out tasks evenly across all available registered TaskManagers

2019-05-21 Thread Ben La Monica (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16845062#comment-16845062 ] Ben La Monica commented on FLINK-12122: --- I'm running into this exact problem, I have a

[jira] [Commented] (FLINK-12122) Spread out tasks evenly across all available registered TaskManagers

2019-04-09 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813208#comment-16813208 ] Till Rohrmann commented on FLINK-12122: --- Thanks for the pointer [~xintongsong]. I will take a look

[jira] [Commented] (FLINK-12122) Spread out tasks evenly across all available registered TaskManagers

2019-04-08 Thread Tony Xintong Song (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16812308#comment-16812308 ] Tony Xintong Song commented on FLINK-12122: --- Hi [~till.rohrmann], I agree with you that we