[jira] [Commented] (FLINK-10848) Flink's Yarn ResourceManager can allocate too many excess containers

2019-01-14 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16741942#comment-16741942 ] Till Rohrmann commented on FLINK-10848: --- We could add such a warning but I would like to only

[jira] [Commented] (FLINK-10848) Flink's Yarn ResourceManager can allocate too many excess containers

2019-01-11 Thread Shuyi Chen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740797#comment-16740797 ] Shuyi Chen commented on FLINK-10848: Also, can you please also help me take a look at

[jira] [Commented] (FLINK-10848) Flink's Yarn ResourceManager can allocate too many excess containers

2019-01-11 Thread Shuyi Chen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740796#comment-16740796 ] Shuyi Chen commented on FLINK-10848: Thanks a lot for fixing the issue, [~till.rohrmann]. One

[jira] [Commented] (FLINK-10848) Flink's Yarn ResourceManager can allocate too many excess containers

2019-01-08 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16737110#comment-16737110 ] Till Rohrmann commented on FLINK-10848: --- Reverted via master:

[jira] [Commented] (FLINK-10848) Flink's Yarn ResourceManager can allocate too many excess containers

2019-01-08 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736940#comment-16736940 ] Till Rohrmann commented on FLINK-10848: --- Some more information: It seems that the problem is

[jira] [Commented] (FLINK-10848) Flink's Yarn ResourceManager can allocate too many excess containers

2019-01-08 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736924#comment-16736924 ] Till Rohrmann commented on FLINK-10848: --- I could confirm my suspicion. Apparently, there is a Yarn

[jira] [Commented] (FLINK-10848) Flink's Yarn ResourceManager can allocate too many excess containers

2019-01-07 Thread Truong Duc Kien (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736636#comment-16736636 ] Truong Duc Kien commented on FLINK-10848: - Yarn can return more containers than the number of

[jira] [Commented] (FLINK-10848) Flink's Yarn ResourceManager can allocate too many excess containers

2019-01-07 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16735965#comment-16735965 ] Till Rohrmann commented on FLINK-10848: --- Update, so far I was not able to reproduce the problem

[jira] [Commented] (FLINK-10848) Flink's Yarn ResourceManager can allocate too many excess containers

2019-01-07 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16735880#comment-16735880 ] Till Rohrmann commented on FLINK-10848: --- My guess would be that we get a different {{Resource}}

[jira] [Commented] (FLINK-10848) Flink's Yarn ResourceManager can allocate too many excess containers

2019-01-05 Thread Shuyi Chen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16735050#comment-16735050 ] Shuyi Chen commented on FLINK-10848: Hi [~gjy], we are running on 2.7.2. Can you share the steps to

[jira] [Commented] (FLINK-10848) Flink's Yarn ResourceManager can allocate too many excess containers

2019-01-05 Thread Gary Yao (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16734998#comment-16734998 ] Gary Yao commented on FLINK-10848: -- [~suez1224] What was the hadoop version that you tested with? I am

[jira] [Commented] (FLINK-10848) Flink's Yarn ResourceManager can allocate too many excess containers

2019-01-05 Thread Shuyi Chen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16734963#comment-16734963 ] Shuyi Chen commented on FLINK-10848: Fixed in 1.6: 7cc4c6f3e5e84efc067f2f2179648e31e5defa27 Fixed in

[jira] [Commented] (FLINK-10848) Flink's Yarn ResourceManager can allocate too many excess containers

2019-01-04 Thread Shuyi Chen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16734322#comment-16734322 ] Shuyi Chen commented on FLINK-10848: Fixed in master: e26d90fc86b266978b4bac84fe02ca34b62983fe.

[jira] [Commented] (FLINK-10848) Flink's Yarn ResourceManager can allocate too many excess containers

2019-01-03 Thread Shuyi Chen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16733245#comment-16733245 ] Shuyi Chen commented on FLINK-10848: [~xinpu], thanks for sharing your thoughts. You are right,

[jira] [Commented] (FLINK-10848) Flink's Yarn ResourceManager can allocate too many excess containers

2019-01-02 Thread Fan Xinpu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16731900#comment-16731900 ] Fan Xinpu commented on FLINK-10848: --- Yes,there is no perfect chance to remove the ContainerRequest

[jira] [Commented] (FLINK-10848) Flink's Yarn ResourceManager can allocate too many excess containers

2018-12-20 Thread Shuyi Chen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16726502#comment-16726502 ] Shuyi Chen commented on FLINK-10848: [~xinpu], the ContainerRequests are sent during the heartbeat

[jira] [Commented] (FLINK-10848) Flink's Yarn ResourceManager can allocate too many excess containers

2018-12-13 Thread Fan Xinpu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16720880#comment-16720880 ] Fan Xinpu commented on FLINK-10848: --- Shuyi, is there a posibility that the ContainerRequest be removed

[jira] [Commented] (FLINK-10848) Flink's Yarn ResourceManager can allocate too many excess containers

2018-11-20 Thread Shuyi Chen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16693835#comment-16693835 ] Shuyi Chen commented on FLINK-10848: [~till.rohrmann], can you help take a look at this PR? Thanks a

[jira] [Commented] (FLINK-10848) Flink's Yarn ResourceManager can allocate too many excess containers

2018-11-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16685392#comment-16685392 ] ASF GitHub Bot commented on FLINK-10848: suez1224 opened a new pull request #7078:

[jira] [Commented] (FLINK-10848) Flink's Yarn ResourceManager can allocate too many excess containers

2018-11-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16685391#comment-16685391 ] ASF GitHub Bot commented on FLINK-10848: suez1224 closed pull request #7078: [FLINK-10848][YARN]

[jira] [Commented] (FLINK-10848) Flink's Yarn ResourceManager can allocate too many excess containers

2018-11-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16684860#comment-16684860 ] ASF GitHub Bot commented on FLINK-10848: suez1224 opened a new pull request #7078:

[jira] [Commented] (FLINK-10848) Flink's Yarn ResourceManager can allocate too many excess containers

2018-11-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16684859#comment-16684859 ] ASF GitHub Bot commented on FLINK-10848: suez1224 closed pull request #7078: [FLINK-10848][YARN]

[jira] [Commented] (FLINK-10848) Flink's Yarn ResourceManager can allocate too many excess containers

2018-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682789#comment-16682789 ] ASF GitHub Bot commented on FLINK-10848: suez1224 closed pull request #7078: [FLINK-10848][YARN]

[jira] [Commented] (FLINK-10848) Flink's Yarn ResourceManager can allocate too many excess containers

2018-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682790#comment-16682790 ] ASF GitHub Bot commented on FLINK-10848: suez1224 opened a new pull request #7078:

[jira] [Commented] (FLINK-10848) Flink's Yarn ResourceManager can allocate too many excess containers

2018-11-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682768#comment-16682768 ] ASF GitHub Bot commented on FLINK-10848: suez1224 opened a new pull request #7078: