[jira] [Commented] (FLINK-18433) From the end-to-end performance test results, 1.11 has a regression

2020-06-30 Thread Aihua Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17148365#comment-17148365 ] Aihua Li commented on FLINK-18433: -- I think this change should be noted in the release note of 1.11 >

[jira] [Commented] (FLINK-18433) From the end-to-end performance test results, 1.11 has a regression

2020-06-30 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17148336#comment-17148336 ] Arvid Heise commented on FLINK-18433: - Would it be a good idea to check for the slaves file and

[jira] [Commented] (FLINK-18433) From the end-to-end performance test results, 1.11 has a regression

2020-06-29 Thread Aihua Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17148331#comment-17148331 ] Aihua Li commented on FLINK-18433: -- I found the reason: There were three machines in the performance

[jira] [Commented] (FLINK-18433) From the end-to-end performance test results, 1.11 has a regression

2020-06-29 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17147739#comment-17147739 ] Piotr Nowojski commented on FLINK-18433: [~AHeise], this metrics comes from:

[jira] [Commented] (FLINK-18433) From the end-to-end performance test results, 1.11 has a regression

2020-06-28 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17147499#comment-17147499 ] Yu Li commented on FLINK-18433: --- bq. The last commit corresponding to the test package is

[jira] [Commented] (FLINK-18433) From the end-to-end performance test results, 1.11 has a regression

2020-06-28 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17147409#comment-17147409 ] Arvid Heise commented on FLINK-18433: - [~trohrmann], I used the local executor with explicit Xmx

[jira] [Commented] (FLINK-18433) From the end-to-end performance test results, 1.11 has a regression

2020-06-27 Thread Aihua Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17147221#comment-17147221 ] Aihua Li commented on FLINK-18433: -- Thanks for all the above analysis.I add some test notes: 1. The

[jira] [Commented] (FLINK-18433) From the end-to-end performance test results, 1.11 has a regression

2020-06-27 Thread Zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17147180#comment-17147180 ] Zhijiang commented on FLINK-18433: -- Thanks for all the above analysis. >From my side, there are

[jira] [Commented] (FLINK-18433) From the end-to-end performance test results, 1.11 has a regression

2020-06-27 Thread Congxian Qiu(klion26) (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17147142#comment-17147142 ] Congxian Qiu(klion26) commented on FLINK-18433: --- Thanks for running these tests [~AHeise].

[jira] [Commented] (FLINK-18433) From the end-to-end performance test results, 1.11 has a regression

2020-06-27 Thread Till Rohrmann (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17146983#comment-17146983 ] Till Rohrmann commented on FLINK-18433: --- Thanks for running these tests [~AHeise]. I guess we have

[jira] [Commented] (FLINK-18433) From the end-to-end performance test results, 1.11 has a regression

2020-06-26 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17146650#comment-17146650 ] Arvid Heise commented on FLINK-18433: - Hi [~liyu], thanks for the update - I feared as much.

[jira] [Commented] (FLINK-18433) From the end-to-end performance test results, 1.11 has a regression

2020-06-26 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17146322#comment-17146322 ] Yu Li commented on FLINK-18433: --- [~AHeise] Thanks for the efforts, and sorry but I'm afraid only [~Aihua]

[jira] [Commented] (FLINK-18433) From the end-to-end performance test results, 1.11 has a regression

2020-06-26 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17146139#comment-17146139 ] Arvid Heise commented on FLINK-18433: - Puh, this is not easy to reproduce. First, for me, both

[jira] [Commented] (FLINK-18433) From the end-to-end performance test results, 1.11 has a regression

2020-06-26 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17146099#comment-17146099 ] Arvid Heise commented on FLINK-18433: - I'm starting to bisect on some EC2 instance. > From the

[jira] [Commented] (FLINK-18433) From the end-to-end performance test results, 1.11 has a regression

2020-06-25 Thread Stephan Ewen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17145698#comment-17145698 ] Stephan Ewen commented on FLINK-18433: -- Other sources of stalls (like GC) of course as well. I

[jira] [Commented] (FLINK-18433) From the end-to-end performance test results, 1.11 has a regression

2020-06-25 Thread Stephan Ewen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17145692#comment-17145692 ] Stephan Ewen commented on FLINK-18433: -- I would not dismiss the runtime code so far. The fact that

[jira] [Commented] (FLINK-18433) From the end-to-end performance test results, 1.11 has a regression

2020-06-25 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17144952#comment-17144952 ] Arvid Heise commented on FLINK-18433: - Doing some bisect on a specific test would definitively help.

[jira] [Commented] (FLINK-18433) From the end-to-end performance test results, 1.11 has a regression

2020-06-25 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17144814#comment-17144814 ] Yu Li commented on FLINK-18433: --- In parallel with the manual analysis, does it worth to use binary search

[jira] [Commented] (FLINK-18433) From the end-to-end performance test results, 1.11 has a regression

2020-06-25 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17144812#comment-17144812 ] Yu Li commented on FLINK-18433: --- And IMHO the most noticeable regressions seem to be barrier alignment

[jira] [Commented] (FLINK-18433) From the end-to-end performance test results, 1.11 has a regression

2020-06-25 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17144797#comment-17144797 ] Yu Li commented on FLINK-18433: --- First of all, are you using the latest release-1.11 branch, some RC tag,

[jira] [Commented] (FLINK-18433) From the end-to-end performance test results, 1.11 has a regression

2020-06-25 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17144762#comment-17144762 ] Piotr Nowojski commented on FLINK-18433: {quote} Could this have anything to do with the n-ary

[jira] [Commented] (FLINK-18433) From the end-to-end performance test results, 1.11 has a regression

2020-06-25 Thread Till Rohrmann (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17144757#comment-17144757 ] Till Rohrmann commented on FLINK-18433: --- Pulling in [~liyu] who might now more about possible

[jira] [Commented] (FLINK-18433) From the end-to-end performance test results, 1.11 has a regression

2020-06-25 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17144723#comment-17144723 ] Arvid Heise commented on FLINK-18433: - Some possible causes from the network stack: - We added a few

[jira] [Commented] (FLINK-18433) From the end-to-end performance test results, 1.11 has a regression

2020-06-25 Thread Till Rohrmann (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17144700#comment-17144700 ] Till Rohrmann commented on FLINK-18433: --- Thanks for running the benchmarks [~Aihua]. Just to

[jira] [Commented] (FLINK-18433) From the end-to-end performance test results, 1.11 has a regression

2020-06-24 Thread Congxian Qiu(klion26) (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17144611#comment-17144611 ] Congxian Qiu(klion26) commented on FLINK-18433: --- [~Aihua] thanks for the work, maybe the