[flink] branch master updated (16ed892 -> f0ff5ba)
This is an automated email from the ASF dual-hosted git repository. xtsong pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git. from 16ed892 [FLINK-19654][python][e2e] Set the parallelism of PyFlink e2e tests to 2 to reduce the execution time add f0ff5ba [hotfix][runtime] Fix typo in MiniCluster No new revisions were added by this update. Summary of changes: .../java/org/apache/flink/runtime/minicluster/MiniCluster.java| 8 1 file changed, 4 insertions(+), 4 deletions(-)
[flink] branch master updated (16ed892 -> f0ff5ba)
This is an automated email from the ASF dual-hosted git repository. xtsong pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git. from 16ed892 [FLINK-19654][python][e2e] Set the parallelism of PyFlink e2e tests to 2 to reduce the execution time add f0ff5ba [hotfix][runtime] Fix typo in MiniCluster No new revisions were added by this update. Summary of changes: .../java/org/apache/flink/runtime/minicluster/MiniCluster.java| 8 1 file changed, 4 insertions(+), 4 deletions(-)
[flink] branch master updated (16ed892 -> f0ff5ba)
This is an automated email from the ASF dual-hosted git repository. xtsong pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git. from 16ed892 [FLINK-19654][python][e2e] Set the parallelism of PyFlink e2e tests to 2 to reduce the execution time add f0ff5ba [hotfix][runtime] Fix typo in MiniCluster No new revisions were added by this update. Summary of changes: .../java/org/apache/flink/runtime/minicluster/MiniCluster.java| 8 1 file changed, 4 insertions(+), 4 deletions(-)
[flink] branch master updated: [hotfix][runtime] Fix typo in MiniCluster
This is an automated email from the ASF dual-hosted git repository.
xtsong pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/flink.git
The following commit(s) were added to refs/heads/master by this push:
new f0ff5ba [hotfix][runtime] Fix typo in MiniCluster
f0ff5ba is described below
commit f0ff5baaca92b2f62a2f860c1a86411c2f0b9ed5
Author: HuangXiao
AuthorDate: Sun Oct 11 13:49:25 2020 +0800
[hotfix][runtime] Fix typo in MiniCluster
This closes #13584.
---
.../java/org/apache/flink/runtime/minicluster/MiniCluster.java| 8
1 file changed, 4 insertions(+), 4 deletions(-)
diff --git
a/flink-runtime/src/main/java/org/apache/flink/runtime/minicluster/MiniCluster.java
b/flink-runtime/src/main/java/org/apache/flink/runtime/minicluster/MiniCluster.java
index a91d20a..95591d2 100644
---
a/flink-runtime/src/main/java/org/apache/flink/runtime/minicluster/MiniCluster.java
+++
b/flink-runtime/src/main/java/org/apache/flink/runtime/minicluster/MiniCluster.java
@@ -265,7 +265,7 @@ public class MiniCluster implements AutoCloseableAsync {
// bring up all the RPC services
LOG.info("Starting RPC Service(s)");
- final RpcServiceFactory
dispatcherResourceManagreComponentRpcServiceFactory;
+ final RpcServiceFactory
dispatcherResourceManagerComponentRpcServiceFactory;
final RpcService metricQueryServiceRpcService;
if (useSingleRpcService) {
@@ -273,7 +273,7 @@ public class MiniCluster implements AutoCloseableAsync {
commonRpcService =
createLocalRpcService(configuration);
final CommonRpcServiceFactory
commonRpcServiceFactory = new CommonRpcServiceFactory(commonRpcService);
taskManagerRpcServiceFactory =
commonRpcServiceFactory;
-
dispatcherResourceManagreComponentRpcServiceFactory = commonRpcServiceFactory;
+
dispatcherResourceManagerComponentRpcServiceFactory = commonRpcServiceFactory;
metricQueryServiceRpcService =
MetricUtils.startLocalMetricsRpcService(configuration);
} else {
@@ -285,7 +285,7 @@ public class MiniCluster implements AutoCloseableAsync {
final String jobManagerBindAddress =
miniClusterConfiguration.getJobManagerBindAddress();
final String taskManagerBindAddress =
miniClusterConfiguration.getTaskManagerBindAddress();
-
dispatcherResourceManagreComponentRpcServiceFactory =
+
dispatcherResourceManagerComponentRpcServiceFactory =
new DedicatedRpcServiceFactory(
configuration,
jobManagerExternalAddress,
@@ -331,7 +331,7 @@ public class MiniCluster implements AutoCloseableAsync {
MetricQueryServiceRetriever
metricQueryServiceRetriever = new
RpcMetricQueryServiceRetriever(metricRegistry.getMetricQueryServiceRpcService());
-
setupDispatcherResourceManagerComponents(configuration,
dispatcherResourceManagreComponentRpcServiceFactory,
metricQueryServiceRetriever);
+
setupDispatcherResourceManagerComponents(configuration,
dispatcherResourceManagerComponentRpcServiceFactory,
metricQueryServiceRetriever);
resourceManagerLeaderRetriever =
haServices.getResourceManagerLeaderRetriever();
dispatcherLeaderRetriever =
haServices.getDispatcherLeaderRetriever();
[flink] branch master updated (d30e523 -> 16ed892)
This is an automated email from the ASF dual-hosted git repository. dianfu pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git. from d30e523 [FLINK-19232][python] Support iterating MapState and MapView add 16ed892 [FLINK-19654][python][e2e] Set the parallelism of PyFlink e2e tests to 2 to reduce the execution time No new revisions were added by this update. Summary of changes: flink-end-to-end-tests/test-scripts/test_pyflink.sh | 7 +++ 1 file changed, 7 insertions(+)
[flink] branch master updated (d30e523 -> 16ed892)
This is an automated email from the ASF dual-hosted git repository. dianfu pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git. from d30e523 [FLINK-19232][python] Support iterating MapState and MapView add 16ed892 [FLINK-19654][python][e2e] Set the parallelism of PyFlink e2e tests to 2 to reduce the execution time No new revisions were added by this update. Summary of changes: flink-end-to-end-tests/test-scripts/test_pyflink.sh | 7 +++ 1 file changed, 7 insertions(+)
[flink] branch master updated (2e60d04 -> d30e523)
This is an automated email from the ASF dual-hosted git repository. dianfu pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git. from 2e60d04 [FLINK-19765][table] Reorder condition blocks in SqlToOperationConverter#convert add d30e523 [FLINK-19232][python] Support iterating MapState and MapView No new revisions were added by this update. Summary of changes: docs/_includes/generated/python_configuration.html | 12 +- flink-python/pyflink/fn_execution/aggregate.py | 7 +- flink-python/pyflink/fn_execution/state_impl.py| 323 - flink-python/pyflink/table/tests/test_aggregate.py | 127 +++- .../org/apache/flink/python/PythonOptions.java | 18 +- .../python/beam/BeamPythonFunctionRunner.java | 221 -- .../streaming/api/utils/ByteArrayWrapper.java | 5 + .../PythonStreamGroupAggregateOperator.java| 3 + 8 files changed, 667 insertions(+), 49 deletions(-)
[flink] branch master updated (2e60d04 -> d30e523)
This is an automated email from the ASF dual-hosted git repository. dianfu pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git. from 2e60d04 [FLINK-19765][table] Reorder condition blocks in SqlToOperationConverter#convert add d30e523 [FLINK-19232][python] Support iterating MapState and MapView No new revisions were added by this update. Summary of changes: docs/_includes/generated/python_configuration.html | 12 +- flink-python/pyflink/fn_execution/aggregate.py | 7 +- flink-python/pyflink/fn_execution/state_impl.py| 323 - flink-python/pyflink/table/tests/test_aggregate.py | 127 +++- .../org/apache/flink/python/PythonOptions.java | 18 +- .../python/beam/BeamPythonFunctionRunner.java | 221 -- .../streaming/api/utils/ByteArrayWrapper.java | 5 + .../PythonStreamGroupAggregateOperator.java| 3 + 8 files changed, 667 insertions(+), 49 deletions(-)
[flink] branch master updated (2e60d04 -> d30e523)
This is an automated email from the ASF dual-hosted git repository. dianfu pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git. from 2e60d04 [FLINK-19765][table] Reorder condition blocks in SqlToOperationConverter#convert add d30e523 [FLINK-19232][python] Support iterating MapState and MapView No new revisions were added by this update. Summary of changes: docs/_includes/generated/python_configuration.html | 12 +- flink-python/pyflink/fn_execution/aggregate.py | 7 +- flink-python/pyflink/fn_execution/state_impl.py| 323 - flink-python/pyflink/table/tests/test_aggregate.py | 127 +++- .../org/apache/flink/python/PythonOptions.java | 18 +- .../python/beam/BeamPythonFunctionRunner.java | 221 -- .../streaming/api/utils/ByteArrayWrapper.java | 5 + .../PythonStreamGroupAggregateOperator.java| 3 + 8 files changed, 667 insertions(+), 49 deletions(-)
[flink] branch master updated (2e60d04 -> d30e523)
This is an automated email from the ASF dual-hosted git repository. dianfu pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git. from 2e60d04 [FLINK-19765][table] Reorder condition blocks in SqlToOperationConverter#convert add d30e523 [FLINK-19232][python] Support iterating MapState and MapView No new revisions were added by this update. Summary of changes: docs/_includes/generated/python_configuration.html | 12 +- flink-python/pyflink/fn_execution/aggregate.py | 7 +- flink-python/pyflink/fn_execution/state_impl.py| 323 - flink-python/pyflink/table/tests/test_aggregate.py | 127 +++- .../org/apache/flink/python/PythonOptions.java | 18 +- .../python/beam/BeamPythonFunctionRunner.java | 221 -- .../streaming/api/utils/ByteArrayWrapper.java | 5 + .../PythonStreamGroupAggregateOperator.java| 3 + 8 files changed, 667 insertions(+), 49 deletions(-)
[flink] branch master updated (8e6b04a -> 2e60d04)
This is an automated email from the ASF dual-hosted git repository. jark pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git. from 8e6b04a [FLINK-19553][web] Make timestamp of checkpoints shown with date format add 2e60d04 [FLINK-19765][table] Reorder condition blocks in SqlToOperationConverter#convert No new revisions were added by this update. Summary of changes: .../apache/flink/sql/parser/ddl/SqlUseCatalog.java | 8 ++- .../operations/SqlToOperationConverter.java| 62 +++--- .../table/sqlexec/SqlToOperationConverter.java | 58 ++-- 3 files changed, 66 insertions(+), 62 deletions(-)
[flink] branch master updated (2e60d04 -> d30e523)
This is an automated email from the ASF dual-hosted git repository. dianfu pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git. from 2e60d04 [FLINK-19765][table] Reorder condition blocks in SqlToOperationConverter#convert add d30e523 [FLINK-19232][python] Support iterating MapState and MapView No new revisions were added by this update. Summary of changes: docs/_includes/generated/python_configuration.html | 12 +- flink-python/pyflink/fn_execution/aggregate.py | 7 +- flink-python/pyflink/fn_execution/state_impl.py| 323 - flink-python/pyflink/table/tests/test_aggregate.py | 127 +++- .../org/apache/flink/python/PythonOptions.java | 18 +- .../python/beam/BeamPythonFunctionRunner.java | 221 -- .../streaming/api/utils/ByteArrayWrapper.java | 5 + .../PythonStreamGroupAggregateOperator.java| 3 + 8 files changed, 667 insertions(+), 49 deletions(-)
[flink] branch master updated (8e6b04a -> 2e60d04)
This is an automated email from the ASF dual-hosted git repository. jark pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git. from 8e6b04a [FLINK-19553][web] Make timestamp of checkpoints shown with date format add 2e60d04 [FLINK-19765][table] Reorder condition blocks in SqlToOperationConverter#convert No new revisions were added by this update. Summary of changes: .../apache/flink/sql/parser/ddl/SqlUseCatalog.java | 8 ++- .../operations/SqlToOperationConverter.java| 62 +++--- .../table/sqlexec/SqlToOperationConverter.java | 58 ++-- 3 files changed, 66 insertions(+), 62 deletions(-)
[flink] branch master updated (8e6b04a -> 2e60d04)
This is an automated email from the ASF dual-hosted git repository. jark pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git. from 8e6b04a [FLINK-19553][web] Make timestamp of checkpoints shown with date format add 2e60d04 [FLINK-19765][table] Reorder condition blocks in SqlToOperationConverter#convert No new revisions were added by this update. Summary of changes: .../apache/flink/sql/parser/ddl/SqlUseCatalog.java | 8 ++- .../operations/SqlToOperationConverter.java| 62 +++--- .../table/sqlexec/SqlToOperationConverter.java | 58 ++-- 3 files changed, 66 insertions(+), 62 deletions(-)
[flink] branch master updated (1bdac23 -> 8e6b04a)
This is an automated email from the ASF dual-hosted git repository. tangyun pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git. from 1bdac23 [FLINK-19777][table-runtime-blink] Fix NullPointException for WindowOperator.close() add 8e6b04a [FLINK-19553][web] Make timestamp of checkpoints shown with date format No new revisions were added by this update. Summary of changes: .../checkpoints/detail/job-checkpoints-detail.component.html | 2 +- .../app/pages/job/checkpoints/job-checkpoints.component.html | 12 ++-- .../subtask/job-checkpoints-subtask.component.html | 2 +- 3 files changed, 8 insertions(+), 8 deletions(-)
[flink] branch master updated (1bdac23 -> 8e6b04a)
This is an automated email from the ASF dual-hosted git repository. tangyun pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git. from 1bdac23 [FLINK-19777][table-runtime-blink] Fix NullPointException for WindowOperator.close() add 8e6b04a [FLINK-19553][web] Make timestamp of checkpoints shown with date format No new revisions were added by this update. Summary of changes: .../checkpoints/detail/job-checkpoints-detail.component.html | 2 +- .../app/pages/job/checkpoints/job-checkpoints.component.html | 12 ++-- .../subtask/job-checkpoints-subtask.component.html | 2 +- 3 files changed, 8 insertions(+), 8 deletions(-)
[flink] branch master updated (8e6b04a -> 2e60d04)
This is an automated email from the ASF dual-hosted git repository. jark pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git. from 8e6b04a [FLINK-19553][web] Make timestamp of checkpoints shown with date format add 2e60d04 [FLINK-19765][table] Reorder condition blocks in SqlToOperationConverter#convert No new revisions were added by this update. Summary of changes: .../apache/flink/sql/parser/ddl/SqlUseCatalog.java | 8 ++- .../operations/SqlToOperationConverter.java| 62 +++--- .../table/sqlexec/SqlToOperationConverter.java | 58 ++-- 3 files changed, 66 insertions(+), 62 deletions(-)
[flink] branch master updated (1bdac23 -> 8e6b04a)
This is an automated email from the ASF dual-hosted git repository. tangyun pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git. from 1bdac23 [FLINK-19777][table-runtime-blink] Fix NullPointException for WindowOperator.close() add 8e6b04a [FLINK-19553][web] Make timestamp of checkpoints shown with date format No new revisions were added by this update. Summary of changes: .../checkpoints/detail/job-checkpoints-detail.component.html | 2 +- .../app/pages/job/checkpoints/job-checkpoints.component.html | 12 ++-- .../subtask/job-checkpoints-subtask.component.html | 2 +- 3 files changed, 8 insertions(+), 8 deletions(-)
[flink] branch master updated (8e6b04a -> 2e60d04)
This is an automated email from the ASF dual-hosted git repository. jark pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git. from 8e6b04a [FLINK-19553][web] Make timestamp of checkpoints shown with date format add 2e60d04 [FLINK-19765][table] Reorder condition blocks in SqlToOperationConverter#convert No new revisions were added by this update. Summary of changes: .../apache/flink/sql/parser/ddl/SqlUseCatalog.java | 8 ++- .../operations/SqlToOperationConverter.java| 62 +++--- .../table/sqlexec/SqlToOperationConverter.java | 58 ++-- 3 files changed, 66 insertions(+), 62 deletions(-)
[flink-web] branch asf-site updated: Update status for Yu to PMC in community web page
This is an automated email from the ASF dual-hosted git repository. liyu pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/flink-web.git The following commit(s) were added to refs/heads/asf-site by this push: new 0f16e95 Update status for Yu to PMC in community web page 0f16e95 is described below commit 0f16e95069373a04d8f3b62bf28fe5267467e03b Author: Yu Li AuthorDate: Tue Oct 27 11:20:43 2020 +0800 Update status for Yu to PMC in community web page --- community.md | 2 +- community.zh.md | 2 +- content/community.html| 2 +- content/zh/community.html | 2 +- 4 files changed, 4 insertions(+), 4 deletions(-) diff --git a/community.md b/community.md index ab6a439..230f480 100644 --- a/community.md +++ b/community.md @@ -510,7 +510,7 @@ Flink Forward is a conference happening yearly in different locations around the https://avatars0.githubusercontent.com/u/6239804?s=50; class="committer-avatar"> Yu Li -Committer +PMC, Committer liyu diff --git a/community.zh.md b/community.zh.md index fd903d7..c3be762 100644 --- a/community.zh.md +++ b/community.zh.md @@ -499,7 +499,7 @@ Flink Forward 大会每年都会在世界的不同地方举办。关于大会最 https://avatars0.githubusercontent.com/u/6239804?s=50; class="committer-avatar"> Yu Li -Committer +PMC, Committer liyu diff --git a/content/community.html b/content/community.html index 6bd7d8e..659f2fd 100644 --- a/content/community.html +++ b/content/community.html @@ -736,7 +736,7 @@ https://avatars0.githubusercontent.com/u/6239804?s=50; class="committer-avatar" /> Yu Li -Committer +PMC, Committer liyu diff --git a/content/zh/community.html b/content/zh/community.html index d8327eb..6c67b1d 100644 --- a/content/zh/community.html +++ b/content/zh/community.html @@ -727,7 +727,7 @@ https://avatars0.githubusercontent.com/u/6239804?s=50; class="committer-avatar" /> Yu Li -Committer +PMC, Committer liyu
[flink] branch master updated (54cd73d -> 1bdac23)
This is an automated email from the ASF dual-hosted git repository. jark pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git. from 54cd73d [FLINK-19780][table-planner-blink] Introduce FlinkRelMdUtil#numDistinctVals to work around precision problem in Calcite's implementation (#13764) add 1bdac23 [FLINK-19777][table-runtime-blink] Fix NullPointException for WindowOperator.close() No new revisions were added by this update. Summary of changes: .../runtime/operators/window/WindowOperator.java| 8 ++-- .../operators/window/WindowOperatorTest.java| 21 + 2 files changed, 27 insertions(+), 2 deletions(-)
[flink] branch master updated (54cd73d -> 1bdac23)
This is an automated email from the ASF dual-hosted git repository. jark pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git. from 54cd73d [FLINK-19780][table-planner-blink] Introduce FlinkRelMdUtil#numDistinctVals to work around precision problem in Calcite's implementation (#13764) add 1bdac23 [FLINK-19777][table-runtime-blink] Fix NullPointException for WindowOperator.close() No new revisions were added by this update. Summary of changes: .../runtime/operators/window/WindowOperator.java| 8 ++-- .../operators/window/WindowOperatorTest.java| 21 + 2 files changed, 27 insertions(+), 2 deletions(-)
[flink] branch master updated (54cd73d -> 1bdac23)
This is an automated email from the ASF dual-hosted git repository. jark pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git. from 54cd73d [FLINK-19780][table-planner-blink] Introduce FlinkRelMdUtil#numDistinctVals to work around precision problem in Calcite's implementation (#13764) add 1bdac23 [FLINK-19777][table-runtime-blink] Fix NullPointException for WindowOperator.close() No new revisions were added by this update. Summary of changes: .../runtime/operators/window/WindowOperator.java| 8 ++-- .../operators/window/WindowOperatorTest.java| 21 + 2 files changed, 27 insertions(+), 2 deletions(-)
[flink] branch master updated (6913508 -> 54cd73d)
This is an automated email from the ASF dual-hosted git repository.
godfrey pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/flink.git.
from 6913508 [FLINK-19755][cep][docs] Fix CEP documentation error of the
example in 'After Match Strategy' section
add 54cd73d [FLINK-19780][table-planner-blink] Introduce
FlinkRelMdUtil#numDistinctVals to work around precision problem in Calcite's
implementation (#13764)
No new revisions were added by this update.
Summary of changes:
.../plan/metadata/FlinkRelMdDistinctRowCount.scala | 4 +-
.../plan/metadata/FlinkRelMdPopulationSize.scala | 4 +-
.../table/planner/plan/utils/FlinkRelMdUtil.scala | 32 ++--
.../metadata/FlinkRelMdDistinctRowCountTest.scala | 19 +-
.../metadata/FlinkRelMdPopulationSizeTest.scala| 16
.../{pojos.scala => FlinkRelMdUtilTest.scala} | 44 +-
6 files changed, 83 insertions(+), 36 deletions(-)
copy
flink-table/flink-table-planner-blink/src/test/scala/org/apache/flink/table/planner/plan/utils/{pojos.scala
=> FlinkRelMdUtilTest.scala} (56%)
[flink] branch master updated (6913508 -> 54cd73d)
This is an automated email from the ASF dual-hosted git repository.
godfrey pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/flink.git.
from 6913508 [FLINK-19755][cep][docs] Fix CEP documentation error of the
example in 'After Match Strategy' section
add 54cd73d [FLINK-19780][table-planner-blink] Introduce
FlinkRelMdUtil#numDistinctVals to work around precision problem in Calcite's
implementation (#13764)
No new revisions were added by this update.
Summary of changes:
.../plan/metadata/FlinkRelMdDistinctRowCount.scala | 4 +-
.../plan/metadata/FlinkRelMdPopulationSize.scala | 4 +-
.../table/planner/plan/utils/FlinkRelMdUtil.scala | 32 ++--
.../metadata/FlinkRelMdDistinctRowCountTest.scala | 19 +-
.../metadata/FlinkRelMdPopulationSizeTest.scala| 16
.../{pojos.scala => FlinkRelMdUtilTest.scala} | 44 +-
6 files changed, 83 insertions(+), 36 deletions(-)
copy
flink-table/flink-table-planner-blink/src/test/scala/org/apache/flink/table/planner/plan/utils/{pojos.scala
=> FlinkRelMdUtilTest.scala} (56%)
[flink] branch release-1.11 updated (61a9f25 -> 6e67b50)
This is an automated email from the ASF dual-hosted git repository. dianfu pushed a change to branch release-1.11 in repository https://gitbox.apache.org/repos/asf/flink.git. from 61a9f25 [hotfix] minor refactoring in ApplicationDispatcherBootstrap add 6e67b50 [FLINK-19755][cep][docs] Fix CEP documentation error of the example in 'After Match Strategy' section No new revisions were added by this update. Summary of changes: docs/dev/table/streaming/match_recognize.md| 32 -- docs/dev/table/streaming/match_recognize.zh.md | 32 -- 2 files changed, 30 insertions(+), 34 deletions(-)
[flink] branch master updated (6913508 -> 54cd73d)
This is an automated email from the ASF dual-hosted git repository.
godfrey pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/flink.git.
from 6913508 [FLINK-19755][cep][docs] Fix CEP documentation error of the
example in 'After Match Strategy' section
add 54cd73d [FLINK-19780][table-planner-blink] Introduce
FlinkRelMdUtil#numDistinctVals to work around precision problem in Calcite's
implementation (#13764)
No new revisions were added by this update.
Summary of changes:
.../plan/metadata/FlinkRelMdDistinctRowCount.scala | 4 +-
.../plan/metadata/FlinkRelMdPopulationSize.scala | 4 +-
.../table/planner/plan/utils/FlinkRelMdUtil.scala | 32 ++--
.../metadata/FlinkRelMdDistinctRowCountTest.scala | 19 +-
.../metadata/FlinkRelMdPopulationSizeTest.scala| 16
.../{pojos.scala => FlinkRelMdUtilTest.scala} | 44 +-
6 files changed, 83 insertions(+), 36 deletions(-)
copy
flink-table/flink-table-planner-blink/src/test/scala/org/apache/flink/table/planner/plan/utils/{pojos.scala
=> FlinkRelMdUtilTest.scala} (56%)
[flink] branch release-1.11 updated (61a9f25 -> 6e67b50)
This is an automated email from the ASF dual-hosted git repository. dianfu pushed a change to branch release-1.11 in repository https://gitbox.apache.org/repos/asf/flink.git. from 61a9f25 [hotfix] minor refactoring in ApplicationDispatcherBootstrap add 6e67b50 [FLINK-19755][cep][docs] Fix CEP documentation error of the example in 'After Match Strategy' section No new revisions were added by this update. Summary of changes: docs/dev/table/streaming/match_recognize.md| 32 -- docs/dev/table/streaming/match_recognize.zh.md | 32 -- 2 files changed, 30 insertions(+), 34 deletions(-)
[flink] branch master updated (6913508 -> 54cd73d)
This is an automated email from the ASF dual-hosted git repository.
godfrey pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/flink.git.
from 6913508 [FLINK-19755][cep][docs] Fix CEP documentation error of the
example in 'After Match Strategy' section
add 54cd73d [FLINK-19780][table-planner-blink] Introduce
FlinkRelMdUtil#numDistinctVals to work around precision problem in Calcite's
implementation (#13764)
No new revisions were added by this update.
Summary of changes:
.../plan/metadata/FlinkRelMdDistinctRowCount.scala | 4 +-
.../plan/metadata/FlinkRelMdPopulationSize.scala | 4 +-
.../table/planner/plan/utils/FlinkRelMdUtil.scala | 32 ++--
.../metadata/FlinkRelMdDistinctRowCountTest.scala | 19 +-
.../metadata/FlinkRelMdPopulationSizeTest.scala| 16
.../{pojos.scala => FlinkRelMdUtilTest.scala} | 44 +-
6 files changed, 83 insertions(+), 36 deletions(-)
copy
flink-table/flink-table-planner-blink/src/test/scala/org/apache/flink/table/planner/plan/utils/{pojos.scala
=> FlinkRelMdUtilTest.scala} (56%)
[flink] branch release-1.11 updated (61a9f25 -> 6e67b50)
This is an automated email from the ASF dual-hosted git repository. dianfu pushed a change to branch release-1.11 in repository https://gitbox.apache.org/repos/asf/flink.git. from 61a9f25 [hotfix] minor refactoring in ApplicationDispatcherBootstrap add 6e67b50 [FLINK-19755][cep][docs] Fix CEP documentation error of the example in 'After Match Strategy' section No new revisions were added by this update. Summary of changes: docs/dev/table/streaming/match_recognize.md| 32 -- docs/dev/table/streaming/match_recognize.zh.md | 32 -- 2 files changed, 30 insertions(+), 34 deletions(-)
[flink] branch release-1.11 updated: [FLINK-19755][cep][docs] Fix CEP documentation error of the example in 'After Match Strategy' section
This is an automated email from the ASF dual-hosted git repository.
dianfu pushed a commit to branch release-1.11
in repository https://gitbox.apache.org/repos/asf/flink.git
The following commit(s) were added to refs/heads/release-1.11 by this push:
new 6e67b50 [FLINK-19755][cep][docs] Fix CEP documentation error of the
example in 'After Match Strategy' section
6e67b50 is described below
commit 6e67b50eaba6b4c23181566bc2fb96130464f876
Author: liuyongvs
AuthorDate: Fri Oct 23 10:33:18 2020 +0800
[FLINK-19755][cep][docs] Fix CEP documentation error of the example in
'After Match Strategy' section
This closes #13754.
---
docs/dev/table/streaming/match_recognize.md| 32 --
docs/dev/table/streaming/match_recognize.zh.md | 32 --
2 files changed, 30 insertions(+), 34 deletions(-)
diff --git a/docs/dev/table/streaming/match_recognize.md
b/docs/dev/table/streaming/match_recognize.md
index 3f0be08..8c99572 100644
--- a/docs/dev/table/streaming/match_recognize.md
+++ b/docs/dev/table/streaming/match_recognize.md
@@ -921,8 +921,9 @@ For the following input rows:
XYZ 2 9 2018-09-17 10:00:02
XYZ 1 10 2018-09-17 10:00:03
XYZ 2 5 2018-09-17 10:00:04
- XYZ 2 17 2018-09-17 10:00:05
- XYZ 2 14 2018-09-17 10:00:06
+ XYZ 2 10 2018-09-17 10:00:05
+ XYZ 2 7 2018-09-17 10:00:06
+ XYZ 2 14 2018-09-17 10:00:07
{% endhighlight %}
We evaluate the following query with different strategies:
@@ -956,12 +957,12 @@ The query will produce different results based on which
`AFTER MATCH` strategy w
symbol sumPricestartTime endTime
== = =
XYZ 26 2018-09-17 10:00:01 2018-09-17 10:00:04
- XYZ 17 2018-09-17 10:00:05 2018-09-17 10:00:06
+ XYZ 17 2018-09-17 10:00:05 2018-09-17 10:00:07
{% endhighlight %}
The first result matched against the rows #1, #2, #3, #4.
-The second result matched against the rows #5, #6.
+The second result matched against the rows #5, #6, #7.
# `AFTER MATCH SKIP TO NEXT ROW`
@@ -970,9 +971,9 @@ The second result matched against the rows #5, #6.
== = =
XYZ 26 2018-09-17 10:00:01 2018-09-17 10:00:04
XYZ 24 2018-09-17 10:00:02 2018-09-17 10:00:05
- XYZ 15 2018-09-17 10:00:03 2018-09-17 10:00:05
- XYZ 22 2018-09-17 10:00:04 2018-09-17 10:00:06
- XYZ 17 2018-09-17 10:00:05 2018-09-17 10:00:06
+ XYZ 25 2018-09-17 10:00:03 2018-09-17 10:00:06
+ XYZ 22 2018-09-17 10:00:04 2018-09-17 10:00:07
+ XYZ 17 2018-09-17 10:00:05 2018-09-17 10:00:07
{% endhighlight %}
Again, the first result matched against the rows #1, #2, #3, #4.
@@ -980,11 +981,11 @@ Again, the first result matched against the rows #1, #2,
#3, #4.
Compared to the previous strategy, the next match includes row #2 again for
the next matching.
Therefore, the second result matched against the rows #2, #3, #4, #5.
-The third result matched against the rows #3, #4, #5.
+The third result matched against the rows #3, #4, #5, #6.
-The forth result matched against the rows #4, #5, #6.
+The forth result matched against the rows #4, #5, #6, #7.
-The last result matched against the rows #5, #6.
+The last result matched against the rows #5, #6, #7.
# `AFTER MATCH SKIP TO LAST A`
@@ -992,19 +993,16 @@ The last result matched against the rows #5, #6.
symbol sumPricestartTime endTime
== = =
XYZ 26 2018-09-17 10:00:01 2018-09-17 10:00:04
- XYZ 15 2018-09-17 10:00:03 2018-09-17 10:00:05
- XYZ 22 2018-09-17 10:00:04 2018-09-17 10:00:06
- XYZ 17 2018-09-17 10:00:05 2018-09-17 10:00:06
+ XYZ 25 2018-09-17 10:00:03 2018-09-17 10:00:06
+ XYZ 17 2018-09-17 10:00:05 2018-09-17 10:00:07
{% endhighlight %}
Again, the first result matched against the rows #1, #2, #3, #4.
Compared to the previous strategy, the next match includes only row #3 (mapped
to `A`) again for
-the next matching. Therefore, the second result matched against the rows #3,
#4, #5.
+the next matching. Therefore, the second result matched against the rows #3,
#4, #5, #6.
-The third result matched against the rows #4, #5, #6.
-
-The last result matched against the rows #5, #6.
+The last result matched against the rows #5, #6, #7.
# `AFTER MATCH SKIP TO FIRST A`
diff --git a/docs/dev/table/streaming/match_recognize.zh.md
b/docs/dev/table/streaming/match_recognize.zh.md
index c5e53c3..ab297a9 100644
--- a/docs/dev/table/streaming/match_recognize.zh.md
+++
[flink] branch release-1.11 updated: [FLINK-19755][cep][docs] Fix CEP documentation error of the example in 'After Match Strategy' section
This is an automated email from the ASF dual-hosted git repository.
dianfu pushed a commit to branch release-1.11
in repository https://gitbox.apache.org/repos/asf/flink.git
The following commit(s) were added to refs/heads/release-1.11 by this push:
new 6e67b50 [FLINK-19755][cep][docs] Fix CEP documentation error of the
example in 'After Match Strategy' section
6e67b50 is described below
commit 6e67b50eaba6b4c23181566bc2fb96130464f876
Author: liuyongvs
AuthorDate: Fri Oct 23 10:33:18 2020 +0800
[FLINK-19755][cep][docs] Fix CEP documentation error of the example in
'After Match Strategy' section
This closes #13754.
---
docs/dev/table/streaming/match_recognize.md| 32 --
docs/dev/table/streaming/match_recognize.zh.md | 32 --
2 files changed, 30 insertions(+), 34 deletions(-)
diff --git a/docs/dev/table/streaming/match_recognize.md
b/docs/dev/table/streaming/match_recognize.md
index 3f0be08..8c99572 100644
--- a/docs/dev/table/streaming/match_recognize.md
+++ b/docs/dev/table/streaming/match_recognize.md
@@ -921,8 +921,9 @@ For the following input rows:
XYZ 2 9 2018-09-17 10:00:02
XYZ 1 10 2018-09-17 10:00:03
XYZ 2 5 2018-09-17 10:00:04
- XYZ 2 17 2018-09-17 10:00:05
- XYZ 2 14 2018-09-17 10:00:06
+ XYZ 2 10 2018-09-17 10:00:05
+ XYZ 2 7 2018-09-17 10:00:06
+ XYZ 2 14 2018-09-17 10:00:07
{% endhighlight %}
We evaluate the following query with different strategies:
@@ -956,12 +957,12 @@ The query will produce different results based on which
`AFTER MATCH` strategy w
symbol sumPricestartTime endTime
== = =
XYZ 26 2018-09-17 10:00:01 2018-09-17 10:00:04
- XYZ 17 2018-09-17 10:00:05 2018-09-17 10:00:06
+ XYZ 17 2018-09-17 10:00:05 2018-09-17 10:00:07
{% endhighlight %}
The first result matched against the rows #1, #2, #3, #4.
-The second result matched against the rows #5, #6.
+The second result matched against the rows #5, #6, #7.
# `AFTER MATCH SKIP TO NEXT ROW`
@@ -970,9 +971,9 @@ The second result matched against the rows #5, #6.
== = =
XYZ 26 2018-09-17 10:00:01 2018-09-17 10:00:04
XYZ 24 2018-09-17 10:00:02 2018-09-17 10:00:05
- XYZ 15 2018-09-17 10:00:03 2018-09-17 10:00:05
- XYZ 22 2018-09-17 10:00:04 2018-09-17 10:00:06
- XYZ 17 2018-09-17 10:00:05 2018-09-17 10:00:06
+ XYZ 25 2018-09-17 10:00:03 2018-09-17 10:00:06
+ XYZ 22 2018-09-17 10:00:04 2018-09-17 10:00:07
+ XYZ 17 2018-09-17 10:00:05 2018-09-17 10:00:07
{% endhighlight %}
Again, the first result matched against the rows #1, #2, #3, #4.
@@ -980,11 +981,11 @@ Again, the first result matched against the rows #1, #2,
#3, #4.
Compared to the previous strategy, the next match includes row #2 again for
the next matching.
Therefore, the second result matched against the rows #2, #3, #4, #5.
-The third result matched against the rows #3, #4, #5.
+The third result matched against the rows #3, #4, #5, #6.
-The forth result matched against the rows #4, #5, #6.
+The forth result matched against the rows #4, #5, #6, #7.
-The last result matched against the rows #5, #6.
+The last result matched against the rows #5, #6, #7.
# `AFTER MATCH SKIP TO LAST A`
@@ -992,19 +993,16 @@ The last result matched against the rows #5, #6.
symbol sumPricestartTime endTime
== = =
XYZ 26 2018-09-17 10:00:01 2018-09-17 10:00:04
- XYZ 15 2018-09-17 10:00:03 2018-09-17 10:00:05
- XYZ 22 2018-09-17 10:00:04 2018-09-17 10:00:06
- XYZ 17 2018-09-17 10:00:05 2018-09-17 10:00:06
+ XYZ 25 2018-09-17 10:00:03 2018-09-17 10:00:06
+ XYZ 17 2018-09-17 10:00:05 2018-09-17 10:00:07
{% endhighlight %}
Again, the first result matched against the rows #1, #2, #3, #4.
Compared to the previous strategy, the next match includes only row #3 (mapped
to `A`) again for
-the next matching. Therefore, the second result matched against the rows #3,
#4, #5.
+the next matching. Therefore, the second result matched against the rows #3,
#4, #5, #6.
-The third result matched against the rows #4, #5, #6.
-
-The last result matched against the rows #5, #6.
+The last result matched against the rows #5, #6, #7.
# `AFTER MATCH SKIP TO FIRST A`
diff --git a/docs/dev/table/streaming/match_recognize.zh.md
b/docs/dev/table/streaming/match_recognize.zh.md
index c5e53c3..ab297a9 100644
--- a/docs/dev/table/streaming/match_recognize.zh.md
+++
[flink] branch master updated (f0f6e50 -> 6913508)
This is an automated email from the ASF dual-hosted git repository. dianfu pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git. from f0f6e50 [FLINK-16595][YARN] Support multiple HDFS NameNodes with Kerberos add 6913508 [FLINK-19755][cep][docs] Fix CEP documentation error of the example in 'After Match Strategy' section No new revisions were added by this update. Summary of changes: docs/dev/table/streaming/match_recognize.md| 32 -- docs/dev/table/streaming/match_recognize.zh.md | 32 -- 2 files changed, 30 insertions(+), 34 deletions(-)
[flink] branch master updated (f0f6e50 -> 6913508)
This is an automated email from the ASF dual-hosted git repository. dianfu pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git. from f0f6e50 [FLINK-16595][YARN] Support multiple HDFS NameNodes with Kerberos add 6913508 [FLINK-19755][cep][docs] Fix CEP documentation error of the example in 'After Match Strategy' section No new revisions were added by this update. Summary of changes: docs/dev/table/streaming/match_recognize.md| 32 -- docs/dev/table/streaming/match_recognize.zh.md | 32 -- 2 files changed, 30 insertions(+), 34 deletions(-)
[flink] branch master updated (5a159d8 -> f0f6e50)
This is an automated email from the ASF dual-hosted git repository. rmetzger pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git. from 5a159d8 [FLINK-19782][python] Remove antlr traces in flink-python add f0f6e50 [FLINK-16595][YARN] Support multiple HDFS NameNodes with Kerberos No new revisions were added by this update. Summary of changes: docs/_includes/generated/yarn_config_configuration.html| 6 ++ .../src/main/java/org/apache/flink/yarn/YarnClusterDescriptor.java | 6 +- .../org/apache/flink/yarn/configuration/YarnConfigOptions.java | 7 +++ 3 files changed, 18 insertions(+), 1 deletion(-)
[flink] branch master updated (5a159d8 -> f0f6e50)
This is an automated email from the ASF dual-hosted git repository. rmetzger pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git. from 5a159d8 [FLINK-19782][python] Remove antlr traces in flink-python add f0f6e50 [FLINK-16595][YARN] Support multiple HDFS NameNodes with Kerberos No new revisions were added by this update. Summary of changes: docs/_includes/generated/yarn_config_configuration.html| 6 ++ .../src/main/java/org/apache/flink/yarn/YarnClusterDescriptor.java | 6 +- .../org/apache/flink/yarn/configuration/YarnConfigOptions.java | 7 +++ 3 files changed, 18 insertions(+), 1 deletion(-)
[flink] branch master updated (5a159d8 -> f0f6e50)
This is an automated email from the ASF dual-hosted git repository. rmetzger pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git. from 5a159d8 [FLINK-19782][python] Remove antlr traces in flink-python add f0f6e50 [FLINK-16595][YARN] Support multiple HDFS NameNodes with Kerberos No new revisions were added by this update. Summary of changes: docs/_includes/generated/yarn_config_configuration.html| 6 ++ .../src/main/java/org/apache/flink/yarn/YarnClusterDescriptor.java | 6 +- .../org/apache/flink/yarn/configuration/YarnConfigOptions.java | 7 +++ 3 files changed, 18 insertions(+), 1 deletion(-)
[flink] branch master updated (2771273 -> 5a159d8)
This is an automated email from the ASF dual-hosted git repository. rmetzger pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git. from 2771273 [FLINK-19785] Upgrade to commons-io 2.7 add 5a159d8 [FLINK-19782][python] Remove antlr traces in flink-python No new revisions were added by this update. Summary of changes: flink-python/pom.xml | 1 + 1 file changed, 1 insertion(+)
[flink] branch master updated (2771273 -> 5a159d8)
This is an automated email from the ASF dual-hosted git repository. rmetzger pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git. from 2771273 [FLINK-19785] Upgrade to commons-io 2.7 add 5a159d8 [FLINK-19782][python] Remove antlr traces in flink-python No new revisions were added by this update. Summary of changes: flink-python/pom.xml | 1 + 1 file changed, 1 insertion(+)
[flink] branch master updated (2771273 -> 5a159d8)
This is an automated email from the ASF dual-hosted git repository. rmetzger pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git. from 2771273 [FLINK-19785] Upgrade to commons-io 2.7 add 5a159d8 [FLINK-19782][python] Remove antlr traces in flink-python No new revisions were added by this update. Summary of changes: flink-python/pom.xml | 1 + 1 file changed, 1 insertion(+)
[flink] branch master updated (4e5da0b -> 2771273)
This is an automated email from the ASF dual-hosted git repository. rmetzger pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git. from 4e5da0b [FLINK-19278] Bump Scala Macros to 2.1.1 add 2771273 [FLINK-19785] Upgrade to commons-io 2.7 No new revisions were added by this update. Summary of changes: flink-dist/src/main/resources/META-INF/NOTICE | 2 +- .../flink-fs-hadoop-shaded/src/main/resources/META-INF/NOTICE | 2 +- flink-filesystems/flink-s3-fs-hadoop/src/main/resources/META-INF/NOTICE | 2 +- flink-filesystems/flink-s3-fs-presto/src/main/resources/META-INF/NOTICE | 2 +- .../flink-swift-fs-hadoop/src/main/resources/META-INF/NOTICE| 2 +- .../flink-table-planner-blink/src/main/resources/META-INF/NOTICE| 2 +- pom.xml | 2 +- 7 files changed, 7 insertions(+), 7 deletions(-)
[flink] branch master updated (aef0648 -> 4e5da0b)
This is an automated email from the ASF dual-hosted git repository. rmetzger pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git. from aef0648 [FLINK-19783] Upgrade Mesos version to 1.7 (#13783) add 4e5da0b [FLINK-19278] Bump Scala Macros to 2.1.1 No new revisions were added by this update. Summary of changes: pom.xml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
[flink] branch master updated (fb0532f -> aef0648)
This is an automated email from the ASF dual-hosted git repository. rmetzger pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git. from fb0532f [minor] Add Javadocs to CEP PatternStream add aef0648 [FLINK-19783] Upgrade Mesos version to 1.7 (#13783) No new revisions were added by this update. Summary of changes: flink-mesos/pom.xml| 2 +- flink-mesos/src/main/resources/META-INF/NOTICE | 4 ++-- 2 files changed, 3 insertions(+), 3 deletions(-)
[flink] branch master updated (fb0532f -> aef0648)
This is an automated email from the ASF dual-hosted git repository. rmetzger pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git. from fb0532f [minor] Add Javadocs to CEP PatternStream add aef0648 [FLINK-19783] Upgrade Mesos version to 1.7 (#13783) No new revisions were added by this update. Summary of changes: flink-mesos/pom.xml| 2 +- flink-mesos/src/main/resources/META-INF/NOTICE | 4 ++-- 2 files changed, 3 insertions(+), 3 deletions(-)
[flink] branch master updated (f02b951 -> fb0532f)
This is an automated email from the ASF dual-hosted git repository. aljoscha pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git. from f02b951 [hotfix] minor refactoring in ApplicationDispatcherBootstrap add 56f9161 [hotfix] Remove unused imports add 1fe0214 [FLINK-19326][cep] Allow explicitly configuring time behaviour on CEP PatternStream add fb0532f [minor] Add Javadocs to CEP PatternStream No new revisions were added by this update. Summary of changes: .../org/apache/flink/cep/scala/PatternStream.scala | 10 +++ .../java/org/apache/flink/cep/PatternStream.java | 22 ++ .../org/apache/flink/cep/PatternStreamBuilder.java | 35 ++ .../org/apache/flink/cep/time/TimeContext.java | 2 +- .../test/java/org/apache/flink/cep/CEPITCase.java | 28 ++--- .../plan/nodes/datastream/DataStreamMatch.scala| 23 ++ .../table/validation/TableSinkValidationTest.scala | 1 - .../api/validation/TableSourceValidationTest.scala | 1 - .../table/runtime/harness/MatchHarnessTest.scala | 3 -- .../harness/SortProcessFunctionHarnessTest.scala | 2 -- .../runtime/stream/TimeAttributesITCase.scala | 1 - .../runtime/stream/sql/InsertIntoITCase.scala | 1 - .../runtime/stream/sql/MatchRecognizeITCase.scala | 9 -- .../runtime/stream/sql/OverWindowITCase.scala | 1 - .../table/runtime/stream/sql/SortITCase.scala | 1 - .../flink/table/runtime/stream/sql/SqlITCase.scala | 1 - .../runtime/stream/table/GroupWindowITCase.scala | 1 - .../table/GroupWindowTableAggregateITCase.scala| 1 - .../runtime/stream/table/OverWindowITCase.scala| 1 - .../runtime/stream/table/TableSinkITCase.scala | 1 - .../runtime/stream/table/TableSourceITCase.scala | 1 - 21 files changed, 89 insertions(+), 57 deletions(-)
[flink] branch master updated (f02b951 -> fb0532f)
This is an automated email from the ASF dual-hosted git repository. aljoscha pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git. from f02b951 [hotfix] minor refactoring in ApplicationDispatcherBootstrap add 56f9161 [hotfix] Remove unused imports add 1fe0214 [FLINK-19326][cep] Allow explicitly configuring time behaviour on CEP PatternStream add fb0532f [minor] Add Javadocs to CEP PatternStream No new revisions were added by this update. Summary of changes: .../org/apache/flink/cep/scala/PatternStream.scala | 10 +++ .../java/org/apache/flink/cep/PatternStream.java | 22 ++ .../org/apache/flink/cep/PatternStreamBuilder.java | 35 ++ .../org/apache/flink/cep/time/TimeContext.java | 2 +- .../test/java/org/apache/flink/cep/CEPITCase.java | 28 ++--- .../plan/nodes/datastream/DataStreamMatch.scala| 23 ++ .../table/validation/TableSinkValidationTest.scala | 1 - .../api/validation/TableSourceValidationTest.scala | 1 - .../table/runtime/harness/MatchHarnessTest.scala | 3 -- .../harness/SortProcessFunctionHarnessTest.scala | 2 -- .../runtime/stream/TimeAttributesITCase.scala | 1 - .../runtime/stream/sql/InsertIntoITCase.scala | 1 - .../runtime/stream/sql/MatchRecognizeITCase.scala | 9 -- .../runtime/stream/sql/OverWindowITCase.scala | 1 - .../table/runtime/stream/sql/SortITCase.scala | 1 - .../flink/table/runtime/stream/sql/SqlITCase.scala | 1 - .../runtime/stream/table/GroupWindowITCase.scala | 1 - .../table/GroupWindowTableAggregateITCase.scala| 1 - .../runtime/stream/table/OverWindowITCase.scala| 1 - .../runtime/stream/table/TableSinkITCase.scala | 1 - .../runtime/stream/table/TableSourceITCase.scala | 1 - 21 files changed, 89 insertions(+), 57 deletions(-)
[flink] branch release-1.11 updated (78cd462 -> 61a9f25)
This is an automated email from the ASF dual-hosted git repository. kkloudas pushed a change to branch release-1.11 in repository https://gitbox.apache.org/repos/asf/flink.git. from 78cd462 [FLINK-19750][connector/kafka] Fix bug of not opening DeserializationSchema when FlinkKafkaConsumerBase recovers from state (#13785) add 3dd5762 [FLINK-19154] ApplicationDispatcherBootstrap cleans up HA data only on FAILED, CANCELLED, SUCCEEDED add 2ff910f [FLINK-19154] Pass DispatcherGateway to DispatcherBootstrap add 69db02b [hotfix] Merge ApplicationDispatcherBootstrap#initialize() with constructor. add 61a9f25 [hotfix] minor refactoring in ApplicationDispatcherBootstrap No new revisions were added by this update. Summary of changes: .../ApplicationDispatcherBootstrap.java| 151 +++- ...ApplicationDispatcherGatewayServiceFactory.java | 18 +- .../application/ApplicationFailureException.java | 82 + .../ApplicationDispatcherBootstrapTest.java| 198 ++--- .../dispatcher/AbstractDispatcherBootstrap.java| 46 - .../dispatcher/DefaultDispatcherBootstrap.java | 53 -- .../flink/runtime/dispatcher/Dispatcher.java | 28 ++- .../runtime/dispatcher/DispatcherBootstrap.java| 13 +- .../dispatcher/DispatcherBootstrapFactory.java | 18 +- .../runtime/dispatcher/DispatcherFactory.java | 12 +- .../runtime/dispatcher/JobDispatcherFactory.java | 13 +- .../flink/runtime/dispatcher/MiniDispatcher.java | 7 +- .../dispatcher/NoOpDispatcherBootstrap.java| 17 +- .../dispatcher/SessionDispatcherFactory.java | 9 +- .../runtime/dispatcher/StandaloneDispatcher.java | 8 +- .../DefaultDispatcherGatewayServiceFactory.java| 9 +- .../dispatcher/DispatcherResourceCleanupTest.java | 3 +- .../flink/runtime/dispatcher/DispatcherTest.java | 22 ++- .../runtime/dispatcher/MiniDispatcherTest.java | 4 +- .../runtime/dispatcher/TestingDispatcher.java | 8 +- .../runner/DefaultDispatcherRunnerITCase.java | 8 +- 21 files changed, 408 insertions(+), 319 deletions(-) create mode 100644 flink-clients/src/main/java/org/apache/flink/client/deployment/application/ApplicationFailureException.java delete mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/AbstractDispatcherBootstrap.java delete mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/DefaultDispatcherBootstrap.java copy flink-clients/src/main/java/org/apache/flink/client/program/ClusterClientProvider.java => flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/DispatcherBootstrapFactory.java (66%) copy flink-python/src/main/java/org/apache/flink/table/runtime/arrow/readers/DoubleFieldReader.java => flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/NoOpDispatcherBootstrap.java (69%)
[flink] branch release-1.11 updated (78cd462 -> 61a9f25)
This is an automated email from the ASF dual-hosted git repository. kkloudas pushed a change to branch release-1.11 in repository https://gitbox.apache.org/repos/asf/flink.git. from 78cd462 [FLINK-19750][connector/kafka] Fix bug of not opening DeserializationSchema when FlinkKafkaConsumerBase recovers from state (#13785) add 3dd5762 [FLINK-19154] ApplicationDispatcherBootstrap cleans up HA data only on FAILED, CANCELLED, SUCCEEDED add 2ff910f [FLINK-19154] Pass DispatcherGateway to DispatcherBootstrap add 69db02b [hotfix] Merge ApplicationDispatcherBootstrap#initialize() with constructor. add 61a9f25 [hotfix] minor refactoring in ApplicationDispatcherBootstrap No new revisions were added by this update. Summary of changes: .../ApplicationDispatcherBootstrap.java| 151 +++- ...ApplicationDispatcherGatewayServiceFactory.java | 18 +- .../application/ApplicationFailureException.java | 82 + .../ApplicationDispatcherBootstrapTest.java| 198 ++--- .../dispatcher/AbstractDispatcherBootstrap.java| 46 - .../dispatcher/DefaultDispatcherBootstrap.java | 53 -- .../flink/runtime/dispatcher/Dispatcher.java | 28 ++- .../runtime/dispatcher/DispatcherBootstrap.java| 13 +- .../dispatcher/DispatcherBootstrapFactory.java | 18 +- .../runtime/dispatcher/DispatcherFactory.java | 12 +- .../runtime/dispatcher/JobDispatcherFactory.java | 13 +- .../flink/runtime/dispatcher/MiniDispatcher.java | 7 +- .../dispatcher/NoOpDispatcherBootstrap.java| 17 +- .../dispatcher/SessionDispatcherFactory.java | 9 +- .../runtime/dispatcher/StandaloneDispatcher.java | 8 +- .../DefaultDispatcherGatewayServiceFactory.java| 9 +- .../dispatcher/DispatcherResourceCleanupTest.java | 3 +- .../flink/runtime/dispatcher/DispatcherTest.java | 22 ++- .../runtime/dispatcher/MiniDispatcherTest.java | 4 +- .../runtime/dispatcher/TestingDispatcher.java | 8 +- .../runner/DefaultDispatcherRunnerITCase.java | 8 +- 21 files changed, 408 insertions(+), 319 deletions(-) create mode 100644 flink-clients/src/main/java/org/apache/flink/client/deployment/application/ApplicationFailureException.java delete mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/AbstractDispatcherBootstrap.java delete mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/DefaultDispatcherBootstrap.java copy flink-clients/src/main/java/org/apache/flink/client/program/ClusterClientProvider.java => flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/DispatcherBootstrapFactory.java (66%) copy flink-python/src/main/java/org/apache/flink/table/runtime/arrow/readers/DoubleFieldReader.java => flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/NoOpDispatcherBootstrap.java (69%)
[flink] branch release-1.11 updated (78cd462 -> 61a9f25)
This is an automated email from the ASF dual-hosted git repository. kkloudas pushed a change to branch release-1.11 in repository https://gitbox.apache.org/repos/asf/flink.git. from 78cd462 [FLINK-19750][connector/kafka] Fix bug of not opening DeserializationSchema when FlinkKafkaConsumerBase recovers from state (#13785) add 3dd5762 [FLINK-19154] ApplicationDispatcherBootstrap cleans up HA data only on FAILED, CANCELLED, SUCCEEDED add 2ff910f [FLINK-19154] Pass DispatcherGateway to DispatcherBootstrap add 69db02b [hotfix] Merge ApplicationDispatcherBootstrap#initialize() with constructor. add 61a9f25 [hotfix] minor refactoring in ApplicationDispatcherBootstrap No new revisions were added by this update. Summary of changes: .../ApplicationDispatcherBootstrap.java| 151 +++- ...ApplicationDispatcherGatewayServiceFactory.java | 18 +- .../application/ApplicationFailureException.java | 82 + .../ApplicationDispatcherBootstrapTest.java| 198 ++--- .../dispatcher/AbstractDispatcherBootstrap.java| 46 - .../dispatcher/DefaultDispatcherBootstrap.java | 53 -- .../flink/runtime/dispatcher/Dispatcher.java | 28 ++- .../runtime/dispatcher/DispatcherBootstrap.java| 13 +- .../dispatcher/DispatcherBootstrapFactory.java | 18 +- .../runtime/dispatcher/DispatcherFactory.java | 12 +- .../runtime/dispatcher/JobDispatcherFactory.java | 13 +- .../flink/runtime/dispatcher/MiniDispatcher.java | 7 +- .../dispatcher/NoOpDispatcherBootstrap.java| 17 +- .../dispatcher/SessionDispatcherFactory.java | 9 +- .../runtime/dispatcher/StandaloneDispatcher.java | 8 +- .../DefaultDispatcherGatewayServiceFactory.java| 9 +- .../dispatcher/DispatcherResourceCleanupTest.java | 3 +- .../flink/runtime/dispatcher/DispatcherTest.java | 22 ++- .../runtime/dispatcher/MiniDispatcherTest.java | 4 +- .../runtime/dispatcher/TestingDispatcher.java | 8 +- .../runner/DefaultDispatcherRunnerITCase.java | 8 +- 21 files changed, 408 insertions(+), 319 deletions(-) create mode 100644 flink-clients/src/main/java/org/apache/flink/client/deployment/application/ApplicationFailureException.java delete mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/AbstractDispatcherBootstrap.java delete mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/DefaultDispatcherBootstrap.java copy flink-clients/src/main/java/org/apache/flink/client/program/ClusterClientProvider.java => flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/DispatcherBootstrapFactory.java (66%) copy flink-python/src/main/java/org/apache/flink/table/runtime/arrow/readers/DoubleFieldReader.java => flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/NoOpDispatcherBootstrap.java (69%)
[flink] branch release-1.11 updated (78cd462 -> 61a9f25)
This is an automated email from the ASF dual-hosted git repository. kkloudas pushed a change to branch release-1.11 in repository https://gitbox.apache.org/repos/asf/flink.git. from 78cd462 [FLINK-19750][connector/kafka] Fix bug of not opening DeserializationSchema when FlinkKafkaConsumerBase recovers from state (#13785) add 3dd5762 [FLINK-19154] ApplicationDispatcherBootstrap cleans up HA data only on FAILED, CANCELLED, SUCCEEDED add 2ff910f [FLINK-19154] Pass DispatcherGateway to DispatcherBootstrap add 69db02b [hotfix] Merge ApplicationDispatcherBootstrap#initialize() with constructor. add 61a9f25 [hotfix] minor refactoring in ApplicationDispatcherBootstrap No new revisions were added by this update. Summary of changes: .../ApplicationDispatcherBootstrap.java| 151 +++- ...ApplicationDispatcherGatewayServiceFactory.java | 18 +- .../application/ApplicationFailureException.java | 82 + .../ApplicationDispatcherBootstrapTest.java| 198 ++--- .../dispatcher/AbstractDispatcherBootstrap.java| 46 - .../dispatcher/DefaultDispatcherBootstrap.java | 53 -- .../flink/runtime/dispatcher/Dispatcher.java | 28 ++- .../runtime/dispatcher/DispatcherBootstrap.java| 13 +- .../dispatcher/DispatcherBootstrapFactory.java | 18 +- .../runtime/dispatcher/DispatcherFactory.java | 12 +- .../runtime/dispatcher/JobDispatcherFactory.java | 13 +- .../flink/runtime/dispatcher/MiniDispatcher.java | 7 +- .../dispatcher/NoOpDispatcherBootstrap.java| 17 +- .../dispatcher/SessionDispatcherFactory.java | 9 +- .../runtime/dispatcher/StandaloneDispatcher.java | 8 +- .../DefaultDispatcherGatewayServiceFactory.java| 9 +- .../dispatcher/DispatcherResourceCleanupTest.java | 3 +- .../flink/runtime/dispatcher/DispatcherTest.java | 22 ++- .../runtime/dispatcher/MiniDispatcherTest.java | 4 +- .../runtime/dispatcher/TestingDispatcher.java | 8 +- .../runner/DefaultDispatcherRunnerITCase.java | 8 +- 21 files changed, 408 insertions(+), 319 deletions(-) create mode 100644 flink-clients/src/main/java/org/apache/flink/client/deployment/application/ApplicationFailureException.java delete mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/AbstractDispatcherBootstrap.java delete mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/DefaultDispatcherBootstrap.java copy flink-clients/src/main/java/org/apache/flink/client/program/ClusterClientProvider.java => flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/DispatcherBootstrapFactory.java (66%) copy flink-python/src/main/java/org/apache/flink/table/runtime/arrow/readers/DoubleFieldReader.java => flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/NoOpDispatcherBootstrap.java (69%)
[flink] 01/04: [FLINK-19154] ApplicationDispatcherBootstrap cleans up HA data only on FAILED, CANCELLED, SUCCEEDED
This is an automated email from the ASF dual-hosted git repository.
kkloudas pushed a commit to branch release-1.11
in repository https://gitbox.apache.org/repos/asf/flink.git
commit 3dd57624b2df7a856352a64a89af8606ae0c61a4
Author: Kostas Kloudas
AuthorDate: Mon Oct 19 09:49:14 2020 +0200
[FLINK-19154] ApplicationDispatcherBootstrap cleans up HA data only on
FAILED, CANCELLED, SUCCEEDED
Depending on the status with which a job got terminated, we may
want to shutdown the cluster and clean up all HA data, or not. To
be able to differentiate between the different termination reasons
we add the ApplicationFailureException.
In addition, to be able to shutdown the cluster without cleaning up
the HA data, we need to be able to terminate the dispatcher's shutdown
future
with an exception. This is what the new error handler pass in the
ApplicationDispatcherBootstrap does. We chose to pass the FatalErrorHandler
as a constructor argument because this allows for more robust code.
---
.../ApplicationDispatcherBootstrap.java| 68 +++-
...ApplicationDispatcherGatewayServiceFactory.java | 6 +-
.../application/ApplicationFailureException.java | 82 +++
.../ApplicationDispatcherBootstrapTest.java| 93 +-
.../flink/runtime/dispatcher/Dispatcher.java | 11 ++-
.../runtime/dispatcher/DispatcherFactory.java | 11 ++-
.../runtime/dispatcher/JobDispatcherFactory.java | 7 +-
.../flink/runtime/dispatcher/MiniDispatcher.java | 6 +-
.../dispatcher/SessionDispatcherFactory.java | 7 +-
.../runtime/dispatcher/StandaloneDispatcher.java | 7 +-
.../DefaultDispatcherGatewayServiceFactory.java| 2 +-
.../dispatcher/DispatcherResourceCleanupTest.java | 2 +-
.../flink/runtime/dispatcher/DispatcherTest.java | 15 ++--
.../runtime/dispatcher/MiniDispatcherTest.java | 2 +-
.../runtime/dispatcher/TestingDispatcher.java | 5 +-
.../runner/DefaultDispatcherRunnerITCase.java | 6 +-
16 files changed, 218 insertions(+), 112 deletions(-)
diff --git
a/flink-clients/src/main/java/org/apache/flink/client/deployment/application/ApplicationDispatcherBootstrap.java
b/flink-clients/src/main/java/org/apache/flink/client/deployment/application/ApplicationDispatcherBootstrap.java
index 2b4ddf3..e581e29 100644
---
a/flink-clients/src/main/java/org/apache/flink/client/deployment/application/ApplicationDispatcherBootstrap.java
+++
b/flink-clients/src/main/java/org/apache/flink/client/deployment/application/ApplicationDispatcherBootstrap.java
@@ -30,7 +30,6 @@ import org.apache.flink.client.program.PackagedProgram;
import org.apache.flink.configuration.Configuration;
import org.apache.flink.configuration.PipelineOptionsInternal;
import org.apache.flink.core.execution.PipelineExecutorServiceLoader;
-import org.apache.flink.runtime.client.JobCancellationException;
import org.apache.flink.runtime.clusterframework.ApplicationStatus;
import org.apache.flink.runtime.concurrent.FutureUtils;
import org.apache.flink.runtime.concurrent.ScheduledExecutor;
@@ -42,8 +41,8 @@ import org.apache.flink.runtime.jobgraph.JobGraph;
import org.apache.flink.runtime.jobmanager.HighAvailabilityMode;
import org.apache.flink.runtime.jobmaster.JobResult;
import org.apache.flink.runtime.messages.Acknowledge;
+import org.apache.flink.runtime.rpc.FatalErrorHandler;
import org.apache.flink.util.ExceptionUtils;
-import org.apache.flink.util.SerializedThrowable;
import org.slf4j.Logger;
import org.slf4j.LoggerFactory;
@@ -52,7 +51,6 @@ import java.util.ArrayList;
import java.util.Collection;
import java.util.List;
import java.util.Optional;
-import java.util.concurrent.CancellationException;
import java.util.concurrent.CompletableFuture;
import java.util.concurrent.CompletionException;
import java.util.concurrent.ScheduledFuture;
@@ -85,6 +83,8 @@ public class ApplicationDispatcherBootstrap extends
AbstractDispatcherBootstrap
private final Configuration configuration;
+ private final FatalErrorHandler errorHandler;
+
private CompletableFuture applicationCompletionFuture;
private ScheduledFuture applicationExecutionTask;
@@ -92,10 +92,12 @@ public class ApplicationDispatcherBootstrap extends
AbstractDispatcherBootstrap
public ApplicationDispatcherBootstrap(
final PackagedProgram application,
final Collection recoveredJobs,
- final Configuration configuration) {
+ final Configuration configuration,
+ final FatalErrorHandler errorHandler) {
this.configuration = checkNotNull(configuration);
this.recoveredJobs = checkNotNull(recoveredJobs);
this.application = checkNotNull(application);
+ this.errorHandler = checkNotNull(errorHandler);
}
@Override
@@ -138,28
[flink] 02/04: [FLINK-19154] Pass DispatcherGateway to DispatcherBootstrap
This is an automated email from the ASF dual-hosted git repository.
kkloudas pushed a commit to branch release-1.11
in repository https://gitbox.apache.org/repos/asf/flink.git
commit 2ff910ff1d1721d88d39ddf3523217b558255543
Author: Kostas Kloudas
AuthorDate: Mon Oct 19 12:42:16 2020 +0200
[FLINK-19154] Pass DispatcherGateway to DispatcherBootstrap
In order to make sure that all calls from the
ApplicationDispatcherBootstrap are executed from the main
thread, we are passing the DispatcherGateway
to the Bootstrap and not the Dispatcher itself.
---
.../ApplicationDispatcherBootstrap.java| 59 ++---
...ApplicationDispatcherGatewayServiceFactory.java | 15 +++-
.../ApplicationDispatcherBootstrapTest.java| 97 --
.../dispatcher/AbstractDispatcherBootstrap.java| 46 --
.../flink/runtime/dispatcher/Dispatcher.java | 19 -
.../runtime/dispatcher/DispatcherBootstrap.java| 4 +-
.../runtime/dispatcher/DispatcherFactory.java | 3 +
.../runtime/dispatcher/JobDispatcherFactory.java | 8 ++
.../flink/runtime/dispatcher/MiniDispatcher.java | 3 +
...Bootstrap.java => NoOpDispatcherBootstrap.java} | 17 +---
.../dispatcher/SessionDispatcherFactory.java | 4 +
.../runtime/dispatcher/StandaloneDispatcher.java | 3 +
.../DefaultDispatcherGatewayServiceFactory.java| 9 +-
.../dispatcher/DispatcherResourceCleanupTest.java | 3 +-
.../flink/runtime/dispatcher/DispatcherTest.java | 14 +++-
.../runtime/dispatcher/MiniDispatcherTest.java | 4 +-
.../runtime/dispatcher/TestingDispatcher.java | 4 +
.../runner/DefaultDispatcherRunnerITCase.java | 2 +
18 files changed, 176 insertions(+), 138 deletions(-)
diff --git
a/flink-clients/src/main/java/org/apache/flink/client/deployment/application/ApplicationDispatcherBootstrap.java
b/flink-clients/src/main/java/org/apache/flink/client/deployment/application/ApplicationDispatcherBootstrap.java
index e581e29..a817048 100644
---
a/flink-clients/src/main/java/org/apache/flink/client/deployment/application/ApplicationDispatcherBootstrap.java
+++
b/flink-clients/src/main/java/org/apache/flink/client/deployment/application/ApplicationDispatcherBootstrap.java
@@ -33,8 +33,6 @@ import
org.apache.flink.core.execution.PipelineExecutorServiceLoader;
import org.apache.flink.runtime.clusterframework.ApplicationStatus;
import org.apache.flink.runtime.concurrent.FutureUtils;
import org.apache.flink.runtime.concurrent.ScheduledExecutor;
-import org.apache.flink.runtime.dispatcher.AbstractDispatcherBootstrap;
-import org.apache.flink.runtime.dispatcher.Dispatcher;
import org.apache.flink.runtime.dispatcher.DispatcherBootstrap;
import org.apache.flink.runtime.dispatcher.DispatcherGateway;
import org.apache.flink.runtime.jobgraph.JobGraph;
@@ -43,6 +41,7 @@ import org.apache.flink.runtime.jobmaster.JobResult;
import org.apache.flink.runtime.messages.Acknowledge;
import org.apache.flink.runtime.rpc.FatalErrorHandler;
import org.apache.flink.util.ExceptionUtils;
+import org.apache.flink.util.FlinkException;
import org.slf4j.Logger;
import org.slf4j.LoggerFactory;
@@ -71,7 +70,7 @@ import static
org.apache.flink.util.Preconditions.checkNotNull;
* if it should submit a job for execution (in case of a new job) or the job
was already recovered and is running.
*/
@Internal
-public class ApplicationDispatcherBootstrap extends
AbstractDispatcherBootstrap {
+public class ApplicationDispatcherBootstrap implements DispatcherBootstrap {
private static final Logger LOG =
LoggerFactory.getLogger(ApplicationDispatcherBootstrap.class);
@@ -79,7 +78,7 @@ public class ApplicationDispatcherBootstrap extends
AbstractDispatcherBootstrap
private final PackagedProgram application;
- private final Collection recoveredJobs;
+ private final Collection recoveredJobIds;
private final Configuration configuration;
@@ -91,22 +90,21 @@ public class ApplicationDispatcherBootstrap extends
AbstractDispatcherBootstrap
public ApplicationDispatcherBootstrap(
final PackagedProgram application,
- final Collection recoveredJobs,
+ final Collection recoveredJobIds,
final Configuration configuration,
final FatalErrorHandler errorHandler) {
this.configuration = checkNotNull(configuration);
- this.recoveredJobs = checkNotNull(recoveredJobs);
+ this.recoveredJobIds = checkNotNull(recoveredJobIds);
this.application = checkNotNull(application);
this.errorHandler = checkNotNull(errorHandler);
}
@Override
- public void initialize(final Dispatcher dispatcher, ScheduledExecutor
scheduledExecutor) {
- checkNotNull(dispatcher);
- launchRecoveredJobGraphs(dispatcher, recoveredJobs);
+
[flink] 03/04: [hotfix] Merge ApplicationDispatcherBootstrap#initialize() with constructor.
This is an automated email from the ASF dual-hosted git repository.
kkloudas pushed a commit to branch release-1.11
in repository https://gitbox.apache.org/repos/asf/flink.git
commit 69db02bddbb535bfc918e97a796037e122a87a71
Author: Kostas Kloudas
AuthorDate: Wed Oct 21 20:55:44 2020 +0200
[hotfix] Merge ApplicationDispatcherBootstrap#initialize() with constructor.
---
.../ApplicationDispatcherBootstrap.java| 38 +-
...ApplicationDispatcherGatewayServiceFactory.java | 3 +-
.../ApplicationDispatcherBootstrapTest.java| 84 --
.../flink/runtime/dispatcher/Dispatcher.java | 10 +--
.../runtime/dispatcher/DispatcherBootstrap.java| 13 +---
...tstrap.java => DispatcherBootstrapFactory.java} | 23 ++
.../runtime/dispatcher/DispatcherFactory.java | 4 +-
.../runtime/dispatcher/JobDispatcherFactory.java | 4 +-
.../flink/runtime/dispatcher/MiniDispatcher.java | 4 +-
.../dispatcher/NoOpDispatcherBootstrap.java| 6 --
.../dispatcher/SessionDispatcherFactory.java | 4 +-
.../runtime/dispatcher/StandaloneDispatcher.java | 4 +-
.../DefaultDispatcherGatewayServiceFactory.java| 2 +-
.../dispatcher/DispatcherResourceCleanupTest.java | 2 +-
.../flink/runtime/dispatcher/DispatcherTest.java | 7 +-
.../runtime/dispatcher/MiniDispatcherTest.java | 2 +-
.../runtime/dispatcher/TestingDispatcher.java | 3 +-
.../runner/DefaultDispatcherRunnerITCase.java | 6 +-
18 files changed, 97 insertions(+), 122 deletions(-)
diff --git
a/flink-clients/src/main/java/org/apache/flink/client/deployment/application/ApplicationDispatcherBootstrap.java
b/flink-clients/src/main/java/org/apache/flink/client/deployment/application/ApplicationDispatcherBootstrap.java
index a817048..1443804 100644
---
a/flink-clients/src/main/java/org/apache/flink/client/deployment/application/ApplicationDispatcherBootstrap.java
+++
b/flink-clients/src/main/java/org/apache/flink/client/deployment/application/ApplicationDispatcherBootstrap.java
@@ -84,7 +84,9 @@ public class ApplicationDispatcherBootstrap implements
DispatcherBootstrap {
private final FatalErrorHandler errorHandler;
- private CompletableFuture applicationCompletionFuture;
+ private final CompletableFuture applicationCompletionFuture;
+
+ private final CompletableFuture clusterShutdownFuture;
private ScheduledFuture applicationExecutionTask;
@@ -92,20 +94,19 @@ public class ApplicationDispatcherBootstrap implements
DispatcherBootstrap {
final PackagedProgram application,
final Collection recoveredJobIds,
final Configuration configuration,
+ final DispatcherGateway dispatcherGateway,
+ final ScheduledExecutor scheduledExecutor,
final FatalErrorHandler errorHandler) {
this.configuration = checkNotNull(configuration);
this.recoveredJobIds = checkNotNull(recoveredJobIds);
this.application = checkNotNull(application);
this.errorHandler = checkNotNull(errorHandler);
- }
- @Override
- public void initialize(final DispatcherGateway dispatcherGateway,
ScheduledExecutor scheduledExecutor) {
- checkNotNull(dispatcherGateway);
+ this.applicationCompletionFuture =
+
fixJobIdAndRunApplicationAsync(dispatcherGateway, scheduledExecutor);
- runApplicationAndShutdownClusterAsync(
- dispatcherGateway,
- scheduledExecutor);
+ this.clusterShutdownFuture =
+
runApplicationAndShutdownClusterAsync(dispatcherGateway);
}
@Override
@@ -124,17 +125,21 @@ public class ApplicationDispatcherBootstrap implements
DispatcherBootstrap {
return applicationExecutionTask;
}
+ @VisibleForTesting
+ CompletableFuture getApplicationCompletionFuture() {
+ return applicationCompletionFuture;
+ }
+
+ @VisibleForTesting
+ CompletableFuture getClusterShutdownFuture() {
+ return clusterShutdownFuture;
+ }
+
/**
* Runs the user program entrypoint and shuts down the given
dispatcherGateway when
* the application completes (either successfully or in case of
failure).
*/
- @VisibleForTesting
- CompletableFuture runApplicationAndShutdownClusterAsync(
- final DispatcherGateway dispatcherGateway,
- final ScheduledExecutor scheduledExecutor) {
-
- applicationCompletionFuture =
fixJobIdAndRunApplicationAsync(dispatcherGateway, scheduledExecutor);
-
+ private CompletableFuture
runApplicationAndShutdownClusterAsync(final DispatcherGateway
dispatcherGateway) {
[flink] branch release-1.11 updated (78cd462 -> 61a9f25)
This is an automated email from the ASF dual-hosted git repository. kkloudas pushed a change to branch release-1.11 in repository https://gitbox.apache.org/repos/asf/flink.git. from 78cd462 [FLINK-19750][connector/kafka] Fix bug of not opening DeserializationSchema when FlinkKafkaConsumerBase recovers from state (#13785) new 3dd5762 [FLINK-19154] ApplicationDispatcherBootstrap cleans up HA data only on FAILED, CANCELLED, SUCCEEDED new 2ff910f [FLINK-19154] Pass DispatcherGateway to DispatcherBootstrap new 69db02b [hotfix] Merge ApplicationDispatcherBootstrap#initialize() with constructor. new 61a9f25 [hotfix] minor refactoring in ApplicationDispatcherBootstrap The 4 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .../ApplicationDispatcherBootstrap.java| 151 +++- ...ApplicationDispatcherGatewayServiceFactory.java | 18 +- .../application/ApplicationFailureException.java | 82 + .../ApplicationDispatcherBootstrapTest.java| 198 ++--- .../dispatcher/AbstractDispatcherBootstrap.java| 46 - .../dispatcher/DefaultDispatcherBootstrap.java | 53 -- .../flink/runtime/dispatcher/Dispatcher.java | 28 ++- .../runtime/dispatcher/DispatcherBootstrap.java| 13 +- .../dispatcher/DispatcherBootstrapFactory.java | 18 +- .../runtime/dispatcher/DispatcherFactory.java | 12 +- .../runtime/dispatcher/JobDispatcherFactory.java | 13 +- .../flink/runtime/dispatcher/MiniDispatcher.java | 7 +- .../dispatcher/NoOpDispatcherBootstrap.java| 17 +- .../dispatcher/SessionDispatcherFactory.java | 9 +- .../runtime/dispatcher/StandaloneDispatcher.java | 8 +- .../DefaultDispatcherGatewayServiceFactory.java| 9 +- .../dispatcher/DispatcherResourceCleanupTest.java | 3 +- .../flink/runtime/dispatcher/DispatcherTest.java | 22 ++- .../runtime/dispatcher/MiniDispatcherTest.java | 4 +- .../runtime/dispatcher/TestingDispatcher.java | 8 +- .../runner/DefaultDispatcherRunnerITCase.java | 8 +- 21 files changed, 408 insertions(+), 319 deletions(-) create mode 100644 flink-clients/src/main/java/org/apache/flink/client/deployment/application/ApplicationFailureException.java delete mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/AbstractDispatcherBootstrap.java delete mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/DefaultDispatcherBootstrap.java copy flink-clients/src/main/java/org/apache/flink/client/program/ClusterClientProvider.java => flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/DispatcherBootstrapFactory.java (66%) copy flink-python/src/main/java/org/apache/flink/table/runtime/arrow/readers/DoubleFieldReader.java => flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/NoOpDispatcherBootstrap.java (69%)
[flink] 04/04: [hotfix] minor refactoring in ApplicationDispatcherBootstrap
This is an automated email from the ASF dual-hosted git repository.
kkloudas pushed a commit to branch release-1.11
in repository https://gitbox.apache.org/repos/asf/flink.git
commit 61a9f25cd827d09e64a9a3f39c0fb85639007b89
Author: Kostas Kloudas
AuthorDate: Wed Oct 21 21:00:27 2020 +0200
[hotfix] minor refactoring in ApplicationDispatcherBootstrap
---
.../ApplicationDispatcherBootstrap.java| 32 +++---
1 file changed, 16 insertions(+), 16 deletions(-)
diff --git
a/flink-clients/src/main/java/org/apache/flink/client/deployment/application/ApplicationDispatcherBootstrap.java
b/flink-clients/src/main/java/org/apache/flink/client/deployment/application/ApplicationDispatcherBootstrap.java
index 1443804..48dd704 100644
---
a/flink-clients/src/main/java/org/apache/flink/client/deployment/application/ApplicationDispatcherBootstrap.java
+++
b/flink-clients/src/main/java/org/apache/flink/client/deployment/application/ApplicationDispatcherBootstrap.java
@@ -142,28 +142,28 @@ public class ApplicationDispatcherBootstrap implements
DispatcherBootstrap {
private CompletableFuture
runApplicationAndShutdownClusterAsync(final DispatcherGateway
dispatcherGateway) {
return applicationCompletionFuture
.handle((r, t) -> {
- if (t != null) {
- final
Optional exception =
-
ExceptionUtils.findThrowable(t, ApplicationFailureException.class);
-
- if (exception.isPresent()) {
- final ApplicationStatus
applicationStatus = exception.get().getStatus();
+ if (t == null) {
+ LOG.info("Application completed
SUCCESSFULLY");
+ return
dispatcherGateway.shutDownCluster(ApplicationStatus.SUCCEEDED);
+ }
- if (applicationStatus
== ApplicationStatus.CANCELED || applicationStatus == ApplicationStatus.FAILED)
{
-
LOG.info("Application {}: ", applicationStatus, t);
- return
dispatcherGateway.shutDownCluster(applicationStatus);
- }
- }
+ final
Optional exception =
+
ExceptionUtils.findThrowable(t, ApplicationFailureException.class);
- LOG.warn("Exiting with
Application Status UNKNOWN: ", t);
-
this.errorHandler.onFatalError(new FlinkException("Application failed
unexpectedly.", t));
+ if (exception.isPresent()) {
+ final ApplicationStatus
applicationStatus = exception.get().getStatus();
- return
FutureUtils.completedExceptionally(t);
+ if (applicationStatus ==
ApplicationStatus.CANCELED || applicationStatus == ApplicationStatus.FAILED) {
+ LOG.info("Application
{}: ", applicationStatus, t);
+ return
dispatcherGateway.shutDownCluster(applicationStatus);
+ }
}
- LOG.info("Application completed
SUCCESSFULLY");
- return
dispatcherGateway.shutDownCluster(ApplicationStatus.SUCCEEDED);
+ LOG.warn("Application failed
unexpectedly: ", t);
+ this.errorHandler.onFatalError(new
FlinkException("Application failed unexpectedly.", t));
+
+ return
FutureUtils.completedExceptionally(t);
})
.thenCompose(Function.identity());
}
[flink] branch master updated (bfd42f9 -> f02b951)
This is an automated email from the ASF dual-hosted git repository. kkloudas pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git. from bfd42f9 [hotfix][docs] Remove unused variable add f29a18e [FLINK-19154] ApplicationDispatcherBootstrap cleans up HA data only on FAILED, CANCELLED, SUCCEEDED add 021456d [FLINK-19154] Pass DispatcherGateway to DispatcherBootstrap add c5ec0b0 [FLINK-19154] Merge ApplicationDispatcherBootstrap#initialize() with constructor. add f02b951 [hotfix] minor refactoring in ApplicationDispatcherBootstrap No new revisions were added by this update. Summary of changes: .../ApplicationDispatcherBootstrap.java| 151 +++- ...ApplicationDispatcherGatewayServiceFactory.java | 18 +- .../application/ApplicationFailureException.java | 82 + .../ApplicationDispatcherBootstrapTest.java| 198 ++--- .../dispatcher/AbstractDispatcherBootstrap.java| 46 - .../dispatcher/DefaultDispatcherBootstrap.java | 53 -- .../flink/runtime/dispatcher/Dispatcher.java | 28 ++- .../runtime/dispatcher/DispatcherBootstrap.java| 13 +- .../dispatcher/DispatcherBootstrapFactory.java | 21 ++- .../runtime/dispatcher/DispatcherFactory.java | 12 +- .../runtime/dispatcher/JobDispatcherFactory.java | 13 +- .../flink/runtime/dispatcher/MiniDispatcher.java | 7 +- .../dispatcher/NoOpDispatcherBootstrap.java| 17 +- .../dispatcher/SessionDispatcherFactory.java | 9 +- .../runtime/dispatcher/StandaloneDispatcher.java | 8 +- .../DefaultDispatcherGatewayServiceFactory.java| 9 +- .../dispatcher/DispatcherResourceCleanupTest.java | 3 +- .../flink/runtime/dispatcher/DispatcherTest.java | 22 ++- .../runtime/dispatcher/MiniDispatcherTest.java | 4 +- .../runtime/dispatcher/TestingDispatcher.java | 8 +- .../runner/DefaultDispatcherRunnerITCase.java | 8 +- 21 files changed, 409 insertions(+), 321 deletions(-) create mode 100644 flink-clients/src/main/java/org/apache/flink/client/deployment/application/ApplicationFailureException.java delete mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/AbstractDispatcherBootstrap.java delete mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/DefaultDispatcherBootstrap.java copy flink-annotations/src/main/java/org/apache/flink/annotation/docs/ConfigGroup.java => flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/DispatcherBootstrapFactory.java (66%) copy flink-python/src/main/java/org/apache/flink/table/runtime/arrow/readers/DoubleFieldReader.java => flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/NoOpDispatcherBootstrap.java (69%)
[flink] branch master updated (bfd42f9 -> f02b951)
This is an automated email from the ASF dual-hosted git repository. kkloudas pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git. from bfd42f9 [hotfix][docs] Remove unused variable add f29a18e [FLINK-19154] ApplicationDispatcherBootstrap cleans up HA data only on FAILED, CANCELLED, SUCCEEDED add 021456d [FLINK-19154] Pass DispatcherGateway to DispatcherBootstrap add c5ec0b0 [FLINK-19154] Merge ApplicationDispatcherBootstrap#initialize() with constructor. add f02b951 [hotfix] minor refactoring in ApplicationDispatcherBootstrap No new revisions were added by this update. Summary of changes: .../ApplicationDispatcherBootstrap.java| 151 +++- ...ApplicationDispatcherGatewayServiceFactory.java | 18 +- .../application/ApplicationFailureException.java | 82 + .../ApplicationDispatcherBootstrapTest.java| 198 ++--- .../dispatcher/AbstractDispatcherBootstrap.java| 46 - .../dispatcher/DefaultDispatcherBootstrap.java | 53 -- .../flink/runtime/dispatcher/Dispatcher.java | 28 ++- .../runtime/dispatcher/DispatcherBootstrap.java| 13 +- .../dispatcher/DispatcherBootstrapFactory.java | 21 ++- .../runtime/dispatcher/DispatcherFactory.java | 12 +- .../runtime/dispatcher/JobDispatcherFactory.java | 13 +- .../flink/runtime/dispatcher/MiniDispatcher.java | 7 +- .../dispatcher/NoOpDispatcherBootstrap.java| 17 +- .../dispatcher/SessionDispatcherFactory.java | 9 +- .../runtime/dispatcher/StandaloneDispatcher.java | 8 +- .../DefaultDispatcherGatewayServiceFactory.java| 9 +- .../dispatcher/DispatcherResourceCleanupTest.java | 3 +- .../flink/runtime/dispatcher/DispatcherTest.java | 22 ++- .../runtime/dispatcher/MiniDispatcherTest.java | 4 +- .../runtime/dispatcher/TestingDispatcher.java | 8 +- .../runner/DefaultDispatcherRunnerITCase.java | 8 +- 21 files changed, 409 insertions(+), 321 deletions(-) create mode 100644 flink-clients/src/main/java/org/apache/flink/client/deployment/application/ApplicationFailureException.java delete mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/AbstractDispatcherBootstrap.java delete mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/DefaultDispatcherBootstrap.java copy flink-annotations/src/main/java/org/apache/flink/annotation/docs/ConfigGroup.java => flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/DispatcherBootstrapFactory.java (66%) copy flink-python/src/main/java/org/apache/flink/table/runtime/arrow/readers/DoubleFieldReader.java => flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/NoOpDispatcherBootstrap.java (69%)
[flink] branch master updated (bfd42f9 -> f02b951)
This is an automated email from the ASF dual-hosted git repository. kkloudas pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git. from bfd42f9 [hotfix][docs] Remove unused variable add f29a18e [FLINK-19154] ApplicationDispatcherBootstrap cleans up HA data only on FAILED, CANCELLED, SUCCEEDED add 021456d [FLINK-19154] Pass DispatcherGateway to DispatcherBootstrap add c5ec0b0 [FLINK-19154] Merge ApplicationDispatcherBootstrap#initialize() with constructor. add f02b951 [hotfix] minor refactoring in ApplicationDispatcherBootstrap No new revisions were added by this update. Summary of changes: .../ApplicationDispatcherBootstrap.java| 151 +++- ...ApplicationDispatcherGatewayServiceFactory.java | 18 +- .../application/ApplicationFailureException.java | 82 + .../ApplicationDispatcherBootstrapTest.java| 198 ++--- .../dispatcher/AbstractDispatcherBootstrap.java| 46 - .../dispatcher/DefaultDispatcherBootstrap.java | 53 -- .../flink/runtime/dispatcher/Dispatcher.java | 28 ++- .../runtime/dispatcher/DispatcherBootstrap.java| 13 +- .../dispatcher/DispatcherBootstrapFactory.java | 21 ++- .../runtime/dispatcher/DispatcherFactory.java | 12 +- .../runtime/dispatcher/JobDispatcherFactory.java | 13 +- .../flink/runtime/dispatcher/MiniDispatcher.java | 7 +- .../dispatcher/NoOpDispatcherBootstrap.java| 17 +- .../dispatcher/SessionDispatcherFactory.java | 9 +- .../runtime/dispatcher/StandaloneDispatcher.java | 8 +- .../DefaultDispatcherGatewayServiceFactory.java| 9 +- .../dispatcher/DispatcherResourceCleanupTest.java | 3 +- .../flink/runtime/dispatcher/DispatcherTest.java | 22 ++- .../runtime/dispatcher/MiniDispatcherTest.java | 4 +- .../runtime/dispatcher/TestingDispatcher.java | 8 +- .../runner/DefaultDispatcherRunnerITCase.java | 8 +- 21 files changed, 409 insertions(+), 321 deletions(-) create mode 100644 flink-clients/src/main/java/org/apache/flink/client/deployment/application/ApplicationFailureException.java delete mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/AbstractDispatcherBootstrap.java delete mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/DefaultDispatcherBootstrap.java copy flink-annotations/src/main/java/org/apache/flink/annotation/docs/ConfigGroup.java => flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/DispatcherBootstrapFactory.java (66%) copy flink-python/src/main/java/org/apache/flink/table/runtime/arrow/readers/DoubleFieldReader.java => flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/NoOpDispatcherBootstrap.java (69%)
[flink] branch master updated (bfd42f9 -> f02b951)
This is an automated email from the ASF dual-hosted git repository. kkloudas pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git. from bfd42f9 [hotfix][docs] Remove unused variable add f29a18e [FLINK-19154] ApplicationDispatcherBootstrap cleans up HA data only on FAILED, CANCELLED, SUCCEEDED add 021456d [FLINK-19154] Pass DispatcherGateway to DispatcherBootstrap add c5ec0b0 [FLINK-19154] Merge ApplicationDispatcherBootstrap#initialize() with constructor. add f02b951 [hotfix] minor refactoring in ApplicationDispatcherBootstrap No new revisions were added by this update. Summary of changes: .../ApplicationDispatcherBootstrap.java| 151 +++- ...ApplicationDispatcherGatewayServiceFactory.java | 18 +- .../application/ApplicationFailureException.java | 82 + .../ApplicationDispatcherBootstrapTest.java| 198 ++--- .../dispatcher/AbstractDispatcherBootstrap.java| 46 - .../dispatcher/DefaultDispatcherBootstrap.java | 53 -- .../flink/runtime/dispatcher/Dispatcher.java | 28 ++- .../runtime/dispatcher/DispatcherBootstrap.java| 13 +- .../dispatcher/DispatcherBootstrapFactory.java | 21 ++- .../runtime/dispatcher/DispatcherFactory.java | 12 +- .../runtime/dispatcher/JobDispatcherFactory.java | 13 +- .../flink/runtime/dispatcher/MiniDispatcher.java | 7 +- .../dispatcher/NoOpDispatcherBootstrap.java| 17 +- .../dispatcher/SessionDispatcherFactory.java | 9 +- .../runtime/dispatcher/StandaloneDispatcher.java | 8 +- .../DefaultDispatcherGatewayServiceFactory.java| 9 +- .../dispatcher/DispatcherResourceCleanupTest.java | 3 +- .../flink/runtime/dispatcher/DispatcherTest.java | 22 ++- .../runtime/dispatcher/MiniDispatcherTest.java | 4 +- .../runtime/dispatcher/TestingDispatcher.java | 8 +- .../runner/DefaultDispatcherRunnerITCase.java | 8 +- 21 files changed, 409 insertions(+), 321 deletions(-) create mode 100644 flink-clients/src/main/java/org/apache/flink/client/deployment/application/ApplicationFailureException.java delete mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/AbstractDispatcherBootstrap.java delete mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/DefaultDispatcherBootstrap.java copy flink-annotations/src/main/java/org/apache/flink/annotation/docs/ConfigGroup.java => flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/DispatcherBootstrapFactory.java (66%) copy flink-python/src/main/java/org/apache/flink/table/runtime/arrow/readers/DoubleFieldReader.java => flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/NoOpDispatcherBootstrap.java (69%)
[flink] branch master updated (bfd42f9 -> f02b951)
This is an automated email from the ASF dual-hosted git repository. kkloudas pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git. from bfd42f9 [hotfix][docs] Remove unused variable add f29a18e [FLINK-19154] ApplicationDispatcherBootstrap cleans up HA data only on FAILED, CANCELLED, SUCCEEDED add 021456d [FLINK-19154] Pass DispatcherGateway to DispatcherBootstrap add c5ec0b0 [FLINK-19154] Merge ApplicationDispatcherBootstrap#initialize() with constructor. add f02b951 [hotfix] minor refactoring in ApplicationDispatcherBootstrap No new revisions were added by this update. Summary of changes: .../ApplicationDispatcherBootstrap.java| 151 +++- ...ApplicationDispatcherGatewayServiceFactory.java | 18 +- .../application/ApplicationFailureException.java | 82 + .../ApplicationDispatcherBootstrapTest.java| 198 ++--- .../dispatcher/AbstractDispatcherBootstrap.java| 46 - .../dispatcher/DefaultDispatcherBootstrap.java | 53 -- .../flink/runtime/dispatcher/Dispatcher.java | 28 ++- .../runtime/dispatcher/DispatcherBootstrap.java| 13 +- .../dispatcher/DispatcherBootstrapFactory.java | 21 ++- .../runtime/dispatcher/DispatcherFactory.java | 12 +- .../runtime/dispatcher/JobDispatcherFactory.java | 13 +- .../flink/runtime/dispatcher/MiniDispatcher.java | 7 +- .../dispatcher/NoOpDispatcherBootstrap.java| 17 +- .../dispatcher/SessionDispatcherFactory.java | 9 +- .../runtime/dispatcher/StandaloneDispatcher.java | 8 +- .../DefaultDispatcherGatewayServiceFactory.java| 9 +- .../dispatcher/DispatcherResourceCleanupTest.java | 3 +- .../flink/runtime/dispatcher/DispatcherTest.java | 22 ++- .../runtime/dispatcher/MiniDispatcherTest.java | 4 +- .../runtime/dispatcher/TestingDispatcher.java | 8 +- .../runner/DefaultDispatcherRunnerITCase.java | 8 +- 21 files changed, 409 insertions(+), 321 deletions(-) create mode 100644 flink-clients/src/main/java/org/apache/flink/client/deployment/application/ApplicationFailureException.java delete mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/AbstractDispatcherBootstrap.java delete mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/DefaultDispatcherBootstrap.java copy flink-annotations/src/main/java/org/apache/flink/annotation/docs/ConfigGroup.java => flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/DispatcherBootstrapFactory.java (66%) copy flink-python/src/main/java/org/apache/flink/table/runtime/arrow/readers/DoubleFieldReader.java => flink-runtime/src/main/java/org/apache/flink/runtime/dispatcher/NoOpDispatcherBootstrap.java (69%)
[flink] branch master updated (d4224d1 -> bfd42f9)
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git. from d4224d1 [FLINK-19781] Upgrade commons-codec to 1.13 add bfd42f9 [hotfix][docs] Remove unused variable No new revisions were added by this update. Summary of changes: docs/_config.yml | 4 1 file changed, 4 deletions(-)
[flink] branch master updated (d4224d1 -> bfd42f9)
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git. from d4224d1 [FLINK-19781] Upgrade commons-codec to 1.13 add bfd42f9 [hotfix][docs] Remove unused variable No new revisions were added by this update. Summary of changes: docs/_config.yml | 4 1 file changed, 4 deletions(-)
[flink] branch master updated (aee0e70 -> d4224d1)
This is an automated email from the ASF dual-hosted git repository. rmetzger pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git. from aee0e70 [FLINK-19676][docs] java package name error in docs. add d4224d1 [FLINK-19781] Upgrade commons-codec to 1.13 No new revisions were added by this update. Summary of changes: .../flink-connector-elasticsearch5/src/main/resources/META-INF/NOTICE | 2 +- .../src/main/resources/META-INF/NOTICE | 2 +- .../src/main/resources/META-INF/NOTICE | 2 +- .../flink-sql-connector-hbase-1.4/src/main/resources/META-INF/NOTICE| 2 +- .../flink-sql-connector-hbase-2.2/src/main/resources/META-INF/NOTICE| 2 +- .../flink-azure-fs-hadoop/src/main/resources/META-INF/NOTICE| 2 +- .../flink-oss-fs-hadoop/src/main/resources/META-INF/NOTICE | 2 +- flink-filesystems/flink-s3-fs-hadoop/src/main/resources/META-INF/NOTICE | 2 +- flink-filesystems/flink-s3-fs-presto/src/main/resources/META-INF/NOTICE | 2 +- .../flink-swift-fs-hadoop/src/main/resources/META-INF/NOTICE| 2 +- .../flink-table-planner-blink/src/main/resources/META-INF/NOTICE| 2 +- flink-table/flink-table-planner/src/main/resources/META-INF/NOTICE | 2 +- pom.xml | 2 +- 13 files changed, 13 insertions(+), 13 deletions(-)
[flink] branch master updated (d4224d1 -> bfd42f9)
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git. from d4224d1 [FLINK-19781] Upgrade commons-codec to 1.13 add bfd42f9 [hotfix][docs] Remove unused variable No new revisions were added by this update. Summary of changes: docs/_config.yml | 4 1 file changed, 4 deletions(-)
[flink] branch master updated (aee0e70 -> d4224d1)
This is an automated email from the ASF dual-hosted git repository. rmetzger pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git. from aee0e70 [FLINK-19676][docs] java package name error in docs. add d4224d1 [FLINK-19781] Upgrade commons-codec to 1.13 No new revisions were added by this update. Summary of changes: .../flink-connector-elasticsearch5/src/main/resources/META-INF/NOTICE | 2 +- .../src/main/resources/META-INF/NOTICE | 2 +- .../src/main/resources/META-INF/NOTICE | 2 +- .../flink-sql-connector-hbase-1.4/src/main/resources/META-INF/NOTICE| 2 +- .../flink-sql-connector-hbase-2.2/src/main/resources/META-INF/NOTICE| 2 +- .../flink-azure-fs-hadoop/src/main/resources/META-INF/NOTICE| 2 +- .../flink-oss-fs-hadoop/src/main/resources/META-INF/NOTICE | 2 +- flink-filesystems/flink-s3-fs-hadoop/src/main/resources/META-INF/NOTICE | 2 +- flink-filesystems/flink-s3-fs-presto/src/main/resources/META-INF/NOTICE | 2 +- .../flink-swift-fs-hadoop/src/main/resources/META-INF/NOTICE| 2 +- .../flink-table-planner-blink/src/main/resources/META-INF/NOTICE| 2 +- flink-table/flink-table-planner/src/main/resources/META-INF/NOTICE | 2 +- pom.xml | 2 +- 13 files changed, 13 insertions(+), 13 deletions(-)
[flink] branch master updated (aee0e70 -> d4224d1)
This is an automated email from the ASF dual-hosted git repository. rmetzger pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git. from aee0e70 [FLINK-19676][docs] java package name error in docs. add d4224d1 [FLINK-19781] Upgrade commons-codec to 1.13 No new revisions were added by this update. Summary of changes: .../flink-connector-elasticsearch5/src/main/resources/META-INF/NOTICE | 2 +- .../src/main/resources/META-INF/NOTICE | 2 +- .../src/main/resources/META-INF/NOTICE | 2 +- .../flink-sql-connector-hbase-1.4/src/main/resources/META-INF/NOTICE| 2 +- .../flink-sql-connector-hbase-2.2/src/main/resources/META-INF/NOTICE| 2 +- .../flink-azure-fs-hadoop/src/main/resources/META-INF/NOTICE| 2 +- .../flink-oss-fs-hadoop/src/main/resources/META-INF/NOTICE | 2 +- flink-filesystems/flink-s3-fs-hadoop/src/main/resources/META-INF/NOTICE | 2 +- flink-filesystems/flink-s3-fs-presto/src/main/resources/META-INF/NOTICE | 2 +- .../flink-swift-fs-hadoop/src/main/resources/META-INF/NOTICE| 2 +- .../flink-table-planner-blink/src/main/resources/META-INF/NOTICE| 2 +- flink-table/flink-table-planner/src/main/resources/META-INF/NOTICE | 2 +- pom.xml | 2 +- 13 files changed, 13 insertions(+), 13 deletions(-)
[flink] branch master updated (aee0e70 -> d4224d1)
This is an automated email from the ASF dual-hosted git repository. rmetzger pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git. from aee0e70 [FLINK-19676][docs] java package name error in docs. add d4224d1 [FLINK-19781] Upgrade commons-codec to 1.13 No new revisions were added by this update. Summary of changes: .../flink-connector-elasticsearch5/src/main/resources/META-INF/NOTICE | 2 +- .../src/main/resources/META-INF/NOTICE | 2 +- .../src/main/resources/META-INF/NOTICE | 2 +- .../flink-sql-connector-hbase-1.4/src/main/resources/META-INF/NOTICE| 2 +- .../flink-sql-connector-hbase-2.2/src/main/resources/META-INF/NOTICE| 2 +- .../flink-azure-fs-hadoop/src/main/resources/META-INF/NOTICE| 2 +- .../flink-oss-fs-hadoop/src/main/resources/META-INF/NOTICE | 2 +- flink-filesystems/flink-s3-fs-hadoop/src/main/resources/META-INF/NOTICE | 2 +- flink-filesystems/flink-s3-fs-presto/src/main/resources/META-INF/NOTICE | 2 +- .../flink-swift-fs-hadoop/src/main/resources/META-INF/NOTICE| 2 +- .../flink-table-planner-blink/src/main/resources/META-INF/NOTICE| 2 +- flink-table/flink-table-planner/src/main/resources/META-INF/NOTICE | 2 +- pom.xml | 2 +- 13 files changed, 13 insertions(+), 13 deletions(-)
[flink] branch master updated (0184672 -> aee0e70)
This is an automated email from the ASF dual-hosted git repository. aljoscha pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git. from 0184672 [refactor][tests][network] Cleanup PartitionRequestClientFactoryTest add aee0e70 [FLINK-19676][docs] java package name error in docs. No new revisions were added by this update. Summary of changes: docs/dev/table/types.md| 6 +++--- docs/dev/table/types.zh.md | 6 +++--- 2 files changed, 6 insertions(+), 6 deletions(-)
[flink] branch master updated (0184672 -> aee0e70)
This is an automated email from the ASF dual-hosted git repository. aljoscha pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git. from 0184672 [refactor][tests][network] Cleanup PartitionRequestClientFactoryTest add aee0e70 [FLINK-19676][docs] java package name error in docs. No new revisions were added by this update. Summary of changes: docs/dev/table/types.md| 6 +++--- docs/dev/table/types.zh.md | 6 +++--- 2 files changed, 6 insertions(+), 6 deletions(-)
[flink] branch master updated (0184672 -> aee0e70)
This is an automated email from the ASF dual-hosted git repository. aljoscha pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git. from 0184672 [refactor][tests][network] Cleanup PartitionRequestClientFactoryTest add aee0e70 [FLINK-19676][docs] java package name error in docs. No new revisions were added by this update. Summary of changes: docs/dev/table/types.md| 6 +++--- docs/dev/table/types.zh.md | 6 +++--- 2 files changed, 6 insertions(+), 6 deletions(-)
[flink] branch master updated (0184672 -> aee0e70)
This is an automated email from the ASF dual-hosted git repository. aljoscha pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git. from 0184672 [refactor][tests][network] Cleanup PartitionRequestClientFactoryTest add aee0e70 [FLINK-19676][docs] java package name error in docs. No new revisions were added by this update. Summary of changes: docs/dev/table/types.md| 6 +++--- docs/dev/table/types.zh.md | 6 +++--- 2 files changed, 6 insertions(+), 6 deletions(-)
[flink] 04/04: [hotfix] minor refactoring in ApplicationDispatcherBootstrap
This is an automated email from the ASF dual-hosted git repository.
kkloudas pushed a commit to branch application-1.11
in repository https://gitbox.apache.org/repos/asf/flink.git
commit a4ae9d8386e74d17edd0b549de537080e1a676d9
Author: Kostas Kloudas
AuthorDate: Wed Oct 21 21:00:27 2020 +0200
[hotfix] minor refactoring in ApplicationDispatcherBootstrap
---
.../ApplicationDispatcherBootstrap.java| 32 +++---
1 file changed, 16 insertions(+), 16 deletions(-)
diff --git
a/flink-clients/src/main/java/org/apache/flink/client/deployment/application/ApplicationDispatcherBootstrap.java
b/flink-clients/src/main/java/org/apache/flink/client/deployment/application/ApplicationDispatcherBootstrap.java
index 1443804..48dd704 100644
---
a/flink-clients/src/main/java/org/apache/flink/client/deployment/application/ApplicationDispatcherBootstrap.java
+++
b/flink-clients/src/main/java/org/apache/flink/client/deployment/application/ApplicationDispatcherBootstrap.java
@@ -142,28 +142,28 @@ public class ApplicationDispatcherBootstrap implements
DispatcherBootstrap {
private CompletableFuture
runApplicationAndShutdownClusterAsync(final DispatcherGateway
dispatcherGateway) {
return applicationCompletionFuture
.handle((r, t) -> {
- if (t != null) {
- final
Optional exception =
-
ExceptionUtils.findThrowable(t, ApplicationFailureException.class);
-
- if (exception.isPresent()) {
- final ApplicationStatus
applicationStatus = exception.get().getStatus();
+ if (t == null) {
+ LOG.info("Application completed
SUCCESSFULLY");
+ return
dispatcherGateway.shutDownCluster(ApplicationStatus.SUCCEEDED);
+ }
- if (applicationStatus
== ApplicationStatus.CANCELED || applicationStatus == ApplicationStatus.FAILED)
{
-
LOG.info("Application {}: ", applicationStatus, t);
- return
dispatcherGateway.shutDownCluster(applicationStatus);
- }
- }
+ final
Optional exception =
+
ExceptionUtils.findThrowable(t, ApplicationFailureException.class);
- LOG.warn("Exiting with
Application Status UNKNOWN: ", t);
-
this.errorHandler.onFatalError(new FlinkException("Application failed
unexpectedly.", t));
+ if (exception.isPresent()) {
+ final ApplicationStatus
applicationStatus = exception.get().getStatus();
- return
FutureUtils.completedExceptionally(t);
+ if (applicationStatus ==
ApplicationStatus.CANCELED || applicationStatus == ApplicationStatus.FAILED) {
+ LOG.info("Application
{}: ", applicationStatus, t);
+ return
dispatcherGateway.shutDownCluster(applicationStatus);
+ }
}
- LOG.info("Application completed
SUCCESSFULLY");
- return
dispatcherGateway.shutDownCluster(ApplicationStatus.SUCCEEDED);
+ LOG.warn("Application failed
unexpectedly: ", t);
+ this.errorHandler.onFatalError(new
FlinkException("Application failed unexpectedly.", t));
+
+ return
FutureUtils.completedExceptionally(t);
})
.thenCompose(Function.identity());
}
[flink] 03/04: [hotfix] Merge ApplicationDispatcherBootstrap#initialize() with constructor.
This is an automated email from the ASF dual-hosted git repository.
kkloudas pushed a commit to branch application-1.11
in repository https://gitbox.apache.org/repos/asf/flink.git
commit 54e8d11d67d8a6a3ebd3da6c2503a2d26dba6924
Author: Kostas Kloudas
AuthorDate: Wed Oct 21 20:55:44 2020 +0200
[hotfix] Merge ApplicationDispatcherBootstrap#initialize() with constructor.
---
.../ApplicationDispatcherBootstrap.java| 38 +-
...ApplicationDispatcherGatewayServiceFactory.java | 3 +-
.../ApplicationDispatcherBootstrapTest.java| 84 --
.../flink/runtime/dispatcher/Dispatcher.java | 10 +--
.../runtime/dispatcher/DispatcherBootstrap.java| 13 +---
...tstrap.java => DispatcherBootstrapFactory.java} | 23 ++
.../runtime/dispatcher/DispatcherFactory.java | 4 +-
.../runtime/dispatcher/JobDispatcherFactory.java | 4 +-
.../flink/runtime/dispatcher/MiniDispatcher.java | 4 +-
.../dispatcher/NoOpDispatcherBootstrap.java| 6 --
.../dispatcher/SessionDispatcherFactory.java | 4 +-
.../runtime/dispatcher/StandaloneDispatcher.java | 4 +-
.../DefaultDispatcherGatewayServiceFactory.java| 2 +-
.../dispatcher/DispatcherResourceCleanupTest.java | 2 +-
.../flink/runtime/dispatcher/DispatcherTest.java | 7 +-
.../runtime/dispatcher/MiniDispatcherTest.java | 2 +-
.../runtime/dispatcher/TestingDispatcher.java | 3 +-
.../runner/DefaultDispatcherRunnerITCase.java | 6 +-
18 files changed, 97 insertions(+), 122 deletions(-)
diff --git
a/flink-clients/src/main/java/org/apache/flink/client/deployment/application/ApplicationDispatcherBootstrap.java
b/flink-clients/src/main/java/org/apache/flink/client/deployment/application/ApplicationDispatcherBootstrap.java
index a817048..1443804 100644
---
a/flink-clients/src/main/java/org/apache/flink/client/deployment/application/ApplicationDispatcherBootstrap.java
+++
b/flink-clients/src/main/java/org/apache/flink/client/deployment/application/ApplicationDispatcherBootstrap.java
@@ -84,7 +84,9 @@ public class ApplicationDispatcherBootstrap implements
DispatcherBootstrap {
private final FatalErrorHandler errorHandler;
- private CompletableFuture applicationCompletionFuture;
+ private final CompletableFuture applicationCompletionFuture;
+
+ private final CompletableFuture clusterShutdownFuture;
private ScheduledFuture applicationExecutionTask;
@@ -92,20 +94,19 @@ public class ApplicationDispatcherBootstrap implements
DispatcherBootstrap {
final PackagedProgram application,
final Collection recoveredJobIds,
final Configuration configuration,
+ final DispatcherGateway dispatcherGateway,
+ final ScheduledExecutor scheduledExecutor,
final FatalErrorHandler errorHandler) {
this.configuration = checkNotNull(configuration);
this.recoveredJobIds = checkNotNull(recoveredJobIds);
this.application = checkNotNull(application);
this.errorHandler = checkNotNull(errorHandler);
- }
- @Override
- public void initialize(final DispatcherGateway dispatcherGateway,
ScheduledExecutor scheduledExecutor) {
- checkNotNull(dispatcherGateway);
+ this.applicationCompletionFuture =
+
fixJobIdAndRunApplicationAsync(dispatcherGateway, scheduledExecutor);
- runApplicationAndShutdownClusterAsync(
- dispatcherGateway,
- scheduledExecutor);
+ this.clusterShutdownFuture =
+
runApplicationAndShutdownClusterAsync(dispatcherGateway);
}
@Override
@@ -124,17 +125,21 @@ public class ApplicationDispatcherBootstrap implements
DispatcherBootstrap {
return applicationExecutionTask;
}
+ @VisibleForTesting
+ CompletableFuture getApplicationCompletionFuture() {
+ return applicationCompletionFuture;
+ }
+
+ @VisibleForTesting
+ CompletableFuture getClusterShutdownFuture() {
+ return clusterShutdownFuture;
+ }
+
/**
* Runs the user program entrypoint and shuts down the given
dispatcherGateway when
* the application completes (either successfully or in case of
failure).
*/
- @VisibleForTesting
- CompletableFuture runApplicationAndShutdownClusterAsync(
- final DispatcherGateway dispatcherGateway,
- final ScheduledExecutor scheduledExecutor) {
-
- applicationCompletionFuture =
fixJobIdAndRunApplicationAsync(dispatcherGateway, scheduledExecutor);
-
+ private CompletableFuture
runApplicationAndShutdownClusterAsync(final DispatcherGateway
dispatcherGateway)
[flink] 02/04: [FLINK-19154] Pass DispatcherGateway to DispatcherBootstrap
This is an automated email from the ASF dual-hosted git repository.
kkloudas pushed a commit to branch application-1.11
in repository https://gitbox.apache.org/repos/asf/flink.git
commit e24f70bbc0a280a6c16c6ee976d3b3232f47c48f
Author: Kostas Kloudas
AuthorDate: Mon Oct 19 12:42:16 2020 +0200
[FLINK-19154] Pass DispatcherGateway to DispatcherBootstrap
In order to make sure that all calls from the
ApplicationDispatcherBootstrap are executed from the main
thread, we are passing the DispatcherGateway
to the Bootstrap and not the Dispatcher itself.
---
.../ApplicationDispatcherBootstrap.java| 59 ++---
...ApplicationDispatcherGatewayServiceFactory.java | 15 +++-
.../ApplicationDispatcherBootstrapTest.java| 97 --
.../dispatcher/AbstractDispatcherBootstrap.java| 46 --
.../flink/runtime/dispatcher/Dispatcher.java | 19 -
.../runtime/dispatcher/DispatcherBootstrap.java| 4 +-
.../runtime/dispatcher/DispatcherFactory.java | 3 +
.../runtime/dispatcher/JobDispatcherFactory.java | 8 ++
.../flink/runtime/dispatcher/MiniDispatcher.java | 3 +
...Bootstrap.java => NoOpDispatcherBootstrap.java} | 17 +---
.../dispatcher/SessionDispatcherFactory.java | 4 +
.../runtime/dispatcher/StandaloneDispatcher.java | 3 +
.../DefaultDispatcherGatewayServiceFactory.java| 9 +-
.../dispatcher/DispatcherResourceCleanupTest.java | 3 +-
.../flink/runtime/dispatcher/DispatcherTest.java | 14 +++-
.../runtime/dispatcher/MiniDispatcherTest.java | 4 +-
.../runtime/dispatcher/TestingDispatcher.java | 4 +
.../runner/DefaultDispatcherRunnerITCase.java | 2 +
18 files changed, 176 insertions(+), 138 deletions(-)
diff --git
a/flink-clients/src/main/java/org/apache/flink/client/deployment/application/ApplicationDispatcherBootstrap.java
b/flink-clients/src/main/java/org/apache/flink/client/deployment/application/ApplicationDispatcherBootstrap.java
index e581e29..a817048 100644
---
a/flink-clients/src/main/java/org/apache/flink/client/deployment/application/ApplicationDispatcherBootstrap.java
+++
b/flink-clients/src/main/java/org/apache/flink/client/deployment/application/ApplicationDispatcherBootstrap.java
@@ -33,8 +33,6 @@ import
org.apache.flink.core.execution.PipelineExecutorServiceLoader;
import org.apache.flink.runtime.clusterframework.ApplicationStatus;
import org.apache.flink.runtime.concurrent.FutureUtils;
import org.apache.flink.runtime.concurrent.ScheduledExecutor;
-import org.apache.flink.runtime.dispatcher.AbstractDispatcherBootstrap;
-import org.apache.flink.runtime.dispatcher.Dispatcher;
import org.apache.flink.runtime.dispatcher.DispatcherBootstrap;
import org.apache.flink.runtime.dispatcher.DispatcherGateway;
import org.apache.flink.runtime.jobgraph.JobGraph;
@@ -43,6 +41,7 @@ import org.apache.flink.runtime.jobmaster.JobResult;
import org.apache.flink.runtime.messages.Acknowledge;
import org.apache.flink.runtime.rpc.FatalErrorHandler;
import org.apache.flink.util.ExceptionUtils;
+import org.apache.flink.util.FlinkException;
import org.slf4j.Logger;
import org.slf4j.LoggerFactory;
@@ -71,7 +70,7 @@ import static
org.apache.flink.util.Preconditions.checkNotNull;
* if it should submit a job for execution (in case of a new job) or the job
was already recovered and is running.
*/
@Internal
-public class ApplicationDispatcherBootstrap extends
AbstractDispatcherBootstrap {
+public class ApplicationDispatcherBootstrap implements DispatcherBootstrap {
private static final Logger LOG =
LoggerFactory.getLogger(ApplicationDispatcherBootstrap.class);
@@ -79,7 +78,7 @@ public class ApplicationDispatcherBootstrap extends
AbstractDispatcherBootstrap
private final PackagedProgram application;
- private final Collection recoveredJobs;
+ private final Collection recoveredJobIds;
private final Configuration configuration;
@@ -91,22 +90,21 @@ public class ApplicationDispatcherBootstrap extends
AbstractDispatcherBootstrap
public ApplicationDispatcherBootstrap(
final PackagedProgram application,
- final Collection recoveredJobs,
+ final Collection recoveredJobIds,
final Configuration configuration,
final FatalErrorHandler errorHandler) {
this.configuration = checkNotNull(configuration);
- this.recoveredJobs = checkNotNull(recoveredJobs);
+ this.recoveredJobIds = checkNotNull(recoveredJobIds);
this.application = checkNotNull(application);
this.errorHandler = checkNotNull(errorHandler);
}
@Override
- public void initialize(final Dispatcher dispatcher, ScheduledExecutor
scheduledExecutor) {
- checkNotNull(dispatcher);
- launchRecoveredJobGraphs(dispatcher,
[flink] 01/04: [FLINK-19154] ApplicationDispatcherBootstrap cleans up HA data only on FAILED, CANCELLED, SUCCEEDED
This is an automated email from the ASF dual-hosted git repository.
kkloudas pushed a commit to branch application-1.11
in repository https://gitbox.apache.org/repos/asf/flink.git
commit 0057edf19168bd415f5c9b34e6b642c6ba460d96
Author: Kostas Kloudas
AuthorDate: Mon Oct 19 09:49:14 2020 +0200
[FLINK-19154] ApplicationDispatcherBootstrap cleans up HA data only on
FAILED, CANCELLED, SUCCEEDED
Depending on the status with which a job got terminated, we may
want to shutdown the cluster and clean up all HA data, or not. To
be able to differentiate between the different termination reasons
we add the ApplicationFailureException.
In addition, to be able to shutdown the cluster without cleaning up
the HA data, we need to be able to terminate the dispatcher's shutdown
future
with an exception. This is what the new error handler pass in the
ApplicationDispatcherBootstrap does. We chose to pass the FatalErrorHandler
as a constructor argument because this allows for more robust code.
---
.../ApplicationDispatcherBootstrap.java| 68 +++-
...ApplicationDispatcherGatewayServiceFactory.java | 6 +-
.../application/ApplicationFailureException.java | 82 +++
.../ApplicationDispatcherBootstrapTest.java| 93 +-
.../flink/runtime/dispatcher/Dispatcher.java | 11 ++-
.../runtime/dispatcher/DispatcherFactory.java | 11 ++-
.../runtime/dispatcher/JobDispatcherFactory.java | 7 +-
.../flink/runtime/dispatcher/MiniDispatcher.java | 6 +-
.../dispatcher/SessionDispatcherFactory.java | 7 +-
.../runtime/dispatcher/StandaloneDispatcher.java | 7 +-
.../DefaultDispatcherGatewayServiceFactory.java| 2 +-
.../dispatcher/DispatcherResourceCleanupTest.java | 2 +-
.../flink/runtime/dispatcher/DispatcherTest.java | 15 ++--
.../runtime/dispatcher/MiniDispatcherTest.java | 2 +-
.../runtime/dispatcher/TestingDispatcher.java | 5 +-
.../runner/DefaultDispatcherRunnerITCase.java | 6 +-
16 files changed, 218 insertions(+), 112 deletions(-)
diff --git
a/flink-clients/src/main/java/org/apache/flink/client/deployment/application/ApplicationDispatcherBootstrap.java
b/flink-clients/src/main/java/org/apache/flink/client/deployment/application/ApplicationDispatcherBootstrap.java
index 2b4ddf3..e581e29 100644
---
a/flink-clients/src/main/java/org/apache/flink/client/deployment/application/ApplicationDispatcherBootstrap.java
+++
b/flink-clients/src/main/java/org/apache/flink/client/deployment/application/ApplicationDispatcherBootstrap.java
@@ -30,7 +30,6 @@ import org.apache.flink.client.program.PackagedProgram;
import org.apache.flink.configuration.Configuration;
import org.apache.flink.configuration.PipelineOptionsInternal;
import org.apache.flink.core.execution.PipelineExecutorServiceLoader;
-import org.apache.flink.runtime.client.JobCancellationException;
import org.apache.flink.runtime.clusterframework.ApplicationStatus;
import org.apache.flink.runtime.concurrent.FutureUtils;
import org.apache.flink.runtime.concurrent.ScheduledExecutor;
@@ -42,8 +41,8 @@ import org.apache.flink.runtime.jobgraph.JobGraph;
import org.apache.flink.runtime.jobmanager.HighAvailabilityMode;
import org.apache.flink.runtime.jobmaster.JobResult;
import org.apache.flink.runtime.messages.Acknowledge;
+import org.apache.flink.runtime.rpc.FatalErrorHandler;
import org.apache.flink.util.ExceptionUtils;
-import org.apache.flink.util.SerializedThrowable;
import org.slf4j.Logger;
import org.slf4j.LoggerFactory;
@@ -52,7 +51,6 @@ import java.util.ArrayList;
import java.util.Collection;
import java.util.List;
import java.util.Optional;
-import java.util.concurrent.CancellationException;
import java.util.concurrent.CompletableFuture;
import java.util.concurrent.CompletionException;
import java.util.concurrent.ScheduledFuture;
@@ -85,6 +83,8 @@ public class ApplicationDispatcherBootstrap extends
AbstractDispatcherBootstrap
private final Configuration configuration;
+ private final FatalErrorHandler errorHandler;
+
private CompletableFuture applicationCompletionFuture;
private ScheduledFuture applicationExecutionTask;
@@ -92,10 +92,12 @@ public class ApplicationDispatcherBootstrap extends
AbstractDispatcherBootstrap
public ApplicationDispatcherBootstrap(
final PackagedProgram application,
final Collection recoveredJobs,
- final Configuration configuration) {
+ final Configuration configuration,
+ final FatalErrorHandler errorHandler) {
this.configuration = checkNotNull(configuration);
this.recoveredJobs = checkNotNull(recoveredJobs);
this.application = checkNotNull(application);
+ this.errorHandler = checkNotNull(errorHandler);
}
@Override
@@
[flink] branch application-1.11 created (now a4ae9d8)
This is an automated email from the ASF dual-hosted git repository. kkloudas pushed a change to branch application-1.11 in repository https://gitbox.apache.org/repos/asf/flink.git. at a4ae9d8 [hotfix] minor refactoring in ApplicationDispatcherBootstrap This branch includes the following new commits: new 0057edf [FLINK-19154] ApplicationDispatcherBootstrap cleans up HA data only on FAILED, CANCELLED, SUCCEEDED new e24f70b [FLINK-19154] Pass DispatcherGateway to DispatcherBootstrap new 54e8d11 [hotfix] Merge ApplicationDispatcherBootstrap#initialize() with constructor. new a4ae9d8 [hotfix] minor refactoring in ApplicationDispatcherBootstrap The 4 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference.
[flink] 01/04: [FLINK-19154] ApplicationDispatcherBootstrap cleans up HA data only on FAILED, CANCELLED, SUCCEEDED
This is an automated email from the ASF dual-hosted git repository.
kkloudas pushed a commit to branch application-1.11
in repository https://gitbox.apache.org/repos/asf/flink.git
commit 0057edf19168bd415f5c9b34e6b642c6ba460d96
Author: Kostas Kloudas
AuthorDate: Mon Oct 19 09:49:14 2020 +0200
[FLINK-19154] ApplicationDispatcherBootstrap cleans up HA data only on
FAILED, CANCELLED, SUCCEEDED
Depending on the status with which a job got terminated, we may
want to shutdown the cluster and clean up all HA data, or not. To
be able to differentiate between the different termination reasons
we add the ApplicationFailureException.
In addition, to be able to shutdown the cluster without cleaning up
the HA data, we need to be able to terminate the dispatcher's shutdown
future
with an exception. This is what the new error handler pass in the
ApplicationDispatcherBootstrap does. We chose to pass the FatalErrorHandler
as a constructor argument because this allows for more robust code.
---
.../ApplicationDispatcherBootstrap.java| 68 +++-
...ApplicationDispatcherGatewayServiceFactory.java | 6 +-
.../application/ApplicationFailureException.java | 82 +++
.../ApplicationDispatcherBootstrapTest.java| 93 +-
.../flink/runtime/dispatcher/Dispatcher.java | 11 ++-
.../runtime/dispatcher/DispatcherFactory.java | 11 ++-
.../runtime/dispatcher/JobDispatcherFactory.java | 7 +-
.../flink/runtime/dispatcher/MiniDispatcher.java | 6 +-
.../dispatcher/SessionDispatcherFactory.java | 7 +-
.../runtime/dispatcher/StandaloneDispatcher.java | 7 +-
.../DefaultDispatcherGatewayServiceFactory.java| 2 +-
.../dispatcher/DispatcherResourceCleanupTest.java | 2 +-
.../flink/runtime/dispatcher/DispatcherTest.java | 15 ++--
.../runtime/dispatcher/MiniDispatcherTest.java | 2 +-
.../runtime/dispatcher/TestingDispatcher.java | 5 +-
.../runner/DefaultDispatcherRunnerITCase.java | 6 +-
16 files changed, 218 insertions(+), 112 deletions(-)
diff --git
a/flink-clients/src/main/java/org/apache/flink/client/deployment/application/ApplicationDispatcherBootstrap.java
b/flink-clients/src/main/java/org/apache/flink/client/deployment/application/ApplicationDispatcherBootstrap.java
index 2b4ddf3..e581e29 100644
---
a/flink-clients/src/main/java/org/apache/flink/client/deployment/application/ApplicationDispatcherBootstrap.java
+++
b/flink-clients/src/main/java/org/apache/flink/client/deployment/application/ApplicationDispatcherBootstrap.java
@@ -30,7 +30,6 @@ import org.apache.flink.client.program.PackagedProgram;
import org.apache.flink.configuration.Configuration;
import org.apache.flink.configuration.PipelineOptionsInternal;
import org.apache.flink.core.execution.PipelineExecutorServiceLoader;
-import org.apache.flink.runtime.client.JobCancellationException;
import org.apache.flink.runtime.clusterframework.ApplicationStatus;
import org.apache.flink.runtime.concurrent.FutureUtils;
import org.apache.flink.runtime.concurrent.ScheduledExecutor;
@@ -42,8 +41,8 @@ import org.apache.flink.runtime.jobgraph.JobGraph;
import org.apache.flink.runtime.jobmanager.HighAvailabilityMode;
import org.apache.flink.runtime.jobmaster.JobResult;
import org.apache.flink.runtime.messages.Acknowledge;
+import org.apache.flink.runtime.rpc.FatalErrorHandler;
import org.apache.flink.util.ExceptionUtils;
-import org.apache.flink.util.SerializedThrowable;
import org.slf4j.Logger;
import org.slf4j.LoggerFactory;
@@ -52,7 +51,6 @@ import java.util.ArrayList;
import java.util.Collection;
import java.util.List;
import java.util.Optional;
-import java.util.concurrent.CancellationException;
import java.util.concurrent.CompletableFuture;
import java.util.concurrent.CompletionException;
import java.util.concurrent.ScheduledFuture;
@@ -85,6 +83,8 @@ public class ApplicationDispatcherBootstrap extends
AbstractDispatcherBootstrap
private final Configuration configuration;
+ private final FatalErrorHandler errorHandler;
+
private CompletableFuture applicationCompletionFuture;
private ScheduledFuture applicationExecutionTask;
@@ -92,10 +92,12 @@ public class ApplicationDispatcherBootstrap extends
AbstractDispatcherBootstrap
public ApplicationDispatcherBootstrap(
final PackagedProgram application,
final Collection recoveredJobs,
- final Configuration configuration) {
+ final Configuration configuration,
+ final FatalErrorHandler errorHandler) {
this.configuration = checkNotNull(configuration);
this.recoveredJobs = checkNotNull(recoveredJobs);
this.application = checkNotNull(application);
+ this.errorHandler = checkNotNull(errorHandler);
}
@Override
@@
[flink] 04/04: [hotfix] minor refactoring in ApplicationDispatcherBootstrap
This is an automated email from the ASF dual-hosted git repository.
kkloudas pushed a commit to branch application-1.11
in repository https://gitbox.apache.org/repos/asf/flink.git
commit a4ae9d8386e74d17edd0b549de537080e1a676d9
Author: Kostas Kloudas
AuthorDate: Wed Oct 21 21:00:27 2020 +0200
[hotfix] minor refactoring in ApplicationDispatcherBootstrap
---
.../ApplicationDispatcherBootstrap.java| 32 +++---
1 file changed, 16 insertions(+), 16 deletions(-)
diff --git
a/flink-clients/src/main/java/org/apache/flink/client/deployment/application/ApplicationDispatcherBootstrap.java
b/flink-clients/src/main/java/org/apache/flink/client/deployment/application/ApplicationDispatcherBootstrap.java
index 1443804..48dd704 100644
---
a/flink-clients/src/main/java/org/apache/flink/client/deployment/application/ApplicationDispatcherBootstrap.java
+++
b/flink-clients/src/main/java/org/apache/flink/client/deployment/application/ApplicationDispatcherBootstrap.java
@@ -142,28 +142,28 @@ public class ApplicationDispatcherBootstrap implements
DispatcherBootstrap {
private CompletableFuture
runApplicationAndShutdownClusterAsync(final DispatcherGateway
dispatcherGateway) {
return applicationCompletionFuture
.handle((r, t) -> {
- if (t != null) {
- final
Optional exception =
-
ExceptionUtils.findThrowable(t, ApplicationFailureException.class);
-
- if (exception.isPresent()) {
- final ApplicationStatus
applicationStatus = exception.get().getStatus();
+ if (t == null) {
+ LOG.info("Application completed
SUCCESSFULLY");
+ return
dispatcherGateway.shutDownCluster(ApplicationStatus.SUCCEEDED);
+ }
- if (applicationStatus
== ApplicationStatus.CANCELED || applicationStatus == ApplicationStatus.FAILED)
{
-
LOG.info("Application {}: ", applicationStatus, t);
- return
dispatcherGateway.shutDownCluster(applicationStatus);
- }
- }
+ final
Optional exception =
+
ExceptionUtils.findThrowable(t, ApplicationFailureException.class);
- LOG.warn("Exiting with
Application Status UNKNOWN: ", t);
-
this.errorHandler.onFatalError(new FlinkException("Application failed
unexpectedly.", t));
+ if (exception.isPresent()) {
+ final ApplicationStatus
applicationStatus = exception.get().getStatus();
- return
FutureUtils.completedExceptionally(t);
+ if (applicationStatus ==
ApplicationStatus.CANCELED || applicationStatus == ApplicationStatus.FAILED) {
+ LOG.info("Application
{}: ", applicationStatus, t);
+ return
dispatcherGateway.shutDownCluster(applicationStatus);
+ }
}
- LOG.info("Application completed
SUCCESSFULLY");
- return
dispatcherGateway.shutDownCluster(ApplicationStatus.SUCCEEDED);
+ LOG.warn("Application failed
unexpectedly: ", t);
+ this.errorHandler.onFatalError(new
FlinkException("Application failed unexpectedly.", t));
+
+ return
FutureUtils.completedExceptionally(t);
})
.thenCompose(Function.identity());
}
[flink] 02/04: [FLINK-19154] Pass DispatcherGateway to DispatcherBootstrap
This is an automated email from the ASF dual-hosted git repository.
kkloudas pushed a commit to branch application-1.11
in repository https://gitbox.apache.org/repos/asf/flink.git
commit e24f70bbc0a280a6c16c6ee976d3b3232f47c48f
Author: Kostas Kloudas
AuthorDate: Mon Oct 19 12:42:16 2020 +0200
[FLINK-19154] Pass DispatcherGateway to DispatcherBootstrap
In order to make sure that all calls from the
ApplicationDispatcherBootstrap are executed from the main
thread, we are passing the DispatcherGateway
to the Bootstrap and not the Dispatcher itself.
---
.../ApplicationDispatcherBootstrap.java| 59 ++---
...ApplicationDispatcherGatewayServiceFactory.java | 15 +++-
.../ApplicationDispatcherBootstrapTest.java| 97 --
.../dispatcher/AbstractDispatcherBootstrap.java| 46 --
.../flink/runtime/dispatcher/Dispatcher.java | 19 -
.../runtime/dispatcher/DispatcherBootstrap.java| 4 +-
.../runtime/dispatcher/DispatcherFactory.java | 3 +
.../runtime/dispatcher/JobDispatcherFactory.java | 8 ++
.../flink/runtime/dispatcher/MiniDispatcher.java | 3 +
...Bootstrap.java => NoOpDispatcherBootstrap.java} | 17 +---
.../dispatcher/SessionDispatcherFactory.java | 4 +
.../runtime/dispatcher/StandaloneDispatcher.java | 3 +
.../DefaultDispatcherGatewayServiceFactory.java| 9 +-
.../dispatcher/DispatcherResourceCleanupTest.java | 3 +-
.../flink/runtime/dispatcher/DispatcherTest.java | 14 +++-
.../runtime/dispatcher/MiniDispatcherTest.java | 4 +-
.../runtime/dispatcher/TestingDispatcher.java | 4 +
.../runner/DefaultDispatcherRunnerITCase.java | 2 +
18 files changed, 176 insertions(+), 138 deletions(-)
diff --git
a/flink-clients/src/main/java/org/apache/flink/client/deployment/application/ApplicationDispatcherBootstrap.java
b/flink-clients/src/main/java/org/apache/flink/client/deployment/application/ApplicationDispatcherBootstrap.java
index e581e29..a817048 100644
---
a/flink-clients/src/main/java/org/apache/flink/client/deployment/application/ApplicationDispatcherBootstrap.java
+++
b/flink-clients/src/main/java/org/apache/flink/client/deployment/application/ApplicationDispatcherBootstrap.java
@@ -33,8 +33,6 @@ import
org.apache.flink.core.execution.PipelineExecutorServiceLoader;
import org.apache.flink.runtime.clusterframework.ApplicationStatus;
import org.apache.flink.runtime.concurrent.FutureUtils;
import org.apache.flink.runtime.concurrent.ScheduledExecutor;
-import org.apache.flink.runtime.dispatcher.AbstractDispatcherBootstrap;
-import org.apache.flink.runtime.dispatcher.Dispatcher;
import org.apache.flink.runtime.dispatcher.DispatcherBootstrap;
import org.apache.flink.runtime.dispatcher.DispatcherGateway;
import org.apache.flink.runtime.jobgraph.JobGraph;
@@ -43,6 +41,7 @@ import org.apache.flink.runtime.jobmaster.JobResult;
import org.apache.flink.runtime.messages.Acknowledge;
import org.apache.flink.runtime.rpc.FatalErrorHandler;
import org.apache.flink.util.ExceptionUtils;
+import org.apache.flink.util.FlinkException;
import org.slf4j.Logger;
import org.slf4j.LoggerFactory;
@@ -71,7 +70,7 @@ import static
org.apache.flink.util.Preconditions.checkNotNull;
* if it should submit a job for execution (in case of a new job) or the job
was already recovered and is running.
*/
@Internal
-public class ApplicationDispatcherBootstrap extends
AbstractDispatcherBootstrap {
+public class ApplicationDispatcherBootstrap implements DispatcherBootstrap {
private static final Logger LOG =
LoggerFactory.getLogger(ApplicationDispatcherBootstrap.class);
@@ -79,7 +78,7 @@ public class ApplicationDispatcherBootstrap extends
AbstractDispatcherBootstrap
private final PackagedProgram application;
- private final Collection recoveredJobs;
+ private final Collection recoveredJobIds;
private final Configuration configuration;
@@ -91,22 +90,21 @@ public class ApplicationDispatcherBootstrap extends
AbstractDispatcherBootstrap
public ApplicationDispatcherBootstrap(
final PackagedProgram application,
- final Collection recoveredJobs,
+ final Collection recoveredJobIds,
final Configuration configuration,
final FatalErrorHandler errorHandler) {
this.configuration = checkNotNull(configuration);
- this.recoveredJobs = checkNotNull(recoveredJobs);
+ this.recoveredJobIds = checkNotNull(recoveredJobIds);
this.application = checkNotNull(application);
this.errorHandler = checkNotNull(errorHandler);
}
@Override
- public void initialize(final Dispatcher dispatcher, ScheduledExecutor
scheduledExecutor) {
- checkNotNull(dispatcher);
- launchRecoveredJobGraphs(dispatcher,
[flink] 03/04: [hotfix] Merge ApplicationDispatcherBootstrap#initialize() with constructor.
This is an automated email from the ASF dual-hosted git repository.
kkloudas pushed a commit to branch application-1.11
in repository https://gitbox.apache.org/repos/asf/flink.git
commit 54e8d11d67d8a6a3ebd3da6c2503a2d26dba6924
Author: Kostas Kloudas
AuthorDate: Wed Oct 21 20:55:44 2020 +0200
[hotfix] Merge ApplicationDispatcherBootstrap#initialize() with constructor.
---
.../ApplicationDispatcherBootstrap.java| 38 +-
...ApplicationDispatcherGatewayServiceFactory.java | 3 +-
.../ApplicationDispatcherBootstrapTest.java| 84 --
.../flink/runtime/dispatcher/Dispatcher.java | 10 +--
.../runtime/dispatcher/DispatcherBootstrap.java| 13 +---
...tstrap.java => DispatcherBootstrapFactory.java} | 23 ++
.../runtime/dispatcher/DispatcherFactory.java | 4 +-
.../runtime/dispatcher/JobDispatcherFactory.java | 4 +-
.../flink/runtime/dispatcher/MiniDispatcher.java | 4 +-
.../dispatcher/NoOpDispatcherBootstrap.java| 6 --
.../dispatcher/SessionDispatcherFactory.java | 4 +-
.../runtime/dispatcher/StandaloneDispatcher.java | 4 +-
.../DefaultDispatcherGatewayServiceFactory.java| 2 +-
.../dispatcher/DispatcherResourceCleanupTest.java | 2 +-
.../flink/runtime/dispatcher/DispatcherTest.java | 7 +-
.../runtime/dispatcher/MiniDispatcherTest.java | 2 +-
.../runtime/dispatcher/TestingDispatcher.java | 3 +-
.../runner/DefaultDispatcherRunnerITCase.java | 6 +-
18 files changed, 97 insertions(+), 122 deletions(-)
diff --git
a/flink-clients/src/main/java/org/apache/flink/client/deployment/application/ApplicationDispatcherBootstrap.java
b/flink-clients/src/main/java/org/apache/flink/client/deployment/application/ApplicationDispatcherBootstrap.java
index a817048..1443804 100644
---
a/flink-clients/src/main/java/org/apache/flink/client/deployment/application/ApplicationDispatcherBootstrap.java
+++
b/flink-clients/src/main/java/org/apache/flink/client/deployment/application/ApplicationDispatcherBootstrap.java
@@ -84,7 +84,9 @@ public class ApplicationDispatcherBootstrap implements
DispatcherBootstrap {
private final FatalErrorHandler errorHandler;
- private CompletableFuture applicationCompletionFuture;
+ private final CompletableFuture applicationCompletionFuture;
+
+ private final CompletableFuture clusterShutdownFuture;
private ScheduledFuture applicationExecutionTask;
@@ -92,20 +94,19 @@ public class ApplicationDispatcherBootstrap implements
DispatcherBootstrap {
final PackagedProgram application,
final Collection recoveredJobIds,
final Configuration configuration,
+ final DispatcherGateway dispatcherGateway,
+ final ScheduledExecutor scheduledExecutor,
final FatalErrorHandler errorHandler) {
this.configuration = checkNotNull(configuration);
this.recoveredJobIds = checkNotNull(recoveredJobIds);
this.application = checkNotNull(application);
this.errorHandler = checkNotNull(errorHandler);
- }
- @Override
- public void initialize(final DispatcherGateway dispatcherGateway,
ScheduledExecutor scheduledExecutor) {
- checkNotNull(dispatcherGateway);
+ this.applicationCompletionFuture =
+
fixJobIdAndRunApplicationAsync(dispatcherGateway, scheduledExecutor);
- runApplicationAndShutdownClusterAsync(
- dispatcherGateway,
- scheduledExecutor);
+ this.clusterShutdownFuture =
+
runApplicationAndShutdownClusterAsync(dispatcherGateway);
}
@Override
@@ -124,17 +125,21 @@ public class ApplicationDispatcherBootstrap implements
DispatcherBootstrap {
return applicationExecutionTask;
}
+ @VisibleForTesting
+ CompletableFuture getApplicationCompletionFuture() {
+ return applicationCompletionFuture;
+ }
+
+ @VisibleForTesting
+ CompletableFuture getClusterShutdownFuture() {
+ return clusterShutdownFuture;
+ }
+
/**
* Runs the user program entrypoint and shuts down the given
dispatcherGateway when
* the application completes (either successfully or in case of
failure).
*/
- @VisibleForTesting
- CompletableFuture runApplicationAndShutdownClusterAsync(
- final DispatcherGateway dispatcherGateway,
- final ScheduledExecutor scheduledExecutor) {
-
- applicationCompletionFuture =
fixJobIdAndRunApplicationAsync(dispatcherGateway, scheduledExecutor);
-
+ private CompletableFuture
runApplicationAndShutdownClusterAsync(final DispatcherGateway
dispatcherGateway)
[flink] branch application-1.11 created (now a4ae9d8)
This is an automated email from the ASF dual-hosted git repository. kkloudas pushed a change to branch application-1.11 in repository https://gitbox.apache.org/repos/asf/flink.git. at a4ae9d8 [hotfix] minor refactoring in ApplicationDispatcherBootstrap This branch includes the following new commits: new 0057edf [FLINK-19154] ApplicationDispatcherBootstrap cleans up HA data only on FAILED, CANCELLED, SUCCEEDED new e24f70b [FLINK-19154] Pass DispatcherGateway to DispatcherBootstrap new 54e8d11 [hotfix] Merge ApplicationDispatcherBootstrap#initialize() with constructor. new a4ae9d8 [hotfix] minor refactoring in ApplicationDispatcherBootstrap The 4 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference.
[flink] branch master updated (4b6d0e6 -> 0184672)
This is an automated email from the ASF dual-hosted git repository. arvid pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git. from 4b6d0e6 [FLINK-19068][k8s] Improve log readability against duplicated pod termination events. add 46bcf38 [tests][network][refactor] Extract NettyServerAndClient.getConnectionID add 086fc01 [FLINK-19791][network][test] Connect to an opened port instead of 8080 add 0184672 [refactor][tests][network] Cleanup PartitionRequestClientFactoryTest No new revisions were added by this update. Summary of changes: .../runtime/io/network/netty/NettyTestUtil.java| 8 +++ .../netty/PartitionRequestClientFactoryTest.java | 83 -- 2 files changed, 38 insertions(+), 53 deletions(-)
[flink] branch master updated (4b6d0e6 -> 0184672)
This is an automated email from the ASF dual-hosted git repository. arvid pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git. from 4b6d0e6 [FLINK-19068][k8s] Improve log readability against duplicated pod termination events. add 46bcf38 [tests][network][refactor] Extract NettyServerAndClient.getConnectionID add 086fc01 [FLINK-19791][network][test] Connect to an opened port instead of 8080 add 0184672 [refactor][tests][network] Cleanup PartitionRequestClientFactoryTest No new revisions were added by this update. Summary of changes: .../runtime/io/network/netty/NettyTestUtil.java| 8 +++ .../netty/PartitionRequestClientFactoryTest.java | 83 -- 2 files changed, 38 insertions(+), 53 deletions(-)
[flink] branch master updated (4b6d0e6 -> 0184672)
This is an automated email from the ASF dual-hosted git repository. arvid pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git. from 4b6d0e6 [FLINK-19068][k8s] Improve log readability against duplicated pod termination events. add 46bcf38 [tests][network][refactor] Extract NettyServerAndClient.getConnectionID add 086fc01 [FLINK-19791][network][test] Connect to an opened port instead of 8080 add 0184672 [refactor][tests][network] Cleanup PartitionRequestClientFactoryTest No new revisions were added by this update. Summary of changes: .../runtime/io/network/netty/NettyTestUtil.java| 8 +++ .../netty/PartitionRequestClientFactoryTest.java | 83 -- 2 files changed, 38 insertions(+), 53 deletions(-)
[flink] branch master updated (4b6d0e6 -> 0184672)
This is an automated email from the ASF dual-hosted git repository. arvid pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git. from 4b6d0e6 [FLINK-19068][k8s] Improve log readability against duplicated pod termination events. add 46bcf38 [tests][network][refactor] Extract NettyServerAndClient.getConnectionID add 086fc01 [FLINK-19791][network][test] Connect to an opened port instead of 8080 add 0184672 [refactor][tests][network] Cleanup PartitionRequestClientFactoryTest No new revisions were added by this update. Summary of changes: .../runtime/io/network/netty/NettyTestUtil.java| 8 +++ .../netty/PartitionRequestClientFactoryTest.java | 83 -- 2 files changed, 38 insertions(+), 53 deletions(-)
[flink] branch master updated (4b6d0e6 -> 0184672)
This is an automated email from the ASF dual-hosted git repository. arvid pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git. from 4b6d0e6 [FLINK-19068][k8s] Improve log readability against duplicated pod termination events. add 46bcf38 [tests][network][refactor] Extract NettyServerAndClient.getConnectionID add 086fc01 [FLINK-19791][network][test] Connect to an opened port instead of 8080 add 0184672 [refactor][tests][network] Cleanup PartitionRequestClientFactoryTest No new revisions were added by this update. Summary of changes: .../runtime/io/network/netty/NettyTestUtil.java| 8 +++ .../netty/PartitionRequestClientFactoryTest.java | 83 -- 2 files changed, 38 insertions(+), 53 deletions(-)
