Repository: flink
Updated Branches:
refs/heads/master 5783671c2 -> f6d866817
[FLINK-4373] [cluster management] Introduce AllocationID, ResourceProfile, and
AllocatedSlot
These classes are introduced as part of the cluster management rework.
This closes #2630
Project:
Repository: flink
Updated Branches:
refs/heads/master fd410d9f6 -> 5783671c2
[FLINK-4717] Add CancelJobWithSavepoint
- Adds CancelJobWithSavepoint message, which triggers a savepoint
before cancelling the respective job.
- Adds -s [targetDirectory] option to CLI cancel command:
*
http://git-wip-us.apache.org/repos/asf/flink/blob/fd410d9f/flink-runtime/src/main/java/org/apache/flink/runtime/checkpoint/savepoint/SavepointStoreFactory.java
--
diff --git
http://git-wip-us.apache.org/repos/asf/flink/blob/fd410d9f/flink-runtime-web/web-dashboard/web/js/index.js
--
diff --git a/flink-runtime-web/web-dashboard/web/js/index.js
b/flink-runtime-web/web-dashboard/web/js/index.js
index
[FLINK-4512] [FLIP-10] Add option to persist periodic checkpoints
[FLINK-4509] [FLIP-10] Specify savepoint directory per savepoint
[FLINK-4507] [FLIP-10] Deprecate savepoint backend config
This closes #2608.
Project: http://git-wip-us.apache.org/repos/asf/flink/repo
Commit:
http://git-wip-us.apache.org/repos/asf/flink/blob/fd410d9f/flink-runtime/src/test/java/org/apache/flink/runtime/checkpoint/CompletedCheckpointStoreTest.java
--
diff --git
http://git-wip-us.apache.org/repos/asf/flink/blob/fd410d9f/flink-runtime-web/web-dashboard/web/partials/jobs/job.plan.node.checkpoints.job.html
--
diff --git
Repository: flink
Updated Branches:
refs/heads/master c7d1a3b8d -> fd410d9f6
http://git-wip-us.apache.org/repos/asf/flink/blob/fd410d9f/flink-streaming-java/src/main/java/org/apache/flink/streaming/api/environment/CheckpointConfig.java
http://git-wip-us.apache.org/repos/asf/flink/blob/fd410d9f/flink-runtime-web/web-dashboard/web/js/vendor.js
--
diff --git a/flink-runtime-web/web-dashboard/web/js/vendor.js
b/flink-runtime-web/web-dashboard/web/js/vendor.js
index
The Buildbot has detected a new failure on builder flink-docs-release-0.10
while building . Full details are available at:
https://ci.apache.org/builders/flink-docs-release-0.10/builds/361
Buildbot URL: https://ci.apache.org/
Buildslave for this Build: bb_slave2_ubuntu
Build Reason: The
The Buildbot has detected a restored build on builder flink-docs-release-0.9
while building . Full details are available at:
https://ci.apache.org/builders/flink-docs-release-0.9/builds/476
Buildbot URL: https://ci.apache.org/
Buildslave for this Build: bb_slave3_ubuntu
Build Reason: The
[hotfix] fix ResourceManagerGateway
Project: http://git-wip-us.apache.org/repos/asf/flink/repo
Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/c6954a94
Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/c6954a94
Diff: http://git-wip-us.apache.org/repos/asf/flink/diff/c6954a94
Repository: flink
Updated Branches:
refs/heads/master a612b9966 -> 436c3335b
[hotfix] Fix ArchivedExecutionGraphTest
Project: http://git-wip-us.apache.org/repos/asf/flink/repo
Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/436c3335
Tree:
Repository: flink
Updated Branches:
refs/heads/master 5dc624bf8 -> 85b53444a
[FLINK-4564] [metrics] Configurable delimiter per reporter
This closes #2517.
Project: http://git-wip-us.apache.org/repos/asf/flink/repo
Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/85b53444
Tree:
[FLINK-3660] Measure latency and exposes them via a metric
This commit adds the initial runtime support for measuring latency of records
going through the system.
I therefore introduced a new StreamElement, called a LatencyMarker.
Similar to Watermarks, LatencyMarkers are emitted from the
Repository: flink
Updated Branches:
refs/heads/master a648f88fb -> a612b9966
http://git-wip-us.apache.org/repos/asf/flink/blob/a612b996/flink-streaming-java/src/test/java/org/apache/flink/streaming/runtime/operators/StreamSourceOperatorTest.java
Repository: flink
Updated Branches:
refs/heads/master 436c3335b -> 5dc624bf8
[FLINK-3660][hotfix] Add missing default value in ConfigConstants
Project: http://git-wip-us.apache.org/repos/asf/flink/repo
Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/5dc624bf
Tree:
[FLINK-4657] Implement HighAvailabilityServices based on ZooKeeper
[FLINK-4657] Implement a few rpc calls for JobMaster
[FLINK-4657][cluster management] Address review comments
[FLINK-4657][cluster management] Throw exception when error occurred when
request input split
Project:
[FLINK-4720] Implement archived ExecutionGraph
This closes #2577.
Project: http://git-wip-us.apache.org/repos/asf/flink/repo
Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/21e8e2dc
Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/21e8e2dc
Diff:
Repository: flink
Updated Branches:
refs/heads/master f6d866817 -> 21e8e2dcf
http://git-wip-us.apache.org/repos/asf/flink/blob/21e8e2dc/flink-runtime/src/test/java/org/apache/flink/runtime/executiongraph/ArchivedExecutionGraphTest.java
http://git-wip-us.apache.org/repos/asf/flink/blob/21e8e2dc/flink-runtime/src/main/java/org/apache/flink/runtime/executiongraph/AccessExecutionVertex.java
--
diff --git
Repository: flink
Updated Branches:
refs/heads/master 9948d4844 -> a648f88fb
[FLINK-4827] [docs] Fix scala Streaming Table example
This closes #2632.
Project: http://git-wip-us.apache.org/repos/asf/flink/repo
Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/a648f88f
Tree:
[FLINK-4529] [flip-6] Move TaskExecutor, JobMaster and ResourceManager out of
the rpc package
The TaskExecutor, the JobMaster and the ResourceManager were still contained in
the rpc
package. With this commit, they will be moved out of this package. Now they are
contained
in dedicated packages
[FLINK-4505] [cluster mngt] Implement TaskManager component's startup
The TaskManagerRunner now contains the startup logic for the TaskManager's
components.
Project: http://git-wip-us.apache.org/repos/asf/flink/repo
Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/c34f13c2
Tree:
http://git-wip-us.apache.org/repos/asf/flink/blob/9c247d1f/flink-runtime/src/test/java/org/apache/flink/runtime/clusterframework/SlotManagerTest.java
--
diff --git
[FLINK-4516] leader election of resourcemanager
- add serial rpc service
- add a special rpcService implementation which directly executes the
asynchronous calls serially one by one, it is just for testcase
- Change ResourceManagerLeaderContender code and TestingSerialRpcService code
- override
[hotfix] Remove unused imports from SlotRequestRegistered/Rejected and
ResourceSlot
Project: http://git-wip-us.apache.org/repos/asf/flink/repo
Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/b2c5c0fd
Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/b2c5c0fd
Diff:
http://git-wip-us.apache.org/repos/asf/flink/blob/9c247d1f/flink-runtime/src/main/java/org/apache/flink/runtime/resourcemanager/SlotRequest.java
--
diff --git
[FLINK-4535] rebase and refine
Project: http://git-wip-us.apache.org/repos/asf/flink/repo
Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/485ef003
Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/485ef003
Diff: http://git-wip-us.apache.org/repos/asf/flink/diff/485ef003
[FLINK-4339] [cluster management] Implement Slot Pool core on JobManager side
Project: http://git-wip-us.apache.org/repos/asf/flink/repo
Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/7aca811d
Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/7aca811d
Diff:
[hotfix] Add methods defined in the gateway to the ResourceManager and
TaskExecutor
Project: http://git-wip-us.apache.org/repos/asf/flink/repo
Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/fbd38671
Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/fbd38671
Diff:
[FLINK-3932] Added ZK ACL configuration for secure cluster setup
This closes #2589.
Project: http://git-wip-us.apache.org/repos/asf/flink/repo
Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/5bd47012
Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/5bd47012
Diff:
Repository: flink
Updated Branches:
refs/heads/master 85b53444a -> 6d4dd7585
[FLINK-4667] Fix for using correct ZK namespace in Yarn deployment
Project: http://git-wip-us.apache.org/repos/asf/flink/repo
Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/6d4dd758
Tree:
[FLINK-4406] [cluster management] Implement job master registration at resource
manager
[FLINK-4406] [cluster management] Skip new connection if new resource manager's
address and leader id are both not changing
[FLINK-4406] [cluster management] Verify registration response with leader id
http://git-wip-us.apache.org/repos/asf/flink/blob/74570d45/flink-runtime/src/test/java/org/apache/flink/runtime/resourcemanager/SlotManagerTest.java
--
diff --git
[FLINK-4687] [rpc] Add getAddress to RpcService
This closes #2551.
Project: http://git-wip-us.apache.org/repos/asf/flink/repo
Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/07512e06
Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/07512e06
Diff:
[FLINK-4580] [rpc] Report rpc invocation exceptions to the caller
This closes #2526.
Project: http://git-wip-us.apache.org/repos/asf/flink/repo
Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/59d9e67b
Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/59d9e67b
Diff:
[FLINK-4746] Make TaskManagerRuntimeInfo an interface
Let the TaskManagerConfiguration implement the TaskManagerRuntimeInformation to
make some of
the TaskManager's configuration values accessible from different components.
This closes #2599.
Project:
[FLINK-4537] rebase and refine
Project: http://git-wip-us.apache.org/repos/asf/flink/repo
Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/34a6854b
Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/34a6854b
Diff: http://git-wip-us.apache.org/repos/asf/flink/diff/34a6854b
[FLINK-4347][FLINK-4348] simplify SlotManager and integrate it with
ResourceManager
Instead of relying on a full synchronization of all slots information on
every heartbeat, the SlotManager is now responsible for updating its
state. It initially syncs all slots upon registration of the
[hotfix] Replace TaskManager.createTaskManagerComponents by TaskManagerServices
Project: http://git-wip-us.apache.org/repos/asf/flink/repo
Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/bce292ae
Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/bce292ae
Diff:
[FLINK-4735] [cluster management] Implements some job execution related RPC
calls on the JobManager
Project: http://git-wip-us.apache.org/repos/asf/flink/repo
Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/041dfd78
Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/041dfd78
http://git-wip-us.apache.org/repos/asf/flink/blob/9c247d1f/flink-runtime/src/main/java/org/apache/flink/runtime/taskexecutor/TaskExecutor.java
--
diff --git
http://git-wip-us.apache.org/repos/asf/flink/blob/9c247d1f/flink-runtime/src/test/java/org/apache/flink/runtime/resourcemanager/SlotManagerTest.java
--
diff --git
[FLINK-4530] [rpc] Generalize TaskExecutorToResourceManagerConnection to be
reusable
This closes #2520
Project: http://git-wip-us.apache.org/repos/asf/flink/repo
Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/b8c6b998
Tree:
[FLINK-4606] integrate features of old ResourceManager
This closes #2540
Project: http://git-wip-us.apache.org/repos/asf/flink/repo
Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/1f198d8c
Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/1f198d8c
Diff:
[FLINK-4703] RpcCompletenessTest: Add support for type arguments and subclasses
This closes #2561
Project: http://git-wip-us.apache.org/repos/asf/flink/repo
Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/6e58ebf2
Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/6e58ebf2
Repository: flink
Updated Branches:
refs/heads/flip-6 48c936eed -> 7aca811df (forced update)
[FLINK-4347][cluster management] Implement SlotManager core
This closes #2388
Project: http://git-wip-us.apache.org/repos/asf/flink/repo
Commit:
[FLINK-4478] [flip-6] Add HeartbeatManager
Add a heartbeat manager abstraction which can monitor heartbeat targets.
Whenever
no heartbeat signal has been received for a heartbeat timeout interval, the
heartbeat manager will issue a heartbeat timeout notification.
Add resourceID to
[FLINK-4408] [JobManager] Introduce JobMasterRunner and implement job
submission & setting up the ExecutionGraph
This closes #2480
Project: http://git-wip-us.apache.org/repos/asf/flink/repo
Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/360eaf8a
Tree:
[FLINK-4606] Integrate the new ResourceManager with the existed
FlinkResourceManager
Project: http://git-wip-us.apache.org/repos/asf/flink/repo
Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/415af17f
Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/415af17f
Diff:
[hotfix] Fix failing JobManagerRunnerMockTest
Project: http://git-wip-us.apache.org/repos/asf/flink/repo
Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/30517da9
Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/30517da9
Diff:
[FLINK-4516] update leadership information in ResourceManager
The leadership information remained static for connected
JobMasters. This updates it to remove stale JobMasters when they lose
leadership status.
This closes #2624
Project: http://git-wip-us.apache.org/repos/asf/flink/repo
Commit:
[FLINK-4656] [rpc] Port the existing code to Flink's own future abstraction
This closes #2530.
Project: http://git-wip-us.apache.org/repos/asf/flink/repo
Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/507e86cf
Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/507e86cf
Diff:
[FLINK-4658] [rpc] Allow RpcService to execute Runnables and Callables in its
executor
This closes #2531.
Project: http://git-wip-us.apache.org/repos/asf/flink/repo
Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/f4dc4741
Tree:
http://git-wip-us.apache.org/repos/asf/flink/blob/0615b62f/flink-runtime/src/main/java/org/apache/flink/runtime/jobmaster/JobMaster.java
--
diff --git
[FLINK-4738] [TaskManager] Port TaskManager logic to new Flip-6 TaskManager
The ported logic contains the task lifecycle management methods, JobManager
association and
setup of TaskManager components.
Introduce Rpc implementations for TaskManager components
Implement metrics setup
Move more
http://git-wip-us.apache.org/repos/asf/flink/blob/0615b62f/flink-runtime/src/main/java/org/apache/flink/runtime/taskexecutor/TaskExecutor.java
--
diff --git
http://git-wip-us.apache.org/repos/asf/flink/blob/5915613d/flink-runtime/src/test/java/org/apache/flink/runtime/resourcemanager/ResourceManagerJobMasterTest.java
--
diff --git
[FLINK-4451] [rpc] Throw RpcConnectionException when rpc endpoint is not
reachable
This PR introduces a RpcConnectionException which is thrown if the rpc endpoint
is not reachable when calling RpcService.connect.
This closes #2405.
Project: http://git-wip-us.apache.org/repos/asf/flink/repo
http://git-wip-us.apache.org/repos/asf/flink/blob/9c247d1f/flink-runtime/src/main/java/org/apache/flink/runtime/rpc/taskexecutor/TaskExecutor.java
--
diff --git
[FLINK-4538][FLINK-4348] ResourceManager slot allocation protcol
- associates JobMasters with JobID instead of InstanceID
- adds TaskExecutorGateway to slot
- adds SlotManager as RM constructor parameter
- adds LeaderRetrievalListener to SlotManager to keep track of the leader id
- tests the
[FLINK-4694] [rpc] Add termination futures to RpcEndpoint and RpcService
The termination futures can be used to wait for the termination of the
respective component.
This closes #2558.
Project: http://git-wip-us.apache.org/repos/asf/flink/repo
Commit:
[FLINK-4375] [distributed coordination] Implement new JobManager creation,
initialization, and basic RPC methods
Project: http://git-wip-us.apache.org/repos/asf/flink/repo
Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/0615b62f
Tree:
[FLINK-4535] [cluster management] resourceManager process the registration from
TaskExecutor
Project: http://git-wip-us.apache.org/repos/asf/flink/repo
Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/c9764c8f
Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/c9764c8f
Diff:
http://git-wip-us.apache.org/repos/asf/flink/blob/bb781aef/flink-runtime/src/main/java/org/apache/flink/runtime/taskmanager/TaskManagerRunner.java
--
diff --git
[FLINK-4505] [cluster mngt] Separate TaskManager service configuration from
TaskManagerConfiguration; Implement TaskManagerRunner
Refactors the startup logic so that is easier to reuse.
This closes #2461.
Project: http://git-wip-us.apache.org/repos/asf/flink/repo
Commit:
Repository: flink-web
Updated Branches:
refs/heads/asf-site a283d1701 -> 7491f2a53
[FLINK-4593] Fix PageRank algorithm example
This closes #35
Project: http://git-wip-us.apache.org/repos/asf/flink-web/repo
Commit: http://git-wip-us.apache.org/repos/asf/flink-web/commit/86d7ae0d
Tree:
Rebuild website
Project: http://git-wip-us.apache.org/repos/asf/flink-web/repo
Commit: http://git-wip-us.apache.org/repos/asf/flink-web/commit/7491f2a5
Tree: http://git-wip-us.apache.org/repos/asf/flink-web/tree/7491f2a5
Diff: http://git-wip-us.apache.org/repos/asf/flink-web/diff/7491f2a5
69 matches
Mail list logo
