[1/2] flink git commit: [hotfix] [rpc] Add RpcConnectionTest to validate that connection buildup fails fast when endpoint is unreachable.

2016-09-26 Thread sewen
Repository: flink Updated Branches: refs/heads/flip-6 fdeda082f -> 3cda59339 [hotfix] [rpc] Add RpcConnectionTest to validate that connection buildup fails fast when endpoint is unreachable. Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos

[2/2] flink git commit: [FLINK-4408] [JobManager] Introduce JobMasterRunner and implement job submission & setting up the ExecutionGraph

2016-09-26 Thread sewen
[FLINK-4408] [JobManager] Introduce JobMasterRunner and implement job submission & setting up the ExecutionGraph This closes #2480 Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/3cda5933 Tree: http://git-wip-us.apache.org/r

flink git commit: [FLINK-4672] [taskmanager] Do not decorate Actor Kill messages

2016-09-26 Thread sewen
Repository: flink Updated Branches: refs/heads/release-1.1 62c666f57 -> caa0fbb21 [FLINK-4672] [taskmanager] Do not decorate Actor Kill messages Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/caa0fbb2 Tree: http://git-wip

[2/2] flink git commit: [FLINK-4672] [taskmanager] Do not decorate Actor Kill messages

2016-09-26 Thread sewen
[FLINK-4672] [taskmanager] Do not decorate Actor Kill messages Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/6f237cfe Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/6f237cfe Diff: http://git-wip-us.apache.org/repos/

[1/2] flink git commit: [FLINK-4218] [checkpoints] Do not rely on FileSystem to determing state sizes

2016-09-26 Thread sewen
Repository: flink Updated Branches: refs/heads/master 28ff5a3c9 -> 95e9004e3 [FLINK-4218] [checkpoints] Do not rely on FileSystem to determing state sizes This prevents failures on eventually consistent S3, where the operations for keys (=entries in the parent directory/bucket) are not guarant

flink git commit: [FLINK-4684] [checkpoints] Remove redundant class loader from CheckpointCoordinator

2016-09-26 Thread sewen
Repository: flink Updated Branches: refs/heads/master 8fa313c39 -> 70e71c161 [FLINK-4684] [checkpoints] Remove redundant class loader from CheckpointCoordinator Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/70e71c16 Tre

flink git commit: [FLINK-4530] [rpc] Generalize TaskExecutorToResourceManagerConnection to be reusable

2016-09-27 Thread sewen
Repository: flink Updated Branches: refs/heads/flip-6 93775cef6 -> ed5c83dc2 [FLINK-4530] [rpc] Generalize TaskExecutorToResourceManagerConnection to be reusable This closes #2520 Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink

[1/3] flink git commit: [hotfix] [tests] Speed up streaming state tests by skipping default retry delay.

2016-09-27 Thread sewen
Repository: flink Updated Branches: refs/heads/master e5d62da2c -> 6e123d287 [hotfix] [tests] Speed up streaming state tests by skipping default retry delay. Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/6e123d28 Tree: h

[3/3] flink git commit: [FLINK-4696] [core] Limit number of Akka threads in local minicluster setups

2016-09-27 Thread sewen
[FLINK-4696] [core] Limit number of Akka threads in local minicluster setups Since Flink uses a rather small number of actors, not too many actor dispatcher threads are needed. To prevent mini cluster setups on multi-core CPUs (32 or 64 cores) to spawn too many threads, this limits the number of

[2/3] flink git commit: [FLINK-4685] [checkpoints] Gather sync/async duration and alignment information for task checkpoints

2016-09-27 Thread sewen
[FLINK-4685] [checkpoints] Gather sync/async duration and alignment information for task checkpoints This adds to each 'acknowledge checkpoint' message - number of bytes buffered during alignment - duration of alignment phase - duration of synchronous part of the operator checkpoint - dur

[1/2] flink git commit: [FLINK-4543] [network] Fix potential deadlock in SpilledSubpartitionViewAsyncIO.

2016-09-27 Thread sewen
Repository: flink Updated Branches: refs/heads/master f1b5b35f5 -> 90902914a [FLINK-4543] [network] Fix potential deadlock in SpilledSubpartitionViewAsyncIO. The deadlock could occur in cases where the SpilledSubpartitionViewAsyncIO would simultaneously try to release a buffer and encounter a

[2/2] flink git commit: [FLINK-4560] [build] Enforcer Java version >= 1.7 via Maven enforcer plugin

2016-09-27 Thread sewen
[FLINK-4560] [build] Enforcer Java version >= 1.7 via Maven enforcer plugin This closes #2458 Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/b928935b Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/b928935b Diff: htt

[1/2] flink git commit: [FLINK-4708] [build] Properly scope Kerberos Test Cluster dependency for tests

2016-09-29 Thread sewen
Repository: flink Updated Branches: refs/heads/master 62d4af881 -> 8243138c3 [FLINK-4708] [build] Properly scope Kerberos Test Cluster dependency for tests Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/8243138c Tree: htt

[2/2] flink git commit: [FLINK-4710] [build] Remove Guice Dependency from Hadoop2

2016-09-29 Thread sewen
[FLINK-4710] [build] Remove Guice Dependency from Hadoop2 This dependency is transitively pulled, but not necessary for the parts of the Hadoop libraries used by Flink. Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/84af0b90

[03/10] flink git commit: [FLINK-4379] [checkpoints] Introduce rescalable operator state

2016-09-30 Thread sewen
http://git-wip-us.apache.org/repos/asf/flink/blob/53ed6ada/flink-streaming-java/src/main/java/org/apache/flink/streaming/api/operators/AbstractStreamOperator.java -- diff --git a/flink-streaming-java/src/main/java/org/apache/flink

[10/10] flink git commit: [FLINK-4379] [checkpoints] Fix minor bug and improve debug logging

2016-09-30 Thread sewen
[FLINK-4379] [checkpoints] Fix minor bug and improve debug logging Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/6f8f5eb3 Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/6f8f5eb3 Diff: http://git-wip-us.apache.org/re

[09/10] flink git commit: [FLINK-4702] [kafka connector] Commit offsets to Kafka asynchronously and don't block on polls

2016-09-30 Thread sewen
[FLINK-4702] [kafka connector] Commit offsets to Kafka asynchronously and don't block on polls Letting the Kafka commit block on polls means that 'notifyCheckpointComplete()' may take very long. This is mostly relevant for low-throughput Kafka topics. Project: http://git-wip-us.apache.org/repo

[02/10] flink git commit: [FLINK-4379] [checkpoints] Introduce rescalable operator state

2016-09-30 Thread sewen
http://git-wip-us.apache.org/repos/asf/flink/blob/53ed6ada/flink-streaming-java/src/test/java/org/apache/flink/streaming/runtime/tasks/StreamMockEnvironment.java -- diff --git a/flink-streaming-java/src/test/java/org/apache/flink/

[04/10] flink git commit: [FLINK-4379] [checkpoints] Introduce rescalable operator state

2016-09-30 Thread sewen
http://git-wip-us.apache.org/repos/asf/flink/blob/53ed6ada/flink-runtime/src/test/java/org/apache/flink/runtime/state/StateBackendTestBase.java -- diff --git a/flink-runtime/src/test/java/org/apache/flink/runtime/state/StateBacken

[05/10] flink git commit: [FLINK-4379] [checkpoints] Introduce rescalable operator state

2016-09-30 Thread sewen
http://git-wip-us.apache.org/repos/asf/flink/blob/53ed6ada/flink-runtime/src/test/java/org/apache/flink/runtime/checkpoint/CheckpointCoordinatorTest.java -- diff --git a/flink-runtime/src/test/java/org/apache/flink/runtime/checkpo

[07/10] flink git commit: [FLINK-4379] [checkpoints] Introduce rescalable operator state

2016-09-30 Thread sewen
http://git-wip-us.apache.org/repos/asf/flink/blob/53ed6ada/flink-runtime/src/main/java/org/apache/flink/runtime/checkpoint/TaskState.java -- diff --git a/flink-runtime/src/main/java/org/apache/flink/runtime/checkpoint/TaskState.ja

[08/10] flink git commit: [FLINK-4379] [checkpoints] Introduce rescalable operator state

2016-09-30 Thread sewen
[FLINK-4379] [checkpoints] Introduce rescalable operator state This introduces the Operator State Backend, which stores state that is not partitioned by a key. It replaces the 'Checkpointed' interface. Additionally, this introduces CheckpointStateHandles as container for all checkpoint related

[06/10] flink git commit: [FLINK-4379] [checkpoints] Introduce rescalable operator state

2016-09-30 Thread sewen
http://git-wip-us.apache.org/repos/asf/flink/blob/53ed6ada/flink-runtime/src/main/java/org/apache/flink/runtime/state/KeyedStateBackend.java -- diff --git a/flink-runtime/src/main/java/org/apache/flink/runtime/state/KeyedStateBack

[01/10] flink git commit: [FLINK-4573] [web dashboard] Fix potential resource leak due to unclosed RandomAccessFile in TaskManagerLogHandler

2016-09-30 Thread sewen
Repository: flink Updated Branches: refs/heads/master 477d1c5d4 -> 92f4539af [FLINK-4573] [web dashboard] Fix potential resource leak due to unclosed RandomAccessFile in TaskManagerLogHandler This closes #2556 Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip

flink git commit: [FLINK-4702] [kafka connector] Commit offsets to Kafka asynchronously and don't block on polls

2016-09-30 Thread sewen
Repository: flink Updated Branches: refs/heads/release-1.1 caa0fbb21 -> 90d77594f [FLINK-4702] [kafka connector] Commit offsets to Kafka asynchronously and don't block on polls Letting the Kafka commit block on polls means that 'notifyCheckpointComplete()' may take very long. This is mostly

[2/2] flink git commit: [FLINK-4744] [streaming api] Followup: Unify names for operator state access methods and comments.

2016-10-05 Thread sewen
[FLINK-4744] [streaming api] Followup: Unify names for operator state access methods and comments. Also make JavaSerializer package private, as it is not intended for user as a proper TypeSerializer Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org

[1/2] flink git commit: [FLINK-4744] [streaming api] Introduce usercode class loader to deserialize partitionable operator state

2016-10-05 Thread sewen
Repository: flink Updated Branches: refs/heads/master 7c9bc1e51 -> 10a42f951 [FLINK-4744] [streaming api] Introduce usercode class loader to deserialize partitionable operator state This closes #2598 Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache

[06/17] flink git commit: [FLINK-4329] [streaming api] Fix Streaming File Source Timestamps/Watermarks Handling

2016-10-05 Thread sewen
[FLINK-4329] [streaming api] Fix Streaming File Source Timestamps/Watermarks Handling This closes #2546 Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/8ff451be Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/8ff451b

[01/17] flink git commit: [FLINK-4737] [core] Ensure that Flink and its Hadoop dependency pull the same version of 'commons-compress'

2016-10-05 Thread sewen
Repository: flink Updated Branches: refs/heads/master 10a42f951 -> 417c5a4b4 [FLINK-4737] [core] Ensure that Flink and its Hadoop dependency pull the same version of 'commons-compress' Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/f

[08/17] flink git commit: [FLINK-4728] [core, optimizer] Replace reference equality with object equality

2016-10-05 Thread sewen
[FLINK-4728] [core,optimizer] Replace reference equality with object equality Some cases of testing Integer equality using == rather than Integer.equals(Integer), and some additional cleanup. This closes #2582 Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.

[05/17] flink git commit: [FLINK-4329] [streaming api] Fix Streaming File Source Timestamps/Watermarks Handling

2016-10-05 Thread sewen
http://git-wip-us.apache.org/repos/asf/flink/blob/8ff451be/flink-streaming-java/src/test/java/org/apache/flink/streaming/util/KeyedOneInputStreamOperatorTestHarness.java -- diff --git a/flink-streaming-java/src/test/java/org/apach

[16/17] flink git commit: [FLINK-4700] [tests] Expand and harden TimeServiceProvider test

2016-10-05 Thread sewen
[FLINK-4700] [tests] Expand and harden TimeServiceProvider test Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/4fc54e3e Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/4fc54e3e Diff: http://git-wip-us.apache.org/repos

[11/17] flink git commit: [FLINK-4739] [elasticsearch connector] Adding packaging details for the Elasticsearch connector

2016-10-05 Thread sewen
[FLINK-4739] [elasticsearch connector] Adding packaging details for the Elasticsearch connector When an uber-jar containing an Elasticsearch sink is executed, an IllegalArgumentException may occur, which is caused by conflicting files of Elasticsearch and it's dependencies in META-INF/services.

[10/17] flink git commit: [hotfix] [streaming api] Cleanup watermark initialization in window operator

2016-10-05 Thread sewen
[hotfix] [streaming api] Cleanup watermark initialization in window operator Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/9d24d51f Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/9d24d51f Diff: http://git-wip-us.apa

[07/17] flink git commit: [FLINK-4737] [core] Add support for bz2 and xy compression in flink-core.

2016-10-05 Thread sewen
[FLINK-4737] [core] Add support for bz2 and xy compression in flink-core. Adds a dependency on 'commons-compression'. This closes #2002 Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/81aec410 Tree: http://git-wip-us.apache.

[03/17] flink git commit: [hotfix] [core] Minor code cleanup and correction of javadocs for filesystem input stream classes.

2016-10-05 Thread sewen
[hotfix] [core] Minor code cleanup and correction of javadocs for filesystem input stream classes. Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/c62776f0 Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/c62776f0 Diff

[15/17] flink git commit: [FLINK-4749] [streaming api] Remove redundant processing time timer sets from window operator

2016-10-05 Thread sewen
[FLINK-4749] [streaming api] Remove redundant processing time timer sets from window operator Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/47e49774 Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/47e49774 Diff: htt

[12/17] flink git commit: [FLINK-4718] [docs] Fix figure about parallel watermarks.

2016-10-05 Thread sewen
[FLINK-4718] [docs] Fix figure about parallel watermarks. This closes #2578 Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/8000b64a Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/8000b64a Diff: http://git-wip-us.apa

[13/17] flink git commit: [FLINK-4750] [runtime] Cleanly await end of all currently executing processing time timers when finite streams finish.

2016-10-05 Thread sewen
[FLINK-4750] [runtime] Cleanly await end of all currently executing processing time timers when finite streams finish. Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/8aea8c8f Tree: http://git-wip-us.apache.org/repos/asf/flin

[02/17] flink git commit: [hotfix] Various code cleanups around time service and asynchronous exceptions

2016-10-05 Thread sewen
[hotfix] Various code cleanups around time service and asynchronous exceptions - DefaultTimeServiceProvider now owns scheduled executor - Enforce that an asynchronous exception handler is always set Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.o

[04/17] flink git commit: [FLINK-4709] [core] Fix resource leak in InputStreamFSInputWrapper

2016-10-05 Thread sewen
[FLINK-4709] [core] Fix resource leak in InputStreamFSInputWrapper This closes #2581 Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/28b37ef9 Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/28b37ef9 Diff: http://git-w

[14/17] flink git commit: [hotfix] [streaming api] Remove obsolete and unused InputTypeSerializer from WindowOperator

2016-10-05 Thread sewen
[hotfix] [streaming api] Remove obsolete and unused InputTypeSerializer from WindowOperator Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/1cd8d4f4 Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/1cd8d4f4 Diff: http:

[09/17] flink git commit: [FLINK-4748] [streaming api] Make timers in Ingestion Time source context properly cancelable.

2016-10-05 Thread sewen
[FLINK-4748] [streaming api] Make timers in Ingestion Time source context properly cancelable. Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/dd3416fd Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/dd3416fd Diff: ht

[17/17] flink git commit: [hotfix] [tests] Remove leftover sysout logging code

2016-10-05 Thread sewen
[hotfix] [tests] Remove leftover sysout logging code Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/417c5a4b Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/417c5a4b Diff: http://git-wip-us.apache.org/repos/asf/flink/

flink git commit: [hotfix] [streaming api] Re-register timers in open() instead of restore()

2016-10-07 Thread sewen
Repository: flink Updated Branches: refs/heads/master 6efb7c266 -> 97c71675a [hotfix] [streaming api] Re-register timers in open() instead of restore() This makes sure timers cannot fire prior to the operator being opened. This closes #2602 Project: http://git-wip-us.apache.org/repos/asf/fl

[2/5] flink git commit: [FLINK-4786] [tests] Fix BarrierBufferTest validation of alignment time computation

2016-10-10 Thread sewen
[FLINK-4786] [tests] Fix BarrierBufferTest validation of alignment time computation Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/14e5ecb4 Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/14e5ecb4 Diff: http://git-wi

[4/5] flink git commit: [hotfix] [tests] Remove leftover sysout logging from AccumulatingAlignedProcessingTimeWindowOperatorTest

2016-10-10 Thread sewen
[hotfix] [tests] Remove leftover sysout logging from AccumulatingAlignedProcessingTimeWindowOperatorTest Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/c1825e3a Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/c1825e3

[1/5] flink git commit: [FLINK-4776] [distributed coordination] Move ExecutionGraph initialization into the dedicated class ExecutionGraphBuilder

2016-10-10 Thread sewen
Repository: flink Updated Branches: refs/heads/master 5e30ba384 -> 33c36e62a [FLINK-4776] [distributed coordination] Move ExecutionGraph initialization into the dedicated class ExecutionGraphBuilder Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.o

[5/5] flink git commit: [hotfix] [tests] Fix PowerMock warnings concerning log4j

2016-10-10 Thread sewen
[hotfix] [tests] Fix PowerMock warnings concerning log4j Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/33c36e62 Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/33c36e62 Diff: http://git-wip-us.apache.org/repos/asf/fl

[3/5] flink git commit: [hotfix] [tests] Increase robustness of Fast Time Window Operator Tests

2016-10-10 Thread sewen
[hotfix] [tests] Increase robustness of Fast Time Window Operator Tests Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/877c267b Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/877c267b Diff: http://git-wip-us.apache.o

flink git commit: [FLINK-4788] [streaming api] Fix state backend classloading from configuration

2016-10-10 Thread sewen
Repository: flink Updated Branches: refs/heads/release-1.1 7267562bb -> d619f51ac [FLINK-4788] [streaming api] Fix state backend classloading from configuration Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/d619f51a Tree

[2/2] flink git commit: [FLINK-4768] [core] Migrate high-availability configuration parameters to ConfigOptions

2016-10-10 Thread sewen
[FLINK-4768] [core] Migrate high-availability configuration parameters to ConfigOptions This closes #2607 Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/abc1657b Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/abc16

[1/2] flink git commit: [FLINK-4764] [core] Introduce Config Options

2016-10-10 Thread sewen
Repository: flink Updated Branches: refs/heads/master 33c36e62a -> abc1657ba [FLINK-4764] [core] Introduce Config Options This is a more concise and maintainable way to define configuration keys, default values, deprecated keys, etc. This closes #2605 Project: http://git-wip-us.apache.org/

flink git commit: [FLINK-4788] [streaming api] Fix state backend classloading from configuration

2016-10-10 Thread sewen
Repository: flink Updated Branches: refs/heads/master 1836e08f0 -> 9e17cbd6b [FLINK-4788] [streaming api] Fix state backend classloading from configuration Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/9e17cbd6 Tree: htt

[3/8] flink git commit: [FLINK-4375] [distributed coordination] Implement new JobManager creation, initialization, and basic RPC methods

2016-10-13 Thread sewen
[FLINK-4375] [distributed coordination] Implement new JobManager creation, initialization, and basic RPC methods Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/34fef475 Tree: http://git-wip-us.apache.org/repos/asf/flink/tree

[1/8] flink git commit: [FLINK-4375] [distributed coordination] Implement new JobManager creation, initialization, and basic RPC methods

2016-10-13 Thread sewen
Repository: flink Updated Branches: refs/heads/flip-6 35a44daa6 -> 48c936eed http://git-wip-us.apache.org/repos/asf/flink/blob/34fef475/flink-runtime/src/main/java/org/apache/flink/runtime/taskexecutor/TaskExecutor.java -- diff

[5/8] flink git commit: [FLINK-4735] [cluster management] Implements some job execution related RPC calls on the JobManager

2016-10-13 Thread sewen
[FLINK-4735] [cluster management] Implements some job execution related RPC calls on the JobManager Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/21b9f16b Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/21b9f16b Dif

[7/8] flink git commit: [FLINK-4764] [core] Introduce Config Options

2016-10-13 Thread sewen
[FLINK-4764] [core] Introduce Config Options This is a more concise and maintainable way to define configuration keys, default values, deprecated keys, etc. This closes #2605 Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/

[2/8] flink git commit: [FLINK-4375] [distributed coordination] Implement new JobManager creation, initialization, and basic RPC methods

2016-10-13 Thread sewen
http://git-wip-us.apache.org/repos/asf/flink/blob/34fef475/flink-runtime/src/main/java/org/apache/flink/runtime/jobmaster/JobMaster.java -- diff --git a/flink-runtime/src/main/java/org/apache/flink/runtime/jobmaster/JobMaster.java

[6/8] flink git commit: [FLINK-4776] [distributed coordination] Move ExecutionGraph initialization into the dedicated class ExecutionGraphBuilder

2016-10-13 Thread sewen
[FLINK-4776] [distributed coordination] Move ExecutionGraph initialization into the dedicated class ExecutionGraphBuilder Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/05436f4b Tree: http://git-wip-us.apache.org/repos/asf/f

[4/8] flink git commit: [FLINK-4768] [core] Migrate high-availability configuration parameters to ConfigOptions

2016-10-13 Thread sewen
[FLINK-4768] [core] Migrate high-availability configuration parameters to ConfigOptions This closes #2607 Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/c8dc074a Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/c8dc0

[8/8] flink git commit: [FLINK-4339] [cluster management] Implement Slot Pool core on JobManager side

2016-10-13 Thread sewen
[FLINK-4339] [cluster management] Implement Slot Pool core on JobManager side Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/48c936ee Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/48c936ee Diff: http://git-wip-us.ap

flink git commit: [FLINK-4373] [cluster management] Introduce AllocationID, ResourceProfile, and AllocatedSlot

2016-10-14 Thread sewen
Repository: flink Updated Branches: refs/heads/master 5783671c2 -> f6d866817 [FLINK-4373] [cluster management] Introduce AllocationID, ResourceProfile, and AllocatedSlot These classes are introduced as part of the cluster management rework. This closes #2630 Project: http://git-wip-us.apac

[07/50] [abbrv] flink git commit: [FLINK-4529] [flip-6] Move TaskExecutor, JobMaster and ResourceManager out of the rpc package

2016-10-14 Thread sewen
[FLINK-4529] [flip-6] Move TaskExecutor, JobMaster and ResourceManager out of the rpc package The TaskExecutor, the JobMaster and the ResourceManager were still contained in the rpc package. With this commit, they will be moved out of this package. Now they are contained in dedicated packages o

[22/50] [abbrv] flink git commit: [FLINK-4505] [cluster mngt] Implement TaskManager component's startup

2016-10-14 Thread sewen
[FLINK-4505] [cluster mngt] Implement TaskManager component's startup The TaskManagerRunner now contains the startup logic for the TaskManager's components. Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/c34f13c2 Tree: http

[03/50] [abbrv] flink git commit: [FLINK-4529] [flip-6] Move TaskExecutor, JobMaster and ResourceManager out of the rpc package

2016-10-14 Thread sewen
http://git-wip-us.apache.org/repos/asf/flink/blob/9c247d1f/flink-runtime/src/test/java/org/apache/flink/runtime/clusterframework/SlotManagerTest.java -- diff --git a/flink-runtime/src/test/java/org/apache/flink/runtime/clusterfram

[08/50] [abbrv] flink git commit: [FLINK-4516] leader election of resourcemanager

2016-10-14 Thread sewen
[FLINK-4516] leader election of resourcemanager - add serial rpc service - add a special rpcService implementation which directly executes the asynchronous calls serially one by one, it is just for testcase - Change ResourceManagerLeaderContender code and TestingSerialRpcService code - override s

[15/50] [abbrv] flink git commit: [hotfix] Remove unused imports from SlotRequestRegistered/Rejected and ResourceSlot

2016-10-14 Thread sewen
[hotfix] Remove unused imports from SlotRequestRegistered/Rejected and ResourceSlot Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/b2c5c0fd Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/b2c5c0fd Diff: http://git-wi

[06/50] [abbrv] flink git commit: [FLINK-4529] [flip-6] Move TaskExecutor, JobMaster and ResourceManager out of the rpc package

2016-10-14 Thread sewen
http://git-wip-us.apache.org/repos/asf/flink/blob/9c247d1f/flink-runtime/src/main/java/org/apache/flink/runtime/resourcemanager/SlotRequest.java -- diff --git a/flink-runtime/src/main/java/org/apache/flink/runtime/resourcemanager/

[23/50] [abbrv] flink git commit: [FLINK-4535] rebase and refine

2016-10-14 Thread sewen
[FLINK-4535] rebase and refine Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/485ef003 Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/485ef003 Diff: http://git-wip-us.apache.org/repos/asf/flink/diff/485ef003 Branch:

[50/50] [abbrv] flink git commit: [FLINK-4339] [cluster management] Implement Slot Pool core on JobManager side

2016-10-14 Thread sewen
[FLINK-4339] [cluster management] Implement Slot Pool core on JobManager side Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/7aca811d Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/7aca811d Diff: http://git-wip-us.ap

[12/50] [abbrv] flink git commit: [hotfix] Add methods defined in the gateway to the ResourceManager and TaskExecutor

2016-10-14 Thread sewen
[hotfix] Add methods defined in the gateway to the ResourceManager and TaskExecutor Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/fbd38671 Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/fbd38671 Diff: http://git-wi

[16/50] [abbrv] flink git commit: [FLINK-4538][FLINK-4348] ResourceManager slot allocation protcol

2016-10-14 Thread sewen
http://git-wip-us.apache.org/repos/asf/flink/blob/74570d45/flink-runtime/src/test/java/org/apache/flink/runtime/resourcemanager/SlotManagerTest.java -- diff --git a/flink-runtime/src/test/java/org/apache/flink/runtime/resourcemana

[26/50] [abbrv] flink git commit: [hotfix] [rpc] Add RpcConnectionTest to validate that connection buildup fails fast when endpoint is unreachable.

2016-10-14 Thread sewen
[hotfix] [rpc] Add RpcConnectionTest to validate that connection buildup fails fast when endpoint is unreachable. Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/0e495b7b Tree: http://git-wip-us.apache.org/repos/asf/flink/tre

[28/50] [abbrv] flink git commit: [FLINK-4687] [rpc] Add getAddress to RpcService

2016-10-14 Thread sewen
[FLINK-4687] [rpc] Add getAddress to RpcService This closes #2551. Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/07512e06 Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/07512e06 Diff: http://git-wip-us.apache.org/r

[29/50] [abbrv] flink git commit: [FLINK-4580] [rpc] Report rpc invocation exceptions to the caller

2016-10-14 Thread sewen
[FLINK-4580] [rpc] Report rpc invocation exceptions to the caller This closes #2526. Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/59d9e67b Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/59d9e67b Diff: http://git-w

[45/50] [abbrv] flink git commit: [FLINK-4746] Make TaskManagerRuntimeInfo an interface

2016-10-14 Thread sewen
[FLINK-4746] Make TaskManagerRuntimeInfo an interface Let the TaskManagerConfiguration implement the TaskManagerRuntimeInformation to make some of the TaskManager's configuration values accessible from different components. This closes #2599. Project: http://git-wip-us.apache.org/repos/asf/fli

[14/50] [abbrv] flink git commit: [FLINK-4537] rebase and refine

2016-10-14 Thread sewen
[FLINK-4537] rebase and refine Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/34a6854b Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/34a6854b Diff: http://git-wip-us.apache.org/repos/asf/flink/diff/34a6854b Branch:

[39/50] [abbrv] flink git commit: [FLINK-4347][FLINK-4348] simplify SlotManager and integrate it with ResourceManager

2016-10-14 Thread sewen
[FLINK-4347][FLINK-4348] simplify SlotManager and integrate it with ResourceManager Instead of relying on a full synchronization of all slots information on every heartbeat, the SlotManager is now responsible for updating its state. It initially syncs all slots upon registration of the TaskExecut

[34/50] [abbrv] flink git commit: [hotfix] Replace TaskManager.createTaskManagerComponents by TaskManagerServices

2016-10-14 Thread sewen
[hotfix] Replace TaskManager.createTaskManagerComponents by TaskManagerServices Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/bce292ae Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/bce292ae Diff: http://git-wip-us.

[41/50] [abbrv] flink git commit: [FLINK-4735] [cluster management] Implements some job execution related RPC calls on the JobManager

2016-10-14 Thread sewen
[FLINK-4735] [cluster management] Implements some job execution related RPC calls on the JobManager Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/041dfd78 Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/041dfd78 Dif

[04/50] [abbrv] flink git commit: [FLINK-4529] [flip-6] Move TaskExecutor, JobMaster and ResourceManager out of the rpc package

2016-10-14 Thread sewen
http://git-wip-us.apache.org/repos/asf/flink/blob/9c247d1f/flink-runtime/src/main/java/org/apache/flink/runtime/taskexecutor/TaskExecutor.java -- diff --git a/flink-runtime/src/main/java/org/apache/flink/runtime/taskexecutor/TaskE

[02/50] [abbrv] flink git commit: [FLINK-4529] [flip-6] Move TaskExecutor, JobMaster and ResourceManager out of the rpc package

2016-10-14 Thread sewen
http://git-wip-us.apache.org/repos/asf/flink/blob/9c247d1f/flink-runtime/src/test/java/org/apache/flink/runtime/resourcemanager/SlotManagerTest.java -- diff --git a/flink-runtime/src/test/java/org/apache/flink/runtime/resourcemana

[13/50] [abbrv] flink git commit: [FLINK-4537] [cluster management] ResourceManager registration with JobManager

2016-10-14 Thread sewen
[FLINK-4537] [cluster management] ResourceManager registration with JobManager Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/efc7de5b Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/efc7de5b Diff: http://git-wip-us.a

[30/50] [abbrv] flink git commit: [FLINK-4530] [rpc] Generalize TaskExecutorToResourceManagerConnection to be reusable

2016-10-14 Thread sewen
[FLINK-4530] [rpc] Generalize TaskExecutorToResourceManagerConnection to be reusable This closes #2520 Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/b8c6b998 Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/b8c6b998

[32/50] [abbrv] flink git commit: [FLINK-4606] integrate features of old ResourceManager

2016-10-14 Thread sewen
[FLINK-4606] integrate features of old ResourceManager This closes #2540 Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/1f198d8c Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/1f198d8c Diff: http://git-wip-us.apache

[31/50] [abbrv] flink git commit: [FLINK-4703] RpcCompletenessTest: Add support for type arguments and subclasses

2016-10-14 Thread sewen
[FLINK-4703] RpcCompletenessTest: Add support for type arguments and subclasses This closes #2561 Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/6e58ebf2 Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/6e58ebf2 Diff:

[01/50] [abbrv] flink git commit: [FLINK-4347][cluster management] Implement SlotManager core [Forced Update!]

2016-10-14 Thread sewen
Repository: flink Updated Branches: refs/heads/flip-6 48c936eed -> 7aca811df (forced update) [FLINK-4347][cluster management] Implement SlotManager core This closes #2388 Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/6e

[24/50] [abbrv] flink git commit: [FLINK-4535] [cluster management] resourceManager process the registration from TaskExecutor

2016-10-14 Thread sewen
[FLINK-4535] [cluster management] resourceManager process the registration from TaskExecutor Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/c9764c8f Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/c9764c8f Diff: http

[20/50] [abbrv] flink git commit: [FLINK-4505] [cluster mngt] Separate TaskManager service configuration from TaskManagerConfiguration; Implement TaskManagerRunner

2016-10-14 Thread sewen
http://git-wip-us.apache.org/repos/asf/flink/blob/bb781aef/flink-runtime/src/main/java/org/apache/flink/runtime/taskmanager/TaskManagerRunner.java -- diff --git a/flink-runtime/src/main/java/org/apache/flink/runtime/taskmanager/Ta

[21/50] [abbrv] flink git commit: [FLINK-4505] [cluster mngt] Separate TaskManager service configuration from TaskManagerConfiguration; Implement TaskManagerRunner

2016-10-14 Thread sewen
[FLINK-4505] [cluster mngt] Separate TaskManager service configuration from TaskManagerConfiguration; Implement TaskManagerRunner Refactors the startup logic so that is easier to reuse. This closes #2461. Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apac

[05/50] [abbrv] flink git commit: [FLINK-4529] [flip-6] Move TaskExecutor, JobMaster and ResourceManager out of the rpc package

2016-10-14 Thread sewen
http://git-wip-us.apache.org/repos/asf/flink/blob/9c247d1f/flink-runtime/src/main/java/org/apache/flink/runtime/rpc/taskexecutor/TaskExecutor.java -- diff --git a/flink-runtime/src/main/java/org/apache/flink/runtime/rpc/taskexecut

[17/50] [abbrv] flink git commit: [FLINK-4538][FLINK-4348] ResourceManager slot allocation protcol

2016-10-14 Thread sewen
[FLINK-4538][FLINK-4348] ResourceManager slot allocation protcol - associates JobMasters with JobID instead of InstanceID - adds TaskExecutorGateway to slot - adds SlotManager as RM constructor parameter - adds LeaderRetrievalListener to SlotManager to keep track of the leader id - tests the inte

[42/50] [abbrv] flink git commit: [FLINK-4694] [rpc] Add termination futures to RpcEndpoint and RpcService

2016-10-14 Thread sewen
[FLINK-4694] [rpc] Add termination futures to RpcEndpoint and RpcService The termination futures can be used to wait for the termination of the respective component. This closes #2558. Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/fli

[49/50] [abbrv] flink git commit: [FLINK-4375] [distributed coordination] Implement new JobManager creation, initialization, and basic RPC methods

2016-10-14 Thread sewen
[FLINK-4375] [distributed coordination] Implement new JobManager creation, initialization, and basic RPC methods Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/0615b62f Tree: http://git-wip-us.apache.org/repos/asf/flink/tree

[36/50] [abbrv] flink git commit: [FLINK-4478] [flip-6] Add HeartbeatManager

2016-10-14 Thread sewen
[FLINK-4478] [flip-6] Add HeartbeatManager Add a heartbeat manager abstraction which can monitor heartbeat targets. Whenever no heartbeat signal has been received for a heartbeat timeout interval, the heartbeat manager will issue a heartbeat timeout notification. Add resourceID to HeartbeatListe

[27/50] [abbrv] flink git commit: [FLINK-4408] [JobManager] Introduce JobMasterRunner and implement job submission & setting up the ExecutionGraph

2016-10-14 Thread sewen
[FLINK-4408] [JobManager] Introduce JobMasterRunner and implement job submission & setting up the ExecutionGraph This closes #2480 Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/360eaf8a Tree: http://git-wip-us.apache.org/r

[40/50] [abbrv] flink git commit: [FLINK-4606] Integrate the new ResourceManager with the existed FlinkResourceManager

2016-10-14 Thread sewen
[FLINK-4606] Integrate the new ResourceManager with the existed FlinkResourceManager Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/415af17f Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/415af17f Diff: http://git-

[37/50] [abbrv] flink git commit: [hotfix] Fix failing JobManagerRunnerMockTest

2016-10-14 Thread sewen
[hotfix] Fix failing JobManagerRunnerMockTest Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/30517da9 Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/30517da9 Diff: http://git-wip-us.apache.org/repos/asf/flink/diff/30

[46/50] [abbrv] flink git commit: [FLINK-4516] update leadership information in ResourceManager

2016-10-14 Thread sewen
[FLINK-4516] update leadership information in ResourceManager The leadership information remained static for connected JobMasters. This updates it to remove stale JobMasters when they lose leadership status. This closes #2624 Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: ht

  1   2   3   4   5   6   7   8   9   10   >