[jira] [Created] (FLINK-5868) Implement a new RestartStrategy that works for the FailoverRegion.

2017-02-21 Thread shuai.xu (JIRA)
shuai.xu created FLINK-5868: --- Summary: Implement a new RestartStrategy that works for the FailoverRegion. Key: FLINK-5868 URL: https://issues.apache.org/jira/browse/FLINK-5868 Project: Flink

[jira] [Updated] (FLINK-4256) Fine-grained recovery

2017-02-21 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuai.xu updated FLINK-4256: Description: When a task fails during execution, Flink currently resets the entire execution graph and

[jira] [Created] (FLINK-5866) The implementation of FailoverRegion.

2017-02-21 Thread shuai.xu (JIRA)
shuai.xu created FLINK-5866: --- Summary: The implementation of FailoverRegion. Key: FLINK-5866 URL: https://issues.apache.org/jira/browse/FLINK-5866 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-5867) The implementation of FailoverCoordinator

2017-02-21 Thread shuai.xu (JIRA)
shuai.xu created FLINK-5867: --- Summary: The implementation of FailoverCoordinator Key: FLINK-5867 URL: https://issues.apache.org/jira/browse/FLINK-5867 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-5869) ExecutionGraph use FailoverCoordinator to manage the failover of execution vertexes

2017-02-21 Thread shuai.xu (JIRA)
shuai.xu created FLINK-5869: --- Summary: ExecutionGraph use FailoverCoordinator to manage the failover of execution vertexes Key: FLINK-5869 URL: https://issues.apache.org/jira/browse/FLINK-5869 Project:

[jira] [Created] (FLINK-5856) Need return redundant containers to yarn for yarn mode

2017-02-20 Thread shuai.xu (JIRA)
shuai.xu created FLINK-5856: --- Summary: Need return redundant containers to yarn for yarn mode Key: FLINK-5856 URL: https://issues.apache.org/jira/browse/FLINK-5856 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-5857) Recycle idle containers in time for yarn mode

2017-02-20 Thread shuai.xu (JIRA)
shuai.xu created FLINK-5857: --- Summary: Recycle idle containers in time for yarn mode Key: FLINK-5857 URL: https://issues.apache.org/jira/browse/FLINK-5857 Project: Flink Issue Type: Bug

[jira] [Updated] (FLINK-5856) Need return redundant containers to yarn for yarn mode

2017-02-23 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuai.xu updated FLINK-5856: Description: In flip6, for flink on yarn mode, RM requests container from yarn according to the requirement

[jira] [Updated] (FLINK-5791) Resource should be strictly matched when allocating for yarn

2017-02-23 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuai.xu updated FLINK-5791: Description: In flip6, for yarn mode, resource should be assigned as requested to avoid resource wasting

[jira] [Created] (FLINK-5791) Resource should be strictly matched when allocating for yarn

2017-02-13 Thread shuai.xu (JIRA)
shuai.xu created FLINK-5791: --- Summary: Resource should be strictly matched when allocating for yarn Key: FLINK-5791 URL: https://issues.apache.org/jira/browse/FLINK-5791 Project: Flink Issue

[jira] [Resolved] (FLINK-5190) ZooKeeperLeaderRetrievalService should not close the zk client when stop

2017-02-13 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuai.xu resolved FLINK-5190. - Resolution: Fixed fix via cbfb807d65b68b2b6157e1b1d42606123ea499ad > ZooKeeperLeaderRetrievalService

[jira] [Resolved] (FLINK-4928) Implement FLIP-6 YARN Application Master Runner

2017-02-13 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuai.xu resolved FLINK-4928. - Resolution: Fixed fix via 0113e5a467858f9cd435e80df2c2626170e5de62 > Implement FLIP-6 YARN Application

[jira] [Resolved] (FLINK-4927) Implement FLI-6 YARN Resource Manager

2017-02-13 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuai.xu resolved FLINK-4927. - Resolution: Fixed fix via e2922add100338776db765a62deb02f556845cf9 > Implement FLI-6 YARN Resource

[jira] [Resolved] (FLINK-4929) Implement FLIP-6 YARN TaskManager Runner

2017-02-13 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuai.xu resolved FLINK-4929. - Resolution: Fixed fix via 371997a81a7035b68cf47e7bca64ce01e3ac36a6 > Implement FLIP-6 YARN TaskManager

[jira] [Resolved] (FLINK-4930) Implement FLIP-6 YARN client

2017-02-13 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuai.xu resolved FLINK-4930. - Resolution: Fixed fix via 3695a8e92e9c3deee368d9cc3ce89a5ab117d6a1 > Implement FLIP-6 YARN client >

[jira] [Created] (FLINK-5793) Running slot may not be add to AllocatedMap in SlotPool

2017-02-13 Thread shuai.xu (JIRA)
shuai.xu created FLINK-5793: --- Summary: Running slot may not be add to AllocatedMap in SlotPool Key: FLINK-5793 URL: https://issues.apache.org/jira/browse/FLINK-5793 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-4444) Add a DFSInputChannel and DFSSubPartition

2016-08-22 Thread shuai.xu (JIRA)
shuai.xu created FLINK-: --- Summary: Add a DFSInputChannel and DFSSubPartition Key: FLINK- URL: https://issues.apache.org/jira/browse/FLINK- Project: Flink Issue Type: Sub-task

[jira] [Assigned] (FLINK-4419) Batch improvement for supporting dfs as a ResultPartitionType

2016-08-22 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuai.xu reassigned FLINK-4419: --- Assignee: shuai.xu > Batch improvement for supporting dfs as a ResultPartitionType >

[jira] [Assigned] (FLINK-4444) Add a DFSInputChannel and DFSSubPartition

2016-08-22 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuai.xu reassigned FLINK-: --- Assignee: shuai.xu > Add a DFSInputChannel and DFSSubPartition >

[jira] [Created] (FLINK-4419) Batch improvement for supporting dfs as a ResultPartitionType

2016-08-17 Thread shuai.xu (JIRA)
shuai.xu created FLINK-4419: --- Summary: Batch improvement for supporting dfs as a ResultPartitionType Key: FLINK-4419 URL: https://issues.apache.org/jira/browse/FLINK-4419 Project: Flink Issue

[jira] [Created] (FLINK-4504) Support user to decide whether the result of an operator is presistent

2016-08-26 Thread shuai.xu (JIRA)
shuai.xu created FLINK-4504: --- Summary: Support user to decide whether the result of an operator is presistent Key: FLINK-4504 URL: https://issues.apache.org/jira/browse/FLINK-4504 Project: Flink

[jira] [Assigned] (FLINK-4504) Support user to decide whether the result of an operator is presistent

2016-08-26 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuai.xu reassigned FLINK-4504: --- Assignee: shuai.xu > Support user to decide whether the result of an operator is presistent >

[jira] [Assigned] (FLINK-4929) Implement FLIP-6 YARN TaskManager Runner

2016-11-10 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuai.xu reassigned FLINK-4929: --- Assignee: shuai.xu > Implement FLIP-6 YARN TaskManager Runner >

[jira] [Updated] (FLINK-5170) getAkkaConfig will use localhost if hostname is specified

2016-11-28 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuai.xu updated FLINK-5170: Labels: flip-6 (was: ) > getAkkaConfig will use localhost if hostname is specified >

[jira] [Updated] (FLINK-5171) Wrong use of Preconditions.checkState in TaskManagerRunner

2016-11-28 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuai.xu updated FLINK-5171: Labels: flip-6 (was: ) > Wrong use of Preconditions.checkState in TaskManagerRunner >

[jira] [Created] (FLINK-5170) getAkkaConfig will use localhost if hostname is specified

2016-11-28 Thread shuai.xu (JIRA)
shuai.xu created FLINK-5170: --- Summary: getAkkaConfig will use localhost if hostname is specified Key: FLINK-5170 URL: https://issues.apache.org/jira/browse/FLINK-5170 Project: Flink Issue Type:

[jira] [Created] (FLINK-5074) Implement a RunningJobRegistry based on Zookeeper

2016-11-15 Thread shuai.xu (JIRA)
shuai.xu created FLINK-5074: --- Summary: Implement a RunningJobRegistry based on Zookeeper Key: FLINK-5074 URL: https://issues.apache.org/jira/browse/FLINK-5074 Project: Flink Issue Type: Task

[jira] [Assigned] (FLINK-5074) Implement a RunningJobRegistry based on Zookeeper

2016-11-15 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuai.xu reassigned FLINK-5074: --- Assignee: shuai.xu > Implement a RunningJobRegistry based on Zookeeper >

[jira] [Assigned] (FLINK-4928) Implement FLIP-6 YARN Application Master Runner

2016-10-27 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuai.xu reassigned FLINK-4928: --- Assignee: shuai.xu > Implement FLIP-6 YARN Application Master Runner >

[jira] [Assigned] (FLINK-4927) Implement FLI-6 YARN Resource Manager

2016-10-27 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuai.xu reassigned FLINK-4927: --- Assignee: shuai.xu > Implement FLI-6 YARN Resource Manager > - >

[jira] [Created] (FLINK-5190) ZooKeeperLeaderRetrievalService should not close the zk client when stop

2016-11-29 Thread shuai.xu (JIRA)
shuai.xu created FLINK-5190: --- Summary: ZooKeeperLeaderRetrievalService should not close the zk client when stop Key: FLINK-5190 URL: https://issues.apache.org/jira/browse/FLINK-5190 Project: Flink

[jira] [Assigned] (FLINK-4930) Implement FLIP-6 YARN client

2016-12-05 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuai.xu reassigned FLINK-4930: --- Assignee: shuai.xu > Implement FLIP-6 YARN client > > >

[jira] [Updated] (FLINK-5791) Support an optimal matching based slot manager for flip6 yarn mode

2017-03-15 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuai.xu updated FLINK-5791: Description: In flip6, for yarn mode, it request containers from yarn according to the resource profile in

[jira] [Updated] (FLINK-5791) Support an optimal matching based slot manager for flip6 yarn mode

2017-03-15 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuai.xu updated FLINK-5791: Summary: Support an optimal matching based slot manager for flip6 yarn mode (was: Resource should be

[jira] [Updated] (FLINK-5867) The implementation of RestartPipelinedRegionStrategy

2017-04-18 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuai.xu updated FLINK-5867: Summary: The implementation of RestartPipelinedRegionStrategy (was: The implementation of

[jira] [Updated] (FLINK-5867) The implementation of RestartPipelinedRegionStrategy

2017-04-18 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuai.xu updated FLINK-5867: Description: The RestartPipelinedRegionStrategy's responsibility is the following: 1. Calculate all

[jira] [Closed] (FLINK-5868) Implement a new RestartStrategy that works for the FailoverRegion.

2017-07-07 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuai.xu closed FLINK-5868. --- Resolution: Fixed Fix Version/s: 1.3.0 > Implement a new RestartStrategy that works for the

[jira] [Closed] (FLINK-5867) The implementation of RestartPipelinedRegionStrategy

2017-07-07 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuai.xu closed FLINK-5867. --- Resolution: Fixed Fix Version/s: 1.3.0 > The implementation of RestartPipelinedRegionStrategy >

[jira] [Closed] (FLINK-5866) The implementation of FailoverRegion.

2017-07-07 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuai.xu closed FLINK-5866. --- Resolution: Fixed Fix Version/s: 1.3.0 > The implementation of FailoverRegion. >

[jira] [Commented] (FLINK-6434) There may be allocatedSlots leak in SlotPool

2017-07-03 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16073081#comment-16073081 ] shuai.xu commented on FLINK-6434: - [~till.rohrmann] Sorry, I have not start working on it > There may be

[jira] [Commented] (FLINK-5857) Recycle idle containers in time for yarn mode

2017-07-06 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16076347#comment-16076347 ] shuai.xu commented on FLINK-5857: - [~till.rohrmann] sure > Recycle idle containers in time for yarn mode

[jira] [Closed] (FLINK-5857) Recycle idle containers in time for yarn mode

2017-07-06 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuai.xu closed FLINK-5857. --- Resolution: Duplicate > Recycle idle containers in time for yarn mode >

[jira] [Updated] (FLINK-6434) There may be allocatedSlots leak in SlotPool

2017-05-04 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuai.xu updated FLINK-6434: Description: If the call allocateSlot() from Execution to Slotpool timeout, the job will begin to failover,

[jira] [Commented] (FLINK-6434) There may be allocatedSlots leak in SlotPool

2017-05-07 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16000232#comment-16000232 ] shuai.xu commented on FLINK-6434: - [~till.rohrmann] This seems can not fix the bug totally, as between

[jira] [Comment Edited] (FLINK-6434) There may be allocatedSlots leak in SlotPool

2017-05-08 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16000232#comment-16000232 ] shuai.xu edited comment on FLINK-6434 at 5/8/17 7:11 AM: - [~till.rohrmann] This

[jira] [Commented] (FLINK-6434) There may be allocatedSlots leak in SlotPool

2017-05-08 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16000435#comment-16000435 ] shuai.xu commented on FLINK-6434: - Yes, add a request id can solve the problem. > There may be

[jira] [Created] (FLINK-6434) There may be allocatedSlots leak in SlotPool

2017-05-03 Thread shuai.xu (JIRA)
shuai.xu created FLINK-6434: --- Summary: There may be allocatedSlots leak in SlotPool Key: FLINK-6434 URL: https://issues.apache.org/jira/browse/FLINK-6434 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-7871) SlotPool should release its unused slot to RM

2017-10-18 Thread shuai.xu (JIRA)
shuai.xu created FLINK-7871: --- Summary: SlotPool should release its unused slot to RM Key: FLINK-7871 URL: https://issues.apache.org/jira/browse/FLINK-7871 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-7870) SlotPool should cancel the slot request to RM if not need any more.

2017-10-18 Thread shuai.xu (JIRA)
shuai.xu created FLINK-7870: --- Summary: SlotPool should cancel the slot request to RM if not need any more. Key: FLINK-7870 URL: https://issues.apache.org/jira/browse/FLINK-7870 Project: Flink

[jira] [Updated] (FLINK-8266) Add network memory to ResourceProfile

2017-12-15 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuai.xu updated FLINK-8266: Labels: flip-6 (was: ) > Add network memory to ResourceProfile > - > >

[jira] [Created] (FLINK-8266) Add network memory to ResourceProfile

2017-12-15 Thread shuai.xu (JIRA)
shuai.xu created FLINK-8266: --- Summary: Add network memory to ResourceProfile Key: FLINK-8266 URL: https://issues.apache.org/jira/browse/FLINK-8266 Project: Flink Issue Type: Improvement

[jira] [Commented] (FLINK-8289) The RestServerEndpoint should return the address with real ip when getRestAdddress

2017-12-19 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16297920#comment-16297920 ] shuai.xu commented on FLINK-8289: - Hi [~eronwright], yes, what we need is the advertised address. But for

[jira] [Created] (FLINK-8288) Register the web interface url to yarn for yarn job mode

2017-12-18 Thread shuai.xu (JIRA)
shuai.xu created FLINK-8288: --- Summary: Register the web interface url to yarn for yarn job mode Key: FLINK-8288 URL: https://issues.apache.org/jira/browse/FLINK-8288 Project: Flink Issue Type: Bug

[jira] [Updated] (FLINK-8289) The RestServerEndpoint should return the address with real ip when getRestAdddress

2017-12-18 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuai.xu updated FLINK-8289: Affects Version/s: 1.5.0 > The RestServerEndpoint should return the address with real ip when >

[jira] [Updated] (FLINK-8288) Register the web interface url to yarn for yarn job mode

2017-12-18 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuai.xu updated FLINK-8288: Affects Version/s: 1.5.0 > Register the web interface url to yarn for yarn job mode >

[jira] [Created] (FLINK-8289) The RestServerEndpoint should return the address with real ip when getRestAdddress

2017-12-18 Thread shuai.xu (JIRA)
shuai.xu created FLINK-8289: --- Summary: The RestServerEndpoint should return the address with real ip when getRestAdddress Key: FLINK-8289 URL: https://issues.apache.org/jira/browse/FLINK-8289 Project:

[jira] [Closed] (FLINK-5190) ZooKeeperLeaderRetrievalService should not close the zk client when stop

2017-12-19 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuai.xu closed FLINK-5190. --- > ZooKeeperLeaderRetrievalService should not close the zk client when stop >

[jira] [Closed] (FLINK-5170) getAkkaConfig will use localhost if hostname is specified

2017-12-19 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuai.xu closed FLINK-5170. --- > getAkkaConfig will use localhost if hostname is specified >

[jira] [Closed] (FLINK-5793) Running slot may not be add to AllocatedMap in SlotPool

2017-12-19 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuai.xu closed FLINK-5793. --- > Running slot may not be add to AllocatedMap in SlotPool >

[jira] [Closed] (FLINK-5171) Wrong use of Preconditions.checkState in TaskManagerRunner

2017-12-19 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuai.xu closed FLINK-5171. --- > Wrong use of Preconditions.checkState in TaskManagerRunner >

[jira] [Closed] (FLINK-6434) There may be allocatedSlots leak in SlotPool

2017-12-19 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuai.xu closed FLINK-6434. --- > There may be allocatedSlots leak in SlotPool > > >

[jira] [Closed] (FLINK-7928) Extend the filed in ResourceProfile for precisely calculating the resource of a task manager

2017-12-19 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuai.xu closed FLINK-7928. --- > Extend the filed in ResourceProfile for precisely calculating the resource of > a task manager >

[jira] [Closed] (FLINK-7878) Extend the resource type user can define in ResourceSpec

2017-12-19 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuai.xu closed FLINK-7878. --- > Extend the resource type user can define in ResourceSpec >

[jira] [Closed] (FLINK-7870) SlotPool should cancel the slot request to RM if not need any more.

2017-11-08 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuai.xu closed FLINK-7870. --- > SlotPool should cancel the slot request to RM if not need any more. >

[jira] [Updated] (FLINK-7969) Resource manager support batch request slots

2017-11-02 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuai.xu updated FLINK-7969: Attachment: (was: rm.png) > Resource manager support batch request slots >

[jira] [Updated] (FLINK-7969) Resource manager support batch request slots

2017-11-02 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuai.xu updated FLINK-7969: Attachment: rm.png > Resource manager support batch request slots >

[jira] [Updated] (FLINK-7969) Resource manager support batch request slots

2017-11-02 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuai.xu updated FLINK-7969: Description: Now resource manager only support requesting slot one by one, it's better to make it support

[jira] [Updated] (FLINK-7969) Resource manager support batch request slots

2017-11-02 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuai.xu updated FLINK-7969: Attachment: rm.jpg > Resource manager support batch request slots >

[jira] [Updated] (FLINK-7969) Resource manager support batch request slots

2017-11-02 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuai.xu updated FLINK-7969: Description: Now resource manager only support requesting slot one by one, it's better to make it support

[jira] [Updated] (FLINK-7970) SlotPool support batch allocating slots

2017-11-02 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuai.xu updated FLINK-7970: Attachment: sp.jpg > SlotPool support batch allocating slots > --- > >

[jira] [Updated] (FLINK-7970) SlotPool support batch allocating slots

2017-11-02 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuai.xu updated FLINK-7970: Description: Now all slot allocation is one by one from execution to slot pool. If batch allocate a number

[jira] [Updated] (FLINK-7970) SlotPool support batch allocating slots

2017-11-02 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuai.xu updated FLINK-7970: Description: Now all slot allocation is one by one from execution to slot pool. If batch allocate a number

[jira] [Assigned] (FLINK-7969) Resource manager support batch request slots

2017-11-02 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuai.xu reassigned FLINK-7969: --- Assignee: shuai.xu > Resource manager support batch request slots >

[jira] [Updated] (FLINK-7969) Resource manager support batch request slots

2017-11-02 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuai.xu updated FLINK-7969: Description: !https://issues.apache.org/jira/secure/attachment/12895559/rm.jpg!Now resource manager only

[jira] [Updated] (FLINK-7969) Resource manager support batch request slots

2017-11-02 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuai.xu updated FLINK-7969: Description: !https://issues.apache.org/jira/secure/attachment/12895559/rm.jpg! Now resource manager only

[jira] [Updated] (FLINK-7969) Resource manager support batch request slots

2017-11-02 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuai.xu updated FLINK-7969: Description: Now resource manager only support requesting slot one by one, it's better to make it support

[jira] [Updated] (FLINK-7969) Resource manager support batch request slots

2017-11-02 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuai.xu updated FLINK-7969: Labels: flip-6 (was: ) > Resource manager support batch request slots >

[jira] [Created] (FLINK-7969) Resource manager support batch request slots

2017-11-02 Thread shuai.xu (JIRA)
shuai.xu created FLINK-7969: --- Summary: Resource manager support batch request slots Key: FLINK-7969 URL: https://issues.apache.org/jira/browse/FLINK-7969 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-7970) SlotPool support batch allocating slots

2017-11-02 Thread shuai.xu (JIRA)
shuai.xu created FLINK-7970: --- Summary: SlotPool support batch allocating slots Key: FLINK-7970 URL: https://issues.apache.org/jira/browse/FLINK-7970 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-8224) Should shudownApplication when job terminated in job mode

2017-12-08 Thread shuai.xu (JIRA)
shuai.xu created FLINK-8224: --- Summary: Should shudownApplication when job terminated in job mode Key: FLINK-8224 URL: https://issues.apache.org/jira/browse/FLINK-8224 Project: Flink Issue Type:

[jira] [Updated] (FLINK-7928) Extend the filed in ResourceProfile for precisely calculating the resource of a task manager

2017-10-25 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuai.xu updated FLINK-7928: Labels: flip-6 (was: ) > Extend the filed in ResourceProfile for precisely calculating the resource of >

[jira] [Created] (FLINK-7928) Extend the filed in ResourceProfile for precisely calculating the resource of a task manager

2017-10-25 Thread shuai.xu (JIRA)
shuai.xu created FLINK-7928: --- Summary: Extend the filed in ResourceProfile for precisely calculating the resource of a task manager Key: FLINK-7928 URL: https://issues.apache.org/jira/browse/FLINK-7928

[jira] [Created] (FLINK-9632) SlotPool should notify the call when allocateSlot meet an exception

2018-06-20 Thread shuai.xu (JIRA)
shuai.xu created FLINK-9632: --- Summary: SlotPool should notify the call when allocateSlot meet an exception Key: FLINK-9632 URL: https://issues.apache.org/jira/browse/FLINK-9632 Project: Flink

[jira] [Updated] (FLINK-9632) SlotPool should notify the caller when allocateSlot meet an exception

2018-06-20 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuai.xu updated FLINK-9632: Summary: SlotPool should notify the caller when allocateSlot meet an exception (was: SlotPool should

[jira] [Created] (FLINK-9293) SlotPool should check slot id when accepting a slot offer with existing allocation id

2018-05-03 Thread shuai.xu (JIRA)
shuai.xu created FLINK-9293: --- Summary: SlotPool should check slot id when accepting a slot offer with existing allocation id Key: FLINK-9293 URL: https://issues.apache.org/jira/browse/FLINK-9293 Project:

[jira] [Created] (FLINK-7878) Extend the resource type user can define in ResourceSpec

2017-10-19 Thread shuai.xu (JIRA)
shuai.xu created FLINK-7878: --- Summary: Extend the resource type user can define in ResourceSpec Key: FLINK-7878 URL: https://issues.apache.org/jira/browse/FLINK-7878 Project: Flink Issue Type: Bug

[jira] [Assigned] (FLINK-7878) Extend the resource type user can define in ResourceSpec

2017-10-19 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuai.xu reassigned FLINK-7878: --- Assignee: shuai.xu > Extend the resource type user can define in ResourceSpec >

[jira] [Updated] (FLINK-7878) Extend the resource type user can define in ResourceSpec

2017-10-19 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuai.xu updated FLINK-7878: Labels: flip-6 (was: ) > Extend the resource type user can define in ResourceSpec >

[jira] [Assigned] (FLINK-7871) SlotPool should release its unused slot to RM

2017-10-27 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuai.xu reassigned FLINK-7871: --- Assignee: shuai.xu > SlotPool should release its unused slot to RM >

[jira] [Commented] (FLINK-8289) The RestServerEndpoint should return the address with real ip when getRestAdddress

2017-12-24 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16303117#comment-16303117 ] shuai.xu commented on FLINK-8289: - The RestServerEndpoint should never know whether there is a proxy, so I

[jira] [Closed] (FLINK-8289) The RestServerEndpoint should return the address with real ip when getRestAdddress

2018-01-15 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuai.xu closed FLINK-8289. --- Resolution: Fixed Fix Version/s: 1.5.0 > The RestServerEndpoint should return the address with real ip

[jira] [Closed] (FLINK-4504) Support user to decide whether the result of an operator is presistent

2018-01-15 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuai.xu closed FLINK-4504. --- Resolution: Won't Fix > Support user to decide whether the result of an operator is presistent >

[jira] [Closed] (FLINK-4444) Add a DFSInputChannel and DFSSubPartition

2018-01-15 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuai.xu closed FLINK-. --- Resolution: Won't Fix > Add a DFSInputChannel and DFSSubPartition > -

[jira] [Created] (FLINK-8442) Should recovery the input split when an execution failover with FailoverRegion

2018-01-17 Thread shuai.xu (JIRA)
shuai.xu created FLINK-8442: --- Summary: Should recovery the input split when an execution failover with FailoverRegion Key: FLINK-8442 URL: https://issues.apache.org/jira/browse/FLINK-8442 Project: Flink

[jira] [Updated] (FLINK-8434) The new yarn resource manager should take over the running task managers after failover

2018-01-15 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuai.xu updated FLINK-8434: Description: The app master which container the job master and yarn resource manager may failover during

[jira] [Created] (FLINK-8434) The new yarn resource manager should take over the running task managers after failover

2018-01-15 Thread shuai.xu (JIRA)
shuai.xu created FLINK-8434: --- Summary: The new yarn resource manager should take over the running task managers after failover Key: FLINK-8434 URL: https://issues.apache.org/jira/browse/FLINK-8434 Project:

[jira] [Created] (FLINK-8399) Use independent configurations for the different timeouts in slot manager

2018-01-09 Thread shuai.xu (JIRA)
shuai.xu created FLINK-8399: --- Summary: Use independent configurations for the different timeouts in slot manager Key: FLINK-8399 URL: https://issues.apache.org/jira/browse/FLINK-8399 Project: Flink

[jira] [Updated] (FLINK-8399) Use independent configurations for the different timeouts in slot manager

2018-01-09 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuai.xu updated FLINK-8399: Description: There are three parameter in slot manager to indicate the timeout for slot request to task

[jira] [Created] (FLINK-9884) Slot request may not be removed when it has already be assigned in slot manager

2018-07-18 Thread shuai.xu (JIRA)
shuai.xu created FLINK-9884: --- Summary: Slot request may not be removed when it has already be assigned in slot manager Key: FLINK-9884 URL: https://issues.apache.org/jira/browse/FLINK-9884 Project: Flink

[jira] [Created] (FLINK-9932) If task executor offer slot to job master timeout the first time, the slot will leak

2018-07-24 Thread shuai.xu (JIRA)
shuai.xu created FLINK-9932: --- Summary: If task executor offer slot to job master timeout the first time, the slot will leak Key: FLINK-9932 URL: https://issues.apache.org/jira/browse/FLINK-9932 Project:

  1   2   >