[jira] [Commented] (FLINK-11105) Add a new implementation of the HighAvailabilityServices using etcd

2018-12-12 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-11105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1671#comment-1671 ] Yang Wang commented on FLINK-11105: --- [~Tison], [~till.rohrmann], [~yanghua] Thanks for all your

[jira] [Comment Edited] (FLINK-11105) Add a new implementation of the HighAvailabilityServices using etcd

2018-12-12 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-11105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1671#comment-1671 ] Yang Wang edited comment on FLINK-11105 at 12/12/18 12:05 PM: -- [~Tison],

[jira] [Commented] (FLINK-11078) Capability to define the numerical range for running TaskExecutors

2018-12-16 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-11078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16722729#comment-16722729 ] Yang Wang commented on FLINK-11078: --- I think this is a very useful feature, especially for running

[jira] [Created] (FLINK-11105) Add an new implementation of the HighAvailabilityServices using etcd

2018-12-07 Thread Yang Wang (JIRA)
Yang Wang created FLINK-11105: - Summary: Add an new implementation of the HighAvailabilityServices using etcd Key: FLINK-11105 URL: https://issues.apache.org/jira/browse/FLINK-11105 Project: Flink

[jira] [Updated] (FLINK-11105) Add a new implementation of the HighAvailabilityServices using etcd

2018-12-07 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-11105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated FLINK-11105: -- Summary: Add a new implementation of the HighAvailabilityServices using etcd (was: Add an new

[jira] [Commented] (FLINK-11105) Add a new implementation of the HighAvailabilityServices using etcd

2018-12-28 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-11105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16730197#comment-16730197 ] Yang Wang commented on FLINK-11105: --- [~ssy] Thanks for your proposal. I have assigned this ticket to

[jira] [Assigned] (FLINK-11105) Add a new implementation of the HighAvailabilityServices using etcd

2018-12-28 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-11105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang reassigned FLINK-11105: - Assignee: Shengyang Sha (was: Yang Wang) > Add a new implementation of the

[jira] [Commented] (FLINK-11484) Blink java.util.concurrent.TimeoutException

2019-01-31 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-11484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758024#comment-16758024 ] Yang Wang commented on FLINK-11484: --- [~pijing] You do not need 200 slots because the slot sharing is

[jira] [Commented] (FLINK-11484) Blink java.util.concurrent.TimeoutException

2019-02-01 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-11484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758848#comment-16758848 ] Yang Wang commented on FLINK-11484: --- Blink share the slots by default, you could run the following

[jira] [Commented] (FLINK-11484) Blink java.util.concurrent.TimeoutException

2019-01-31 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-11484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16757108#comment-16757108 ] Yang Wang commented on FLINK-11484: --- [~pijing], thanks for your feedback. {code:java} ./flink run -m

[jira] [Updated] (FLINK-12160) Support for transferring user config files on kubernetes

2019-04-10 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated FLINK-12160: -- Issue Type: Sub-task (was: New Feature) Parent: FLINK-9953 > Support for transferring user

[jira] [Created] (FLINK-12160) Support for transferring user config files on kubernetes

2019-04-10 Thread Yang Wang (JIRA)
Yang Wang created FLINK-12160: - Summary: Support for transferring user config files on kubernetes Key: FLINK-12160 URL: https://issues.apache.org/jira/browse/FLINK-12160 Project: Flink Issue

[jira] [Assigned] (FLINK-12160) Support for transferring user config files on kubernetes

2019-04-15 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang reassigned FLINK-12160: - Assignee: Yang Wang > Support for transferring user config files on kubernetes >

[jira] [Commented] (FLINK-12751) Create file based HA support

2019-06-11 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16860638#comment-16860638 ] Yang Wang commented on FLINK-12751: --- The file based HA assumes that there is only one job manager is

[jira] [Commented] (FLINK-12751) Create file based HA support

2019-07-08 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16880105#comment-16880105 ] Yang Wang commented on FLINK-12751: --- Hi [~Xeli], i am not sure the backend implementation of PVC

[jira] [Comment Edited] (FLINK-12751) Create file based HA support

2019-07-08 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16873830#comment-16873830 ] Yang Wang edited comment on FLINK-12751 at 7/8/19 8:07 AM: --- [~borisl] Sorry

[jira] [Commented] (FLINK-13127) "--yarnship" doesn't support resource classloading

2019-07-08 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-13127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16880157#comment-16880157 ] Yang Wang commented on FLINK-13127: --- Hi [~davidmoravek], You are correct. The shipped files and jars

[jira] [Commented] (FLINK-13685) YARN deployment hangs when requested container is above the maximum vcore size

2019-08-11 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-13685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904830#comment-16904830 ] Yang Wang commented on FLINK-13685: --- Hi [~gyfora], Thanks for creating this ticket. You are right.

[jira] [Updated] (FLINK-13685) YARN deployment hangs when requested container is above the maximum vcore size

2019-08-11 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-13685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated FLINK-13685: -- Description: When deploying on YARN flink explicitly checks whether the requested container  vcores 

[jira] [Commented] (FLINK-13758) failed to submit JobGraph when registered hdfs file in DistributedCache

2019-08-18 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-13758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16910139#comment-16910139 ] Yang Wang commented on FLINK-13758: --- Hi [~luoguohao] Do you mean to register a cached file located on

[jira] [Commented] (FLINK-13787) PrometheusPushGatewayReporter does not cleanup TM metrics when run on kubernetes

2019-08-21 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16912910#comment-16912910 ] Yang Wang commented on FLINK-13787: --- I agree with [~kaibo.zhou]. Prometheus pushgateway with TTL

[jira] [Commented] (FLINK-13633) Move submittedJobGraph and completedCheckpoint to cluster-id subdirectory of high-availability storage

2019-09-03 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16921239#comment-16921239 ] Yang Wang commented on FLINK-13633: --- [~azagrebin] I have submitted a PR, please help to review. 

[jira] [Commented] (FLINK-13633) Move submittedJobGraph and completedCheckpoint to cluster-id subdirectory of high-availability storage

2019-09-03 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16921301#comment-16921301 ] Yang Wang commented on FLINK-13633: --- Hi [~azagrebin] Sorry for that. Next time, i will wait for a

[jira] [Updated] (FLINK-13938) Use yarn public distributed cache to speed up containers launch

2019-09-03 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated FLINK-13938: -- Description: By default, the LocalResourceVisibility is APPLICATION, so they will be downloaded only

[jira] [Commented] (FLINK-13938) Use yarn public distributed cache to speed up containers launch

2019-09-03 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16921883#comment-16921883 ] Yang Wang commented on FLINK-13938: --- [~yanghua], thanks for your comments. I think we could benefit

[jira] [Commented] (FLINK-13838) Support -yta(--yarnshipArchives) arguments in flink run command line

2019-09-03 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16921956#comment-16921956 ] Yang Wang commented on FLINK-13838: --- Hi [~Zentol] It is just a command-line argument and forwarding

[jira] [Commented] (FLINK-13839) Support to set yarn node label for flink jobmanager and taskmanager container

2019-08-25 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915455#comment-16915455 ] Yang Wang commented on FLINK-13839: --- Hi [~yanghua], Thanks for your kind reminder. I think this

[jira] [Created] (FLINK-13938) Use yarn public distributed cache to speed up containers launch

2019-09-02 Thread Yang Wang (Jira)
Yang Wang created FLINK-13938: - Summary: Use yarn public distributed cache to speed up containers launch Key: FLINK-13938 URL: https://issues.apache.org/jira/browse/FLINK-13938 Project: Flink

[jira] [Created] (FLINK-13837) Support --files and --libjars arguments in flink run command line

2019-08-23 Thread Yang Wang (Jira)
Yang Wang created FLINK-13837: - Summary: Support --files and --libjars arguments in flink run command line Key: FLINK-13837 URL: https://issues.apache.org/jira/browse/FLINK-13837 Project: Flink

[jira] [Created] (FLINK-13838) Support -yta(--yarnshipArchives) arguments in flink run command line

2019-08-23 Thread Yang Wang (Jira)
Yang Wang created FLINK-13838: - Summary: Support -yta(--yarnshipArchives) arguments in flink run command line Key: FLINK-13838 URL: https://issues.apache.org/jira/browse/FLINK-13838 Project: Flink

[jira] [Created] (FLINK-13839) Support to set yarn node label for flink jobmanager and taskmanager container

2019-08-23 Thread Yang Wang (Jira)
Yang Wang created FLINK-13839: - Summary: Support to set yarn node label for flink jobmanager and taskmanager container Key: FLINK-13839 URL: https://issues.apache.org/jira/browse/FLINK-13839 Project:

[jira] [Commented] (FLINK-13838) Support -yta(--yarnshipArchives) arguments in flink run command line

2019-09-04 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16922396#comment-16922396 ] Yang Wang commented on FLINK-13838: --- The use case is some users already have a tar.gz and want to ship

[jira] [Commented] (FLINK-13838) Support -yta(--yarnshipArchives) arguments in flink run command line

2019-09-04 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16922436#comment-16922436 ] Yang Wang commented on FLINK-13838: --- Aha, i think we are on the same page now. The local resource in

[jira] [Commented] (FLINK-14051) Deploy job cluster in attached mode

2019-09-16 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930267#comment-16930267 ] Yang Wang commented on FLINK-14051: --- I agree with [~Tison] that the code path should be more clearly.

[jira] [Commented] (FLINK-14033) Distributed caches are not registered in Yarn Per Job Cluster Mode

2019-09-16 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930302#comment-16930302 ] Yang Wang commented on FLINK-14033: --- Seems that UserArtifacts is not added to yarn distributed cache

[jira] [Commented] (FLINK-13838) Support -yta(--yarnshipArchives) arguments in flink run command line

2019-09-16 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930308#comment-16930308 ] Yang Wang commented on FLINK-13838: --- [~Zentol] Yes, it is supported by all hadoop version(2.4.1 and

[jira] [Commented] (FLINK-9953) Active Kubernetes integration

2019-08-07 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16901759#comment-16901759 ] Yang Wang commented on FLINK-9953: -- Hi [~frank wang], Thanks for you attention. Chunhui Shi, Ji Liu and

[jira] [Commented] (FLINK-13590) flink-on-yarn sometimes could create many little files that are xxx-taskmanager-conf.yaml

2019-08-07 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-13590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16901791#comment-16901791 ] Yang Wang commented on FLINK-13590: --- Hi [~shu_wen...@qq.com] Thanks for sharing this issue. I think

[jira] [Commented] (FLINK-13590) flink-on-yarn sometimes could create many little files that are xxx-taskmanager-conf.yaml

2019-08-07 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-13590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16901979#comment-16901979 ] Yang Wang commented on FLINK-13590: --- [~shu_wen...@qq.com], it seems that the containers completed

[jira] [Created] (FLINK-13633) Move submittedJobGraph and completedCheckpoint to cluster-id subdirectory of high-availability storage

2019-08-07 Thread Yang Wang (JIRA)
Yang Wang created FLINK-13633: - Summary: Move submittedJobGraph and completedCheckpoint to cluster-id subdirectory of high-availability storage Key: FLINK-13633 URL: https://issues.apache.org/jira/browse/FLINK-13633

[jira] [Commented] (FLINK-13324) flink-shaded-hadoop could exclude curator dependency

2019-07-24 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-13324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16891737#comment-16891737 ] Yang Wang commented on FLINK-13324: --- Hi [~Tison], The curator has been shaded in flink-shaded-hadoop

[jira] [Commented] (FLINK-13324) flink-shaded-hadoop could exclude curator dependency

2019-07-25 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-13324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16892533#comment-16892533 ] Yang Wang commented on FLINK-13324: --- [~Tison] Sorry for late. # The configuration element true is to

[jira] [Commented] (FLINK-14033) Distributed caches are not registered in Yarn Per Job Cluster Mode

2019-09-18 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16932995#comment-16932995 ] Yang Wang commented on FLINK-14033: --- [~ZhenqiuHuang] Yeah, even many users are using -yt to distribute

[jira] [Updated] (FLINK-14172) Implement KubeClient with official Java client library for kubernetes

2019-09-23 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated FLINK-14172: -- Parent: FLINK-9953 Issue Type: Sub-task (was: New Feature) > Implement KubeClient with

[jira] [Created] (FLINK-14172) Implement KubeClient with official Java client library for kubernetes

2019-09-23 Thread Yang Wang (Jira)
Yang Wang created FLINK-14172: - Summary: Implement KubeClient with official Java client library for kubernetes Key: FLINK-14172 URL: https://issues.apache.org/jira/browse/FLINK-14172 Project: Flink

[jira] [Commented] (FLINK-14268) YARN AM endless restarts when using wrong checkpoint path or wrong checkpoint

2019-09-29 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940627#comment-16940627 ] Yang Wang commented on FLINK-14268: --- Do you mean `yarn.application-attempts` does not works? I have

[jira] [Commented] (FLINK-12751) Create file based HA support

2019-06-26 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16873830#comment-16873830 ] Yang Wang commented on FLINK-12751: --- [~borisl] Sorry for the late. Just as you say, job manager

[jira] [Commented] (FLINK-13132) Allow ClusterEntrypoints use user main method to generate job graph

2019-07-10 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-13132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16881759#comment-16881759 ] Yang Wang commented on FLINK-13132: --- Hi [~suez1224], [~ZhenqiuHuang] Generating job graph in the

[jira] [Commented] (FLINK-13162) Default value of slot.idle.timeout is too large for batch job

2019-07-10 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-13162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16881800#comment-16881800 ] Yang Wang commented on FLINK-13162: --- Hi [~zjffdu] This may happen in blink, but not in flink now. In

[jira] [Commented] (FLINK-13127) "--yarnship" doesn't support resource classloading

2019-07-10 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-13127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16881808#comment-16881808 ] Yang Wang commented on FLINK-13127: --- Hi David, Sounds great. It is exactly what we want. Just make

[jira] [Commented] (FLINK-14582) Do not upload {uuid}-taskmanager-conf.yaml for each task manager container

2019-11-05 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968044#comment-16968044 ] Yang Wang commented on FLINK-14582: --- [~trohrmann] I will take a look at the PR and help to verify

[jira] [Comment Edited] (FLINK-13184) Starting a TaskExecutor blocks the YarnResourceManager's main thread

2019-11-10 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16971079#comment-16971079 ] Yang Wang edited comment on FLINK-13184 at 11/10/19 12:24 PM: -- [~trohrmann]

[jira] [Commented] (FLINK-14501) Move ClusterDescriptor/ClusterSpecification creation from the CustomCommandLine to a ClusterClientFactory

2019-10-31 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964531#comment-16964531 ] Yang Wang commented on FLINK-14501: --- Glad to see that Jira has been resolved. I will add a

[jira] [Updated] (FLINK-13938) Use pre-uploaded flink binary to accelerate flink submission

2019-11-14 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated FLINK-13938: -- Summary: Use pre-uploaded flink binary to accelerate flink submission (was: Use yarn public

[jira] [Commented] (FLINK-14382) Incorrect handling of FLINK_PLUGINS_DIR on Yarn

2019-11-05 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16967410#comment-16967410 ] Yang Wang commented on FLINK-14382: --- [~pnowojski] [~trohrmann] I have attached a PR to fix this

[jira] [Commented] (FLINK-13938) Use yarn public distributed cache to speed up containers launch

2019-11-08 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16970025#comment-16970025 ] Yang Wang commented on FLINK-13938: --- [~tison] Thanks for your comments. The files and jars in the

[jira] [Commented] (FLINK-13184) Starting a TaskExecutor blocks the YarnResourceManager's main thread

2019-11-10 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16971079#comment-16971079 ] Yang Wang commented on FLINK-13184: --- [~trohrmann] `NMClientAsync` use a internal thread pool to

[jira] [Commented] (FLINK-15007) Flink on YARN does not request required TaskExecutors in some cases

2019-12-03 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16986770#comment-16986770 ] Yang Wang commented on FLINK-15007: --- I think [~xintongsong] is right. I am developing the active Flink

[jira] [Commented] (FLINK-15036) Container startup error will be handled out side of the YarnResourceManager's main thread

2019-12-03 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16986913#comment-16986913 ] Yang Wang commented on FLINK-15036: --- [~trohrmann] You are right. It should be handled in the main

[jira] [Comment Edited] (FLINK-15036) Container startup error will be handled out side of the YarnResourceManager's main thread

2019-12-03 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16986913#comment-16986913 ] Yang Wang edited comment on FLINK-15036 at 12/3/19 1:54 PM: [~trohrmann] You

[jira] [Comment Edited] (FLINK-15053) Configurations with values contains space may cause TM failures on Yarn

2019-12-04 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16988404#comment-16988404 ] Yang Wang edited comment on FLINK-15053 at 12/5/19 2:52 AM: [~xintongsong] I

[jira] [Commented] (FLINK-15053) Configurations with values contains space may cause TM failures on Yarn

2019-12-04 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16988395#comment-16988395 ] Yang Wang commented on FLINK-15053: --- [~xintongsong] Thanks for creating this ticket. I think it just

[jira] [Commented] (FLINK-15053) Configurations with values contains space may cause TM failures on Yarn

2019-12-04 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16988404#comment-16988404 ] Yang Wang commented on FLINK-15053: --- [~xintongsong] I think single quotation marks works for all the 

[jira] [Updated] (FLINK-10934) Support per-job mode in kubernetes

2019-12-09 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-10934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated FLINK-10934: -- Parent: (was: FLINK-9953) Issue Type: New Feature (was: Sub-task) > Support per-job mode

[jira] [Updated] (FLINK-10939) Add documents for Flink on native k8s

2019-12-09 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-10939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated FLINK-10939: -- Fix Version/s: 1.10.0 > Add documents for Flink on native k8s > -

[jira] [Updated] (FLINK-9953) Active Kubernetes integration

2019-12-09 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-9953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated FLINK-9953: - Fix Version/s: 1.10.0 > Active Kubernetes integration > - > >

[jira] [Updated] (FLINK-14460) Active Kubernetes integration phase2 - Production Optimization

2019-12-09 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated FLINK-14460: -- Fix Version/s: (was: 1.10.0) > Active Kubernetes integration phase2 - Production Optimization >

[jira] [Updated] (FLINK-14460) Active Kubernetes integration phase2 - Production Optimization

2019-12-09 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated FLINK-14460: -- Fix Version/s: 1.10.0 > Active Kubernetes integration phase2 - Production Optimization >

[jira] [Updated] (FLINK-9953) Active Kubernetes integration

2019-12-09 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-9953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated FLINK-9953: - Description: This is the umbrella issue tracking Flink's active Kubernetes integration. Active means in

[jira] [Updated] (FLINK-9953) Active Kubernetes integration

2019-12-09 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-9953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated FLINK-9953: - Labels: (was: pull-request-available) > Active Kubernetes integration > -

[jira] [Updated] (FLINK-10934) Support per-job mode in kubernetes

2019-12-09 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-10934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated FLINK-10934: -- Parent: FLINK-14460 Issue Type: Sub-task (was: New Feature) > Support per-job mode in

[jira] [Updated] (FLINK-9953) Active Kubernetes integration

2019-12-09 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-9953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated FLINK-9953: - Issue Type: Bug (was: New Feature) > Active Kubernetes integration > - > >

[jira] [Created] (FLINK-15153) Service selector needs to contain jobmanager component label

2019-12-09 Thread Yang Wang (Jira)
Yang Wang created FLINK-15153: - Summary: Service selector needs to contain jobmanager component label Key: FLINK-15153 URL: https://issues.apache.org/jira/browse/FLINK-15153 Project: Flink

[jira] [Updated] (FLINK-10938) Enable Flink on native k8s E2E Tests in Travis CI

2019-12-09 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-10938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated FLINK-10938: -- Priority: Blocker (was: Major) > Enable Flink on native k8s E2E Tests in Travis CI >

[jira] [Updated] (FLINK-10939) Add documents for Flink on native k8s

2019-12-09 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-10939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated FLINK-10939: -- Priority: Blocker (was: Major) > Add documents for Flink on native k8s >

[jira] [Commented] (FLINK-15053) Configurations with values contains space may cause TM failures on Yarn

2019-12-09 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16991494#comment-16991494 ] Yang Wang commented on FLINK-15053: --- All the value of dynamic properties will be put into a pair of

[jira] [Updated] (FLINK-9953) Active Kubernetes integration

2019-12-09 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-9953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated FLINK-9953: - Issue Type: New Feature (was: Bug) > Active Kubernetes integration > - > >

[jira] [Updated] (FLINK-15153) Service selector needs to contain jobmanager component label

2019-12-09 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated FLINK-15153: -- Fix Version/s: 1.10.0 > Service selector needs to contain jobmanager component label >

[jira] [Updated] (FLINK-15153) Service selector needs to contain jobmanager component label

2019-12-09 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated FLINK-15153: -- Component/s: Deployment / Kubernetes > Service selector needs to contain jobmanager component label >

[jira] [Updated] (FLINK-10938) Enable Flink on native k8s E2E Tests in Travis CI

2019-12-09 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-10938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated FLINK-10938: -- Fix Version/s: 1.10.0 > Enable Flink on native k8s E2E Tests in Travis CI >

[jira] [Commented] (FLINK-15053) Configurations with values contains space may cause TM failures on Yarn

2019-12-10 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992467#comment-16992467 ] Yang Wang commented on FLINK-15053: --- [~trohrmann], thanks for your comment. I will try to give a fix

[jira] [Updated] (FLINK-15153) Service selector needs to contain jobmanager component label

2019-12-10 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated FLINK-15153: -- Priority: Critical (was: Major) > Service selector needs to contain jobmanager component label >

[jira] [Comment Edited] (FLINK-15179) Kubernetes should not have a CustomCommandLine.

2019-12-12 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16995321#comment-16995321 ] Yang Wang edited comment on FLINK-15179 at 12/13/19 4:28 AM: - [~trohrmann] 

[jira] [Commented] (FLINK-15179) Kubernetes should not have a CustomCommandLine.

2019-12-12 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16995321#comment-16995321 ] Yang Wang commented on FLINK-15179: --- [~trohrmann] Thanks a lot for your comments. [~kkl0u] I think we

[jira] [Commented] (FLINK-15194) Directories in distributed caches are not extracted in Yarn Per Job Cluster Mode

2019-12-12 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16995405#comment-16995405 ] Yang Wang commented on FLINK-15194: --- [~zhongwei] Many thanks for your quick response. [~trohrmann] 

[jira] [Comment Edited] (FLINK-15179) Kubernetes should not have a CustomCommandLine.

2019-12-13 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16995321#comment-16995321 ] Yang Wang edited comment on FLINK-15179 at 12/13/19 8:19 AM: - [~trohrmann] 

[jira] [Commented] (FLINK-15179) Kubernetes should not have a CustomCommandLine.

2019-12-10 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16993241#comment-16993241 ] Yang Wang commented on FLINK-15179: --- Hi, [~kkl0u] Does `AbstractCustomCommandLine` will be deprecated

[jira] [Commented] (FLINK-15153) Service selector needs to contain jobmanager component label

2019-12-10 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16993251#comment-16993251 ] Yang Wang commented on FLINK-15153: --- [~dian.fu] Thanks for your kindly reminding. I have opened a

[jira] [Commented] (FLINK-15226) Running job with application parameters fails on a job cluster

2019-12-13 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16995630#comment-16995630 ] Yang Wang commented on FLINK-15226: --- I'm curious what do you want to do? Do you want to add some your

[jira] [Commented] (FLINK-15248) FileUtils#compressDirectory behaves buggy when processing relative directory path

2019-12-13 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16995614#comment-16995614 ] Yang Wang commented on FLINK-15248: --- How about add some java document description that the target

[jira] [Updated] (FLINK-10938) Enable active kubernetes integration e2e test for session cluster

2019-12-13 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-10938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated FLINK-10938: -- Summary: Enable active kubernetes integration e2e test for session cluster (was: Enable Flink on

[jira] [Commented] (FLINK-15288) Starting jobmanager pod should respect containerized.heap-cutoff

2019-12-17 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16998106#comment-16998106 ] Yang Wang commented on FLINK-15288: --- [~trohrmann] Could you please assign this ticket to me? I will

[jira] [Updated] (FLINK-10938) Add e2e test for natively running Flink session cluster on Kubernetes

2019-12-16 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-10938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated FLINK-10938: -- Summary: Add e2e test for natively running Flink session cluster on Kubernetes (was: Enable active

[jira] [Created] (FLINK-15288) Starting jobmanager pod should respect containerized.heap-cutoff

2019-12-16 Thread Yang Wang (Jira)
Yang Wang created FLINK-15288: - Summary: Starting jobmanager pod should respect containerized.heap-cutoff Key: FLINK-15288 URL: https://issues.apache.org/jira/browse/FLINK-15288 Project: Flink

[jira] [Updated] (FLINK-15251) Fabric8FlinkKubeClient doesn't work if ingress has hostname but no IP

2019-12-16 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated FLINK-15251: -- Parent: FLINK-9953 Issue Type: Sub-task (was: Bug) > Fabric8FlinkKubeClient doesn't work if

[jira] [Commented] (FLINK-15195) Remove unused KubernetesConfigOptionsInternal.ENTRY_POINT_CLASS_ARGS

2019-12-11 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16993448#comment-16993448 ] Yang Wang commented on FLINK-15195: --- [~kkl0u], you are right. 

[jira] [Created] (FLINK-15197) Add resource related config options to dynamical properties for Kubernetes

2019-12-11 Thread Yang Wang (Jira)
Yang Wang created FLINK-15197: - Summary: Add resource related config options to dynamical properties for Kubernetes Key: FLINK-15197 URL: https://issues.apache.org/jira/browse/FLINK-15197 Project: Flink

[jira] [Updated] (FLINK-15153) Service selector needs to contain jobmanager component label

2019-12-11 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated FLINK-15153: -- Parent: FLINK-9953 Issue Type: Sub-task (was: Bug) > Service selector needs to contain

[jira] [Commented] (FLINK-15053) Configurations with values contains space may cause TM failures on Yarn

2019-12-11 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16993513#comment-16993513 ] Yang Wang commented on FLINK-15053: --- [~gjy] [~trohrmann] I have attached a PR for this ticket. Please

[jira] [Commented] (FLINK-15179) Kubernetes should not have a CustomCommandLine.

2019-12-11 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16993444#comment-16993444 ] Yang Wang commented on FLINK-15179: --- [~kkl0u] Thanks a lot for your clarification. It makes sense to

  1   2   3   4   5   6   7   8   9   10   >