[jira] [Commented] (FLINK-2326) Mutitenancy on Yarn
[ https://issues.apache.org/jira/browse/FLINK-2326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14717141#comment-14717141 ] ASF GitHub Bot commented on FLINK-2326: --- Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/1062#issuecomment-135503479 Will merge this... Mutitenancy on Yarn --- Key: FLINK-2326 URL: https://issues.apache.org/jira/browse/FLINK-2326 Project: Flink Issue Type: Improvement Components: YARN Client Affects Versions: 0.9 Environment: Centos 6.6 Hadoop 2.7 secured with kerberos Flink 0.9 Reporter: LINTE Assignee: Robert Metzger When a user launch a Flink cluster on yarn, i .yarn-properties file is created in the conf directory. In multiuser environnement the configuration directory is read only. Even with write permission for all user on conf directory, then just on user can run a Flink cluster. Regards -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (FLINK-2326) Mutitenancy on Yarn
[ https://issues.apache.org/jira/browse/FLINK-2326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14717262#comment-14717262 ] ASF GitHub Bot commented on FLINK-2326: --- Github user hsaputra commented on the pull request: https://github.com/apache/flink/pull/1062#issuecomment-135518748 Confirming that with my local travis also work. +1 Mutitenancy on Yarn --- Key: FLINK-2326 URL: https://issues.apache.org/jira/browse/FLINK-2326 Project: Flink Issue Type: Improvement Components: YARN Client Affects Versions: 0.9 Environment: Centos 6.6 Hadoop 2.7 secured with kerberos Flink 0.9 Reporter: LINTE Assignee: Robert Metzger When a user launch a Flink cluster on yarn, i .yarn-properties file is created in the conf directory. In multiuser environnement the configuration directory is read only. Even with write permission for all user on conf directory, then just on user can run a Flink cluster. Regards -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (FLINK-2326) Mutitenancy on Yarn
[ https://issues.apache.org/jira/browse/FLINK-2326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14716413#comment-14716413 ] ASF GitHub Bot commented on FLINK-2326: --- Github user chiwanpark commented on the pull request: https://github.com/apache/flink/pull/1062#issuecomment-135370510 I pulled this request into my local machine (OS X 10.9, JDK 1.8, Scala 2.10) and tested. I got an exception while running test four times: ``` 12:32:20,075 ERROR org.apache.flink.yarn.YARNSessionFIFOITCase - Test testJavaAPI(org.apache.flink.yarn.YARNSessionFIFOITCase) failed with: java.lang.AssertionError: There is at least one application on the cluster is not finished.App application_1440646275804_0005 is in state RUNNING at org.junit.Assert.fail(Assert.java:88) at org.apache.flink.yarn.YarnTestBase.checkClusterEmpty(YarnTestBase.java:147) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.rules.RunRules.evaluate(RunRules.java:20) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) at org.junit.rules.RunRules.evaluate(RunRules.java:20) at org.junit.runners.ParentRunner.run(ParentRunner.java:309) at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:264) at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:153) at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:124) at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) ``` Is this error unrelated? Mutitenancy on Yarn --- Key: FLINK-2326 URL: https://issues.apache.org/jira/browse/FLINK-2326 Project: Flink Issue Type: Improvement Components: YARN Client Affects Versions: 0.9 Environment: Centos 6.6 Hadoop 2.7 secured with kerberos Flink 0.9 Reporter: LINTE Assignee: Robert Metzger When a user launch a Flink cluster on yarn, i .yarn-properties file is created in the conf directory. In multiuser environnement the configuration directory is read only. Even with write permission for all user on conf directory, then just on user can run a Flink cluster. Regards -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (FLINK-2326) Mutitenancy on Yarn
[ https://issues.apache.org/jira/browse/FLINK-2326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14716422#comment-14716422 ] ASF GitHub Bot commented on FLINK-2326: --- Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1062#issuecomment-135371903 Can you check the logs of `application_1440646275804_0005`? They are located in `target/yarn-...`. Mutitenancy on Yarn --- Key: FLINK-2326 URL: https://issues.apache.org/jira/browse/FLINK-2326 Project: Flink Issue Type: Improvement Components: YARN Client Affects Versions: 0.9 Environment: Centos 6.6 Hadoop 2.7 secured with kerberos Flink 0.9 Reporter: LINTE Assignee: Robert Metzger When a user launch a Flink cluster on yarn, i .yarn-properties file is created in the conf directory. In multiuser environnement the configuration directory is read only. Even with write permission for all user on conf directory, then just on user can run a Flink cluster. Regards -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (FLINK-2326) Mutitenancy on Yarn
[ https://issues.apache.org/jira/browse/FLINK-2326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14716424#comment-14716424 ] ASF GitHub Bot commented on FLINK-2326: --- Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1062#issuecomment-135372331 The travis build passed btw. Mutitenancy on Yarn --- Key: FLINK-2326 URL: https://issues.apache.org/jira/browse/FLINK-2326 Project: Flink Issue Type: Improvement Components: YARN Client Affects Versions: 0.9 Environment: Centos 6.6 Hadoop 2.7 secured with kerberos Flink 0.9 Reporter: LINTE Assignee: Robert Metzger When a user launch a Flink cluster on yarn, i .yarn-properties file is created in the conf directory. In multiuser environnement the configuration directory is read only. Even with write permission for all user on conf directory, then just on user can run a Flink cluster. Regards -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (FLINK-2326) Mutitenancy on Yarn
[ https://issues.apache.org/jira/browse/FLINK-2326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14716442#comment-14716442 ] ASF GitHub Bot commented on FLINK-2326: --- Github user chiwanpark commented on the pull request: https://github.com/apache/flink/pull/1062#issuecomment-135374495 Here is `jobmanager-main.log` in `application_1440646275804_0005`: ``` 19:07:45,732 WARN org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 19:07:45,789 INFO org.apache.flink.yarn.ApplicationMaster$ - YARN daemon runs as chiwanpark setting user to execute Flink ApplicationMaster/JobManager to chiwanpark 19:07:45,792 INFO org.apache.flink.yarn.ApplicationMaster$ - 19:07:45,792 INFO org.apache.flink.yarn.ApplicationMaster$ - Starting YARN ApplicationMaster/JobManager (Version: 0.10-SNAPSHOT, Rev:473940e, Date:27.08.2015 @ 00:24:26 KST) 19:07:45,792 INFO org.apache.flink.yarn.ApplicationMaster$ - Current user: chiwanpark 19:07:45,792 INFO org.apache.flink.yarn.ApplicationMaster$ - JVM: Java HotSpot(TM) 64-Bit Server VM - Oracle Corporation - 1.8/25.45-b02 19:07:45,792 INFO org.apache.flink.yarn.ApplicationMaster$ - Maximum heap size: 161 MiBytes 19:07:45,792 INFO org.apache.flink.yarn.ApplicationMaster$ - JAVA_HOME: /Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home 19:07:45,792 INFO org.apache.flink.yarn.ApplicationMaster$ - JVM Options: 19:07:45,792 INFO org.apache.flink.yarn.ApplicationMaster$ - -Xmx168M 19:07:45,792 INFO org.apache.flink.yarn.ApplicationMaster$ - -Dlog.file=/Users/chiwanpark/IdeaProjects/flink/flink-yarn-tests/target/flink-yarn-tests-fifo/flink-yarn-tests-fifo-logDir-nm-0_0/application_1440670005972_0005/container_1440670005972_0005_01_01/jobmanager-main.log 19:07:45,792 INFO org.apache.flink.yarn.ApplicationMaster$ - -Dlogback.configurationFile=file:logback.xml 19:07:45,792 INFO org.apache.flink.yarn.ApplicationMaster$ - -Dlog4j.configuration=file:log4j.properties 19:07:45,792 INFO org.apache.flink.yarn.ApplicationMaster$ - Program Arguments: (none) 19:07:45,792 INFO org.apache.flink.yarn.ApplicationMaster$ - 19:07:45,793 INFO org.apache.flink.yarn.ApplicationMaster$ - registered UNIX signal handlers for [TERM, HUP, INT] 19:07:45,868 INFO org.apache.flink.yarn.ApplicationMaster$ - Loading config from: /Users/chiwanpark/IdeaProjects/flink/flink-yarn-tests/target/flink-yarn-tests-fifo/flink-yarn-tests-fifo-localDir-nm-0_0/usercache/chiwanpark/appcache/application_1440670005972_0005/container_1440670005972_0005_01_01. 19:07:45,884 INFO org.apache.flink.yarn.ApplicationMaster$ - Starting JobManager for YARN 19:07:46,248 INFO akka.event.slf4j.Slf4jLogger - Slf4jLogger started 19:07:46,287 INFO Remoting - Starting remoting 19:07:46,471 INFO Remoting - Remoting started; listening on addresses :[akka.tcp://flink@192.168.1.123:64985] 19:07:46,487 INFO org.apache.flink.runtime.blob.BlobServer - Created BLOB server storage directory /var/folders/80/mfngp4yj53ncx998zpny91c0gn/T/blobStore-d36178fe-9cc4-467f-a391-5b1d7da71adb 19:07:46,491 INFO org.apache.flink.runtime.blob.BlobServer - Started BLOB server at 0.0.0.0:64986 - max concurrent requests: 50 - max backlog: 1000 19:07:46,511 INFO org.apache.flink.yarn.ApplicationMaster$$anonfun$2$$anon$1- Starting JobManager at akka://flink/user/jobmanager#-1579769592. 19:07:46,526 INFO org.apache.flink.yarn.ApplicationMaster$ - Starting Job Manger web frontend. 19:07:46,528 INFO org.apache.flink.runtime.jobmanager.web.WebInfoServer - Setting up web info server, using web-root directory jar:file:/Users/chiwanpark/IdeaProjects/flink/flink-yarn-tests/target/flink-yarn-tests-fifo/flink-yarn-tests-fifo-localDir-nm-0_0/usercache/chiwanpark/appcache/application_1440670005972_0005/filecache/12/flink-dist-0.10-SNAPSHOT.jar!/web-docs-infoserver. 19:07:46,594 INFO org.eclipse.jetty.util.log -
[jira] [Commented] (FLINK-2326) Mutitenancy on Yarn
[ https://issues.apache.org/jira/browse/FLINK-2326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14716464#comment-14716464 ] ASF GitHub Bot commented on FLINK-2326: --- Github user chiwanpark commented on the pull request: https://github.com/apache/flink/pull/1062#issuecomment-135378762 I got `java.lang.AssertionError: Unable to find expected string 'The Flink YARN client has been started in detached mode' in log messages` also. I'll retry after reboot my machine. Mutitenancy on Yarn --- Key: FLINK-2326 URL: https://issues.apache.org/jira/browse/FLINK-2326 Project: Flink Issue Type: Improvement Components: YARN Client Affects Versions: 0.9 Environment: Centos 6.6 Hadoop 2.7 secured with kerberos Flink 0.9 Reporter: LINTE Assignee: Robert Metzger When a user launch a Flink cluster on yarn, i .yarn-properties file is created in the conf directory. In multiuser environnement the configuration directory is read only. Even with write permission for all user on conf directory, then just on user can run a Flink cluster. Regards -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (FLINK-2326) Mutitenancy on Yarn
[ https://issues.apache.org/jira/browse/FLINK-2326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14716511#comment-14716511 ] ASF GitHub Bot commented on FLINK-2326: --- Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1062#issuecomment-135396645 is it possible that you have some hadoop environment variables set (HADOOP_CONF_DIR, HADOOP_HOME, ..) ? Mutitenancy on Yarn --- Key: FLINK-2326 URL: https://issues.apache.org/jira/browse/FLINK-2326 Project: Flink Issue Type: Improvement Components: YARN Client Affects Versions: 0.9 Environment: Centos 6.6 Hadoop 2.7 secured with kerberos Flink 0.9 Reporter: LINTE Assignee: Robert Metzger When a user launch a Flink cluster on yarn, i .yarn-properties file is created in the conf directory. In multiuser environnement the configuration directory is read only. Even with write permission for all user on conf directory, then just on user can run a Flink cluster. Regards -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (FLINK-2326) Mutitenancy on Yarn
[ https://issues.apache.org/jira/browse/FLINK-2326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14716358#comment-14716358 ] ASF GitHub Bot commented on FLINK-2326: --- Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/1062#issuecomment-135362907 Looks good. Will merge this... Mutitenancy on Yarn --- Key: FLINK-2326 URL: https://issues.apache.org/jira/browse/FLINK-2326 Project: Flink Issue Type: Improvement Components: YARN Client Affects Versions: 0.9 Environment: Centos 6.6 Hadoop 2.7 secured with kerberos Flink 0.9 Reporter: LINTE Assignee: Robert Metzger When a user launch a Flink cluster on yarn, i .yarn-properties file is created in the conf directory. In multiuser environnement the configuration directory is read only. Even with write permission for all user on conf directory, then just on user can run a Flink cluster. Regards -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (FLINK-2326) Mutitenancy on Yarn
[ https://issues.apache.org/jira/browse/FLINK-2326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14716361#comment-14716361 ] ASF GitHub Bot commented on FLINK-2326: --- Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1062#issuecomment-135363533 Lets first wait for the builds to pass. The errors are actually not unrelated to my change. Mutitenancy on Yarn --- Key: FLINK-2326 URL: https://issues.apache.org/jira/browse/FLINK-2326 Project: Flink Issue Type: Improvement Components: YARN Client Affects Versions: 0.9 Environment: Centos 6.6 Hadoop 2.7 secured with kerberos Flink 0.9 Reporter: LINTE Assignee: Robert Metzger When a user launch a Flink cluster on yarn, i .yarn-properties file is created in the conf directory. In multiuser environnement the configuration directory is read only. Even with write permission for all user on conf directory, then just on user can run a Flink cluster. Regards -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (FLINK-2326) Mutitenancy on Yarn
[ https://issues.apache.org/jira/browse/FLINK-2326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14716367#comment-14716367 ] ASF GitHub Bot commented on FLINK-2326: --- Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/1062#issuecomment-135364251 I would have checked it anyways again, but I'll delay my tests then. IIRC, this should go into 0.10-milestone1? Mutitenancy on Yarn --- Key: FLINK-2326 URL: https://issues.apache.org/jira/browse/FLINK-2326 Project: Flink Issue Type: Improvement Components: YARN Client Affects Versions: 0.9 Environment: Centos 6.6 Hadoop 2.7 secured with kerberos Flink 0.9 Reporter: LINTE Assignee: Robert Metzger When a user launch a Flink cluster on yarn, i .yarn-properties file is created in the conf directory. In multiuser environnement the configuration directory is read only. Even with write permission for all user on conf directory, then just on user can run a Flink cluster. Regards -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (FLINK-2326) Mutitenancy on Yarn
[ https://issues.apache.org/jira/browse/FLINK-2326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14716542#comment-14716542 ] ASF GitHub Bot commented on FLINK-2326: --- Github user chiwanpark commented on the pull request: https://github.com/apache/flink/pull/1062#issuecomment-135401201 @rmetzger Oh, after I clean my local maven repository and rebuild all projects, then the test works. Sorry for wrong reporting. Mutitenancy on Yarn --- Key: FLINK-2326 URL: https://issues.apache.org/jira/browse/FLINK-2326 Project: Flink Issue Type: Improvement Components: YARN Client Affects Versions: 0.9 Environment: Centos 6.6 Hadoop 2.7 secured with kerberos Flink 0.9 Reporter: LINTE Assignee: Robert Metzger When a user launch a Flink cluster on yarn, i .yarn-properties file is created in the conf directory. In multiuser environnement the configuration directory is read only. Even with write permission for all user on conf directory, then just on user can run a Flink cluster. Regards -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (FLINK-2326) Mutitenancy on Yarn
[ https://issues.apache.org/jira/browse/FLINK-2326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14714422#comment-14714422 ] ASF GitHub Bot commented on FLINK-2326: --- GitHub user rmetzger opened a pull request: https://github.com/apache/flink/pull/1062 [FLINK-2326] Write yarn properties file to temp directory Flink's YARN client is writing a `.yarn-properties` file to the `conf/` directory containing the JobManager's host and port. It seems that at least two users were installing Flink into a read only location, thus Flink was unable to write the properties file to `conf/`. With this change, the file is written into the `/tmp/` directory with the current user's name. This will allow to use a shared Flink installation with different users at the same time. I also introduced a configuration value to change the location of the properties file. You can merge this pull request into a Git repository by running: $ git pull https://github.com/rmetzger/flink flink2326 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/flink/pull/1062.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1062 commit 473940eda06e2874d6b2cec5e50ee07d6054f438 Author: Robert Metzger rmetz...@apache.org Date: 2015-08-26T14:11:30Z [FLINK-2326] Write yarn properties file to temp directory Mutitenancy on Yarn --- Key: FLINK-2326 URL: https://issues.apache.org/jira/browse/FLINK-2326 Project: Flink Issue Type: Improvement Components: YARN Client Affects Versions: 0.9 Environment: Centos 6.6 Hadoop 2.7 secured with kerberos Flink 0.9 Reporter: LINTE Assignee: Robert Metzger When a user launch a Flink cluster on yarn, i .yarn-properties file is created in the conf directory. In multiuser environnement the configuration directory is read only. Even with write permission for all user on conf directory, then just on user can run a Flink cluster. Regards -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (FLINK-2326) Mutitenancy on Yarn
[ https://issues.apache.org/jira/browse/FLINK-2326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14715567#comment-14715567 ] ASF GitHub Bot commented on FLINK-2326: --- Github user hsaputra commented on the pull request: https://github.com/apache/flink/pull/1062#issuecomment-135177677 +1 LGTM The build errors seem unrelated, but @rmetzger could you try in your fork to see if they pass? Mutitenancy on Yarn --- Key: FLINK-2326 URL: https://issues.apache.org/jira/browse/FLINK-2326 Project: Flink Issue Type: Improvement Components: YARN Client Affects Versions: 0.9 Environment: Centos 6.6 Hadoop 2.7 secured with kerberos Flink 0.9 Reporter: LINTE Assignee: Robert Metzger When a user launch a Flink cluster on yarn, i .yarn-properties file is created in the conf directory. In multiuser environnement the configuration directory is read only. Even with write permission for all user on conf directory, then just on user can run a Flink cluster. Regards -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (FLINK-2326) Mutitenancy on Yarn
[ https://issues.apache.org/jira/browse/FLINK-2326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14713585#comment-14713585 ] LINTE commented on FLINK-2326: -- [~rmetzger], thank you, it will allow us to collocalize many durable flink cluster in an Hadoop multitenancy environment. Mutitenancy on Yarn --- Key: FLINK-2326 URL: https://issues.apache.org/jira/browse/FLINK-2326 Project: Flink Issue Type: Improvement Components: YARN Client Affects Versions: 0.9 Environment: Centos 6.6 Hadoop 2.7 secured with kerberos Flink 0.9 Reporter: LINTE Assignee: Robert Metzger When a user launch a Flink cluster on yarn, i .yarn-properties file is created in the conf directory. In multiuser environnement the configuration directory is read only. Even with write permission for all user on conf directory, then just on user can run a Flink cluster. Regards -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (FLINK-2326) Mutitenancy on Yarn
[ https://issues.apache.org/jira/browse/FLINK-2326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14618664#comment-14618664 ] LINTE commented on FLINK-2326: -- Thanks for your feed back. I think i will be better to write .yarn-properties to ~/.flink/.yarn-properties. I will be easier to manage for multi tenant environement (with users segregation and common product installation). Regards Mutitenancy on Yarn --- Key: FLINK-2326 URL: https://issues.apache.org/jira/browse/FLINK-2326 Project: Flink Issue Type: Improvement Components: YARN Client Affects Versions: 0.9 Environment: Centos 6.6 Hadoop 2.7 secured with kerberos Flink 0.9 Reporter: LINTE When a user launch a Flink cluster on yarn, i .yarn-properties file is created in the conf directory. In multiuser environnement the configuration directory is read only. Even with write permission for all user on conf directory, then just on user can run a Flink cluster. Regards -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (FLINK-2326) Mutitenancy on Yarn
[ https://issues.apache.org/jira/browse/FLINK-2326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14618668#comment-14618668 ] Robert Metzger commented on FLINK-2326: --- Okay, I understand. If you want, I can introduce a configuration value which allows setting a custom path for the .yarn-properties file. Is this issue blocking you from using Flink in production? Mutitenancy on Yarn --- Key: FLINK-2326 URL: https://issues.apache.org/jira/browse/FLINK-2326 Project: Flink Issue Type: Improvement Components: YARN Client Affects Versions: 0.9 Environment: Centos 6.6 Hadoop 2.7 secured with kerberos Flink 0.9 Reporter: LINTE When a user launch a Flink cluster on yarn, i .yarn-properties file is created in the conf directory. In multiuser environnement the configuration directory is read only. Even with write permission for all user on conf directory, then just on user can run a Flink cluster. Regards -- This message was sent by Atlassian JIRA (v6.3.4#6332)
