[
https://issues.apache.org/jira/browse/FLINK-9554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16505627#comment-16505627
]
ASF GitHub Bot commented on FLINK-9554:
---------------------------------------
GitHub user zjffdu opened a pull request:
https://github.com/apache/flink/pull/6140
[FLINK-9554] flink scala shell doesn't work in yarn mode
## What is the purpose of the change
This PR is trying to fix the issue of scala-shell unable to run in yarn
mode.
## Brief change log
The root cause is the options of CustomCommandLine is missed which cause
the "-m yarn-cluster" can not be parsed correctly.
## Verifying this change
I verify it manually on a single node hadoop cluster. I think it is better
to add integration for that so that we can avoid the regression issue in
future. If necessary, I can create a ticket for it and do it in another PR.
## Does this pull request potentially affect one of the following parts:
- Dependencies (does it add or upgrade a dependency): ( no)
- The public API, i.e., is any changed class annotated with
`@Public(Evolving)`: (no)
- The serializers: (no)
- The runtime per-record code paths (performance sensitive): (no)
- Anything that affects deployment or recovery: JobManager (and its
components), Checkpointing, Yarn/Mesos, ZooKeeper: (no )
- The S3 file system connector: (no)
## Documentation
- Does this pull request introduce a new feature? (no)
- If yes, how is the feature documented? ( not documented)
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/zjffdu/flink FLINK-9554
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/flink/pull/6140.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #6140
----
commit f3d37d4799e51323fbbcd52cf972ac1d874d2514
Author: Jeff Zhang <zjffdu@...>
Date: 2018-06-07T09:47:32Z
save
commit d65058133ce220e2d4212b906d521b38b9ef53dd
Author: Jeff Zhang <zjffdu@...>
Date: 2018-06-08T02:39:27Z
[FLINK-9554] flink scala shell doesn't work in yarn mode
----
> flink scala shell doesn't work in yarn mode
> -------------------------------------------
>
> Key: FLINK-9554
> URL: https://issues.apache.org/jira/browse/FLINK-9554
> Project: Flink
> Issue Type: Bug
> Components: Scala Shell
> Affects Versions: 1.5.0
> Reporter: Jeff Zhang
> Priority: Major
>
> It still try to use StandaloneCluster even I specify it using yarn mode.
>
> Command I Use: bin/start-scala-shell.sh yarn -n 1
>
> {code:java}
> Starting Flink Shell:
> 2018-06-06 12:30:02,672 INFO
> org.apache.flink.configuration.GlobalConfiguration - Loading
> configuration property: jobmanager.rpc.address, localhost
> 2018-06-06 12:30:02,673 INFO
> org.apache.flink.configuration.GlobalConfiguration - Loading
> configuration property: jobmanager.rpc.port, 6123
> 2018-06-06 12:30:02,674 INFO
> org.apache.flink.configuration.GlobalConfiguration - Loading
> configuration property: jobmanager.heap.mb, 1024
> 2018-06-06 12:30:02,674 INFO
> org.apache.flink.configuration.GlobalConfiguration - Loading
> configuration property: taskmanager.heap.mb, 1024
> 2018-06-06 12:30:02,674 INFO
> org.apache.flink.configuration.GlobalConfiguration - Loading
> configuration property: taskmanager.numberOfTaskSlots, 1
> 2018-06-06 12:30:02,674 INFO
> org.apache.flink.configuration.GlobalConfiguration - Loading
> configuration property: parallelism.default, 1
> 2018-06-06 12:30:02,675 INFO
> org.apache.flink.configuration.GlobalConfiguration - Loading
> configuration property: rest.port, 8081
> Exception in thread "main" java.lang.UnsupportedOperationException: Can't
> deploy a standalone cluster.
> at
> org.apache.flink.client.deployment.StandaloneClusterDescriptor.deploySessionCluster(StandaloneClusterDescriptor.java:57)
> at
> org.apache.flink.client.deployment.StandaloneClusterDescriptor.deploySessionCluster(StandaloneClusterDescriptor.java:31)
> at
> org.apache.flink.api.scala.FlinkShell$.deployNewYarnCluster(FlinkShell.scala:272)
> at
> org.apache.flink.api.scala.FlinkShell$.fetchConnectionInfo(FlinkShell.scala:164)
> at org.apache.flink.api.scala.FlinkShell$.liftedTree1$1(FlinkShell.scala:194)
> at org.apache.flink.api.scala.FlinkShell$.startShell(FlinkShell.scala:193)
> at org.apache.flink.api.scala.FlinkShell$.main(FlinkShell.scala:135)
> at org.apache.flink.api.scala.FlinkShell.main(FlinkShell.scala){code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
