回复:Flink Yarn session

2018-01-28 Thread 邓俊华
-archives.apache.org/mod_mbox/flink-user/201710.mbox/%3CCAC27z=Povyq2OFimHdiOFd_E_hS7MVE7ttd8xn=oxttuqoc...@mail.gmail.com%3E --发件人:Soheil Pourbafrani 发送时间:2018年1月28日(星期日) 14:37收件人:user 主 题:Flink Yarn session I've set up a Hado

Flink Yarn session

2018-01-27 Thread Soheil Pourbafrani
I've set up a Hadoop HA cluster and I want to run Flink applications on YARN. The elaborated problem is in StackOverflow: Here is the question Please help!

Flink Yarn Session failures

2017-08-28 Thread Chan, Regina
Hi, Was trying to understand why it takes about 9 minutes between the last try to start a container and when it finally gets the sigterm to kill the YarnApplicationMasterRunner. Client: Calc Engine: 2017-08-28 12:39:23,596 INFO org.apache.flink.yarn.YarnClusterClient

Re: flink yarn-session failure

2015-11-19 Thread Robert Metzger
Hi Stefanos, the pasted yarn-site.xml file looks fine on the first sight. You don't need a yarn-site.xml file for Namenodes or DataNodes, these belong to HDFS. In YARN these components are called ResourceManager and NodeManager. You can usually create one yarn-site.xml file and copy it to all mac

Re: flink yarn-session failure

2015-11-19 Thread Stefanos Antaris
Yes. You are right. I cannot run any YARN application. However, i have no localhost in my yarn-site.xml. yarn.nodemanager.aux-services mapreduce_shuffle yarn.nodemanager.aux-services.mapreduce_shuffle.class org.apache.hadoop.mapred.ShuffleHandler

Re: flink yarn-session failure

2015-11-19 Thread Robert Metzger
The exception is thrown even before Flink code is executed, so I assume that your YARN setup is not properly working. Did you try running any other YARN application on the setup? I suspect that other systems like MapReduce or Spark will also not run on the environment. Maybe the yarn-site.xml on t

flink yarn-session failure

2015-11-19 Thread Stefanos Antaris
Hi to all, i am trying to use Flink with Hadoop yarn but i am facing an exception while trying to create a yarn-session. First of all, i have a Hadoop cluster with 20 VMs that uses yarn. I can start the Hadoop cluster and run Hadoop jobs without any problem. Furthermore, i am trying to deploy