Re: Moving from single-node, Maven examples to cluster execution

All right, I figured I’d have to do shading, but hadn’t gotten around to experimenting. I’ll try it out. Prez Cannady p: 617 500 3378 e: revp...@opencorrelate.org GH: https://github.com/opencorrelate LI:

Re: Moving from single-node, Maven examples to cluster execution

Hi Prez, You need to build a jar with all your dependencies bundled inside. With maven you can use maven-assembly-plugin for this, or with SBT there's sbt-assembly. Once you've done this, you can login to the JobManager node of your Flink cluster, copy the jar across and use the Flink command

Re: cluster execution

xD… a simple "hdfs dfs -chmod -R 777 /users" fixed it! > Am 01.02.2016 um 12:17 schrieb Till Rohrmann : > > Hi Lydia, > > I looks like that. I guess you should check your hdfs access rights. > > Cheers, > Till > > On Mon, Feb 1, 2016 at 11:28 AM, Lydia Ickler

Re: cluster execution

Hi Lydia, I looks like that. I guess you should check your hdfs access rights. Cheers, Till On Mon, Feb 1, 2016 at 11:28 AM, Lydia Ickler wrote: > Hi Till, > > thanks for your reply! > I tested it with the Wordcount example. > Everything works fine if I run the

cluster execution

Hi all, I am doing some operations on a DataSet> … (see code below) When I run my program on a cluster with 3 machines I can see within the web client that only my master is executing the program. Do I have to specify somewhere that all machines have to

Re: cluster execution

Hi Lydia, what do you mean with master? Usually when you submit a program to the cluster and don’t specify the parallelism in your program, then it will be executed with the parallelism.default value as parallelism. You can specify the value in your cluster configuration flink-config.yaml file.

Re: Cluster Execution - log

Hi! Seems that you have different versions of the code running locally and on the cluster. Is it possible that you did a code update locally (client), and forgot to update the cluster (or the other way around)? Greetings, Stephan On Thu, Jul 23, 2015 at 3:10 PM, Juan Fumero

Cluster execution -jar files-

Hi, I would like to use the createRemoteEnvironment to run the application in a cluster and I have some questions. Following the documentation in [1] It is not clear to me how to use it. What should be the content of the jar file? All the external libraries that I use? or need to include the

Re: Cluster execution -jar files-

As the JavaDoc explains: * @param jarFiles The JAR files with code that needs to be shipped to the cluster. If the program uses * user-defined functions, user-defined input formats, or any libraries, those must be * provided in the JAR