Re: Flink on EC"

Hi Thomas, I'm sorry that nobody responded anymore. As you you've probably noticed, there is a lot of traffic on the mailing lists and sometimes stuff gets lost. Were you able to get the S3 file system running with Flink? If not, lets try to figure out why it is not picking up the config

Re: Flink on EC"

Hi Thomas, It appears Flink couldn't pick up the Hadoop configuration. Did you set the environment variables HADOOP_CONF_DIR or HADOOP_HOME? Best, Max On Sun, Nov 8, 2015 at 7:52 PM, Thomas Götzinger wrote: > Sorry for Confusing, > > the flink cluster throws following

Re: Flink on EC"

Sorry for Confusing, the flink cluster throws following stack trace.. org.apache.flink.client.program.ProgramInvocationException: The program execution failed: Failed to submit job 29a2a25d49aa0706588ccdb8b7e81c6c (Flink Java Job at Sun Nov 08 18:50:52 UTC 2015) at

Re: Flink on EC"

HI Fabian, thanks for reply. I use a karamel receipt to install flink on ec2.Currently I am using flink-0.9.1-bin-hadoop24.tgz . In that file the NativeS3FileSystem is included. First I’ve tried it with the

Re: Flink on EC"

Hi Thomas, Try to switch to Emr amo 3.5 and register hadoop's s3 FileSystem instead of the one packed with flink *Sent from my ZenFone On Oct 29, 2015 4:36 AM, "Thomas Götzinger" wrote: > Hello Flink Team, > > We at IESE Fraunhofer are evaluating Flink for a project and

Re: Flink on EC"

Hi Thomas, until recently, Flink provided an own implementation of a S3FileSystem which wasn't fully tested and buggy. We removed that implementation and are using now (in 0.10-SNAPSHOT) Hadoop's S3 implementation by default. If you want to continue using 0.9.1 you can configure Flink to use