Update the link in Job.java for Flink examples

2016-03-10 Thread janardhan shetty
We need to update the Job.java file of 1.0 to hold the correct links of flink examples: Currently it is pointing to http://flink.apache.org/docs/latest/examples.html Correct link : https://ci.apache.org/projects/flink/flink-docs-master/apis/batch/examples.html

Re: a question about operatorChain.broadcastCheckpointBarrier

2016-03-10 Thread Ma GuoWei
it is very helpful。 thanks a lot now i know the souce task needs the lock。 Other tasks like the StreamTask will handle broadcast and checkpoint then process element so lock is “no use” in those tasks。 am i right? thanks your help very much! 发自我的 iPhone > 在 2016年3月10日,下午7:45,Aljoscha

Re: Flink-1.0.0 JobManager is not running in Docker Container on AWS

2016-03-10 Thread Deepak Jha
Hi Stephan, I am able to figure out the issue... Here is my explanation.. As I've said, I'm trying to setup Flink HA cluster in docker containers managed by Amazon ECS. I've a remote zookeeper cluster running in AWS. There are few issues when we deploy it using docker --- Flink uses

[jira] [Created] (FLINK-3605) DataSet.output(HadoopOutput) always expects a LongWritable as a key and throws an exception when supplied with other Writable Key Types

2016-03-10 Thread Andrew Palumbo (JIRA)
Andrew Palumbo created FLINK-3605: - Summary: DataSet.output(HadoopOutput) always expects a LongWritable as a key and throws an exception when supplied with other Writable Key Types Key: FLINK-3605 URL:

[jira] [Created] (FLINK-3604) Enable ignored Table API tests

2016-03-10 Thread Fabian Hueske (JIRA)
Fabian Hueske created FLINK-3604: Summary: Enable ignored Table API tests Key: FLINK-3604 URL: https://issues.apache.org/jira/browse/FLINK-3604 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-3603) Re-enable Table API explain

2016-03-10 Thread Fabian Hueske (JIRA)
Fabian Hueske created FLINK-3603: Summary: Re-enable Table API explain Key: FLINK-3603 URL: https://issues.apache.org/jira/browse/FLINK-3603 Project: Flink Issue Type: Improvement

Re: Flink-1.0.0 JobManager is not running in Docker Container on AWS

2016-03-10 Thread Stephan Ewen
Hi! Is it possible that the docker container config forbids to open ports? Flink will try to open some ports and needs the OS or container to permit that. Greetings, Stephan On Thu, Mar 10, 2016 at 6:27 PM, Deepak Jha wrote: > Hi Stephan, > I tried 0.10.2 as well still

Re: Flink-1.0.0 JobManager is not running in Docker Container on AWS

2016-03-10 Thread Deepak Jha
Hi Stephan, I tried 0.10.2 as well still running into the same issue. On Thursday, March 10, 2016, Deepak Jha wrote: > Yes. Flink 1.0.0 > > On Thursday, March 10, 2016, Stephan Ewen > wrote: > >> Hi! >>

[jira] [Created] (FLINK-3602) Recursive Types are not supported / crash TypeExtractor

2016-03-10 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-3602: --- Summary: Recursive Types are not supported / crash TypeExtractor Key: FLINK-3602 URL: https://issues.apache.org/jira/browse/FLINK-3602 Project: Flink Issue

[jira] [Created] (FLINK-3601) JobManagerTest times out on StopSignal test

2016-03-10 Thread Maximilian Michels (JIRA)
Maximilian Michels created FLINK-3601: - Summary: JobManagerTest times out on StopSignal test Key: FLINK-3601 URL: https://issues.apache.org/jira/browse/FLINK-3601 Project: Flink Issue

Re: Flink-1.0.0 JobManager is not running in Docker Container on AWS

2016-03-10 Thread Deepak Jha
Yes. Flink 1.0.0 On Thursday, March 10, 2016, Stephan Ewen wrote: > Hi! > > Is this Flink 1.0.0 ? > > Stephan > > > On Thu, Mar 10, 2016 at 6:02 AM, Deepak Jha > wrote: > > > Hi All, > > > > I'm trying to setup Flink 1.0.0 cluster on Docker

[jira] [Created] (FLINK-3600) Provide clear description network ports usage

2016-03-10 Thread Ufuk Celebi (JIRA)
Ufuk Celebi created FLINK-3600: -- Summary: Provide clear description network ports usage Key: FLINK-3600 URL: https://issues.apache.org/jira/browse/FLINK-3600 Project: Flink Issue Type:

Re: Flink-1.0.0 JobManager is not running in Docker Container on AWS

2016-03-10 Thread Stephan Ewen
Hi! Is this Flink 1.0.0 ? Stephan On Thu, Mar 10, 2016 at 6:02 AM, Deepak Jha wrote: > Hi All, > > I'm trying to setup Flink 1.0.0 cluster on Docker (separate containers for > jobmanager and taskmanager) inside AWS (Using AWS ECS service). I tested it > locally and its

Re: a question about operatorChain.broadcastCheckpointBarrier

2016-03-10 Thread Aljoscha Krettek
Hi, that call needs to be in the lock scope because we need to ensure that no element processing/element emission happens while we forward the checkpoint barrier and perform the checkpoint. Let me illustrate with an example. Say we have a source. What can happen in the source if the call is

[jira] [Created] (FLINK-3599) GSoC: Code Generation in Serializers

2016-03-10 Thread JIRA
Márton Balassi created FLINK-3599: - Summary: GSoC: Code Generation in Serializers Key: FLINK-3599 URL: https://issues.apache.org/jira/browse/FLINK-3599 Project: Flink Issue Type: Improvement

Re: Tuple performance and the curious JIT compiler

2016-03-10 Thread Márton Balassi
If the community can agree that the proposal that Gábor Horváth has suggested is a nice approach and can accept that the results will be coming around mid summer, then I would strongly suggest "reserving" him this topic. His previous experience makes him a strong candidate for the task. To add to

Re: Tuple performance and the curious JIT compiler

2016-03-10 Thread Ufuk Celebi
Very nice proposal! On Wed, Mar 9, 2016 at 6:35 PM, Stephan Ewen wrote: > Thanks for posting this. > > I think it is not super urgent (in the sense of weeks or few months), so > results around mid summer is probably good. > The background in LLVM is a very good base for this! >

[jira] [Created] (FLINK-3598) java.lang.NoSuchMethodError: org.apache.flink.api.java.typeutils.TypeExtractor.createTypeInfo

2016-03-10 Thread Rik Schreurs (JIRA)
Rik Schreurs created FLINK-3598: --- Summary: java.lang.NoSuchMethodError: org.apache.flink.api.java.typeutils.TypeExtractor.createTypeInfo Key: FLINK-3598 URL: https://issues.apache.org/jira/browse/FLINK-3598