[jira] [Created] (FLINK-4779) Restoring from savepoint fails when BucketingSink has not yet created folder

2016-10-07 Thread static-max (JIRA)
static-max created FLINK-4779: - Summary: Restoring from savepoint fails when BucketingSink has not yet created folder Key: FLINK-4779 URL: https://issues.apache.org/jira/browse/FLINK-4779 Project: Flink

Aw: Re: Re: Re: Flink Gelly

2016-10-07 Thread dfki
Hi Fabian,    thanks for your reply.  I guess I will have to change something in my code in general to keep  the Hash Tables rather small.  Have a nice weekend!  Best, Dennis   Gesendet: Freitag, 07. Oktober 2016 um 13:31 Uhr Von: "Fabian Hueske" An: "dev@flink.apache.org"

Re: [VOTE] Release Apache Flink 1.1.3 (RC1)

2016-10-07 Thread Maximilian Michels
-1 overall (see below) +1 for: - scanned commit history for dubious changes - ran "mvn clean install -Dhadoop.version=2.6.0 -Pinclude-yarn-tests" successfully - started cluster via "./bin/start-cluster.sh" - run batch and streaming examples via web interface and CLI - used web interface for

[jira] [Created] (FLINK-4777) ContinuousFileMonitoringFunction may throw IOException when files are moved

2016-10-07 Thread Maximilian Michels (JIRA)
Maximilian Michels created FLINK-4777: - Summary: ContinuousFileMonitoringFunction may throw IOException when files are moved Key: FLINK-4777 URL: https://issues.apache.org/jira/browse/FLINK-4777

Re: [DISCUSS][FLIP-4] Enhance Window Evictor in Flink

2016-10-07 Thread Vishnu Viswanath
Hi Radu, Yes we can remove elements randomly using iterator.remove() Regards, Vishnu On Fri, Oct 7, 2016 at 2:57 AM, Radu Tudoran wrote: > Hi, > > I must apologies that I missed some of the email exchanges on this thread > and thus my remark/question might have been

[jira] [Created] (FLINK-4776) Move ExecutionGraph initialization into a dedicated class

2016-10-07 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-4776: --- Summary: Move ExecutionGraph initialization into a dedicated class Key: FLINK-4776 URL: https://issues.apache.org/jira/browse/FLINK-4776 Project: Flink Issue

Re: Issue in implementation of window operation

2016-10-07 Thread Stephan Ewen
Hi! There are some examples for how to write that in the documentation: https://ci.apache.org/projects/flink/flink-docs-release-1.1/apis/streaming/windows.html Best, Stephan On Fri, Oct 7, 2016 at 10:46 AM, MOHAMMAD SHAKIR wrote: > Hi, > I am trying to implement a

Re: Releasing Flink 1.1.3

2016-10-07 Thread Kostas Kloudas
Hi all, Tried the Kafka source and the continuous file sources and everything seems to be working fine. Kostas > On Oct 5, 2016, at 6:53 PM, Ufuk Celebi wrote: > > Thanks for your effort! > > I'm going to kick off the build now. :-) > > On Wed, Oct 5, 2016 at 5:59 PM,

[jira] [Created] (FLINK-4775) Simplify access to MetricStore

2016-10-07 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-4775: --- Summary: Simplify access to MetricStore Key: FLINK-4775 URL: https://issues.apache.org/jira/browse/FLINK-4775 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-4774) QueryScopeInfo scope concatenation broken

2016-10-07 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-4774: --- Summary: QueryScopeInfo scope concatenation broken Key: FLINK-4774 URL: https://issues.apache.org/jira/browse/FLINK-4774 Project: Flink Issue Type:

[jira] [Created] (FLINK-4771) Compression for AvroOutputFormat

2016-10-07 Thread Lars Bachmann (JIRA)
Lars Bachmann created FLINK-4771: Summary: Compression for AvroOutputFormat Key: FLINK-4771 URL: https://issues.apache.org/jira/browse/FLINK-4771 Project: Flink Issue Type: Improvement

Issue in implementation of window operation

2016-10-07 Thread MOHAMMAD SHAKIR
Hi, I am trying to implement a user defined function on the tumbling Window using "apply" function. Kindly help me by giving an example. Thanks and Regards Mohammad Shakir

Re: [VOTE] Release Apache Flink 1.1.3 (RC1)

2016-10-07 Thread Kostas Kloudas
Hi all, I tested the Kafka source and continuous file sources and everything seems to be working fine. Kostas > On Oct 6, 2016, at 3:37 PM, Fabian Hueske wrote: > > +1 to release (binding) > > - checked hashes and signatures > - checked diffs against 1.1.2: no

[jira] [Created] (FLINK-4772) Store metrics in MetricStore as strings

2016-10-07 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-4772: --- Summary: Store metrics in MetricStore as strings Key: FLINK-4772 URL: https://issues.apache.org/jira/browse/FLINK-4772 Project: Flink Issue Type:

[jira] [Created] (FLINK-4773) Introduce an OperatorIOMetricGroup

2016-10-07 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-4773: --- Summary: Introduce an OperatorIOMetricGroup Key: FLINK-4773 URL: https://issues.apache.org/jira/browse/FLINK-4773 Project: Flink Issue Type:

[FLINK-3035] Redis as State Backend

2016-10-07 Thread Ovidiu Cristian Marcu
Hi Can you please expand the last comment: "I think, however, that for other reasons we will probably not be able to implement this well. The problem is that we have to somehow get at the state in redis for checkpointing. And if we use only one Redis instance for all states then this will be

[jira] [Created] (FLINK-4778) Update program example in /docs/setup/cli.md due to the change in FLINK-2021

2016-10-07 Thread Pattarawat Chormai (JIRA)
Pattarawat Chormai created FLINK-4778: - Summary: Update program example in /docs/setup/cli.md due to the change in FLINK-2021 Key: FLINK-4778 URL: https://issues.apache.org/jira/browse/FLINK-4778

Re: [VOTE] Release Apache Flink 1.1.3 (RC1)

2016-10-07 Thread Stephan Ewen
Thanks, Max, for finding this. I looked at the pull request, looks good. Lets merge it and create another release candidate. For the testing of the RC1: - Joined Kostas with some verification of the Kafka 0.9 consumer behavior for low throughput streams - mvn clean verily for Scala 2.11,

Re: Re: Flink Gelly

2016-10-07 Thread Vasiliki Kalavri
Hi Dennis, On 7 October 2016 at 11:29, wrote: > Hi Vasia, > > thanks for your reply. > > Currently I am testing it on my normal workstation (16GB Ram) but I also > tried it on out cluster. > Both are failing at the same amount of nodes, so I guess it has something > to do with

Aw: Re: Re: Flink Gelly

2016-10-07 Thread dfki
Hi again,   I tried to change some configs and set the available amount memory to 4096mb  but there is no difference at all. Furthermore I monitored the usage of of RAM by the JVM and it does not go beyond 3gb at all.  I still don't think that the memory is the propblem. For me it looks like

Re: Re: Re: Flink Gelly

2016-10-07 Thread Fabian Hueske
Hi, the exception > java.lang.RuntimeException: Memory ran out. Compaction failed. says that the hash table ran out of memory. Gelly is implemented on top of Flink's DataSet API. So this would rather be a problem with DataSet than Gelly. I think Vasia is right about the memory configuration.

[jira] [Created] (FLINK-4764) Introduce config options

2016-10-07 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-4764: --- Summary: Introduce config options Key: FLINK-4764 URL: https://issues.apache.org/jira/browse/FLINK-4764 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-4765) Migrate ConfigConstants to ConfigOptions

2016-10-07 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-4765: --- Summary: Migrate ConfigConstants to ConfigOptions Key: FLINK-4765 URL: https://issues.apache.org/jira/browse/FLINK-4765 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-4766) Migrate TaskManager configuration options

2016-10-07 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-4766: --- Summary: Migrate TaskManager configuration options Key: FLINK-4766 URL: https://issues.apache.org/jira/browse/FLINK-4766 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-4767) Migrate JobManager configuration options

2016-10-07 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-4767: --- Summary: Migrate JobManager configuration options Key: FLINK-4767 URL: https://issues.apache.org/jira/browse/FLINK-4767 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-4763) Documentation doesn't update nightly

2016-10-07 Thread Maximilian Michels (JIRA)
Maximilian Michels created FLINK-4763: - Summary: Documentation doesn't update nightly Key: FLINK-4763 URL: https://issues.apache.org/jira/browse/FLINK-4763 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-4770) Migrate Job Execution configuration options

2016-10-07 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-4770: --- Summary: Migrate Job Execution configuration options Key: FLINK-4770 URL: https://issues.apache.org/jira/browse/FLINK-4770 Project: Flink Issue Type: Sub-task

Re: [DISCUSS][FLIP-4] Enhance Window Evictor in Flink

2016-10-07 Thread Vishnu Viswanath
Hi Aljoscha, To pass the time information to Evictor at the same to not expose the StreamRecord, I suppose we can change the signature of evictBefore and evictAfter to take Iterable> instead Iterable void evictBefore(Iterable> elements, int size, W

Assign issue

2016-10-07 Thread Anton Solovev
Hi folks. I want to do something for flink. As the first step I have started doing https://issues.apache.org/jira/browse/FLINK-4743, could you assign it for me in JIRA. Thanks. Anton Solovev Junior Software Engineer Office: +7 846 200 09 70 x 55621 Email:

[jira] [Created] (FLINK-4762) Use plural in time interval units

2016-10-07 Thread Timo Walther (JIRA)
Timo Walther created FLINK-4762: --- Summary: Use plural in time interval units Key: FLINK-4762 URL: https://issues.apache.org/jira/browse/FLINK-4762 Project: Flink Issue Type: Bug

RE: [DISCUSS][FLIP-4] Enhance Window Evictor in Flink

2016-10-07 Thread Radu Tudoran
Hi, I must apologies that I missed some of the email exchanges on this thread and thus my remark/question might have been already settled. Does this interface you propose enable to remove also elements out of order e.g., assuming I have elements 1,2,3,4,5 in the window buffer to be able to

Recall: Assign issue

2016-10-07 Thread Anton Solovev
Anton Solovev would like to recall the message, "Assign issue".

Assign issue

2016-10-07 Thread Anton Solovev
Hi folks. I want to do something for flink. As the first step I have started doing https://issues.apache.org/jira/browse/FLINK-4743, could you assign it for me in JIRA. Thanks. Best regards, Anton Solovev

Recall: Assign issue

2016-10-07 Thread Anton Solovev
Anton Solovev would like to recall the message, "Assign issue".

Re: Assign issue

2016-10-07 Thread Fabian Hueske
Hi Anton, I gave you Contributor permissions for JIRA and assigned the issue to you. You can now also assign other issues to yourself. Best, Fabian 2016-10-07 10:09 GMT+02:00 Anton Solovev : > Hi folks. > > > I want to do something for flink. As the first step I have

[jira] [Created] (FLINK-4768) Migrate High Availability configuration options

2016-10-07 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-4768: --- Summary: Migrate High Availability configuration options Key: FLINK-4768 URL: https://issues.apache.org/jira/browse/FLINK-4768 Project: Flink Issue Type:

[jira] [Created] (FLINK-4769) Migrate Metrics configuration options

2016-10-07 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-4769: --- Summary: Migrate Metrics configuration options Key: FLINK-4769 URL: https://issues.apache.org/jira/browse/FLINK-4769 Project: Flink Issue Type: Sub-task

Aw: Re: Flink Gelly

2016-10-07 Thread dfki
Hi Vasia,    thanks for your reply.    Currently I am testing it on my normal workstation (16GB Ram) but I also tried it on out cluster.  Both are failing at the same amount of nodes, so I guess it has something to do with Gelly or with the properties.   The configured memory is default. I did