[jira] [Created] (FLINK-8649) Scala StreamExecutionEnvironment.createInput should pass on the TypeInfo

2018-02-13 Thread Gabor Gevay (JIRA)
Gabor Gevay created FLINK-8649: -- Summary: Scala StreamExecutionEnvironment.createInput should pass on the TypeInfo Key: FLINK-8649 URL: https://issues.apache.org/jira/browse/FLINK-8649 Project: Flink

[jira] [Commented] (FLINK-8116) Stale comments referring to Checkpointed interface

2017-11-26 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16266003#comment-16266003 ] Gabor Gevay commented on FLINK-8116: Hi, The mentions of the Checkpointed interface need to be

[jira] [Resolved] (FLINK-8117) Eliminate modulo operation from RoundRobinChannelSelector and RebalancePartitioner

2017-11-24 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gevay resolved FLINK-8117. Resolution: Implemented > Eliminate modulo operation from RoundRobinChannelSelector and >

[jira] [Updated] (FLINK-8130) Javadocs link for snapshot release is not correct

2017-11-22 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gevay updated FLINK-8130: --- Fix Version/s: (was: 1.4.0) 1.5.0 > Javadocs link for snapshot release is not

[jira] [Updated] (FLINK-8117) Eliminate modulo operation from RoundRobinChannelSelector and RebalancePartitioner

2017-11-21 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gevay updated FLINK-8117: --- Description: {{RoundRobinChannelSelector}}, {{RebalancePartitioner}}, and {{RescalePartitioner}} use

[jira] [Created] (FLINK-8117) Eliminate modulo operation from RoundRobinChannelSelector and RebalancePartitioner

2017-11-20 Thread Gabor Gevay (JIRA)
Gabor Gevay created FLINK-8117: -- Summary: Eliminate modulo operation from RoundRobinChannelSelector and RebalancePartitioner Key: FLINK-8117 URL: https://issues.apache.org/jira/browse/FLINK-8117

[jira] [Updated] (FLINK-7702) Javadocs are not being built

2017-11-20 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gevay updated FLINK-7702: --- Fix Version/s: (was: 1.4.0) 1.5.0 > Javadocs are not being built >

[jira] [Created] (FLINK-8116) Stale comments referring to Checkpointed interface

2017-11-20 Thread Gabor Gevay (JIRA)
Gabor Gevay created FLINK-8116: -- Summary: Stale comments referring to Checkpointed interface Key: FLINK-8116 URL: https://issues.apache.org/jira/browse/FLINK-8116 Project: Flink Issue Type: Bug

[jira] [Reopened] (FLINK-7702) Javadocs are not being built

2017-11-20 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gevay reopened FLINK-7702: Assignee: (was: Aljoscha Krettek) I'm reopening this, since it seems that this is again not

[jira] [Commented] (FLINK-4575) DataSet aggregate methods should support POJOs

2017-11-13 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16249444#comment-16249444 ] Gabor Gevay commented on FLINK-4575: OK, makes sense. Feel free to close this jira, if you think we

[jira] [Commented] (FLINK-4575) DataSet aggregate methods should support POJOs

2017-11-12 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248874#comment-16248874 ] Gabor Gevay commented on FLINK-4575: [~vcycyv], I'm not sure how would {{getFlatFields}} help here.

[jira] [Commented] (FLINK-7916) Remove NetworkStackThroughputITCase

2017-10-25 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16218609#comment-16218609 ] Gabor Gevay commented on FLINK-7916: In {{flink-tests}} there is a package called

[jira] [Commented] (FLINK-1268) FileOutputFormat with overwrite does not clear local output directories

2017-10-10 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198727#comment-16198727 ] Gabor Gevay commented on FLINK-1268: This issue just happened to me. I ran my job locally with

[jira] [Updated] (FLINK-7702) Javadocs link broken

2017-09-27 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gevay updated FLINK-7702: --- Fix Version/s: 1.4.0 > Javadocs link broken > > > Key:

[jira] [Created] (FLINK-7702) Javadocs link broken

2017-09-27 Thread Gabor Gevay (JIRA)
Gabor Gevay created FLINK-7702: -- Summary: Javadocs link broken Key: FLINK-7702 URL: https://issues.apache.org/jira/browse/FLINK-7702 Project: Flink Issue Type: Bug Components:

[jira] [Created] (FLINK-7685) CompilerException: "Bug: Logic for branching plans (non-tree plans) has an error, and does not track the re-joining of branches correctly"

2017-09-25 Thread Gabor Gevay (JIRA)
Gabor Gevay created FLINK-7685: -- Summary: CompilerException: "Bug: Logic for branching plans (non-tree plans) has an error, and does not track the re-joining of branches correctly" Key: FLINK-7685 URL:

[jira] [Created] (FLINK-7680) Add "Performance Tuning" section to docs

2017-09-24 Thread Gabor Gevay (JIRA)
Gabor Gevay created FLINK-7680: -- Summary: Add "Performance Tuning" section to docs Key: FLINK-7680 URL: https://issues.apache.org/jira/browse/FLINK-7680 Project: Flink Issue Type: Improvement

[jira] [Updated] (FLINK-7629) Scala stream aggregations should support nested field expressions

2017-09-17 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gevay updated FLINK-7629: --- Description: In the Scala API, {{KeyedStream.maxBy}} and similar methods currently only work with a

[jira] [Created] (FLINK-7629) Scala stream aggregations should support nested field expressions

2017-09-15 Thread Gabor Gevay (JIRA)
Gabor Gevay created FLINK-7629: -- Summary: Scala stream aggregations should support nested field expressions Key: FLINK-7629 URL: https://issues.apache.org/jira/browse/FLINK-7629 Project: Flink

[jira] [Resolved] (FLINK-4867) Investigate code generation for improving sort performance

2017-09-05 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gevay resolved FLINK-4867. Resolution: Done I'm closing this, as [~heytitle] did the performance investigation, and concluded

[jira] [Assigned] (FLINK-5734) Implement code generation for NormalizedKeySorter

2017-09-05 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gevay reassigned FLINK-5734: -- Assignee: Gabor Gevay > Implement code generation for NormalizedKeySorter >

[jira] [Updated] (FLINK-5734) Implement code generation for NormalizedKeySorter

2017-09-05 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gevay updated FLINK-5734: --- Description: Link to design document :

[jira] [Updated] (FLINK-5734) Implement code generation for NormalizedKeySorter

2017-09-05 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gevay updated FLINK-5734: --- Fix Version/s: 1.4.0 > Implement code generation for NormalizedKeySorter >

[jira] [Commented] (FLINK-2147) Approximate calculation of frequencies in data streams

2017-04-04 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15955166#comment-15955166 ] Gabor Gevay commented on FLINK-2147: Maybe we could over-partition the sketch into maxParallelism

[jira] [Reopened] (FLINK-2144) Incremental count, average, and variance for windows

2017-04-03 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gevay reopened FLINK-2144: Reopening to change it back to "Won't fix", instead of "Fixed" > Incremental count, average, and

[jira] [Resolved] (FLINK-2144) Incremental count, average, and variance for windows

2017-04-03 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gevay resolved FLINK-2144. Resolution: Won't Fix > Incremental count, average, and variance for windows >

[jira] [Commented] (FLINK-5888) ForwardedFields annotation is not generating optimised execution plan in example KMeans job

2017-02-22 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15878779#comment-15878779 ] Gabor Gevay commented on FLINK-5888: Just a wild guess: Is it possible that the shuffle actually ended

[jira] [Commented] (FLINK-1730) Add a FlinkTools.persist style method to the Data Set.

2017-02-13 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15863673#comment-15863673 ] Gabor Gevay commented on FLINK-1730: Hi [~kateri] I'm also really looking forward to this feature.

[jira] [Commented] (FLINK-4867) Investigate code generation for improving sort performance

2016-10-20 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15592359#comment-15592359 ] Gabor Gevay commented on FLINK-4867: Hm, this sounds quite interesting. Could you please share the

[jira] [Assigned] (FLINK-4867) Investigate code generation for improving sort performance

2016-10-20 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gevay reassigned FLINK-4867: -- Assignee: Gabor Gevay > Investigate code generation for improving sort performance >

[jira] [Commented] (FLINK-4867) Investigate code generation for improving sort performance

2016-10-20 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15592367#comment-15592367 ] Gabor Gevay commented on FLINK-4867: That's nice, thanks! > Investigate code generation for improving

[jira] [Updated] (FLINK-4869) Store record pointer after record keys

2016-10-20 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gevay updated FLINK-4869: --- Labels: performance (was: ) > Store record pointer after record keys >

[jira] [Updated] (FLINK-4860) Sort performance

2016-10-20 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gevay updated FLINK-4860: --- Component/s: Local Runtime > Sort performance > > > Key: FLINK-4860

[jira] [Updated] (FLINK-4860) Sort performance

2016-10-20 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gevay updated FLINK-4860: --- Labels: performance (was: ) > Sort performance > > > Key:

[jira] [Updated] (FLINK-4868) Insertion sort could avoid the swaps

2016-10-20 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gevay updated FLINK-4868: --- Description: This is about the fallback to insertion sort at the beginning of

[jira] [Created] (FLINK-4868) Insertion sort could avoid the swaps

2016-10-20 Thread Gabor Gevay (JIRA)
Gabor Gevay created FLINK-4868: -- Summary: Insertion sort could avoid the swaps Key: FLINK-4868 URL: https://issues.apache.org/jira/browse/FLINK-4868 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-4867) Investigate code generation for improving sort performance

2016-10-20 Thread Gabor Gevay (JIRA)
Gabor Gevay created FLINK-4867: -- Summary: Investigate code generation for improving sort performance Key: FLINK-4867 URL: https://issues.apache.org/jira/browse/FLINK-4867 Project: Flink Issue

[jira] [Comment Edited] (FLINK-3999) Rename the `running` flag in the drivers to `canceled`

2016-10-18 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587764#comment-15587764 ] Gabor Gevay edited comment on FLINK-3999 at 10/19/16 5:47 AM: -- Won't Fix; See

[jira] [Resolved] (FLINK-3999) Rename the `running` flag in the drivers to `canceled`

2016-10-18 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gevay resolved FLINK-3999. Resolution: Won't Fix See comment here:

[jira] [Commented] (FLINK-3322) MemoryManager creates too much GC pressure with iterative jobs

2016-09-11 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15482191#comment-15482191 ] Gabor Gevay commented on FLINK-3322: [~ram_krish] You are right, making the sorters resettable will be

[jira] [Commented] (FLINK-3322) MemoryManager creates too much GC pressure with iterative jobs

2016-09-08 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15474575#comment-15474575 ] Gabor Gevay commented on FLINK-3322: I've just realized that what I wrote above doesn't cover the

[jira] [Commented] (FLINK-3322) MemoryManager creates too much GC pressure with iterative jobs

2016-09-08 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15474531#comment-15474531 ] Gabor Gevay commented on FLINK-3322: I had an offline chat with [~StephanEwen], and an alternative

[jira] [Commented] (FLINK-4578) AggregateOperator incorrectly sets ForwardedField with nested composite types

2016-09-04 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15463363#comment-15463363 ] Gabor Gevay commented on FLINK-4578: A hacky solution might be to create some dummy {{Keys}} object

[jira] [Commented] (FLINK-4575) DataSet aggregate methods should support POJOs

2016-09-04 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15463360#comment-15463360 ] Gabor Gevay commented on FLINK-4575: This is a bit harder than I thought, because of adding the

[jira] [Updated] (FLINK-4575) DataSet aggregate methods should support POJOs

2016-09-04 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gevay updated FLINK-4575: --- Assignee: (was: Gabor Gevay) > DataSet aggregate methods should support POJOs >

[jira] [Created] (FLINK-4578) AggregateOperator incorrectly sets ForwardedField with nested composite types

2016-09-04 Thread Gabor Gevay (JIRA)
Gabor Gevay created FLINK-4578: -- Summary: AggregateOperator incorrectly sets ForwardedField with nested composite types Key: FLINK-4578 URL: https://issues.apache.org/jira/browse/FLINK-4578 Project:

[jira] [Assigned] (FLINK-4575) DataSet aggregate methods should support POJOs

2016-09-04 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gevay reassigned FLINK-4575: -- Assignee: Gabor Gevay > DataSet aggregate methods should support POJOs >

[jira] [Created] (FLINK-4575) DataSet aggregate methods should support POJOs

2016-09-04 Thread Gabor Gevay (JIRA)
Gabor Gevay created FLINK-4575: -- Summary: DataSet aggregate methods should support POJOs Key: FLINK-4575 URL: https://issues.apache.org/jira/browse/FLINK-4575 Project: Flink Issue Type:

[jira] [Updated] (FLINK-2662) CompilerException: "Bug: Plan generation for Unions picked a ship strategy between binary plan operators."

2016-08-31 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gevay updated FLINK-2662: --- Priority: Critical (was: Major) > CompilerException: "Bug: Plan generation for Unions picked a ship

[jira] [Commented] (FLINK-3322) MemoryManager creates too much GC pressure with iterative jobs

2016-08-26 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15438599#comment-15438599 ] Gabor Gevay commented on FLINK-3322: Yes, I think Stephan meant that you would be mainly working on

[jira] [Commented] (FLINK-3322) MemoryManager creates too much GC pressure with iterative jobs

2016-08-25 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15437410#comment-15437410 ] Gabor Gevay commented on FLINK-3322: Yes, I volunteer to help :) > MemoryManager creates too much GC

[jira] [Comment Edited] (FLINK-3322) MemoryManager creates too much GC pressure with iterative jobs

2016-08-25 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15436605#comment-15436605 ] Gabor Gevay edited comment on FLINK-3322 at 8/25/16 10:05 AM: -- I think it

[jira] [Commented] (FLINK-3322) MemoryManager creates too much GC pressure with iterative jobs

2016-08-25 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15436605#comment-15436605 ] Gabor Gevay commented on FLINK-3322: I think it would be very good to finally solve this issue!

[jira] [Updated] (FLINK-3999) Rename the `running` flag in the drivers to `canceled`

2016-08-24 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gevay updated FLINK-3999: --- Assignee: Neelesh Srinivas Salian > Rename the `running` flag in the drivers to `canceled` >

[jira] [Commented] (FLINK-3999) Rename the `running` flag in the drivers to `canceled`

2016-08-24 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435446#comment-15435446 ] Gabor Gevay commented on FLINK-3999: Yes, thank you for working on it! > Rename the `running` flag in

[jira] [Updated] (FLINK-3722) The divisions in the InMemorySorters' swap/compare methods hurt performance

2016-08-21 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gevay updated FLINK-3722: --- Assignee: (was: Gabor Gevay) > The divisions in the InMemorySorters' swap/compare methods hurt

[jira] [Resolved] (FLINK-3291) Object reuse bug in MergeIterator.HeadStream.nextHead

2016-08-21 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gevay resolved FLINK-3291. Resolution: Fixed > Object reuse bug in MergeIterator.HeadStream.nextHead >

[jira] [Updated] (FLINK-3322) MemoryManager creates too much GC pressure with iterative jobs

2016-08-21 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gevay updated FLINK-3322: --- Assignee: (was: Gabor Horvath) > MemoryManager creates too much GC pressure with iterative jobs >

[jira] [Updated] (FLINK-3322) MemoryManager creates too much GC pressure with iterative jobs

2016-08-21 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gevay updated FLINK-3322: --- Component/s: (was: Distributed Coordination) Local Runtime > MemoryManager

[jira] [Updated] (FLINK-3394) Clear up the contract of MutableObjectIterator.next(reuse)

2016-08-21 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gevay updated FLINK-3394: --- Component/s: (was: Distributed Coordination) Local Runtime > Clear up the

[jira] [Comment Edited] (FLINK-3279) Optionally disable DistinctOperator combiner

2016-07-15 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15379599#comment-15379599 ] Gabor Gevay edited comment on FLINK-3279 at 7/15/16 4:00 PM: - I think no. And

[jira] [Commented] (FLINK-3279) Optionally disable DistinctOperator combiner

2016-07-15 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15379599#comment-15379599 ] Gabor Gevay commented on FLINK-3279: https://issues.apache.org/jira/browse/FLINK-3479? > Optionally

[jira] [Commented] (FLINK-4029) Multi-field "sum" function just like "keyBy"

2016-07-08 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15367631#comment-15367631 ] Gabor Gevay commented on FLINK-4029: You might want to reuse the FieldAccessor infrastructure that is

[jira] [Updated] (FLINK-1730) Add a FlinkTools.persist style method to the Data Set.

2016-06-03 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gevay updated FLINK-1730: --- Priority: Major (was: Minor) > Add a FlinkTools.persist style method to the Data Set. >

[jira] [Created] (FLINK-3999) Rename the `running` flag in the drivers to `canceled`

2016-05-31 Thread Gabor Gevay (JIRA)
Gabor Gevay created FLINK-3999: -- Summary: Rename the `running` flag in the drivers to `canceled` Key: FLINK-3999 URL: https://issues.apache.org/jira/browse/FLINK-3999 Project: Flink Issue Type:

[jira] [Commented] (FLINK-3291) Object reuse bug in MergeIterator.HeadStream.nextHead

2016-05-27 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15303994#comment-15303994 ] Gabor Gevay commented on FLINK-3291: This bug occurred when object reuse is enabled. This is disabled

[jira] [Commented] (FLINK-3702) DataStream API PojoFieldAccessor doesn't support nested POJOs

2016-05-22 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15295698#comment-15295698 ] Gabor Gevay commented on FLINK-3702: This turned out to be more complicated than I thought, but I'm

[jira] [Assigned] (FLINK-3702) DataStream API PojoFieldAccessor doesn't support nested POJOs

2016-05-22 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gevay reassigned FLINK-3702: -- Assignee: Gabor Gevay > DataStream API PojoFieldAccessor doesn't support nested POJOs >

[jira] [Commented] (FLINK-3702) DataStream API PojoFieldAccessor doesn't support nested POJOs

2016-05-22 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15295621#comment-15295621 ] Gabor Gevay commented on FLINK-3702: I'll try to quickly do it now. > DataStream API

[jira] [Commented] (FLINK-2144) Incremental count, average, and variance for windows

2016-05-20 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15293629#comment-15293629 ] Gabor Gevay commented on FLINK-2144: But why couldn't we provide FoldFunctions for these in the API?

[jira] [Commented] (FLINK-2147) Approximate calculation of frequencies in data streams

2016-05-19 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15291006#comment-15291006 ] Gabor Gevay commented on FLINK-2147: > From a first look, something like StreamGroupedFold would be

[jira] [Commented] (FLINK-2147) Approximate calculation of frequencies in data streams

2016-05-16 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15284479#comment-15284479 ] Gabor Gevay commented on FLINK-2147: Yes. We should probably look in the direction of FoldFunction,

[jira] [Updated] (FLINK-2144) Incremental count, average, and variance for windows

2016-05-16 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gevay updated FLINK-2144: --- Summary: Incremental count, average, and variance for windows (was: Implement incremental count,

[jira] [Commented] (FLINK-2142) GSoC project: Exact and Approximate Statistics for Data Streams and Windows

2016-05-16 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15284474#comment-15284474 ] Gabor Gevay commented on FLINK-2142: (I've also broken off FLINK-2144.) > GSoC project: Exact and

[jira] [Updated] (FLINK-2144) Implement incremental count, average, and variance for windows

2016-05-16 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gevay updated FLINK-2144: --- Summary: Implement incremental count, average, and variance for windows (was: Implement count,

[jira] [Updated] (FLINK-2144) Implement incremental count, average, and variance for windows

2016-05-16 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gevay updated FLINK-2144: --- Assignee: (was: Gabor Gevay) > Implement incremental count, average, and variance for windows >

[jira] [Updated] (FLINK-2144) Implement count, average, and variance for windows

2016-05-16 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gevay updated FLINK-2144: --- Issue Type: New Feature (was: Sub-task) Parent: (was: FLINK-2142) > Implement count,

[jira] [Commented] (FLINK-2144) Implement count, average, and variance for windows

2016-05-16 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15284473#comment-15284473 ] Gabor Gevay commented on FLINK-2144: Originally, I wanted to make this calculation incremental both on

[jira] [Commented] (FLINK-2147) Approximate calculation of frequencies in data streams

2016-05-16 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15284468#comment-15284468 ] Gabor Gevay commented on FLINK-2147: (Note that the out-of-order problem that I mentioned for the

[jira] [Commented] (FLINK-2147) Approximate calculation of frequencies in data streams

2016-05-16 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15284467#comment-15284467 ] Gabor Gevay commented on FLINK-2147: In my opinion, the semantics would be to calculate the statistic

[jira] [Commented] (FLINK-2147) Approximate calculation of frequencies in data streams

2016-05-16 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15284437#comment-15284437 ] Gabor Gevay commented on FLINK-2147: I'm actually now closing the incremental median and similar

[jira] [Commented] (FLINK-2142) GSoC project: Exact and Approximate Statistics for Data Streams and Windows

2016-05-16 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15284435#comment-15284435 ] Gabor Gevay commented on FLINK-2142: This proposal was based on the old (pre-0.10) windowing API. I'm

[jira] [Resolved] (FLINK-2145) Median calculation for windows

2016-05-16 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gevay resolved FLINK-2145. Resolution: Won't Fix I'm closing this, as it was based on assumptions of the old (pre-0.10)

[jira] [Commented] (FLINK-2147) Approximate calculation of frequencies in data streams

2016-05-16 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15284427#comment-15284427 ] Gabor Gevay commented on FLINK-2147: OK, we can certainly think about it. It would probably make

[jira] [Updated] (FLINK-2147) Approximate calculation of frequencies in data streams

2016-05-16 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gevay updated FLINK-2147: --- Labels: approximate statistics (was: statistics) > Approximate calculation of frequencies in data

[jira] [Updated] (FLINK-2148) Approximately calculate the number of distinct elements of a stream

2016-05-16 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gevay updated FLINK-2148: --- Labels: approximate statistics (was: statistics) > Approximately calculate the number of distinct

[jira] [Resolved] (FLINK-2146) Fast calculation of min/max with arbitrary eviction and triggers

2016-05-16 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gevay resolved FLINK-2146. Resolution: Not A Problem I'm closing this, since with the redesigned windowing API (since 0.10)

[jira] [Updated] (FLINK-2148) Approximately calculate the number of distinct elements of a stream

2016-05-16 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gevay updated FLINK-2148: --- Issue Type: New Feature (was: Sub-task) Parent: (was: FLINK-2142) > Approximately

[jira] [Updated] (FLINK-2147) Approximate calculation of frequencies in data streams

2016-05-16 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gevay updated FLINK-2147: --- Priority: Major (was: Minor) > Approximate calculation of frequencies in data streams >

[jira] [Updated] (FLINK-2147) Approximate calculation of frequencies in data streams

2016-05-16 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gevay updated FLINK-2147: --- Issue Type: New Feature (was: Sub-task) Parent: (was: FLINK-2142) > Approximate

[jira] [Commented] (FLINK-2147) Approximate calculation of frequencies in data streams

2016-05-16 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15284406#comment-15284406 ] Gabor Gevay commented on FLINK-2147: Yes, I think it would be very good if you worked on this, and

[jira] [Commented] (FLINK-2147) Approximate calculation of frequencies in data streams

2016-05-16 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15284312#comment-15284312 ] Gabor Gevay commented on FLINK-2147: Unfortunately, no. > Approximate calculation of frequencies in

[jira] [Updated] (FLINK-3788) Programs extending App trait cause problems because of DelayedInit

2016-05-14 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gevay updated FLINK-3788: --- Summary: Programs extending App trait cause problems because of DelayedInit (was: Local variable

[jira] [Commented] (FLINK-3788) Local variable values are not distributed to job runners

2016-04-19 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15247896#comment-15247896 ] Gabor Gevay commented on FLINK-3788: It seems that the `extends App` stuff is causing this somehow. If

[jira] [Updated] (FLINK-3479) Add hash-based strategy for CombineFunction

2016-04-15 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gevay updated FLINK-3479: --- Priority: Minor (was: Major) > Add hash-based strategy for CombineFunction >

[jira] [Created] (FLINK-3722) The divisions in the InMemorySorters' swap/compare methods hurt performance

2016-04-09 Thread Gabor Gevay (JIRA)
Gabor Gevay created FLINK-3722: -- Summary: The divisions in the InMemorySorters' swap/compare methods hurt performance Key: FLINK-3722 URL: https://issues.apache.org/jira/browse/FLINK-3722 Project: Flink

[jira] [Assigned] (FLINK-3477) Add hash-based combine strategy for ReduceFunction

2016-04-08 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gevay reassigned FLINK-3477: -- Assignee: Gabor Gevay > Add hash-based combine strategy for ReduceFunction >

[jira] [Commented] (FLINK-3322) MemoryManager creates too much GC pressure with iterative jobs

2016-02-26 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15168845#comment-15168845 ] Gabor Gevay commented on FLINK-3322: Actually, these are separate runs, so all of them are initial

[jira] [Commented] (FLINK-3519) Subclasses of Tuples don't work if the declared type of a DataSet is not the descendant

2016-02-26 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15168836#comment-15168836 ] Gabor Gevay commented on FLINK-3519: OK, I have found a good reason for the Gelly style subclassing:

[jira] [Commented] (FLINK-3519) Subclasses of Tuples don't work if the declared type of a DataSet is not the descendant

2016-02-26 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15168812#comment-15168812 ] Gabor Gevay commented on FLINK-3519: But if you were aware of this problem, then what was the original

  1   2   3   >