[GitHub] flink pull request: [FLINK-3337] [runtime] mvn test fails on flink...

2016-02-05 Thread greghogan
GitHub user greghogan opened a pull request: https://github.com/apache/flink/pull/1596 [FLINK-3337] [runtime] mvn test fails on flink-runtime because curator classes not found Removes curator dependency exclusions from flink-runtime. This resolves NoClassDefFoundError

[jira] [Commented] (FLINK-3337) mvn test fails on flink-runtime because curator classes not found

2016-02-05 Thread Greg Hogan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15135087#comment-15135087 ] Greg Hogan commented on FLINK-3337: --- The excludes were added in {{e31a4d8a}}. {{mvn test}} succeeds for

[GitHub] flink pull request:

2016-02-05 Thread alexeyegorov
Github user alexeyegorov commented on the pull request: https://github.com/apache/flink/commit/21a715867d655bb61df9a9f7eef37e42b99e206a#commitcomment-15927084 has this commit been added to the current 1.0-SNAPSHOT? I become a problem while building my project and find that

[GitHub] flink pull request:

2016-02-05 Thread uce
Github user uce commented on the pull request: https://github.com/apache/flink/commit/21a715867d655bb61df9a9f7eef37e42b99e206a#commitcomment-15927499 Please consult this page and use the new Maven artifacts (with Scala suffixes):

[jira] [Commented] (FLINK-2678) DataSet API does not support multi-dimensional arrays as keys

2016-02-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15134308#comment-15134308 ] ASF GitHub Bot commented on FLINK-2678: --- Github user sbcd90 closed the pull request at:

[GitHub] flink pull request: [FLINK-2678]DataSet API does not support multi...

2016-02-05 Thread sbcd90
Github user sbcd90 closed the pull request at: https://github.com/apache/flink/pull/1566 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (FLINK-3266) LocalFlinkMiniCluster leaks resources when multiple jobs are submitted

2016-02-05 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15134386#comment-15134386 ] Stephan Ewen commented on FLINK-3266: - Can you verify they stay alive after a single execution with

[jira] [Closed] (FLINK-3227) Translate physical Table API plan into DataSet program

2016-02-05 Thread Timo Walther (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Timo Walther closed FLINK-3227. --- Resolution: Won't Fix > Translate physical Table API plan into DataSet program >

[jira] [Commented] (FLINK-3227) Translate physical Table API plan into DataSet program

2016-02-05 Thread Timo Walther (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15134398#comment-15134398 ] Timo Walther commented on FLINK-3227: - No objections from my side. I will close it and create a new

[jira] [Reopened] (FLINK-3347) TaskManager ActorSystems need to restart themselves in case they notice quarantine

2016-02-05 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann reopened FLINK-3347: -- > TaskManager ActorSystems need to restart themselves in case they notice > quarantine >

[jira] [Commented] (FLINK-3347) TaskManager ActorSystems need to restart themselves in case they notice quarantine

2016-02-05 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15134301#comment-15134301 ] Till Rohrmann commented on FLINK-3347: -- Haha, I just closed FLINK-3345 as a duplicate of this one.

[jira] [Commented] (FLINK-3337) mvn test fails on flink-runtime because curator classes not found

2016-02-05 Thread Greg Hogan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15134362#comment-15134362 ] Greg Hogan commented on FLINK-3337: --- It's not a local mixup but I was only running test. {code} git

[jira] [Commented] (FLINK-3337) mvn test fails on flink-runtime because curator classes not found

2016-02-05 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15134448#comment-15134448 ] Stephan Ewen commented on FLINK-3337: - You have a newer Maven version, maybe some behavior changed.

[GitHub] flink pull request: [FLINK-3226] Implement a CodeGenerator for an ...

2016-02-05 Thread twalthr
GitHub user twalthr opened a pull request: https://github.com/apache/flink/pull/1595 [FLINK-3226] Implement a CodeGenerator for an efficient translation to DataSet programs This PR implements a CodeGenerator for Table API on Calcite. It includes the following: -

[jira] [Created] (FLINK-3348) taskmanager.memory.off-heap missing bc documentation

2016-02-05 Thread Flavio Pompermaier (JIRA)
Flavio Pompermaier created FLINK-3348: - Summary: taskmanager.memory.off-heap missing bc documentation Key: FLINK-3348 URL: https://issues.apache.org/jira/browse/FLINK-3348 Project: Flink

[jira] [Commented] (FLINK-3337) mvn test fails on flink-runtime because curator classes not found

2016-02-05 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15134371#comment-15134371 ] Stephan Ewen commented on FLINK-3337: - Just tried that, worked on my machine. Can you try to clear

[jira] [Commented] (FLINK-3253) deserializeObject exception on WindowOperator

2016-02-05 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15134395#comment-15134395 ] Aljoscha Krettek commented on FLINK-3253: - Hi [~godfreyhe], we recently changed the internals of

[jira] [Commented] (FLINK-3304) AvroOutputFormat.setSchema() doesn't work in yarn-cluster mode

2016-02-05 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15134424#comment-15134424 ] Robert Metzger commented on FLINK-3304: --- The problem is that the Schema is not serializable. The

[jira] [Commented] (FLINK-3226) Translate optimized logical Table API plans into physical plans representing DataSet programs

2016-02-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15134451#comment-15134451 ] ASF GitHub Bot commented on FLINK-3226: --- GitHub user twalthr opened a pull request:

[jira] [Commented] (FLINK-3337) mvn test fails on flink-runtime because curator classes not found

2016-02-05 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15134328#comment-15134328 ] Robert Metzger commented on FLINK-3337: --- I wonder if this commit caused the issue:

[jira] [Updated] (FLINK-3337) mvn test fails on flink-runtime because curator classes not found

2016-02-05 Thread Greg Hogan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Hogan updated FLINK-3337: -- Attachment: mvn.txt {{mvn test}} stdout > mvn test fails on flink-runtime because curator classes not

[jira] [Issue Comment Deleted] (FLINK-3337) mvn test fails on flink-runtime because curator classes not found

2016-02-05 Thread Greg Hogan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Hogan updated FLINK-3337: -- Comment: was deleted (was: {{mvn test}} stdout) > mvn test fails on flink-runtime because curator

[jira] [Commented] (FLINK-3343) Exception while using Kafka 0.9 connector

2016-02-05 Thread Farouk Salem (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15134481#comment-15134481 ] Farouk Salem commented on FLINK-3343: - Thanks for your replies. I decreased the batch size to 6000

[jira] [Updated] (FLINK-3347) TaskManager ActorSystems need to restart themselves in case they notice quarantine

2016-02-05 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen updated FLINK-3347: Priority: Critical (was: Major) > TaskManager ActorSystems need to restart themselves in case they

[GitHub] flink pull request: [FLINK-2021] Rework examples to use ParameterT...

2016-02-05 Thread rmetzger
Github user rmetzger commented on the pull request: https://github.com/apache/flink/pull/1581#issuecomment-180422247 Awesome, thank you! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[jira] [Created] (FLINK-3346) Replace Akka death watch with own heartbeats

2016-02-05 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-3346: Summary: Replace Akka death watch with own heartbeats Key: FLINK-3346 URL: https://issues.apache.org/jira/browse/FLINK-3346 Project: Flink Issue Type:

[jira] [Commented] (FLINK-2021) Rework examples to use ParameterTool

2016-02-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15134383#comment-15134383 ] ASF GitHub Bot commented on FLINK-2021: --- Github user rmetzger commented on the pull request:

[jira] [Commented] (FLINK-3337) mvn test fails on flink-runtime because curator classes not found

2016-02-05 Thread Greg Hogan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15134405#comment-15134405 ] Greg Hogan commented on FLINK-3337: --- This is on a fresh AWS instance, Linux AMI. {code} sudo yum -y

[jira] [Commented] (FLINK-3349) PlanVisualizer doesn't work

2016-02-05 Thread Riccardo Diomedi (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15134649#comment-15134649 ] Riccardo Diomedi commented on FLINK-3349: - yes! > PlanVisualizer doesn't work >

[jira] [Created] (FLINK-3349) planVisualizer doesn't work!

2016-02-05 Thread Riccardo Diomedi (JIRA)
Riccardo Diomedi created FLINK-3349: --- Summary: planVisualizer doesn't work! Key: FLINK-3349 URL: https://issues.apache.org/jira/browse/FLINK-3349 Project: Flink Issue Type: Bug Affects

[jira] [Commented] (FLINK-3349) PlanVisualizer doesn't work

2016-02-05 Thread Greg Hogan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15134643#comment-15134643 ] Greg Hogan commented on FLINK-3349: --- Are you viewing Flink from a machine connected to the Internet? >

[jira] [Updated] (FLINK-3349) PlanVisualizer doesn't work

2016-02-05 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabian Hueske updated FLINK-3349: - Summary: PlanVisualizer doesn't work (was: planVisualizer doesn't work!) > PlanVisualizer

[GitHub] flink pull request: [hotfix] [docs] Fixed typo in process model il...

2016-02-05 Thread stefanobaghino
GitHub user stefanobaghino opened a pull request: https://github.com/apache/flink/pull/1592 [hotfix] [docs] Fixed typo in process model illustration YARM -> YARN You can merge this pull request into a Git repository by running: $ git pull https://github.com/radicalbit/flink

[jira] [Resolved] (FLINK-3347) TaskManager ActorSystems need to restart themselves in case they notice quarantine

2016-02-05 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen resolved FLINK-3347. - Resolution: Duplicate Duplicate of FLINK-3345 > TaskManager ActorSystems need to restart

[jira] [Closed] (FLINK-3347) TaskManager ActorSystems need to restart themselves in case they notice quarantine

2016-02-05 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen closed FLINK-3347. --- > TaskManager ActorSystems need to restart themselves in case they notice > quarantine >

[jira] [Closed] (FLINK-3345) Restart TaskManager in case of a Akka quarantine event

2016-02-05 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann closed FLINK-3345. Resolution: Duplicate Duplicate of issue FLINK-3347 > Restart TaskManager in case of a Akka

[jira] [Created] (FLINK-3347) TaskManager ActorSystems need to restart themselves in case they notice quarantine

2016-02-05 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-3347: --- Summary: TaskManager ActorSystems need to restart themselves in case they notice quarantine Key: FLINK-3347 URL: https://issues.apache.org/jira/browse/FLINK-3347

[jira] [Commented] (FLINK-2111) Add "stop" signal to cleanly shutdown streaming jobs

2016-02-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15135236#comment-15135236 ] ASF GitHub Bot commented on FLINK-2111: --- Github user tillrohrmann commented on the pull request:

[GitHub] flink pull request: [FLINK-2111] Add "stop" signal to cleanly shut...

2016-02-05 Thread tillrohrmann
Github user tillrohrmann commented on the pull request: https://github.com/apache/flink/pull/750#issuecomment-180617867 Ok let us include as a first version a stop implementation where you don't have the strong consistency guarantees. But before I think we should still change three

[jira] [Commented] (FLINK-3337) mvn test fails on flink-runtime because curator classes not found

2016-02-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15135088#comment-15135088 ] ASF GitHub Bot commented on FLINK-3337: --- GitHub user greghogan opened a pull request:

[jira] [Assigned] (FLINK-3337) mvn test fails on flink-runtime because curator classes not found

2016-02-05 Thread Greg Hogan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Hogan reassigned FLINK-3337: - Assignee: Greg Hogan > mvn test fails on flink-runtime because curator classes not found >

[jira] [Commented] (FLINK-3349) PlanVisualizer doesn't work

2016-02-05 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15134932#comment-15134932 ] Robert Metzger commented on FLINK-3349: --- Can you open the Developer Tools of your browser (with a

[GitHub] flink pull request: [FLINK-3234] [dataSet] Add KeySelector support...

2016-02-05 Thread fhueske
Github user fhueske commented on a diff in the pull request: https://github.com/apache/flink/pull/1585#discussion_r51992647 --- Diff: flink-java/src/main/java/org/apache/flink/api/java/operators/SortPartitionOperator.java --- @@ -79,16 +112,33 @@ public

[jira] [Commented] (FLINK-3234) SortPartition does not support KeySelectorFunctions

2016-02-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15133886#comment-15133886 ] ASF GitHub Bot commented on FLINK-3234: --- Github user fhueske commented on a diff in the pull

[GitHub] flink pull request: [FLINK-3234] [dataSet] Add KeySelector support...

2016-02-05 Thread fhueske
Github user fhueske commented on the pull request: https://github.com/apache/flink/pull/1585#issuecomment-180268588 Hi @chiwanpark, thanks for the update! The refactorings you proposed make a lot of sense. +1 Thanks, Fabian --- If your project is set up for it, you can

[jira] [Commented] (FLINK-3234) SortPartition does not support KeySelectorFunctions

2016-02-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15133895#comment-15133895 ] ASF GitHub Bot commented on FLINK-3234: --- Github user fhueske commented on the pull request:

[GitHub] flink pull request: [FLINK-2678]DataSet API does not support multi...

2016-02-05 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/1566#discussion_r51997240 --- Diff: flink-core/src/main/java/org/apache/flink/api/java/typeutils/ObjectArrayTypeInfo.java --- @@ -72,15 +77,59 @@ public int getTotalFields() {

[jira] [Commented] (FLINK-2678) DataSet API does not support multi-dimensional arrays as keys

2016-02-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15133932#comment-15133932 ] ASF GitHub Bot commented on FLINK-2678: --- Github user tillrohrmann commented on a diff in the pull

[GitHub] flink pull request: [FLINK-2678]DataSet API does not support multi...

2016-02-05 Thread tillrohrmann
Github user tillrohrmann commented on the pull request: https://github.com/apache/flink/pull/1566#issuecomment-180284317 I think the PR is still not in a good shape. I pointed out the problematic code sections. Also please bear in mind that people will always try to review

[GitHub] flink pull request:

2016-02-05 Thread fhueske
Github user fhueske commented on the pull request: https://github.com/apache/flink/commit/629015fbff477f8a20d2142094e4015f4520e80b#commitcomment-15909932 In flink-libraries/flink-table/src/main/scala/org/apache/flink/api/table/plan/functions/AggregateFunction.scala: In

[GitHub] flink pull request:

2016-02-05 Thread fhueske
Github user fhueske commented on the pull request: https://github.com/apache/flink/commit/629015fbff477f8a20d2142094e4015f4520e80b#commitcomment-15909895 In flink-libraries/flink-table/src/main/scala/org/apache/flink/api/table/plan/functions/AggregateFunction.scala: In

[jira] [Commented] (FLINK-3330) Add SparseVector support to GradientDescent in FlinkML

2016-02-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15133989#comment-15133989 ] ASF GitHub Bot commented on FLINK-3330: --- Github user tillrohrmann commented on a diff in the pull

[jira] [Commented] (FLINK-3330) Add SparseVector support to GradientDescent in FlinkML

2016-02-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15133991#comment-15133991 ] ASF GitHub Bot commented on FLINK-3330: --- Github user tillrohrmann commented on the pull request:

[jira] [Commented] (FLINK-3330) Add SparseVector support to GradientDescent in FlinkML

2016-02-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15133990#comment-15133990 ] ASF GitHub Bot commented on FLINK-3330: --- Github user tillrohrmann commented on a diff in the pull

[GitHub] flink pull request: [FLINK-3336] Add Rescale Data Shipping for Dat...

2016-02-05 Thread aljoscha
Github user aljoscha commented on the pull request: https://github.com/apache/flink/pull/1589#issuecomment-180299872 Added a figure to the doc :smile: --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[jira] [Commented] (FLINK-3336) Add Semi-Rebalance Data Shipping for DataStream

2016-02-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15134013#comment-15134013 ] ASF GitHub Bot commented on FLINK-3336: --- Github user aljoscha commented on the pull request:

[GitHub] flink pull request: [FLINK-2678]DataSet API does not support multi...

2016-02-05 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/1566#discussion_r51997124 --- Diff: flink-core/src/main/java/org/apache/flink/api/java/typeutils/ObjectArrayTypeInfo.java --- @@ -72,15 +77,59 @@ public int getTotalFields() {

[jira] [Commented] (FLINK-2678) DataSet API does not support multi-dimensional arrays as keys

2016-02-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15133929#comment-15133929 ] ASF GitHub Bot commented on FLINK-2678: --- Github user tillrohrmann commented on a diff in the pull

[GitHub] flink pull request:

2016-02-05 Thread fhueske
Github user fhueske commented on the pull request: https://github.com/apache/flink/commit/629015fbff477f8a20d2142094e4015f4520e80b#commitcomment-15909944 In flink-libraries/flink-table/src/main/scala/org/apache/flink/api/table/plan/functions/AggregateFunction.scala: In

[jira] [Commented] (FLINK-3336) Add Semi-Rebalance Data Shipping for DataStream

2016-02-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15133959#comment-15133959 ] ASF GitHub Bot commented on FLINK-3336: --- Github user uce commented on the pull request:

[jira] [Created] (FLINK-3342) Operator checkpoint statistics state size overflow

2016-02-05 Thread Ufuk Celebi (JIRA)
Ufuk Celebi created FLINK-3342: -- Summary: Operator checkpoint statistics state size overflow Key: FLINK-3342 URL: https://issues.apache.org/jira/browse/FLINK-3342 Project: Flink Issue Type:

[jira] [Commented] (FLINK-1731) Add kMeans clustering algorithm to machine learning library

2016-02-05 Thread Simone Robutti (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15134002#comment-15134002 ] Simone Robutti commented on FLINK-1731: --- Hi Till, any news on the inclusion of K-Means in the 1.0

[jira] [Comment Edited] (FLINK-1731) Add kMeans clustering algorithm to machine learning library

2016-02-05 Thread Simone Robutti (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15134002#comment-15134002 ] Simone Robutti edited comment on FLINK-1731 at 2/5/16 10:56 AM: Hi

[jira] [Updated] (FLINK-3333) Documentation about object reuse should be improved

2016-02-05 Thread Gabor Gevay (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Gevay updated FLINK-: --- Component/s: Documentation > Documentation about object reuse should be improved >

[jira] [Comment Edited] (FLINK-1731) Add kMeans clustering algorithm to machine learning library

2016-02-05 Thread Simone Robutti (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15134002#comment-15134002 ] Simone Robutti edited comment on FLINK-1731 at 2/5/16 10:56 AM: Hi

[GitHub] flink pull request: [FLINK-3234] [dataSet] Add KeySelector support...

2016-02-05 Thread fhueske
Github user fhueske commented on a diff in the pull request: https://github.com/apache/flink/pull/1585#discussion_r51993269 --- Diff: flink-java/src/test/java/org/apache/flink/api/java/operator/SortPartitionTest.java --- @@ -169,6 +169,38 @@ public void

[jira] [Commented] (FLINK-3234) SortPartition does not support KeySelectorFunctions

2016-02-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15133893#comment-15133893 ] ASF GitHub Bot commented on FLINK-3234: --- Github user fhueske commented on a diff in the pull

[GitHub] flink pull request: [FLINK-3234] [dataSet] Add KeySelector support...

2016-02-05 Thread fhueske
Github user fhueske commented on a diff in the pull request: https://github.com/apache/flink/pull/1585#discussion_r51993427 --- Diff: flink-tests/src/test/java/org/apache/flink/test/javaApiOperators/SortPartitionITCase.java --- @@ -197,6 +198,58 @@ public void

[jira] [Commented] (FLINK-3234) SortPartition does not support KeySelectorFunctions

2016-02-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15133894#comment-15133894 ] ASF GitHub Bot commented on FLINK-3234: --- Github user fhueske commented on a diff in the pull

[GitHub] flink pull request: [FLINK-3234] [dataSet] Add KeySelector support...

2016-02-05 Thread fhueske
Github user fhueske commented on a diff in the pull request: https://github.com/apache/flink/pull/1585#discussion_r51993309 --- Diff: flink-scala/src/main/scala/org/apache/flink/api/scala/PartitionSortedDataSet.scala --- @@ -35,16 +37,30 @@ class PartitionSortedDataSet[T:

[jira] [Commented] (FLINK-3234) SortPartition does not support KeySelectorFunctions

2016-02-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15133892#comment-15133892 ] ASF GitHub Bot commented on FLINK-3234: --- Github user fhueske commented on a diff in the pull

[GitHub] flink pull request: [hotfix] [docs] Fixed typo in process model il...

2016-02-05 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/1592 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (FLINK-2021) Rework examples to use ParameterTool

2016-02-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15133923#comment-15133923 ] ASF GitHub Bot commented on FLINK-2021: --- Github user fhueske commented on the pull request:

[GitHub] flink pull request: [FLINK-2021] Rework examples to use ParameterT...

2016-02-05 Thread fhueske
Github user fhueske commented on the pull request: https://github.com/apache/flink/pull/1581#issuecomment-180279675 Hi Stefano, thanks for the update! - you are right, it is good practice to not squash commits the address PR feedback. That make following the changes much

[GitHub] flink pull request:

2016-02-05 Thread fhueske
Github user fhueske commented on the pull request: https://github.com/apache/flink/commit/629015fbff477f8a20d2142094e4015f4520e80b#commitcomment-15909835 In flink-libraries/flink-table/src/main/scala/org/apache/flink/api/table/plan/functions/AggregateFunction.scala: In

[GitHub] flink pull request: [FLINK-2678]DataSet API does not support multi...

2016-02-05 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/1566#discussion_r51997602 --- Diff: flink-core/src/test/java/org/apache/flink/api/java/typeutils/runtime/ObjectArrayComparatorCompositeTypeTest.java --- @@ -0,0 +1,106 @@

[jira] [Commented] (FLINK-3327) Attach the ExecutionConfig to the JobGraph and make it accessible to the AbstractInvocable.

2016-02-05 Thread Kostas (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15133944#comment-15133944 ] Kostas commented on FLINK-3327: --- This is a subtask of the FLINK-2523 issue. After this, making the task

[GitHub] flink pull request: [FLINK-3336] Add Rescale Data Shipping for Dat...

2016-02-05 Thread aljoscha
Github user aljoscha commented on the pull request: https://github.com/apache/flink/pull/1589#issuecomment-180284761 I addressed @uce's comments, thanks for those. I also had a discussion with @StephanEwen and he came up with the name `rescale()` for this distribution pattern. The

[jira] [Commented] (FLINK-3336) Add Semi-Rebalance Data Shipping for DataStream

2016-02-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15133949#comment-15133949 ] ASF GitHub Bot commented on FLINK-3336: --- Github user aljoscha commented on the pull request:

[GitHub] flink pull request: [FLINK-3330] [ml] Fix SparseVector support in ...

2016-02-05 Thread tillrohrmann
Github user tillrohrmann commented on the pull request: https://github.com/apache/flink/pull/1587#issuecomment-180292797 Travis passed. Will merge the PR then. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[jira] [Commented] (FLINK-3330) Add SparseVector support to GradientDescent in FlinkML

2016-02-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15133988#comment-15133988 ] ASF GitHub Bot commented on FLINK-3330: --- Github user tillrohrmann commented on a diff in the pull

[GitHub] flink pull request: [FLINK-3330] [ml] Fix SparseVector support in ...

2016-02-05 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/1587#discussion_r52001518 --- Diff: flink-libraries/flink-ml/src/main/scala/org/apache/flink/ml/optimization/GradientDescent.scala --- @@ -192,10 +190,18 @@ abstract class

[GitHub] flink pull request: [FLINK-3330] [ml] Fix SparseVector support in ...

2016-02-05 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/1587#discussion_r52001489 --- Diff: flink-libraries/flink-ml/src/main/scala/org/apache/flink/ml/optimization/GradientDescent.scala --- @@ -192,10 +190,18 @@ abstract class

[jira] [Commented] (FLINK-2678) DataSet API does not support multi-dimensional arrays as keys

2016-02-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15133935#comment-15133935 ] ASF GitHub Bot commented on FLINK-2678: --- Github user tillrohrmann commented on a diff in the pull

[GitHub] flink pull request: [FLINK-2678]DataSet API does not support multi...

2016-02-05 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/1566#discussion_r51997409 --- Diff: flink-core/src/main/java/org/apache/flink/api/java/typeutils/runtime/ObjectArrayComparator.java --- @@ -0,0 +1,199 @@ +/* + *

[GitHub] flink pull request: [FLINK-3120] [runtime] Manually configure Nett...

2016-02-05 Thread uce
GitHub user uce opened a pull request: https://github.com/apache/flink/pull/1593 [FLINK-3120] [runtime] Manually configure Netty's ByteBufAllocator tl;dr Change default Netty configuration to be relative to number of slots, i.e. configure one memory arena (in

[jira] [Commented] (FLINK-3120) Set number of event loop thread and number of buffer pool arenas to same number

2016-02-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15133951#comment-15133951 ] ASF GitHub Bot commented on FLINK-3120: --- GitHub user uce opened a pull request:

[jira] [Commented] (FLINK-2721) Add Tuple meta information

2016-02-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15133966#comment-15133966 ] ASF GitHub Bot commented on FLINK-2721: --- Github user mxm commented on the pull request:

[GitHub] flink pull request: [FLINK-2721] [Storm Compatibility] Add Tuple m...

2016-02-05 Thread mxm
Github user mxm commented on the pull request: https://github.com/apache/flink/pull/1591#issuecomment-180288305 @mjsax Would be good to merge this. I'll take a look later. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] flink pull request: [FLINK-3336] Add Rescale Data Shipping for Dat...

2016-02-05 Thread uce
Github user uce commented on the pull request: https://github.com/apache/flink/pull/1589#issuecomment-180286680 +1 to `rescale`. Would be nice to add the figure to the docs (parallelism 2-4-2 should be fine though?) --- If your project is set up for it, you can reply to this email

[jira] [Closed] (FLINK-3330) Add SparseVector support to GradientDescent in FlinkML

2016-02-05 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann closed FLINK-3330. Resolution: Fixed Fixed via fe0c3b539b320fd065b329f34f81be49b4bdab1a > Add SparseVector support to

[jira] [Commented] (FLINK-3330) Add SparseVector support to GradientDescent in FlinkML

2016-02-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15134000#comment-15134000 ] ASF GitHub Bot commented on FLINK-3330: --- Github user asfgit closed the pull request at:

[GitHub] flink pull request: [FLINK-3330] [ml] Fix SparseVector support in ...

2016-02-05 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/1587 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] flink pull request: [FLINK-3120] [runtime] Manually configure Nett...

2016-02-05 Thread uce
Github user uce commented on the pull request: https://github.com/apache/flink/pull/1593#issuecomment-180305086 (I forgot to add that in a small set of experiments with both YARN and Standalone setups on 4 nodes I did not notice a difference in performance. For YARN, I tested both

[jira] [Commented] (FLINK-3343) Exception while using Kafka 0.9 connector

2016-02-05 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15134110#comment-15134110 ] Robert Metzger commented on FLINK-3343: --- No problem. lets use this jira to figure out a solution to

[jira] [Commented] (FLINK-3343) Exception while using Kafka 0.9 connector

2016-02-05 Thread Farouk Salem (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15134111#comment-15134111 ] Farouk Salem commented on FLINK-3343: - By the way, I opened this as "improvement" because I think that

[jira] [Created] (FLINK-3344) EventTimeWindowCheckpointingITCase.testPreAggregatedTumblingTimeWindow

2016-02-05 Thread Matthias J. Sax (JIRA)
Matthias J. Sax created FLINK-3344: -- Summary: EventTimeWindowCheckpointingITCase.testPreAggregatedTumblingTimeWindow Key: FLINK-3344 URL: https://issues.apache.org/jira/browse/FLINK-3344 Project:

[GitHub] flink pull request: [FLINK-3336] Add Rescale Data Shipping for Dat...

2016-02-05 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/1589#discussion_r52012134 --- Diff: flink-streaming-java/src/main/java/org/apache/flink/streaming/runtime/partitioner/RescalePartitioner.java --- @@ -0,0 +1,65 @@ +/* +

[jira] [Created] (FLINK-3343) Exception while using Kafka 0.9 connector

2016-02-05 Thread Farouk Salem (JIRA)
Farouk Salem created FLINK-3343: --- Summary: Exception while using Kafka 0.9 connector Key: FLINK-3343 URL: https://issues.apache.org/jira/browse/FLINK-3343 Project: Flink Issue Type:

[jira] [Commented] (FLINK-3343) Exception while using Kafka 0.9 connector

2016-02-05 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15134095#comment-15134095 ] Robert Metzger commented on FLINK-3343: --- Can you try setting the {{batch.size}} to "0". This way we

  1   2   >