[jira] [Comment Edited] (FLINK-2066) Make delay between execution retries configurable

2015-10-02 Thread Chengxuan Wang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14942140#comment-14942140 ] Chengxuan Wang edited comment on FLINK-2066 at 10/3/15 6:32 AM:

[jira] [Commented] (FLINK-2066) Make delay between execution retries configurable

2015-10-02 Thread Chengxuan Wang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14942140#comment-14942140 ] Chengxuan Wang commented on FLINK-2066: --- Hi, Ewen, so the delay also should be speci

[jira] [Commented] (FLINK-2815) [REFACTOR] Remove Pact from class and file names since it is no longer valid reference

2015-10-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14942089#comment-14942089 ] ASF GitHub Bot commented on FLINK-2815: --- GitHub user hsaputra opened a pull request:

[GitHub] flink pull request: [FLINK-2815] [REFACTOR] Remove Pact from class...

2015-10-02 Thread hsaputra
GitHub user hsaputra opened a pull request: https://github.com/apache/flink/pull/1218 [FLINK-2815] [REFACTOR] Remove Pact from class and file names since it is no longer valid reference Remove Pact word from class and file names in Apache Flink. Pact was the name used in Stratos

[jira] [Created] (FLINK-2815) [REFACTOR] Remove Pact from class and file names since it is no longer valid reference

2015-10-02 Thread Henry Saputra (JIRA)
Henry Saputra created FLINK-2815: Summary: [REFACTOR] Remove Pact from class and file names since it is no longer valid reference Key: FLINK-2815 URL: https://issues.apache.org/jira/browse/FLINK-2815

[jira] [Updated] (FLINK-2765) Upgrade hbase version for hadoop-2 to 1.1 release

2015-10-02 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated FLINK-2765: -- Description: Currently 0.98.11 is used: {code} 0.98.11-hadoop2 {code} Stable release for hadoop-

[jira] [Commented] (FLINK-2066) Make delay between execution retries configurable

2015-10-02 Thread Chengxuan Wang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941774#comment-14941774 ] Chengxuan Wang commented on FLINK-2066: --- Ok. Let me try this. Thanks. > Make delay

[jira] [Created] (FLINK-2814) DeltaIteration: DualInputPlanNode cannot be cast to SingleInputPlanNode

2015-10-02 Thread Greg Hogan (JIRA)
Greg Hogan created FLINK-2814: - Summary: DeltaIteration: DualInputPlanNode cannot be cast to SingleInputPlanNode Key: FLINK-2814 URL: https://issues.apache.org/jira/browse/FLINK-2814 Project: Flink

[GitHub] flink pull request: [FLINK-2642] [table] Scala Table API crashes w...

2015-10-02 Thread hsaputra
Github user hsaputra commented on a diff in the pull request: https://github.com/apache/flink/pull/1209#discussion_r41051842 --- Diff: flink-staging/flink-table/src/main/scala/org/apache/flink/api/table/plan/PlanTranslator.scala --- @@ -110,7 +110,8 @@ abstract class PlanTranslato

[jira] [Commented] (FLINK-2642) Scala Table API crashes when executing word count example

2015-10-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941529#comment-14941529 ] ASF GitHub Bot commented on FLINK-2642: --- Github user hsaputra commented on the pull

[jira] [Commented] (FLINK-2642) Scala Table API crashes when executing word count example

2015-10-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941528#comment-14941528 ] ASF GitHub Bot commented on FLINK-2642: --- Github user hsaputra commented on a diff in

[GitHub] flink pull request: [FLINK-2642] [table] Scala Table API crashes w...

2015-10-02 Thread hsaputra
Github user hsaputra commented on the pull request: https://github.com/apache/flink/pull/1209#issuecomment-145115050 +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled an

[jira] [Commented] (FLINK-2666) Allow custom Timestamp extractors for Flink sources

2015-10-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941466#comment-14941466 ] ASF GitHub Bot commented on FLINK-2666: --- Github user aljoscha commented on the pull

[GitHub] flink pull request: [FLINK-2666] Add timestamp extraction operator

2015-10-02 Thread aljoscha
Github user aljoscha commented on the pull request: https://github.com/apache/flink/pull/1201#issuecomment-145096795 Ok, I saw a failure in the WatermarkITCase that could be a real problem. I'm investigating. --- If your project is set up for it, you can reply to this email and have

[jira] [Commented] (FLINK-2666) Allow custom Timestamp extractors for Flink sources

2015-10-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941418#comment-14941418 ] ASF GitHub Bot commented on FLINK-2666: --- Github user gyfora commented on the pull re

[GitHub] flink pull request: [FLINK-2666] Add timestamp extraction operator

2015-10-02 Thread gyfora
Github user gyfora commented on the pull request: https://github.com/apache/flink/pull/1201#issuecomment-145088560 I think it should be good to merge :+1: --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project d

[GitHub] flink pull request: [FLINK-2566] FlinkTopologyContext not populate...

2015-10-02 Thread mjsax
Github user mjsax commented on the pull request: https://github.com/apache/flink/pull/1135#issuecomment-145085684 Prove reading for README, Web documenation, and examples JavaDoc would be appreciated ;) It's a lot if renaming going on and I might have missed something. --- If your p

[jira] [Commented] (FLINK-2566) FlinkTopologyContext not populated completely

2015-10-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941388#comment-14941388 ] ASF GitHub Bot commented on FLINK-2566: --- Github user mjsax commented on the pull req

[jira] [Commented] (FLINK-2566) FlinkTopologyContext not populated completely

2015-10-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941386#comment-14941386 ] ASF GitHub Bot commented on FLINK-2566: --- Github user mjsax commented on the pull req

[GitHub] flink pull request: [FLINK-2566] FlinkTopologyContext not populate...

2015-10-02 Thread mjsax
Github user mjsax commented on the pull request: https://github.com/apache/flink/pull/1135#issuecomment-145085340 Just updated this PR. It additionally contains the maven module restructuring and internal code cleanup in a second commit. If no objects, I will push this into master.

[jira] [Commented] (FLINK-2716) Checksum method for DataSet and Graph

2015-10-02 Thread Greg Hogan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941379#comment-14941379 ] Greg Hogan commented on FLINK-2716: --- [~StephanEwen], I would like to use {{TypeComparato

[jira] [Commented] (FLINK-2809) DataSet[Unit] doesn't work

2015-10-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941359#comment-14941359 ] ASF GitHub Bot commented on FLINK-2809: --- GitHub user ggevay opened a pull request:

[GitHub] flink pull request: [FLINK-2809] [scala-api] Added UnitTypeInfo an...

2015-10-02 Thread ggevay
GitHub user ggevay opened a pull request: https://github.com/apache/flink/pull/1217 [FLINK-2809] [scala-api] Added UnitTypeInfo and UnitSerializer. Created UnitTypeInfo and UnitSerializer, which will be created for a DataSet[Unit]. Also added a test. There is a funny si

[jira] [Commented] (FLINK-2802) Watermark triggered operators cannot progress with cyclic flows

2015-10-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941348#comment-14941348 ] ASF GitHub Bot commented on FLINK-2802: --- GitHub user gyfora opened a pull request:

[GitHub] flink pull request: [FLINK-2802] [streaming] Remove cyclic waterma...

2015-10-02 Thread gyfora
GitHub user gyfora opened a pull request: https://github.com/apache/flink/pull/1216 [FLINK-2802] [streaming] Remove cyclic watermark dependencies for iterations This PR contains a simple change so that if timestamps are enabled, iteration sources automatically emit a `Long.MAX_VALUE

[jira] [Assigned] (FLINK-2811) Add page with configuration overview

2015-10-02 Thread Sachin Goel (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sachin Goel reassigned FLINK-2811: -- Assignee: Sachin Goel > Add page with configuration overview >

[jira] [Created] (FLINK-2813) Document off-heap configuration

2015-10-02 Thread Maximilian Michels (JIRA)
Maximilian Michels created FLINK-2813: - Summary: Document off-heap configuration Key: FLINK-2813 URL: https://issues.apache.org/jira/browse/FLINK-2813 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-2812) KeySelectorUtil.getSelectorForKeys and TypeExtractor.getKeySelectorTypes are incompatible

2015-10-02 Thread JIRA
Márton Balassi created FLINK-2812: - Summary: KeySelectorUtil.getSelectorForKeys and TypeExtractor.getKeySelectorTypes are incompatible Key: FLINK-2812 URL: https://issues.apache.org/jira/browse/FLINK-2812

[jira] [Created] (FLINK-2811) Add page with configuration overview

2015-10-02 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-2811: - Summary: Add page with configuration overview Key: FLINK-2811 URL: https://issues.apache.org/jira/browse/FLINK-2811 Project: Flink Issue Type: Sub-task

[jira] [Closed] (FLINK-1052) Access to stdout and log information of Taskmanagers from the web interface

2015-10-02 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger closed FLINK-1052. - Resolution: Won't Fix > Access to stdout and log information of Taskmanagers from the web interfac

[GitHub] flink pull request: [FLINK-2797][cli] Add support for running jobs...

2015-10-02 Thread sachingoel0101
Github user sachingoel0101 commented on the pull request: https://github.com/apache/flink/pull/1214#issuecomment-145059638 It doesn't really make sense to call `print` or `collect` in detached mode. Even if the result is printed on JobManager, client cannot access it anyway [short of

[jira] [Commented] (FLINK-2797) CLI: Missing option to submit jobs in detached mode

2015-10-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941250#comment-14941250 ] ASF GitHub Bot commented on FLINK-2797: --- Github user sachingoel0101 commented on the

[jira] [Commented] (FLINK-2354) Recover running jobs on JobManager failure

2015-10-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941227#comment-14941227 ] ASF GitHub Bot commented on FLINK-2354: --- Github user tillrohrmann commented on a dif

[GitHub] flink pull request: [FLINK-2354] Add job graph and checkpoint reco...

2015-10-02 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/1153#discussion_r41030614 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/checkpoint/ZooKeeperCheckpointIDCounter.java --- @@ -0,0 +1,130 @@ +/* + * Licens

[jira] [Commented] (FLINK-2354) Recover running jobs on JobManager failure

2015-10-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941223#comment-14941223 ] ASF GitHub Bot commented on FLINK-2354: --- Github user tillrohrmann commented on a dif

[GitHub] flink pull request: [FLINK-2354] Add job graph and checkpoint reco...

2015-10-02 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/1153#discussion_r41029773 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/checkpoint/SuccessfulCheckpoint.java --- @@ -19,29 +19,28 @@ package org.apache.flin

[jira] [Commented] (FLINK-2354) Recover running jobs on JobManager failure

2015-10-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941221#comment-14941221 ] ASF GitHub Bot commented on FLINK-2354: --- Github user tillrohrmann commented on a dif

[jira] [Closed] (FLINK-2727) Add a base class for MessageQueue-with-acknowledgement sources

2015-10-02 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen closed FLINK-2727. --- > Add a base class for MessageQueue-with-acknowledgement sources > ---

[GitHub] flink pull request: Stream API Refactoring

2015-10-02 Thread aljoscha
GitHub user aljoscha opened a pull request: https://github.com/apache/flink/pull/1215 Stream API Refactoring This is a WIP of the refactoring. I still want to add Javadocs and a new join operator based on tagged union that uses the new windowing operators. You can merge this

[jira] [Resolved] (FLINK-2727) Add a base class for MessageQueue-with-acknowledgement sources

2015-10-02 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen resolved FLINK-2727. - Resolution: Implemented Fix Version/s: 0.10 Implemented in daeab84985bb510351b04e08f83cdd6c

[GitHub] flink pull request: [FLINK-2354] Add job graph and checkpoint reco...

2015-10-02 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/1153#discussion_r41029601 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/checkpoint/StateForTask.java --- @@ -48,9 +55,9 @@ private final int subtask;

[jira] [Commented] (FLINK-2727) Add a base class for MessageQueue-with-acknowledgement sources

2015-10-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941218#comment-14941218 ] ASF GitHub Bot commented on FLINK-2727: --- Github user asfgit closed the pull request

[GitHub] flink pull request: [FLINK-2727] [streaming] Add a base class for ...

2015-10-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/1163 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (FLINK-2797) CLI: Missing option to submit jobs in detached mode

2015-10-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941214#comment-14941214 ] ASF GitHub Bot commented on FLINK-2797: --- Github user mxm commented on the pull reque

[GitHub] flink pull request: [FLINK-2797][cli] Add support for running jobs...

2015-10-02 Thread mxm
Github user mxm commented on the pull request: https://github.com/apache/flink/pull/1214#issuecomment-145044584 The current version of the detached mode doesn't really work for eager execution calls like `count()` or `collect()`. Those calls will also be executed detached and thus the

[GitHub] flink pull request: [hotfix] Execute YARN integration tests only u...

2015-10-02 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/1210#issuecomment-145042315 Let's hope the world moves beyond Hadoop 2.3 quickly so we can activate it again for the default version +1 --- If your project is set up for it, you can r

[jira] [Updated] (FLINK-2810) Warn user if bc not installed

2015-10-02 Thread Greg Hogan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Hogan updated FLINK-2810: -- Description: taskmanager.sh will print the following message when starting the cluster if bc is not ins

[GitHub] flink pull request: [hotfix] Execute YARN integration tests only u...

2015-10-02 Thread mxm
Github user mxm commented on the pull request: https://github.com/apache/flink/pull/1210#issuecomment-145036429 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and w

[jira] [Updated] (FLINK-2799) Yarn tests cannot be executed with DEBUG log level

2015-10-02 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated FLINK-2799: -- Fix Version/s: 0.10 > Yarn tests cannot be executed with DEBUG log level > -

[jira] [Updated] (FLINK-2799) Yarn tests cannot be executed with DEBUG log level

2015-10-02 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated FLINK-2799: -- Affects Version/s: 0.10 0.9 > Yarn tests cannot be executed with

[jira] [Updated] (FLINK-2810) Warn user if bc not installed

2015-10-02 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated FLINK-2810: -- Fix Version/s: 0.10 > Warn user if bc not installed > - > >

[jira] [Updated] (FLINK-2810) Warn user if bc not installed

2015-10-02 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maximilian Michels updated FLINK-2810: -- Affects Version/s: (was: master) 0.10 > Warn user if bc not i

[jira] [Commented] (FLINK-2810) Warn user if bc not installed

2015-10-02 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941185#comment-14941185 ] Maximilian Michels commented on FLINK-2810: --- Yes, bash cannot perform floating p

[GitHub] flink pull request: [FLINK-2354] Add job graph and checkpoint reco...

2015-10-02 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/1153#discussion_r41025127 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/checkpoint/CheckpointCoordinator.java --- @@ -178,9 +195,9 @@ public void run() {

[jira] [Commented] (FLINK-2779) Update documentation to reflect new Stream/Window API

2015-10-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941179#comment-14941179 ] ASF GitHub Bot commented on FLINK-2779: --- Github user senorcarbone commented on the p

[GitHub] flink pull request: [FLINK-2779][FLINK-2794][streaming][docs] New ...

2015-10-02 Thread senorcarbone
Github user senorcarbone commented on the pull request: https://github.com/apache/flink/pull/1208#issuecomment-145032778 Ah Indeed. I just reviewed this with the prospect of custom pre-aggregations in mind and it seems like pre-aggregation strategies operate on bucket-granularity. Sol

[jira] [Commented] (FLINK-2354) Recover running jobs on JobManager failure

2015-10-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941177#comment-14941177 ] ASF GitHub Bot commented on FLINK-2354: --- Github user tillrohrmann commented on a dif

[jira] [Commented] (FLINK-2354) Recover running jobs on JobManager failure

2015-10-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941173#comment-14941173 ] ASF GitHub Bot commented on FLINK-2354: --- Github user tillrohrmann commented on a dif

[jira] [Commented] (FLINK-2810) Warn user if bc not installed

2015-10-02 Thread Greg Hogan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941172#comment-14941172 ] Greg Hogan commented on FLINK-2810: --- Bash arithmetic evaluation is limited to integers.

[GitHub] flink pull request: [FLINK-2354] Add job graph and checkpoint reco...

2015-10-02 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/1153#discussion_r41024851 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/checkpoint/CheckpointCoordinator.java --- @@ -110,61 +120,68 @@ public Chec

[GitHub] flink pull request: [FLINK-2779][FLINK-2794][streaming][docs] New ...

2015-10-02 Thread aljoscha
Github user aljoscha commented on the pull request: https://github.com/apache/flink/pull/1208#issuecomment-145029475 @senorcarbone It doesn't restrict. You can use an assigner that assigns to one single window. Then using, trigger and evictor you can implement everything that was poss

[jira] [Commented] (FLINK-2779) Update documentation to reflect new Stream/Window API

2015-10-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941163#comment-14941163 ] ASF GitHub Bot commented on FLINK-2779: --- Github user aljoscha commented on the pull

[GitHub] flink pull request: [FLINK-2797][cli] Add support for running jobs...

2015-10-02 Thread mxm
Github user mxm commented on the pull request: https://github.com/apache/flink/pull/1214#issuecomment-145029090 Looks good but the Maven Checkstyle check doesn't pass... --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] flink pull request: [FLINK-2779][FLINK-2794][streaming][docs] New ...

2015-10-02 Thread senorcarbone
Github user senorcarbone commented on the pull request: https://github.com/apache/flink/pull/1208#issuecomment-145028978 From a quick read on the documentation (and prior knowledge from google dataflow) it is easy to get a full picture of the new semantics. Even though I like it from

[jira] [Commented] (FLINK-2779) Update documentation to reflect new Stream/Window API

2015-10-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941160#comment-14941160 ] ASF GitHub Bot commented on FLINK-2779: --- Github user senorcarbone commented on the p

[jira] [Commented] (FLINK-2797) CLI: Missing option to submit jobs in detached mode

2015-10-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941161#comment-14941161 ] ASF GitHub Bot commented on FLINK-2797: --- Github user mxm commented on the pull reque

[jira] [Commented] (FLINK-1789) Allow adding of URLs to the usercode class loader

2015-10-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941151#comment-14941151 ] ASF GitHub Bot commented on FLINK-1789: --- Github user mxm commented on the pull reque

[GitHub] flink pull request: [FLINK-1789] [core] [runtime] [java-api] Allow...

2015-10-02 Thread mxm
Github user mxm commented on the pull request: https://github.com/apache/flink/pull/593#issuecomment-145026274 This looks good to merge. However, there are a lot of merge conflicts. Could you rebase to the master again? We're are thinking about creating a release candidate for 0.10 un

[jira] [Commented] (FLINK-2779) Update documentation to reflect new Stream/Window API

2015-10-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941150#comment-14941150 ] ASF GitHub Bot commented on FLINK-2779: --- Github user senorcarbone commented on the p

[GitHub] flink pull request: [FLINK-2779][FLINK-2794][streaming][docs] New ...

2015-10-02 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/1208#issuecomment-145025216 Would be a nice addition to the docs, to state that global time reduce (and other aggregations) are pre-aggregated in parallel. --- If your project is set up for it

[jira] [Commented] (FLINK-2779) Update documentation to reflect new Stream/Window API

2015-10-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941148#comment-14941148 ] ASF GitHub Bot commented on FLINK-2779: --- Github user StephanEwen commented on the pu

[jira] [Commented] (FLINK-2779) Update documentation to reflect new Stream/Window API

2015-10-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941144#comment-14941144 ] ASF GitHub Bot commented on FLINK-2779: --- Github user StephanEwen commented on the pu

[GitHub] flink pull request: [FLINK-2779][FLINK-2794][streaming][docs] New ...

2015-10-02 Thread senorcarbone
Github user senorcarbone commented on the pull request: https://github.com/apache/flink/pull/1208#issuecomment-145025577 Nice doc so far ^^ One tiny fix on the *Advanced window constructs* subsection: [0,1000], [100,1100], **[200,1200]**, ..., [1000, 2000] --- If yo

[jira] [Commented] (FLINK-2779) Update documentation to reflect new Stream/Window API

2015-10-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941146#comment-14941146 ] ASF GitHub Bot commented on FLINK-2779: --- Github user gyfora commented on the pull re

[GitHub] flink pull request: [FLINK-2779][FLINK-2794][streaming][docs] New ...

2015-10-02 Thread gyfora
Github user gyfora commented on the pull request: https://github.com/apache/flink/pull/1208#issuecomment-145024860 That is what I mean, global time reduce. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project d

[GitHub] flink pull request: [FLINK-2797][cli] Add support for running jobs...

2015-10-02 Thread sachingoel0101
Github user sachingoel0101 commented on the pull request: https://github.com/apache/flink/pull/1214#issuecomment-145023847 I tested the normal execution mode. However, I don't have a yarn setup. Can someone give it a quick check with yarn? Quick question though: In detached mode, p

[GitHub] flink pull request: [FLINK-2779][FLINK-2794][streaming][docs] New ...

2015-10-02 Thread StephanEwen
Github user StephanEwen commented on the pull request: https://github.com/apache/flink/pull/1208#issuecomment-145024435 Global windows are not parallel, not in any system, it is inherent in the operation. You can pre-aggregate in parallel, if the windows are time windows. Thes

[jira] [Commented] (FLINK-2797) CLI: Missing option to submit jobs in detached mode

2015-10-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941142#comment-14941142 ] ASF GitHub Bot commented on FLINK-2797: --- Github user sachingoel0101 commented on the

[jira] [Commented] (FLINK-2810) Warn user if bc not installed

2015-10-02 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941138#comment-14941138 ] Stephan Ewen commented on FLINK-2810: - Do the scripts strictly need {{bc}} ? You can d

[GitHub] flink pull request: [FLINK-2797][cli] Add support for running jobs...

2015-10-02 Thread sachingoel0101
GitHub user sachingoel0101 opened a pull request: https://github.com/apache/flink/pull/1214 [FLINK-2797][cli] Add support for running jobs in detached mode from CLI Adds an option `-d` to run jobs in detached mode. You can merge this pull request into a Git repository by running:

[GitHub] flink pull request: [FLINK-2779][FLINK-2794][streaming][docs] New ...

2015-10-02 Thread aljoscha
Github user aljoscha commented on the pull request: https://github.com/apache/flink/pull/1208#issuecomment-145021034 There should be some streaming specific stuff in the `Execution Config` section. For example, there is `enableTimestamps()` and `setAutoWatermarkInterval()`. --- If y

[jira] [Commented] (FLINK-2797) CLI: Missing option to submit jobs in detached mode

2015-10-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941137#comment-14941137 ] ASF GitHub Bot commented on FLINK-2797: --- GitHub user sachingoel0101 opened a pull re

[jira] [Commented] (FLINK-2779) Update documentation to reflect new Stream/Window API

2015-10-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941136#comment-14941136 ] ASF GitHub Bot commented on FLINK-2779: --- Github user aljoscha commented on the pull

[jira] [Commented] (FLINK-2779) Update documentation to reflect new Stream/Window API

2015-10-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941133#comment-14941133 ] ASF GitHub Bot commented on FLINK-2779: --- Github user aljoscha commented on the pull

[jira] [Commented] (FLINK-2779) Update documentation to reflect new Stream/Window API

2015-10-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941132#comment-14941132 ] ASF GitHub Bot commented on FLINK-2779: --- Github user aljoscha commented on the pull

[jira] [Commented] (FLINK-2779) Update documentation to reflect new Stream/Window API

2015-10-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941134#comment-14941134 ] ASF GitHub Bot commented on FLINK-2779: --- Github user gyfora commented on the pull re

[GitHub] flink pull request: [FLINK-2779][FLINK-2794][streaming][docs] New ...

2015-10-02 Thread aljoscha
Github user aljoscha commented on the pull request: https://github.com/apache/flink/pull/1208#issuecomment-145020534 If split is mentioned select should also be mentioned. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. I

[GitHub] flink pull request: [FLINK-2779][FLINK-2794][streaming][docs] New ...

2015-10-02 Thread gyfora
Github user gyfora commented on the pull request: https://github.com/apache/flink/pull/1208#issuecomment-145020604 "Windows on unkeyed data streams (non-parallel windows)" I still think that this gives a bad false impression of executing all global windows including time in a non-p

[GitHub] flink pull request: [FLINK-2779][FLINK-2794][streaming][docs] New ...

2015-10-02 Thread aljoscha
Github user aljoscha commented on the pull request: https://github.com/apache/flink/pull/1208#issuecomment-145020475 The ConnectedStreams example formatting is off (in Transformations section), also there should be something like: ```java ConnectedStreams<> connectedStreams = s

[jira] [Commented] (FLINK-2779) Update documentation to reflect new Stream/Window API

2015-10-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941130#comment-14941130 ] ASF GitHub Bot commented on FLINK-2779: --- Github user aljoscha commented on the pull

[GitHub] flink pull request: [FLINK-2779][FLINK-2794][streaming][docs] New ...

2015-10-02 Thread gyfora
Github user gyfora commented on the pull request: https://github.com/apache/flink/pull/1208#issuecomment-145020261 @aljoscha : what I meant was just that we define some time semantics with the window assigner --- If your project is set up for it, you can reply to this email and have

[GitHub] flink pull request: [FLINK-2779][FLINK-2794][streaming][docs] New ...

2015-10-02 Thread aljoscha
Github user aljoscha commented on the pull request: https://github.com/apache/flink/pull/1208#issuecomment-145020330 @gyfora, yes, thats right --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[jira] [Commented] (FLINK-2779) Update documentation to reflect new Stream/Window API

2015-10-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941129#comment-14941129 ] ASF GitHub Bot commented on FLINK-2779: --- Github user gyfora commented on the pull re

[GitHub] flink pull request: [FLINK-2779][FLINK-2794][streaming][docs] New ...

2015-10-02 Thread aljoscha
Github user aljoscha commented on the pull request: https://github.com/apache/flink/pull/1208#issuecomment-145020080 @gyfora Yes, they work with the same semantics. What do you mean by "fix time trigger/eviction determined by the window assigner"? --- If your project is set up for it

[jira] [Commented] (FLINK-2779) Update documentation to reflect new Stream/Window API

2015-10-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941128#comment-14941128 ] ASF GitHub Bot commented on FLINK-2779: --- Github user aljoscha commented on the pull

[GitHub] flink pull request: [FLINK-2779][FLINK-2794][streaming][docs] New ...

2015-10-02 Thread aljoscha
Github user aljoscha commented on the pull request: https://github.com/apache/flink/pull/1208#issuecomment-145019903 The WindowFunction has a different signature for regular windows and all windows. This should maybe be visible in the transformations section. --- If your project is s

[jira] [Commented] (FLINK-2779) Update documentation to reflect new Stream/Window API

2015-10-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941127#comment-14941127 ] ASF GitHub Bot commented on FLINK-2779: --- Github user aljoscha commented on the pull

[jira] [Created] (FLINK-2810) Warn user if bc not installed

2015-10-02 Thread Greg Hogan (JIRA)
Greg Hogan created FLINK-2810: - Summary: Warn user if bc not installed Key: FLINK-2810 URL: https://issues.apache.org/jira/browse/FLINK-2810 Project: Flink Issue Type: Improvement Compo

[GitHub] flink pull request: [FLINK-2779][FLINK-2794][streaming][docs] New ...

2015-10-02 Thread gyfora
Github user gyfora commented on the pull request: https://github.com/apache/flink/pull/1208#issuecomment-145017991 The description of Evictors for the keyed windows are a little bit messy, what gets evicted from where. There is also some conflict with the example and the description:

[jira] [Commented] (FLINK-2779) Update documentation to reflect new Stream/Window API

2015-10-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941119#comment-14941119 ] ASF GitHub Bot commented on FLINK-2779: --- Github user gyfora commented on the pull re

  1   2   >