[jira] [Updated] (FLINK-5077) testStreamTableSink fails unstable

2016-11-15 Thread Boris Osipov (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Osipov updated FLINK-5077: Summary: testStreamTableSink fails unstable (was: testStreamTableSink falls unstable) >

[jira] [Created] (FLINK-5077) testStreamTableSink falls unstable

2016-11-15 Thread Boris Osipov (JIRA)
Boris Osipov created FLINK-5077: --- Summary: testStreamTableSink falls unstable Key: FLINK-5077 URL: https://issues.apache.org/jira/browse/FLINK-5077 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-5076) Shutting down TM when shutting down new mini cluster

2016-11-15 Thread Biao Liu (JIRA)
Biao Liu created FLINK-5076: --- Summary: Shutting down TM when shutting down new mini cluster Key: FLINK-5076 URL: https://issues.apache.org/jira/browse/FLINK-5076 Project: Flink Issue Type:

[jira] [Comment Edited] (FLINK-5013) Flink Kinesis connector doesn't work on old EMR versions

2016-11-15 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15669628#comment-15669628 ] Tzu-Li (Gordon) Tai edited comment on FLINK-5013 at 11/16/16 6:55 AM: --

[jira] [Comment Edited] (FLINK-5013) Flink Kinesis connector doesn't work on old EMR versions

2016-11-15 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15669628#comment-15669628 ] Tzu-Li (Gordon) Tai edited comment on FLINK-5013 at 11/16/16 6:53 AM: --

[jira] [Commented] (FLINK-5013) Flink Kinesis connector doesn't work on old EMR versions

2016-11-15 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15669628#comment-15669628 ] Tzu-Li (Gordon) Tai commented on FLINK-5013: Resolved for master with

[jira] [Commented] (FLINK-5013) Flink Kinesis connector doesn't work on old EMR versions

2016-11-15 Thread Craig Foster (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15669623#comment-15669623 ] Craig Foster commented on FLINK-5013: - Is there a fix/issue pending for correctly shading in

[jira] [Closed] (FLINK-4727) Kafka 0.9 Consumer should also checkpoint auto retrieved offsets even when no data is read

2016-11-15 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai closed FLINK-4727. -- Resolution: Resolved > Kafka 0.9 Consumer should also checkpoint auto retrieved offsets

[jira] [Commented] (FLINK-5013) Flink Kinesis connector doesn't work on old EMR versions

2016-11-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15669591#comment-15669591 ] ASF GitHub Bot commented on FLINK-5013: --- Github user asfgit closed the pull request at:

[GitHub] flink pull request #2787: [FLINK-5013] [kinesis] Shade AWS dependencies to w...

2016-11-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/2787 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] flink issue #2787: [FLINK-5013] [kinesis] Shade AWS dependencies to work wit...

2016-11-15 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/2787 Merging ... --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[jira] [Commented] (FLINK-5013) Flink Kinesis connector doesn't work on old EMR versions

2016-11-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15669582#comment-15669582 ] ASF GitHub Bot commented on FLINK-5013: --- Github user tzulitai commented on the issue:

[jira] [Created] (FLINK-5075) Kinesis consumer incorrectly determines shards as newly discovered when tested against Kinesalite

2016-11-15 Thread Tzu-Li (Gordon) Tai (JIRA)
Tzu-Li (Gordon) Tai created FLINK-5075: -- Summary: Kinesis consumer incorrectly determines shards as newly discovered when tested against Kinesalite Key: FLINK-5075 URL:

[jira] [Assigned] (FLINK-5074) Implement a RunningJobRegistry based on Zookeeper

2016-11-15 Thread shuai.xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shuai.xu reassigned FLINK-5074: --- Assignee: shuai.xu > Implement a RunningJobRegistry based on Zookeeper >

[jira] [Created] (FLINK-5074) Implement a RunningJobRegistry based on Zookeeper

2016-11-15 Thread shuai.xu (JIRA)
shuai.xu created FLINK-5074: --- Summary: Implement a RunningJobRegistry based on Zookeeper Key: FLINK-5074 URL: https://issues.apache.org/jira/browse/FLINK-5074 Project: Flink Issue Type: Task

[jira] [Closed] (FLINK-4164) Use only one rocksdb column family to store all states in an operator

2016-11-15 Thread LiuBiao (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LiuBiao closed FLINK-4164. -- Resolution: Won't Fix As the state backend has been reconstructed, this issue should be closed. > Use only

[jira] [Commented] (FLINK-3869) WindowedStream.apply with FoldFunction is too restrictive

2016-11-15 Thread Yassine Marzougui (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15669039#comment-15669039 ] Yassine Marzougui commented on FLINK-3869: -- [~aljoscha] would it be OK if I incorporate the

[jira] [Commented] (FLINK-5013) Flink Kinesis connector doesn't work on old EMR versions

2016-11-15 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15668845#comment-15668845 ] Robert Metzger commented on FLINK-5013: --- We only strictly enforce the maven version when building a

[jira] [Commented] (FLINK-5056) BucketingSink deletes valid data when checkpoint notification is slow.

2016-11-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15668827#comment-15668827 ] ASF GitHub Bot commented on FLINK-5056: --- Github user zentol commented on the issue:

[GitHub] flink issue #2797: [FLINK-5056] Makes the BucketingSink rescalable.

2016-11-15 Thread zentol
Github user zentol commented on the issue: https://github.com/apache/flink/pull/2797 Do we provide anything that allows the user to identify files that weren't cleaned up but can be removed? Something like a list of "active" pending files? --- If your project is set up for it, you

[jira] [Comment Edited] (FLINK-4499) Introduce findbugs maven plugin

2016-11-15 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15585619#comment-15585619 ] Ted Yu edited comment on FLINK-4499 at 11/15/16 10:55 PM: -- +1 on starting with a

[jira] [Commented] (FLINK-5056) BucketingSink deletes valid data when checkpoint notification is slow.

2016-11-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15668574#comment-15668574 ] ASF GitHub Bot commented on FLINK-5056: --- Github user zentol commented on a diff in the pull request:

[jira] [Commented] (FLINK-5056) BucketingSink deletes valid data when checkpoint notification is slow.

2016-11-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15668573#comment-15668573 ] ASF GitHub Bot commented on FLINK-5056: --- Github user zentol commented on a diff in the pull request:

[GitHub] flink pull request #2797: [FLINK-5056] Makes the BucketingSink rescalable.

2016-11-15 Thread zentol
Github user zentol commented on a diff in the pull request: https://github.com/apache/flink/pull/2797#discussion_r88124075 --- Diff: flink-streaming-connectors/flink-connector-filesystem/src/test/java/org/apache/flink/streaming/connectors/fs/bucketing/BucketingSinkTest.java ---

[GitHub] flink pull request #2797: [FLINK-5056] Makes the BucketingSink rescalable.

2016-11-15 Thread zentol
Github user zentol commented on a diff in the pull request: https://github.com/apache/flink/pull/2797#discussion_r88125887 --- Diff: flink-streaming-connectors/flink-connector-filesystem/src/test/java/org/apache/flink/streaming/connectors/fs/bucketing/BucketingSinkTest.java ---

[GitHub] flink pull request #2797: [FLINK-5056] Makes the BucketingSink rescalable.

2016-11-15 Thread zentol
Github user zentol commented on a diff in the pull request: https://github.com/apache/flink/pull/2797#discussion_r88127261 --- Diff:

[jira] [Commented] (FLINK-5056) BucketingSink deletes valid data when checkpoint notification is slow.

2016-11-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15668572#comment-15668572 ] ASF GitHub Bot commented on FLINK-5056: --- Github user zentol commented on a diff in the pull request:

[jira] [Commented] (FLINK-5056) BucketingSink deletes valid data when checkpoint notification is slow.

2016-11-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15668498#comment-15668498 ] ASF GitHub Bot commented on FLINK-5056: --- Github user zentol commented on a diff in the pull request:

[GitHub] flink pull request #2797: [FLINK-5056] Makes the BucketingSink rescalable.

2016-11-15 Thread zentol
Github user zentol commented on a diff in the pull request: https://github.com/apache/flink/pull/2797#discussion_r88122097 --- Diff: flink-streaming-connectors/flink-connector-filesystem/src/test/java/org/apache/flink/streaming/connectors/fs/bucketing/BucketingSinkTest.java ---

[jira] [Commented] (FLINK-5056) BucketingSink deletes valid data when checkpoint notification is slow.

2016-11-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15668495#comment-15668495 ] ASF GitHub Bot commented on FLINK-5056: --- Github user kl0u commented on the issue:

[GitHub] flink issue #2797: [FLINK-5056] Makes the BucketingSink rescalable.

2016-11-15 Thread kl0u
Github user kl0u commented on the issue: https://github.com/apache/flink/pull/2797 Sorry I just amended my previous commit with the comment integration. :S --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[jira] [Commented] (FLINK-5056) BucketingSink deletes valid data when checkpoint notification is slow.

2016-11-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15668477#comment-15668477 ] ASF GitHub Bot commented on FLINK-5056: --- Github user zentol commented on a diff in the pull request:

[GitHub] flink pull request #2797: [FLINK-5056] Makes the BucketingSink rescalable.

2016-11-15 Thread zentol
Github user zentol commented on a diff in the pull request: https://github.com/apache/flink/pull/2797#discussion_r88120352 --- Diff: flink-streaming-connectors/flink-connector-filesystem/src/main/java/org/apache/flink/streaming/connectors/fs/bucketing/BucketingSink.java --- @@

[jira] [Commented] (FLINK-5056) BucketingSink deletes valid data when checkpoint notification is slow.

2016-11-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15668461#comment-15668461 ] ASF GitHub Bot commented on FLINK-5056: --- Github user zentol commented on the issue:

[GitHub] flink issue #2797: [FLINK-5056] Makes the BucketingSink rescalable.

2016-11-15 Thread zentol
Github user zentol commented on the issue: https://github.com/apache/flink/pull/2797 That makes sense, thanks for the explanation. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[jira] [Commented] (FLINK-5056) BucketingSink deletes valid data when checkpoint notification is slow.

2016-11-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15668371#comment-15668371 ] ASF GitHub Bot commented on FLINK-5056: --- Github user kl0u commented on the issue:

[GitHub] flink issue #2797: [FLINK-5056] Makes the BucketingSink rescalable.

2016-11-15 Thread kl0u
Github user kl0u commented on the issue: https://github.com/apache/flink/pull/2797 The subtask matters for files that were opened but they did not make it into a checkpoint because a failure occurred after they were opened but before a checkpoint barrier arrived. These are the

[jira] [Commented] (FLINK-4937) Add incremental group window aggregation for streaming Table API

2016-11-15 Thread sunjincheng (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15668362#comment-15668362 ] sunjincheng commented on FLINK-4937: I really want to separate incremental and non-incremental

[jira] [Commented] (FLINK-4937) Add incremental group window aggregation for streaming Table API

2016-11-15 Thread sunjincheng (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15668332#comment-15668332 ] sunjincheng commented on FLINK-4937: done > Add incremental group window aggregation for streaming

[GitHub] flink pull request #2797: [FLINK-5056] Makes the BucketingSink rescalable.

2016-11-15 Thread zentol
Github user zentol commented on a diff in the pull request: https://github.com/apache/flink/pull/2797#discussion_r88113221 --- Diff: flink-streaming-connectors/flink-connector-filesystem/src/main/java/org/apache/flink/streaming/connectors/fs/bucketing/BucketingSink.java --- @@

[jira] [Commented] (FLINK-4937) Add incremental group window aggregation for streaming Table API

2016-11-15 Thread sunjincheng (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15668331#comment-15668331 ] sunjincheng commented on FLINK-4937: done > Add incremental group window aggregation for streaming

[jira] [Commented] (FLINK-4937) Add incremental group window aggregation for streaming Table API

2016-11-15 Thread sunjincheng (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15668327#comment-15668327 ] sunjincheng commented on FLINK-4937: done > Add incremental group window aggregation for streaming

[jira] [Commented] (FLINK-5056) BucketingSink deletes valid data when checkpoint notification is slow.

2016-11-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15668324#comment-15668324 ] ASF GitHub Bot commented on FLINK-5056: --- Github user zentol commented on a diff in the pull request:

[jira] [Commented] (FLINK-5056) BucketingSink deletes valid data when checkpoint notification is slow.

2016-11-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15668314#comment-15668314 ] ASF GitHub Bot commented on FLINK-5056: --- Github user zentol commented on the issue:

[GitHub] flink issue #2797: [FLINK-5056] Makes the BucketingSink rescalable.

2016-11-15 Thread zentol
Github user zentol commented on the issue: https://github.com/apache/flink/pull/2797 No, it's not just that one method. The method is on a whole other level; it is so easy to edit a commit there simply is no reason for such a thing to exist in the *initial PR*. So, let's go

[jira] [Commented] (FLINK-5056) BucketingSink deletes valid data when checkpoint notification is slow.

2016-11-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15668281#comment-15668281 ] ASF GitHub Bot commented on FLINK-5056: --- Github user kl0u commented on a diff in the pull request:

[GitHub] flink pull request #2797: [FLINK-5056] Makes the BucketingSink rescalable.

2016-11-15 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/2797#discussion_r88110293 --- Diff: flink-streaming-connectors/flink-connector-filesystem/src/main/java/org/apache/flink/streaming/connectors/fs/bucketing/BucketingSink.java --- @@

[jira] [Commented] (FLINK-4913) Per-job Yarn clusters: include user jar in system class loader

2016-11-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15668275#comment-15668275 ] ASF GitHub Bot commented on FLINK-4913: --- Github user mxm commented on the issue:

[GitHub] flink issue #2795: Revert "[FLINK-4913][yarn] include user jars in system cl...

2016-11-15 Thread mxm
Github user mxm commented on the issue: https://github.com/apache/flink/pull/2795 Thanks. +1 for reverting then! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[jira] [Commented] (FLINK-5056) BucketingSink deletes valid data when checkpoint notification is slow.

2016-11-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15668195#comment-15668195 ] ASF GitHub Bot commented on FLINK-5056: --- Github user kl0u commented on a diff in the pull request:

[GitHub] flink pull request #2797: [FLINK-5056] Makes the BucketingSink rescalable.

2016-11-15 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/2797#discussion_r88105517 --- Diff: flink-streaming-connectors/flink-connector-filesystem/src/main/java/org/apache/flink/streaming/connectors/fs/bucketing/BucketingSink.java --- @@

[jira] [Updated] (FLINK-4900) Implement Docker image support

2016-11-15 Thread JIRA
[ https://issues.apache.org/jira/browse/FLINK-4900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mischa Krüger updated FLINK-4900: - Labels: release (was: release review) > Implement Docker image support >

[jira] [Commented] (FLINK-5056) BucketingSink deletes valid data when checkpoint notification is slow.

2016-11-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15668128#comment-15668128 ] ASF GitHub Bot commented on FLINK-5056: --- Github user zentol commented on a diff in the pull request:

[jira] [Updated] (FLINK-4900) Implement Docker image support

2016-11-15 Thread JIRA
[ https://issues.apache.org/jira/browse/FLINK-4900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mischa Krüger updated FLINK-4900: - Labels: release review (was: release) > Implement Docker image support >

[GitHub] flink pull request #2797: [FLINK-5056] Makes the BucketingSink rescalable.

2016-11-15 Thread zentol
Github user zentol commented on a diff in the pull request: https://github.com/apache/flink/pull/2797#discussion_r88101910 --- Diff: flink-streaming-connectors/flink-connector-filesystem/src/main/java/org/apache/flink/streaming/connectors/fs/bucketing/BucketingSink.java --- @@

[jira] [Created] (FLINK-5073) ZooKeeperCompleteCheckpointStore executes blocking delete operation in ZooKeeper client thread

2016-11-15 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-5073: Summary: ZooKeeperCompleteCheckpointStore executes blocking delete operation in ZooKeeper client thread Key: FLINK-5073 URL: https://issues.apache.org/jira/browse/FLINK-5073

[jira] [Updated] (FLINK-4900) Implement Docker image support

2016-11-15 Thread JIRA
[ https://issues.apache.org/jira/browse/FLINK-4900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mischa Krüger updated FLINK-4900: - Labels: release (was: ) > Implement Docker image support > -- > >

[jira] [Assigned] (FLINK-4900) Implement Docker image support

2016-11-15 Thread JIRA
[ https://issues.apache.org/jira/browse/FLINK-4900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mischa Krüger reassigned FLINK-4900: Assignee: Mischa Krüger (was: Eron Wright ) > Implement Docker image support >

[jira] [Commented] (FLINK-5008) Update quickstart documentation

2016-11-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15667701#comment-15667701 ] ASF GitHub Bot commented on FLINK-5008: --- Github user NicoK commented on the issue:

[GitHub] flink issue #2764: [FLINK-5008] Update quickstart documentation

2016-11-15 Thread NicoK
Github user NicoK commented on the issue: https://github.com/apache/flink/pull/2764 I tried with several versions of Eclipse and Scala IDE, even with the one claimed to work. Unfortunately, I got none of them to work. --- If your project is set up for it, you can reply to this email

[jira] [Commented] (FLINK-4604) Add support for standard deviation/variance

2016-11-15 Thread Timo Walther (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15667697#comment-15667697 ] Timo Walther commented on FLINK-4604: - I looked into the problem. If you take a look at

[GitHub] flink issue #2797: [FLINK-5056] Makes the BucketingSink rescalable.

2016-11-15 Thread kl0u
Github user kl0u commented on the issue: https://github.com/apache/flink/pull/2797 Thanks for the first review @zentol . On the comment about the diff reduction, you are referring to the removal of the method in the intermediate commits that was not used? If yes, then this

[GitHub] flink issue #2814: Corrected log4j files.

2016-11-15 Thread greghogan
Github user greghogan commented on the issue: https://github.com/apache/flink/pull/2814 +1 to merge --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[jira] [Commented] (FLINK-5056) BucketingSink deletes valid data when checkpoint notification is slow.

2016-11-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15667681#comment-15667681 ] ASF GitHub Bot commented on FLINK-5056: --- Github user kl0u commented on the issue:

[jira] [Commented] (FLINK-5056) BucketingSink deletes valid data when checkpoint notification is slow.

2016-11-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15667672#comment-15667672 ] ASF GitHub Bot commented on FLINK-5056: --- Github user kl0u commented on a diff in the pull request:

[GitHub] flink pull request #2797: [FLINK-5056] Makes the BucketingSink rescalable.

2016-11-15 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/2797#discussion_r88063735 --- Diff: flink-streaming-connectors/flink-connector-filesystem/src/main/java/org/apache/flink/streaming/connectors/fs/bucketing/BucketingSink.java --- @@

[GitHub] flink issue #2740: [FLINK-4964] [ml]

2016-11-15 Thread thvasilo
Github user thvasilo commented on the issue: https://github.com/apache/flink/pull/2740 @greghogan Excuse my ignorance, I'm only now learning about Flink internals :) It seems like the issue here was that `partitionByRange` partitions keys in ascending order but we want the end

[jira] [Commented] (FLINK-4964) FlinkML - Add StringIndexer

2016-11-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15667671#comment-15667671 ] ASF GitHub Bot commented on FLINK-4964: --- Github user thvasilo commented on the issue:

[jira] [Commented] (FLINK-5056) BucketingSink deletes valid data when checkpoint notification is slow.

2016-11-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15667664#comment-15667664 ] ASF GitHub Bot commented on FLINK-5056: --- Github user kl0u commented on a diff in the pull request:

[GitHub] flink pull request #2797: [FLINK-5056] Makes the BucketingSink rescalable.

2016-11-15 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/2797#discussion_r88063330 --- Diff: flink-streaming-connectors/flink-connector-filesystem/src/main/java/org/apache/flink/streaming/connectors/fs/bucketing/BucketingSink.java --- @@

[GitHub] flink pull request #2814: Corrected log4j files.

2016-11-15 Thread bitchelov
GitHub user bitchelov opened a pull request: https://github.com/apache/flink/pull/2814 Corrected log4j files. Thanks for contributing to Apache Flink. Before you open your pull request, please take the following check list into consideration. If your changes take all of the

[GitHub] flink pull request #2802: Minor fixes

2016-11-15 Thread bitchelov
Github user bitchelov closed the pull request at: https://github.com/apache/flink/pull/2802 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] flink pull request #2800: Update README.md

2016-11-15 Thread bitchelov
Github user bitchelov closed the pull request at: https://github.com/apache/flink/pull/2800 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (FLINK-4565) Support for SQL IN operator

2016-11-15 Thread Nikolay Vasilishin (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15667527#comment-15667527 ] Nikolay Vasilishin commented on FLINK-4565: --- Thanks, guys. I've implemented first two cases:

[jira] [Commented] (FLINK-5056) BucketingSink deletes valid data when checkpoint notification is slow.

2016-11-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15667497#comment-15667497 ] ASF GitHub Bot commented on FLINK-5056: --- Github user zentol commented on the issue:

[GitHub] flink issue #2797: [FLINK-5056] Makes the BucketingSink rescalable.

2016-11-15 Thread zentol
Github user zentol commented on the issue: https://github.com/apache/flink/pull/2797 I also haven't checked the tests yet. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] flink pull request #2797: [FLINK-5056] Makes the BucketingSink rescalable.

2016-11-15 Thread zentol
Github user zentol commented on a diff in the pull request: https://github.com/apache/flink/pull/2797#discussion_r88044100 --- Diff: flink-streaming-connectors/flink-connector-filesystem/src/main/java/org/apache/flink/streaming/connectors/fs/bucketing/BucketingSink.java --- @@

[jira] [Commented] (FLINK-5056) BucketingSink deletes valid data when checkpoint notification is slow.

2016-11-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15667493#comment-15667493 ] ASF GitHub Bot commented on FLINK-5056: --- Github user zentol commented on a diff in the pull request:

[jira] [Commented] (FLINK-5056) BucketingSink deletes valid data when checkpoint notification is slow.

2016-11-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15667489#comment-15667489 ] ASF GitHub Bot commented on FLINK-5056: --- Github user zentol commented on a diff in the pull request:

[jira] [Commented] (FLINK-5056) BucketingSink deletes valid data when checkpoint notification is slow.

2016-11-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15667490#comment-15667490 ] ASF GitHub Bot commented on FLINK-5056: --- Github user zentol commented on a diff in the pull request:

[GitHub] flink pull request #2797: [FLINK-5056] Makes the BucketingSink rescalable.

2016-11-15 Thread zentol
Github user zentol commented on a diff in the pull request: https://github.com/apache/flink/pull/2797#discussion_r88044225 --- Diff: flink-streaming-connectors/flink-connector-filesystem/src/main/java/org/apache/flink/streaming/connectors/fs/bucketing/BucketingSink.java --- @@

[jira] [Commented] (FLINK-5056) BucketingSink deletes valid data when checkpoint notification is slow.

2016-11-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15667492#comment-15667492 ] ASF GitHub Bot commented on FLINK-5056: --- Github user zentol commented on a diff in the pull request:

[jira] [Commented] (FLINK-5056) BucketingSink deletes valid data when checkpoint notification is slow.

2016-11-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15667491#comment-15667491 ] ASF GitHub Bot commented on FLINK-5056: --- Github user zentol commented on a diff in the pull request:

[GitHub] flink pull request #2797: [FLINK-5056] Makes the BucketingSink rescalable.

2016-11-15 Thread zentol
Github user zentol commented on a diff in the pull request: https://github.com/apache/flink/pull/2797#discussion_r88043878 --- Diff: flink-streaming-connectors/flink-connector-filesystem/src/main/java/org/apache/flink/streaming/connectors/fs/bucketing/BucketingSink.java --- @@

[GitHub] flink pull request #2797: [FLINK-5056] Makes the BucketingSink rescalable.

2016-11-15 Thread zentol
Github user zentol commented on a diff in the pull request: https://github.com/apache/flink/pull/2797#discussion_r88044327 --- Diff: flink-streaming-connectors/flink-connector-filesystem/src/main/java/org/apache/flink/streaming/connectors/fs/bucketing/BucketingSink.java --- @@

[GitHub] flink pull request #2797: [FLINK-5056] Makes the BucketingSink rescalable.

2016-11-15 Thread zentol
Github user zentol commented on a diff in the pull request: https://github.com/apache/flink/pull/2797#discussion_r88032585 --- Diff: flink-streaming-connectors/flink-connector-filesystem/src/main/java/org/apache/flink/streaming/connectors/fs/bucketing/BucketingSink.java --- @@

[jira] [Closed] (FLINK-4369) EvictingWindowOperator Must Actually Evict Elements

2016-11-15 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed FLINK-4369. --- Resolution: Fixed Fix Version/s: 1.2.0 > EvictingWindowOperator Must Actually Evict

[jira] [Reopened] (FLINK-4369) EvictingWindowOperator Must Actually Evict Elements

2016-11-15 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek reopened FLINK-4369: - Reopen to set fix version. > EvictingWindowOperator Must Actually Evict Elements >

[jira] [Commented] (FLINK-4174) Enhance Window Evictor

2016-11-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15667457#comment-15667457 ] ASF GitHub Bot commented on FLINK-4174: --- Github user aljoscha commented on the issue:

[GitHub] flink issue #2736: [FLINK-4174] Enhance evictor functionality

2016-11-15 Thread aljoscha
Github user aljoscha commented on the issue: https://github.com/apache/flink/pull/2736 I reopened and then closed with the correct fix version. I think no-one can change closed issues. --- If your project is set up for it, you can reply to this email and have your reply appear on

[jira] [Closed] (FLINK-4174) Enhance Window Evictor

2016-11-15 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed FLINK-4174. --- Resolution: Fixed Fix Version/s: 1.2.0 > Enhance Window Evictor >

[jira] [Reopened] (FLINK-4174) Enhance Window Evictor

2016-11-15 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek reopened FLINK-4174: - Reopen to set fix version. > Enhance Window Evictor > -- > >

[jira] [Commented] (FLINK-5072) MetricFetcher Ask Timeout

2016-11-15 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15667421#comment-15667421 ] Chesnay Schepler commented on FLINK-5072: - hmm. Well it isn't something critical if the

[GitHub] flink issue #2740: [FLINK-4964] [ml]

2016-11-15 Thread greghogan
Github user greghogan commented on the issue: https://github.com/apache/flink/pull/2740 `zipWithIndex` preserves the order between partitions (DataSetUtils.java:121). @tfournier314, I don't think it's a problem pushing your current code since we're still discussing the PR. --- If

[jira] [Commented] (FLINK-4964) FlinkML - Add StringIndexer

2016-11-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15667423#comment-15667423 ] ASF GitHub Bot commented on FLINK-4964: --- Github user greghogan commented on the issue:

[GitHub] flink issue #2736: [FLINK-4174] Enhance evictor functionality

2016-11-15 Thread soniclavier
Github user soniclavier commented on the issue: https://github.com/apache/flink/pull/2736 I don't think I can edit a closed issue, could you please make the edit. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[jira] [Commented] (FLINK-4174) Enhance Window Evictor

2016-11-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15667391#comment-15667391 ] ASF GitHub Bot commented on FLINK-4174: --- Github user soniclavier commented on the issue:

[jira] [Created] (FLINK-5072) MetricFetcher Ask Timeout

2016-11-15 Thread Ufuk Celebi (JIRA)
Ufuk Celebi created FLINK-5072: -- Summary: MetricFetcher Ask Timeout Key: FLINK-5072 URL: https://issues.apache.org/jira/browse/FLINK-5072 Project: Flink Issue Type: Improvement

[jira] [Commented] (FLINK-5056) BucketingSink deletes valid data when checkpoint notification is slow.

2016-11-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15667325#comment-15667325 ] ASF GitHub Bot commented on FLINK-5056: --- Github user zentol commented on a diff in the pull request:

[jira] [Commented] (FLINK-4174) Enhance Window Evictor

2016-11-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15667353#comment-15667353 ] ASF GitHub Bot commented on FLINK-4174: --- Github user aljoscha commented on the issue:

  1   2   3   >