[GitHub] flink pull request #3870: [Flink 6537] Fixes and improvements for incrementa...

2017-05-11 Thread StefanRRichter
GitHub user StefanRRichter opened a pull request: https://github.com/apache/flink/pull/3870 [Flink 6537] Fixes and improvements for incremental checkpoints in RocksDB This PR bundles several fixes and improvements for incremental checkpoints in RocksDB. In particular, this

[jira] [Commented] (FLINK-6351) Refactor YarnFlinkApplicationMasterRunner by combining AbstractYarnFlinkApplicationMasterRunner in one class

2017-05-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16006237#comment-16006237 ] ASF GitHub Bot commented on FLINK-6351: --- Github user shuai-xu commented on the issue:

[GitHub] flink issue #3755: [FLINK-6351] [YARN] Refactoring YarnFlinkApplicationMaste...

2017-05-11 Thread shuai-xu
Github user shuai-xu commented on the issue: https://github.com/apache/flink/pull/3755 There will soon be a YarnFlinkAppMaster extends AbstractYarnFlinkApplicationMasterRunner for flink yarn cluster mode, so need not combine them to one class. --- If your project is set up for it,

[jira] [Commented] (FLINK-5853) Add consecutive event based filters

2017-05-11 Thread Dawid Wysakowicz (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16006272#comment-16006272 ] Dawid Wysakowicz commented on FLINK-5853: - Hi [~kkl0u], Yes it is. I agree [FLINK-6420] is more

[jira] [Commented] (FLINK-5781) Generation HTML from ConfigOption

2017-05-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16006307#comment-16006307 ] ASF GitHub Bot commented on FLINK-5781: --- Github user zentol commented on a diff in the pull request:

[jira] [Created] (FLINK-6541) Jar upload directory not created

2017-05-11 Thread Andrey (JIRA)
Andrey created FLINK-6541: - Summary: Jar upload directory not created Key: FLINK-6541 URL: https://issues.apache.org/jira/browse/FLINK-6541 Project: Flink Issue Type: Bug Affects Versions: 1.2.0

[jira] [Assigned] (FLINK-6542) Non-keyed, non-windowed aggregation fails

2017-05-11 Thread Xingcan Cui (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xingcan Cui reassigned FLINK-6542: -- Assignee: Xingcan Cui > Non-keyed, non-windowed aggregation fails >

[GitHub] flink pull request #3673: [FLINK-5256] Extend DataSetSingleRowJoin to suppor...

2017-05-11 Thread DmytroShkvyra
Github user DmytroShkvyra commented on a diff in the pull request: https://github.com/apache/flink/pull/3673#discussion_r115996407 --- Diff: flink-libraries/flink-table/src/test/scala/org/apache/flink/table/api/scala/batch/sql/DataSetSingleRowJoinTest.scala --- @@ -187,9 +187,106

[jira] [Commented] (FLINK-5256) Extend DataSetSingleRowJoin to support Left and Right joins

2017-05-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16006457#comment-16006457 ] ASF GitHub Bot commented on FLINK-5256: --- Github user DmytroShkvyra commented on a diff in the pull

[jira] [Commented] (FLINK-5256) Extend DataSetSingleRowJoin to support Left and Right joins

2017-05-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16006462#comment-16006462 ] ASF GitHub Bot commented on FLINK-5256: --- Github user DmytroShkvyra commented on the issue:

[GitHub] flink issue #3870: [Flink 6537] Fixes and improvements for incremental check...

2017-05-11 Thread gyfora
Github user gyfora commented on the issue: https://github.com/apache/flink/pull/3870 Hi, I am sending this because I will be away for the weekend so won't have time to test further until monday. I pulled these changes and Stephan's classloader fix but I still get some errors.

[jira] [Commented] (FLINK-6515) KafkaConsumer checkpointing fails because of ClassLoader issues

2017-05-11 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16006481#comment-16006481 ] Robert Metzger commented on FLINK-6515: --- When can we expect a fix for this? > KafkaConsumer

[jira] [Assigned] (FLINK-6125) Commons httpclient is not shaded anymore in Flink 1.2

2017-05-11 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger reassigned FLINK-6125: - Assignee: (was: Robert Metzger) > Commons httpclient is not shaded anymore in Flink

[jira] [Commented] (FLINK-6125) Commons httpclient is not shaded anymore in Flink 1.2

2017-05-11 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16006375#comment-16006375 ] Robert Metzger commented on FLINK-6125: --- I've unassigned myself. There are too many other things to

[GitHub] flink issue #2367: [FLINK-3703][cep] Add sequence matching semantics to disc...

2017-05-11 Thread mushketyk
Github user mushketyk commented on the issue: https://github.com/apache/flink/pull/2367 @kl0u Sure. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[jira] [Commented] (FLINK-3703) Add sequence matching semantics to discard matched events

2017-05-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16006388#comment-16006388 ] ASF GitHub Bot commented on FLINK-3703: --- Github user mushketyk closed the pull request at:

[GitHub] flink pull request #2367: [FLINK-3703][cep] Add sequence matching semantics ...

2017-05-11 Thread mushketyk
Github user mushketyk closed the pull request at: https://github.com/apache/flink/pull/2367 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Created] (FLINK-6545) Make incremental checkpoints externalizable

2017-05-11 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-6545: - Summary: Make incremental checkpoints externalizable Key: FLINK-6545 URL: https://issues.apache.org/jira/browse/FLINK-6545 Project: Flink Issue Type:

[GitHub] flink issue #3870: [Flink 6537] Fixes and improvements for incremental check...

2017-05-11 Thread StefanRRichter
Github user StefanRRichter commented on the issue: https://github.com/apache/flink/pull/3870 @gyfora Yes, this is still a limitation, because the incremental checkpoints are currently not (yet) externalizable. The missing piece is, exactly as you said, familiarizing the

[jira] [Commented] (FLINK-5781) Generation HTML from ConfigOption

2017-05-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16006311#comment-16006311 ] ASF GitHub Bot commented on FLINK-5781: --- Github user zentol commented on a diff in the pull request:

[GitHub] flink pull request #3495: [FLINK-5781][config] Generation HTML from ConfigOp...

2017-05-11 Thread zentol
Github user zentol commented on a diff in the pull request: https://github.com/apache/flink/pull/3495#discussion_r115973034 --- Diff: flink-core/src/main/java/org/apache/flink/configuration/ConfigOptionsDocGenerator.java --- @@ -0,0 +1,279 @@ +/* + * Licensed to the

[jira] [Commented] (FLINK-3703) Add sequence matching semantics to discard matched events

2017-05-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16006315#comment-16006315 ] ASF GitHub Bot commented on FLINK-3703: --- Github user kl0u commented on the issue:

[GitHub] flink issue #2367: [FLINK-3703][cep] Add sequence matching semantics to disc...

2017-05-11 Thread kl0u
Github user kl0u commented on the issue: https://github.com/apache/flink/pull/2367 Hi @mushketyk . I am trying to clean up a bit the open PRs for the CEP library and the related JIRAs. The issue that this PR covers was already implemented as part of multiple other

[jira] [Created] (FLINK-6542) Non-keyed, non-windowed aggregation fails

2017-05-11 Thread Timo Walther (JIRA)
Timo Walther created FLINK-6542: --- Summary: Non-keyed, non-windowed aggregation fails Key: FLINK-6542 URL: https://issues.apache.org/jira/browse/FLINK-6542 Project: Flink Issue Type: Bug

[jira] [Updated] (FLINK-6542) Non-keyed, non-windowed aggregation fails

2017-05-11 Thread Timo Walther (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Timo Walther updated FLINK-6542: Affects Version/s: 1.3.0 > Non-keyed, non-windowed aggregation fails >

[jira] [Commented] (FLINK-3703) Add sequence matching semantics to discard matched events

2017-05-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16006387#comment-16006387 ] ASF GitHub Bot commented on FLINK-3703: --- Github user mushketyk commented on the issue:

[GitHub] flink issue #3673: [FLINK-5256] Extend DataSetSingleRowJoin to support Left ...

2017-05-11 Thread DmytroShkvyra
Github user DmytroShkvyra commented on the issue: https://github.com/apache/flink/pull/3673 Hi @fhueske thanks for help. I have fixed your comments. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[jira] [Closed] (FLINK-3703) Add sequence matching semantics to discard matched events

2017-05-11 Thread Kostas Kloudas (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kostas Kloudas closed FLINK-3703. - Resolution: Implemented Fix Version/s: 1.3.0 This was covered by other issues including

[GitHub] flink pull request #3495: [FLINK-5781][config] Generation HTML from ConfigOp...

2017-05-11 Thread zentol
Github user zentol commented on a diff in the pull request: https://github.com/apache/flink/pull/3495#discussion_r115972689 --- Diff: flink-core/src/main/java/org/apache/flink/configuration/ConfigOptionsDocGenerator.java --- @@ -0,0 +1,279 @@ +/* + * Licensed to the

[jira] [Commented] (FLINK-5781) Generation HTML from ConfigOption

2017-05-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16006316#comment-16006316 ] ASF GitHub Bot commented on FLINK-5781: --- Github user zentol commented on a diff in the pull request:

[jira] [Created] (FLINK-6544) Expose Backend State Interface for UDAGG

2017-05-11 Thread Kaibo Zhou (JIRA)
Kaibo Zhou created FLINK-6544: - Summary: Expose Backend State Interface for UDAGG Key: FLINK-6544 URL: https://issues.apache.org/jira/browse/FLINK-6544 Project: Flink Issue Type: Improvement

[jira] [Updated] (FLINK-6541) Jar upload directory not created

2017-05-11 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger updated FLINK-6541: -- Component/s: Webfrontend > Jar upload directory not created >

[jira] [Commented] (FLINK-6545) Make incremental checkpoints externalizable

2017-05-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16006471#comment-16006471 ] ASF GitHub Bot commented on FLINK-6545: --- Github user StefanRRichter commented on the issue:

[jira] [Commented] (FLINK-6558) Yarn tests fail on Windows

2017-05-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16006662#comment-16006662 ] ASF GitHub Bot commented on FLINK-6558: --- GitHub user zentol opened a pull request:

[jira] [Created] (FLINK-6558) Yarn tests fail on Windows

2017-05-11 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-6558: --- Summary: Yarn tests fail on Windows Key: FLINK-6558 URL: https://issues.apache.org/jira/browse/FLINK-6558 Project: Flink Issue Type: Improvement

[GitHub] flink pull request #3874: [FLINK-6558] Disable yarn tests on Windows

2017-05-11 Thread zentol
GitHub user zentol opened a pull request: https://github.com/apache/flink/pull/3874 [FLINK-6558] Disable yarn tests on Windows This PR disabled a several YARN tests on Windows. They are failing since they try to start an HDFS cluster. You can merge this pull request into a Git

[jira] [Commented] (FLINK-5679) Refactor *CheckpointedITCase tests to speed up

2017-05-11 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16006719#comment-16006719 ] Stephan Ewen commented on FLINK-5679: - {{PartitionedStateCheckpointingITCase}} refactored in - 1.3

[jira] [Closed] (FLINK-6515) KafkaConsumer checkpointing fails because of ClassLoader issues

2017-05-11 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen closed FLINK-6515. --- > KafkaConsumer checkpointing fails because of ClassLoader issues >

[jira] [Resolved] (FLINK-6515) KafkaConsumer checkpointing fails because of ClassLoader issues

2017-05-11 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen resolved FLINK-6515. - Resolution: Fixed Fix Version/s: 1.4.0 Fixed in - 1.3.0 via

[jira] [Closed] (FLINK-6501) Make sure NOTICE files are bundled into shaded JAR files

2017-05-11 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen closed FLINK-6501. --- > Make sure NOTICE files are bundled into shaded JAR files >

[GitHub] flink pull request #3746: [FLINK-4022] [kafka] Partition and topic discovery...

2017-05-11 Thread aljoscha
Github user aljoscha commented on a diff in the pull request: https://github.com/apache/flink/pull/3746#discussion_r115996970 --- Diff: flink-connectors/flink-connector-kafka-base/src/main/java/org/apache/flink/streaming/connectors/kafka/internals/AbstractFetcher.java --- @@

[GitHub] flink pull request #3746: [FLINK-4022] [kafka] Partition and topic discovery...

2017-05-11 Thread aljoscha
Github user aljoscha commented on a diff in the pull request: https://github.com/apache/flink/pull/3746#discussion_r116000971 --- Diff: flink-connectors/flink-connector-kafka-base/src/main/java/org/apache/flink/streaming/connectors/kafka/FlinkKafkaConsumerBase.java --- @@ -503,23

[GitHub] flink pull request #3746: [FLINK-4022] [kafka] Partition and topic discovery...

2017-05-11 Thread aljoscha
Github user aljoscha commented on a diff in the pull request: https://github.com/apache/flink/pull/3746#discussion_r115997026 --- Diff: flink-connectors/flink-connector-kafka-base/src/main/java/org/apache/flink/streaming/connectors/kafka/internals/AbstractFetcher.java --- @@

[jira] [Commented] (FLINK-4022) Partition discovery / regex topic subscription for the Kafka consumer

2017-05-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16006678#comment-16006678 ] ASF GitHub Bot commented on FLINK-4022: --- Github user aljoscha commented on a diff in the pull

[jira] [Commented] (FLINK-4022) Partition discovery / regex topic subscription for the Kafka consumer

2017-05-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16006677#comment-16006677 ] ASF GitHub Bot commented on FLINK-4022: --- Github user aljoscha commented on a diff in the pull

[jira] [Commented] (FLINK-4022) Partition discovery / regex topic subscription for the Kafka consumer

2017-05-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16006679#comment-16006679 ] ASF GitHub Bot commented on FLINK-4022: --- Github user aljoscha commented on a diff in the pull

[jira] [Resolved] (FLINK-6508) Include license files of packaged dependencies

2017-05-11 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen resolved FLINK-6508. - Resolution: Fixed Fix Version/s: 1.4.0 Fixed in - 1.3.0 via

[jira] [Commented] (FLINK-6558) Yarn tests fail on Windows

2017-05-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16006810#comment-16006810 ] ASF GitHub Bot commented on FLINK-6558: --- Github user StephanEwen commented on the issue:

[GitHub] flink issue #3874: [FLINK-6558] Disable yarn tests on Windows

2017-05-11 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/3874 Looks good to me, +1 to merge this... --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[jira] [Resolved] (FLINK-6531) Deserialize checkpoint hooks with user classloader

2017-05-11 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen resolved FLINK-6531. - Resolution: Fixed Fix Version/s: 1.4.0 Fixed in - 1.3.0 via

[jira] [Closed] (FLINK-6531) Deserialize checkpoint hooks with user classloader

2017-05-11 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen closed FLINK-6531. --- > Deserialize checkpoint hooks with user classloader > --

[jira] [Closed] (FLINK-6508) Include license files of packaged dependencies

2017-05-11 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen closed FLINK-6508. --- > Include license files of packaged dependencies > -- > >

[jira] [Resolved] (FLINK-6501) Make sure NOTICE files are bundled into shaded JAR files

2017-05-11 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen resolved FLINK-6501. - Resolution: Fixed Fixed in - 1.3.0 via 95fd2d371eae43be1ea2534efe653af1a7095d0b - 1.4.0 via

[jira] [Comment Edited] (FLINK-5753) CEP timeout handler.

2017-05-11 Thread Kostas Kloudas (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16006685#comment-16006685 ] Kostas Kloudas edited comment on FLINK-5753 at 5/11/17 4:59 PM: Hi

[jira] [Commented] (FLINK-6548) AvroOutputFormatTest fails on Windows

2017-05-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16006808#comment-16006808 ] ASF GitHub Bot commented on FLINK-6548: --- Github user StephanEwen commented on the issue:

[GitHub] flink issue #3871: [FLINK-6548] Fix AvroOutputFormatTest#testCompression on ...

2017-05-11 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/3871 +1, looks good --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[jira] [Commented] (FLINK-6542) Non-keyed, non-windowed aggregation fails

2017-05-11 Thread Xingcan Cui (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16006720#comment-16006720 ] Xingcan Cui commented on FLINK-6542: Hi [~twalthr], maybe we forget to call env.execute()... >

[GitHub] flink pull request #3802: Add Evenly Graph Generator to Flink Gelly

2017-05-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/3802 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] flink pull request #3866: A refactor to avoid cloned code in try-catch block...

2017-05-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/3866 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (FLINK-5753) CEP timeout handler.

2017-05-11 Thread Kostas Kloudas (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16006685#comment-16006685 ] Kostas Kloudas commented on FLINK-5753: --- Hi [~jurijuri]! Thanks for reporting this! I assume that

[jira] [Commented] (FLINK-6116) Watermarks don't work when unioning with same DataStream

2017-05-11 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16006684#comment-16006684 ] Aljoscha Krettek commented on FLINK-6116: - Got it! The problem is here

[jira] [Commented] (FLINK-6414) Use scala.binary.version in place of change-scala-version.sh

2017-05-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16006709#comment-16006709 ] ASF GitHub Bot commented on FLINK-6414: --- Github user asfgit closed the pull request at:

[GitHub] flink pull request #3800: [FLINK-6414] [build] Use scala.binary.version in p...

2017-05-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/3800 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] flink pull request #3868: [FLINK-6532] [checkpoints] Ensure proper classload...

2017-05-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/3868 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (FLINK-6532) Mesos version check

2017-05-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16006708#comment-16006708 ] ASF GitHub Bot commented on FLINK-6532: --- Github user asfgit closed the pull request at:

[jira] [Created] (FLINK-6536) Improve error message in SharedBuffer::put()

2017-05-11 Thread Kostas Kloudas (JIRA)
Kostas Kloudas created FLINK-6536: - Summary: Improve error message in SharedBuffer::put() Key: FLINK-6536 URL: https://issues.apache.org/jira/browse/FLINK-6536 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-6537) Umbrella issue for fixes to incremental snapshots

2017-05-11 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-6537: - Summary: Umbrella issue for fixes to incremental snapshots Key: FLINK-6537 URL: https://issues.apache.org/jira/browse/FLINK-6537 Project: Flink Issue

[jira] [Created] (FLINK-6539) Add automated end-to-end tests

2017-05-11 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created FLINK-6539: --- Summary: Add automated end-to-end tests Key: FLINK-6539 URL: https://issues.apache.org/jira/browse/FLINK-6539 Project: Flink Issue Type: Improvement

[jira] [Commented] (FLINK-5679) Refactor *CheckpointedITCase tests to speed up

2017-05-11 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16006194#comment-16006194 ] Stephan Ewen commented on FLINK-5679: - I have a refactoring for

[GitHub] flink issue #2568: [FLINK-4636] Add boundary check for priorityqueue for cep...

2017-05-11 Thread kl0u
Github user kl0u commented on the issue: https://github.com/apache/flink/pull/2568 Hi @jaxbihani ! As you may have noticed, the `CEP` library has gone through a major refactoring and now the JIRA that this PR addresses is obsolete. Could you please close this PR? --- If your

[jira] [Commented] (FLINK-4636) AbstractCEPPatternOperator fails to restore state

2017-05-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16006215#comment-16006215 ] ASF GitHub Bot commented on FLINK-4636: --- Github user kl0u commented on the issue:

[jira] [Closed] (FLINK-5853) Add consecutive event based filters

2017-05-11 Thread Dawid Wysakowicz (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dawid Wysakowicz closed FLINK-5853. --- Resolution: Duplicate > Add consecutive event based filters >

[GitHub] flink pull request #3495: [FLINK-5781][config] Generation HTML from ConfigOp...

2017-05-11 Thread zentol
Github user zentol commented on a diff in the pull request: https://github.com/apache/flink/pull/3495#discussion_r115971032 --- Diff: flink-core/src/main/java/org/apache/flink/configuration/ConfigOptionsDocGenerator.java --- @@ -0,0 +1,279 @@ +/* + * Licensed to the

[GitHub] flink pull request #3495: [FLINK-5781][config] Generation HTML from ConfigOp...

2017-05-11 Thread zentol
Github user zentol commented on a diff in the pull request: https://github.com/apache/flink/pull/3495#discussion_r115971869 --- Diff: flink-core/src/main/java/org/apache/flink/configuration/ConfigOptionsDocGenerator.java --- @@ -0,0 +1,279 @@ +/* + * Licensed to the

[jira] [Updated] (FLINK-6255) Remove PatternStream.getSideOutput()

2017-05-11 Thread Kostas Kloudas (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kostas Kloudas updated FLINK-6255: -- Description: We cannot currently use the result of {{select()/flatSelect()}} to get the side

[jira] [Updated] (FLINK-6533) Duplicated registration of new shared state when checkpoint confirmations are still pending

2017-05-11 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-6533: -- Issue Type: Sub-task (was: Bug) Parent: FLINK-6537 > Duplicated registration of new

[jira] [Updated] (FLINK-6527) OperatorSubtaskState has empty implementations of (un)/registerSharedStates

2017-05-11 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-6527: -- Issue Type: Sub-task (was: Bug) Parent: FLINK-6537 > OperatorSubtaskState has empty

[jira] [Commented] (FLINK-5781) Generation HTML from ConfigOption

2017-05-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16006199#comment-16006199 ] ASF GitHub Bot commented on FLINK-5781: --- Github user dawidwys commented on the issue:

[GitHub] flink issue #3495: [FLINK-5781][config] Generation HTML from ConfigOption

2017-05-11 Thread zentol
Github user zentol commented on the issue: https://github.com/apache/flink/pull/3495 I would use the class name, as otherwise we add an additional source of mistakes. When introducing the `ConfigGroups` annotation the first time; if the configured default name doesn't match the class

[jira] [Updated] (FLINK-6534) SharedStateRegistry is disposing state handles from main thread

2017-05-11 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-6534: Fix Version/s: 1.3.0 > SharedStateRegistry is disposing state handles from main thread >

[jira] [Commented] (FLINK-6332) Upgrade Scala version to 2.11.11

2017-05-11 Thread Greg Hogan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16006228#comment-16006228 ] Greg Hogan commented on FLINK-6332: --- [2.11.11 concludes the 2.11

[jira] [Updated] (FLINK-6505) Proactively cleanup local FS for RocksDBKeyedStateBackend on startup

2017-05-11 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-6505: Fix Version/s: 1.3.0 > Proactively cleanup local FS for RocksDBKeyedStateBackend on startup

[jira] [Updated] (FLINK-6540) Add more thorough tests for RocksDB and incremental checkpointing

2017-05-11 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-6540: Priority: Blocker (was: Major) > Add more thorough tests for RocksDB and incremental

[jira] [Updated] (FLINK-6540) Add more thorough tests for RocksDB and incremental checkpointing

2017-05-11 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-6540: Fix Version/s: 1.3.0 > Add more thorough tests for RocksDB and incremental checkpointing >

[jira] [Updated] (FLINK-6534) SharedStateRegistry is disposing state handles from main thread

2017-05-11 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-6534: Priority: Blocker (was: Major) > SharedStateRegistry is disposing state handles from main

[jira] [Updated] (FLINK-6504) Lack of synchronization on materializedSstFiles in RocksDBKEyedStateBackend

2017-05-11 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-6504: Priority: Blocker (was: Major) > Lack of synchronization on materializedSstFiles in

[jira] [Updated] (FLINK-6504) Lack of synchronization on materializedSstFiles in RocksDBKEyedStateBackend

2017-05-11 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-6504: Fix Version/s: 1.3.0 > Lack of synchronization on materializedSstFiles in

[GitHub] flink issue #3856: [FLINK-5998] Fix shaded Hadoop Jar

2017-05-11 Thread gyfora
Github user gyfora commented on the issue: https://github.com/apache/flink/pull/3856 @aljoscha Yes, that might work although I prefer this fix compared to having to mess with the maven versions on deploy servers. --- If your project is set up for it, you can reply to this email and

[jira] [Commented] (FLINK-5781) Generation HTML from ConfigOption

2017-05-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16006150#comment-16006150 ] ASF GitHub Bot commented on FLINK-5781: --- Github user dawidwys commented on the issue:

[GitHub] flink issue #3495: [FLINK-5781][config] Generation HTML from ConfigOption

2017-05-11 Thread dawidwys
Github user dawidwys commented on the issue: https://github.com/apache/flink/pull/3495 I do like you code, only thing missing I had in mind yesterday was an idea of defaultGroup, which is an easy way to group options with not overlapping prefixes e.g. right now in documentation (in

[jira] [Updated] (FLINK-6505) Proactively cleanup local FS for RocksDBKeyedStateBackend on startup

2017-05-11 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-6505: -- Issue Type: Sub-task (was: Bug) Parent: FLINK-6537 > Proactively cleanup local FS for

[jira] [Updated] (FLINK-6504) Lack of synchronization on materializedSstFiles in RocksDBKEyedStateBackend

2017-05-11 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-6504: -- Issue Type: Sub-task (was: Bug) Parent: FLINK-6537 > Lack of synchronization on

[jira] [Updated] (FLINK-6475) Incremental snapshots in RocksDB hold lock during async file upload

2017-05-11 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-6475: -- Issue Type: Sub-task (was: Bug) Parent: FLINK-6537 > Incremental snapshots in RocksDB

[GitHub] flink issue #3495: [FLINK-5781][config] Generation HTML from ConfigOption

2017-05-11 Thread zentol
Github user zentol commented on the issue: https://github.com/apache/flink/pull/3495 Couldn't we create the default group implicitly by taking all options that aren't part of any ConfigGroup? As in having ConfigGroup only describing sub-groups that should be excluded from the default

[GitHub] flink issue #3495: [FLINK-5781][config] Generation HTML from ConfigOption

2017-05-11 Thread dawidwys
Github user dawidwys commented on the issue: https://github.com/apache/flink/pull/3495 It works exactly as you describe. The role of `defaultGroup` in `ConfigGroups` is setting a name of the defaultGroup. I agree using `ConfigGroup` for the `defaultGroup` may be counter intuitive.

[jira] [Updated] (FLINK-6537) Umbrella issue for fixes to incremental snapshots

2017-05-11 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-6537: Fix Version/s: 1.3.0 > Umbrella issue for fixes to incremental snapshots >

[jira] [Updated] (FLINK-6505) Proactively cleanup local FS for RocksDBKeyedStateBackend on startup

2017-05-11 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-6505: Priority: Blocker (was: Major) > Proactively cleanup local FS for RocksDBKeyedStateBackend

[jira] [Commented] (FLINK-5998) Un-fat Hadoop from Flink fat jar

2017-05-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16006132#comment-16006132 ] ASF GitHub Bot commented on FLINK-5998: --- Github user gyfora commented on the issue:

[jira] [Created] (FLINK-6540) Create tests that cover all the issues

2017-05-11 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-6540: - Summary: Create tests that cover all the issues Key: FLINK-6540 URL: https://issues.apache.org/jira/browse/FLINK-6540 Project: Flink Issue Type: Sub-task

[jira] [Updated] (FLINK-6540) Add more thorough tests for RocksDB and incremental checkpointing

2017-05-11 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-6540: Summary: Add more thorough tests for RocksDB and incremental checkpointing (was: Create

<    1   2   3   >