[jira] [Commented] (FLINK-4565) Support for SQL IN operator

2016-11-11 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15656570#comment-15656570 ] Fabian Hueske commented on FLINK-4565: -- It is true, the "few literals" case of {{IN}} and {{NOT IN}}

[jira] [Commented] (FLINK-5013) Flink Kinesis connector doesn't work on old EMR versions

2016-11-11 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15656578#comment-15656578 ] Fabian Hueske commented on FLINK-5013: -- Two users on the mailing list reported that using Maven 3.0.x

[jira] [Commented] (FLINK-5016) EventTimeWindowCheckpointingITCase testTumblingTimeWindowWithKVStateMaxMaxParallelism with RocksDB hangs

2016-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15656605#comment-15656605 ] ASF GitHub Bot commented on FLINK-5016: --- Github user StefanRRichter commented on the issue:

[GitHub] flink pull request #2784: [backport] [FLINK-5040] [jobmanager] Set correct i...

2016-11-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/2784 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (FLINK-5040) Set correct input channel types with eager scheduling

2016-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15656533#comment-15656533 ] ASF GitHub Bot commented on FLINK-5040: --- Github user asfgit closed the pull request at:

[jira] [Closed] (FLINK-5040) Set correct input channel types with eager scheduling

2016-11-11 Thread Ufuk Celebi (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ufuk Celebi closed FLINK-5040. -- Resolution: Fixed Fixed in {{0d2e8b2, 2742d5c, 5d5637b}} (master) and {{b5a4cb6, 55c506f, 0bd8e02}}

[jira] [Comment Edited] (FLINK-5013) Flink Kinesis connector doesn't work on old EMR versions

2016-11-11 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15656541#comment-15656541 ] Tzu-Li (Gordon) Tai edited comment on FLINK-5013 at 11/11/16 8:59 AM: --

[GitHub] flink pull request #2772: [FLINK-5012] Expose Timestamp in Timely FlatMap Fu...

2016-11-11 Thread aljoscha
Github user aljoscha closed the pull request at: https://github.com/apache/flink/pull/2772 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (FLINK-5012) Provide Timestamp in TimelyFlatMapFunction

2016-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15656592#comment-15656592 ] ASF GitHub Bot commented on FLINK-5012: --- Github user aljoscha closed the pull request at:

[GitHub] flink issue #2786: [FLINK-5016] [ci] Increase no output timeout to 10 mins

2016-11-11 Thread StefanRRichter
Github user StefanRRichter commented on the issue: https://github.com/apache/flink/pull/2786 +1 for increased timeout. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[jira] [Commented] (FLINK-5013) Flink Kinesis connector doesn't work on old EMR versions

2016-11-11 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15656541#comment-15656541 ] Tzu-Li (Gordon) Tai commented on FLINK-5013: Results of my tests: Shading {{com.amazonaws.*}}

[jira] [Commented] (FLINK-5012) Provide Timestamp in TimelyFlatMapFunction

2016-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15656596#comment-15656596 ] ASF GitHub Bot commented on FLINK-5012: --- Github user aljoscha commented on the issue:

[jira] [Assigned] (FLINK-5012) Provide Timestamp in TimelyFlatMapFunction

2016-11-11 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek reassigned FLINK-5012: --- Assignee: Aljoscha Krettek > Provide Timestamp in TimelyFlatMapFunction >

[GitHub] flink issue #2772: [FLINK-5012] Expose Timestamp in Timely FlatMap Functions

2016-11-11 Thread aljoscha
Github user aljoscha commented on the issue: https://github.com/apache/flink/pull/2772 Thanks for reviewing @jgrier! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[jira] [Closed] (FLINK-5012) Provide Timestamp in TimelyFlatMapFunction

2016-11-11 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed FLINK-5012. --- Resolution: Fixed Fix Version/s: 1.2.0 Implemented in

[jira] [Created] (FLINK-5051) Backwards compatibility for serializers in backend state

2016-11-11 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-5051: - Summary: Backwards compatibility for serializers in backend state Key: FLINK-5051 URL: https://issues.apache.org/jira/browse/FLINK-5051 Project: Flink

[jira] [Commented] (FLINK-5016) EventTimeWindowCheckpointingITCase testTumblingTimeWindowWithKVStateMaxMaxParallelism with RocksDB hangs

2016-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15656556#comment-15656556 ] ASF GitHub Bot commented on FLINK-5016: --- GitHub user uce opened a pull request:

[jira] [Commented] (FLINK-5040) Set correct input channel types with eager scheduling

2016-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15656557#comment-15656557 ] ASF GitHub Bot commented on FLINK-5040: --- Github user uce closed the pull request at:

[GitHub] flink pull request #2783: [FLINK-5040] [jobmanager] Set correct input channe...

2016-11-11 Thread uce
Github user uce closed the pull request at: https://github.com/apache/flink/pull/2783 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (FLINK-4648) Implement bipartite graph generators

2016-11-11 Thread Ivan Mushketyk (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15656559#comment-15656559 ] Ivan Mushketyk commented on FLINK-4648: --- Implemented here:

[GitHub] flink pull request #2786: [FLINK-5016] [ci] Increase no output timeout to 10...

2016-11-11 Thread uce
GitHub user uce opened a pull request: https://github.com/apache/flink/pull/2786 [FLINK-5016] [ci] Increase no output timeout to 10 mins Some heavy test suites occasionally have quite long running times on Travis, in which cases the no output timeout of 5 mins is too aggressive and

[GitHub] flink issue #2782: [hotfix] Prevent possible NPE in FlumeSink.

2016-11-11 Thread chermenin
Github user chermenin commented on the issue: https://github.com/apache/flink/pull/2782 1) I researched this question a little. It based on issue [FLINK-4631](https://issues.apache.org/jira/browse/FLINK-4631) and affect PR #2709. So, it's more wide issue and all elements of streaming

[jira] [Commented] (FLINK-4631) NullPointerException during stream task cleanup

2016-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15656608#comment-15656608 ] ASF GitHub Bot commented on FLINK-4631: --- Github user chermenin commented on the issue:

[jira] [Commented] (FLINK-3613) Add standard deviation, mean, variance to list of Aggregations

2016-11-11 Thread Anton Mushin (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15656530#comment-15656530 ] Anton Mushin commented on FLINK-3613: - Hi [~fhueske], Thanks for your reply. [~StephanEwen] and

[GitHub] flink pull request #2787: [FLINK-5013] [kinesis] Shade AWS dependencies to w...

2016-11-11 Thread tzulitai
GitHub user tzulitai opened a pull request: https://github.com/apache/flink/pull/2787 [FLINK-5013] [kinesis] Shade AWS dependencies to work with older EMR versions This PR adds shading to fix the reported dependency issues on older EMR versions. Randomly tested for 4.x EMR on

[jira] [Commented] (FLINK-5013) Flink Kinesis connector doesn't work on old EMR versions

2016-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15656576#comment-15656576 ] ASF GitHub Bot commented on FLINK-5013: --- GitHub user tzulitai opened a pull request:

[jira] [Commented] (FLINK-5016) EventTimeWindowCheckpointingITCase testTumblingTimeWindowWithKVStateMaxMaxParallelism with RocksDB hangs

2016-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15656585#comment-15656585 ] ASF GitHub Bot commented on FLINK-5016: --- Github user aljoscha commented on the issue:

[GitHub] flink issue #2786: [FLINK-5016] [ci] Increase no output timeout to 10 mins

2016-11-11 Thread aljoscha
Github user aljoscha commented on the issue: https://github.com/apache/flink/pull/2786 I think it's fine to increase the timeout. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] flink pull request #2788: [FLINK-5026] Rename TimelyFlatMap to Process

2016-11-11 Thread aljoscha
GitHub user aljoscha opened a pull request: https://github.com/apache/flink/pull/2788 [FLINK-5026] Rename TimelyFlatMap to Process This is only renaming, the changed Javadoc probably requires most attention when reviewing this. R: @jgrier if you could have a look that

[jira] [Commented] (FLINK-5026) Rename TimelyFlatMap to Process

2016-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15656777#comment-15656777 ] ASF GitHub Bot commented on FLINK-5026: --- GitHub user aljoscha opened a pull request:

[GitHub] flink pull request #2782: [hotfix] Prevent possible NPE in FlumeSink.

2016-11-11 Thread chermenin
Github user chermenin closed the pull request at: https://github.com/apache/flink/pull/2782 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (FLINK-4631) NullPointerException during stream task cleanup

2016-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15656839#comment-15656839 ] ASF GitHub Bot commented on FLINK-4631: --- Github user chermenin commented on the issue:

[GitHub] flink issue #2782: [hotfix] Prevent possible NPE in FlumeSink.

2016-11-11 Thread chermenin
Github user chermenin commented on the issue: https://github.com/apache/flink/pull/2782 I close this PR. Changes will be included into other PR to complete solve [FLINK-4631](https://issues.apache.org/jira/browse/FLINK-4631) (reopened issue). --- If your project is set up for it,

[GitHub] flink issue #2785: [FLINK-5006] SystemProcessingTimeServiceTest.testTimerSor...

2016-11-11 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/2785 It's not about timing guarantees here, only about order of running timers. The problem is that they are sorted by the delay which is affected by races/stalls, rather than by proper timestamp.

[jira] [Commented] (FLINK-5006) SystemProcessingTimeServiceTest.testTimerSorting fails

2016-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15656884#comment-15656884 ] ASF GitHub Bot commented on FLINK-5006: --- Github user StephanEwen commented on the issue:

[jira] [Updated] (FLINK-5002) Lack of synchronization in LocalBufferPool#getNumberOfUsedBuffers

2016-11-11 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen updated FLINK-5002: Labels: easyfix starter (was: ) > Lack of synchronization in

[jira] [Created] (FLINK-5052) Changing the maximum parallelism (number of key groups) of a job

2016-11-11 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-5052: - Summary: Changing the maximum parallelism (number of key groups) of a job Key: FLINK-5052 URL: https://issues.apache.org/jira/browse/FLINK-5052 Project: Flink

[jira] [Created] (FLINK-5053) Incremental / lightweight snapshots for checkpoints

2016-11-11 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-5053: - Summary: Incremental / lightweight snapshots for checkpoints Key: FLINK-5053 URL: https://issues.apache.org/jira/browse/FLINK-5053 Project: Flink Issue

[jira] [Reopened] (FLINK-4631) NullPointerException during stream task cleanup

2016-11-11 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabian Hueske reopened FLINK-4631: -- Reopened upon request of [~chermenin]. > NullPointerException during stream task cleanup >

[jira] [Commented] (FLINK-5050) JSON.org license is CatX

2016-11-11 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15656895#comment-15656895 ] Stephan Ewen commented on FLINK-5050: - Do we need the {{hive-exec}} dependency, or can we exclude that

[GitHub] flink issue #2629: [FLINK-4391] Provide support for asynchronous operations ...

2016-11-11 Thread bjlovegithub
Github user bjlovegithub commented on the issue: https://github.com/apache/flink/pull/2629 Hi @tillrohrmann . I have updated the code again, adding the Emitter Thread, using the latest OperatorStateStore, updating the test codes. Thanks --- If your project is set up for it, you can

[jira] [Commented] (FLINK-4631) NullPointerException during stream task cleanup

2016-11-11 Thread Alexander Chermenin (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15656726#comment-15656726 ] Alexander Chermenin commented on FLINK-4631: I think this ticket must be reopened because

[jira] [Commented] (FLINK-4391) Provide support for asynchronous operations over streams

2016-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15656730#comment-15656730 ] ASF GitHub Bot commented on FLINK-4391: --- Github user bjlovegithub commented on the issue:

[jira] [Commented] (FLINK-5049) Instability in QueryableStateITCase.testQueryableStateWithTaskManagerFailure

2016-11-11 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15656919#comment-15656919 ] Stephan Ewen commented on FLINK-5049: - Does the test have any specific guard against the state rolling

[jira] [Commented] (FLINK-4541) Support for SQL NOT IN operator

2016-11-11 Thread Alexander Shoshin (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15656831#comment-15656831 ] Alexander Shoshin commented on FLINK-4541: -- NOT IN operator does not work with nested queries

[jira] [Commented] (FLINK-4552) Refactor WindowOperator/Trigger Tests

2016-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15657012#comment-15657012 ] ASF GitHub Bot commented on FLINK-4552: --- Github user StefanRRichter commented on the issue:

[jira] [Comment Edited] (FLINK-5013) Flink Kinesis connector doesn't work on old EMR versions

2016-11-11 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15657042#comment-15657042 ] Tzu-Li (Gordon) Tai edited comment on FLINK-5013 at 11/11/16 1:15 PM: --

[GitHub] flink pull request #2542: [FLINK-4613] [ml] Extend ALS to handle implicit fe...

2016-11-11 Thread gaborhermann
Github user gaborhermann commented on a diff in the pull request: https://github.com/apache/flink/pull/2542#discussion_r87587473 --- Diff: flink-libraries/flink-ml/src/main/scala/org/apache/flink/ml/recommendation/ALS.scala --- @@ -273,6 +308,14 @@ object ALS { val

[GitHub] flink issue #2785: [FLINK-5006] SystemProcessingTimeServiceTest.testTimerSor...

2016-11-11 Thread aljoscha
Github user aljoscha commented on the issue: https://github.com/apache/flink/pull/2785 @StephanEwen I think it's not a problem that these physical, low-level timers don't fire in order of their timestamp because the ordering of timers is maintained in the implementation of

[jira] [Commented] (FLINK-4613) Extend ALS to handle implicit feedback datasets

2016-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15657073#comment-15657073 ] ASF GitHub Bot commented on FLINK-4613: --- Github user gaborhermann commented on a diff in the pull

[jira] [Commented] (FLINK-5006) SystemProcessingTimeServiceTest.testTimerSorting fails

2016-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15657076#comment-15657076 ] ASF GitHub Bot commented on FLINK-5006: --- Github user aljoscha commented on the issue:

[GitHub] flink pull request #2542: [FLINK-4613] [ml] Extend ALS to handle implicit fe...

2016-11-11 Thread gaborhermann
Github user gaborhermann commented on a diff in the pull request: https://github.com/apache/flink/pull/2542#discussion_r87588061 --- Diff: flink-libraries/flink-ml/src/main/scala/org/apache/flink/ml/recommendation/ALS.scala --- @@ -675,7 +756,69 @@ object ALS {

[GitHub] flink issue #2572: [FLINK-4552] Refactor WindowOperator/Trigger Tests

2016-11-11 Thread StefanRRichter
Github user StefanRRichter commented on the issue: https://github.com/apache/flink/pull/2572 Had another look at the changes, I think it is a very well written test! +1 for merge. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[jira] [Commented] (FLINK-5021) Makes the ContinuousFileReaderOperator rescalable.

2016-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15657045#comment-15657045 ] ASF GitHub Bot commented on FLINK-5021: --- Github user aljoscha commented on the issue:

[GitHub] flink issue #2763: [FLINK-5021] Makes the ContinuousFileReaderOperator resca...

2016-11-11 Thread aljoscha
Github user aljoscha commented on the issue: https://github.com/apache/flink/pull/2763 I merged this, thanks for your work! 👍 Could you please close this PR and the Jira issue? --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] flink pull request #2763: [FLINK-5021] Makes the ContinuousFileReaderOperato...

2016-11-11 Thread kl0u
Github user kl0u closed the pull request at: https://github.com/apache/flink/pull/2763 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Closed] (FLINK-5021) Makes the ContinuousFileReaderOperator rescalable.

2016-11-11 Thread Kostas Kloudas (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kostas Kloudas closed FLINK-5021. - Resolution: Fixed > Makes the ContinuousFileReaderOperator rescalable. >

[jira] [Updated] (FLINK-5054) Make the BucketingSink rescalable.

2016-11-11 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-5054: Description: Aims at integrating the BucketingSink with the rescalable state abstractions

[jira] [Commented] (FLINK-4613) Extend ALS to handle implicit feedback datasets

2016-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15657101#comment-15657101 ] ASF GitHub Bot commented on FLINK-4613: --- Github user gaborhermann commented on the issue:

[GitHub] flink issue #2542: [FLINK-4613] [ml] Extend ALS to handle implicit feedback ...

2016-11-11 Thread gaborhermann
Github user gaborhermann commented on the issue: https://github.com/apache/flink/pull/2542 Thank you @thvasilo for your thorough review :) @mbalassi I think this PR is ready to merge. Could you do a review when you have some time? --- If your project is set up for it, you

[jira] [Commented] (FLINK-5006) SystemProcessingTimeServiceTest.testTimerSorting fails

2016-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15657114#comment-15657114 ] ASF GitHub Bot commented on FLINK-5006: --- Github user StephanEwen commented on the issue:

[GitHub] flink issue #2785: [FLINK-5006] SystemProcessingTimeServiceTest.testTimerSor...

2016-11-11 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/2785 @aljoscha Okay, if that is the only thing that we use it for, then order is indeed not important for that service. Are we sure it is not used in other places? --- If your project is set up for

[jira] [Created] (FLINK-5054) Make the BucketingSink rescalable.

2016-11-11 Thread Kostas Kloudas (JIRA)
Kostas Kloudas created FLINK-5054: - Summary: Make the BucketingSink rescalable. Key: FLINK-5054 URL: https://issues.apache.org/jira/browse/FLINK-5054 Project: Flink Issue Type: Improvement

[jira] [Commented] (FLINK-5013) Flink Kinesis connector doesn't work on old EMR versions

2016-11-11 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15657042#comment-15657042 ] Tzu-Li (Gordon) Tai commented on FLINK-5013: Update: I've found the problem with the

[jira] [Commented] (FLINK-5021) Makes the ContinuousFileReaderOperator rescalable.

2016-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15657059#comment-15657059 ] ASF GitHub Bot commented on FLINK-5021: --- Github user kl0u closed the pull request at:

[jira] [Commented] (FLINK-4613) Extend ALS to handle implicit feedback datasets

2016-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15657084#comment-15657084 ] ASF GitHub Bot commented on FLINK-4613: --- Github user gaborhermann commented on a diff in the pull

[jira] [Commented] (FLINK-5048) Kafka Consumer (0.9/0.10) threading model leads problematic cancellation behavior

2016-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15657219#comment-15657219 ] ASF GitHub Bot commented on FLINK-5048: --- GitHub user StephanEwen opened a pull request:

[GitHub] flink pull request #2789: [FLINK-5048] [Kafka Consumer] Change thread model ...

2016-11-11 Thread StephanEwen
GitHub user StephanEwen opened a pull request: https://github.com/apache/flink/pull/2789 [FLINK-5048] [Kafka Consumer] Change thread model of FlinkKafkaConsumer to better handel shutdown/interrupt situations **NOTE:** Only the second commit is relevant, the first commit only

[jira] [Commented] (FLINK-5006) SystemProcessingTimeServiceTest.testTimerSorting fails

2016-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15657226#comment-15657226 ] ASF GitHub Bot commented on FLINK-5006: --- Github user StephanEwen commented on the issue:

[GitHub] flink issue #2785: [FLINK-5006] SystemProcessingTimeServiceTest.testTimerSor...

2016-11-11 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/2785 Okay, if that is the case, then we should probably simply remove the "test timer sorting" test and note down that this does not give any guarantees on the order of timers. @BorisOsipov

[jira] [Commented] (FLINK-3123) Allow setting custom start-offsets for the Kafka consumer

2016-11-11 Thread Juho Autio (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15657244#comment-15657244 ] Juho Autio commented on FLINK-3123: --- Nice one, looking forward to this! {quote} If a subscribed

[jira] [Created] (FLINK-5055) Security feature crashes JM for certain Hadoop versions even though using no Kerberos

2016-11-11 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-5055: Summary: Security feature crashes JM for certain Hadoop versions even though using no Kerberos Key: FLINK-5055 URL: https://issues.apache.org/jira/browse/FLINK-5055

[GitHub] flink issue #2785: [FLINK-5006] SystemProcessingTimeServiceTest.testTimerSor...

2016-11-11 Thread aljoscha
Github user aljoscha commented on the issue: https://github.com/apache/flink/pull/2785 @StephanEwen It's used to drive the automatic watermark generation and the inactivity timer in the `BucketingSink`, but those are cases where the order doesn't matter. --- If your project is set

[jira] [Commented] (FLINK-5006) SystemProcessingTimeServiceTest.testTimerSorting fails

2016-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15657138#comment-15657138 ] ASF GitHub Bot commented on FLINK-5006: --- Github user aljoscha commented on the issue:

[jira] [Commented] (FLINK-5055) Security feature crashes JM for certain Hadoop versions even though using no Kerberos

2016-11-11 Thread Vijay Srinivasaraghavan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15657184#comment-15657184 ] Vijay Srinivasaraghavan commented on FLINK-5055: Flink security context gets initialized

[jira] [Created] (FLINK-5056) BucketingSink deletes valid data when checkpoint notification is slow.

2016-11-11 Thread Kostas Kloudas (JIRA)
Kostas Kloudas created FLINK-5056: - Summary: BucketingSink deletes valid data when checkpoint notification is slow. Key: FLINK-5056 URL: https://issues.apache.org/jira/browse/FLINK-5056 Project:

[jira] [Commented] (FLINK-3848) Add ProjectableTableSource interface and translation rule

2016-11-11 Thread Anton Solovev (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15657432#comment-15657432 ] Anton Solovev commented on FLINK-3848: -- I have a question about type info, it looks like one int

[GitHub] flink pull request #2790: [FLINK-4491] Handle index.number_of_shards in the ...

2016-11-11 Thread ddolzan
GitHub user ddolzan opened a pull request: https://github.com/apache/flink/pull/2790 [FLINK-4491] Handle index.number_of_shards in the ES connector Implemented the Index Template and Index Mapping creation. Number of shards and many other properties can be defined in the Index

[jira] [Comment Edited] (FLINK-3123) Allow setting custom start-offsets for the Kafka consumer

2016-11-11 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15657704#comment-15657704 ] Tzu-Li (Gordon) Tai edited comment on FLINK-3123 at 11/11/16 6:18 PM: --

[jira] [Commented] (FLINK-5013) Flink Kinesis connector doesn't work on old EMR versions

2016-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15657832#comment-15657832 ] ASF GitHub Bot commented on FLINK-5013: --- Github user tzulitai commented on the issue:

[GitHub] flink issue #2787: [FLINK-5013] [kinesis] Shade AWS dependencies to work wit...

2016-11-11 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/2787 I've actually found out the reason for `HttpConnectionParams.setSoKeepalive` error, noted in the last comment in JIRA. Cross-posting it here so we don't need to jump around two places: It

[jira] [Commented] (FLINK-5013) Flink Kinesis connector doesn't work on old EMR versions

2016-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15657722#comment-15657722 ] ASF GitHub Bot commented on FLINK-5013: --- Github user StephanEwen commented on the issue:

[jira] [Comment Edited] (FLINK-3848) Add ProjectableTableSource interface and translation rule

2016-11-11 Thread Anton Solovev (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15657432#comment-15657432 ] Anton Solovev edited comment on FLINK-3848 at 11/11/16 5:59 PM: I have a

[GitHub] flink issue #2787: [FLINK-5013] [kinesis] Shade AWS dependencies to work wit...

2016-11-11 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/2787 One thought on the `HttpConnectionParams.setSoKeepalive` - we had issues with Hadoop pulling in a wrong version of that class. I think we shaded it in Flink's Hadoop dependency, but it might

[GitHub] flink pull request #2789: [FLINK-5048] [Kafka Consumer] Change thread model ...

2016-11-11 Thread tzulitai
Github user tzulitai commented on a diff in the pull request: https://github.com/apache/flink/pull/2789#discussion_r87621534 --- Diff: flink-streaming-connectors/flink-connector-kafka-0.9/src/main/java/org/apache/flink/streaming/connectors/kafka/internal/Handover.java --- @@ -0,0

[GitHub] flink pull request #2789: [FLINK-5048] [Kafka Consumer] Change thread model ...

2016-11-11 Thread tzulitai
Github user tzulitai commented on a diff in the pull request: https://github.com/apache/flink/pull/2789#discussion_r87621606 --- Diff: flink-streaming-connectors/flink-connector-kafka-0.9/src/main/java/org/apache/flink/streaming/connectors/kafka/internal/Handover.java --- @@ -0,0

[GitHub] flink pull request #2789: [FLINK-5048] [Kafka Consumer] Change thread model ...

2016-11-11 Thread tzulitai
Github user tzulitai commented on a diff in the pull request: https://github.com/apache/flink/pull/2789#discussion_r87625136 --- Diff: flink-streaming-connectors/flink-connector-kafka-0.9/src/main/java/org/apache/flink/streaming/connectors/kafka/internal/Handover.java --- @@ -0,0

[GitHub] flink pull request #2789: [FLINK-5048] [Kafka Consumer] Change thread model ...

2016-11-11 Thread tzulitai
Github user tzulitai commented on a diff in the pull request: https://github.com/apache/flink/pull/2789#discussion_r87626228 --- Diff: flink-streaming-connectors/flink-connector-kafka-0.9/src/main/java/org/apache/flink/streaming/connectors/kafka/internal/Kafka09Fetcher.java ---

[GitHub] flink pull request #2789: [FLINK-5048] [Kafka Consumer] Change thread model ...

2016-11-11 Thread tzulitai
Github user tzulitai commented on a diff in the pull request: https://github.com/apache/flink/pull/2789#discussion_r87624670 --- Diff: flink-streaming-connectors/flink-connector-kafka-0.9/src/main/java/org/apache/flink/streaming/connectors/kafka/internal/Handover.java --- @@ -0,0

[jira] [Comment Edited] (FLINK-3123) Allow setting custom start-offsets for the Kafka consumer

2016-11-11 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15657704#comment-15657704 ] Tzu-Li (Gordon) Tai edited comment on FLINK-3123 at 11/11/16 6:18 PM: --

[jira] [Commented] (FLINK-3123) Allow setting custom start-offsets for the Kafka consumer

2016-11-11 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15657704#comment-15657704 ] Tzu-Li (Gordon) Tai commented on FLINK-3123: Hi [~juho.autio.r], {quote} My use case is

[jira] [Commented] (FLINK-4491) Handle index.number_of_shards in the ES connector

2016-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15657408#comment-15657408 ] ASF GitHub Bot commented on FLINK-4491: --- GitHub user ddolzan opened a pull request:

[jira] [Commented] (FLINK-5048) Kafka Consumer (0.9/0.10) threading model leads problematic cancellation behavior

2016-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15657652#comment-15657652 ] ASF GitHub Bot commented on FLINK-5048: --- Github user tzulitai commented on a diff in the pull

[jira] [Commented] (FLINK-5048) Kafka Consumer (0.9/0.10) threading model leads problematic cancellation behavior

2016-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15657656#comment-15657656 ] ASF GitHub Bot commented on FLINK-5048: --- Github user tzulitai commented on a diff in the pull

[jira] [Commented] (FLINK-5048) Kafka Consumer (0.9/0.10) threading model leads problematic cancellation behavior

2016-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15657655#comment-15657655 ] ASF GitHub Bot commented on FLINK-5048: --- Github user tzulitai commented on a diff in the pull

[jira] [Commented] (FLINK-5048) Kafka Consumer (0.9/0.10) threading model leads problematic cancellation behavior

2016-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15657653#comment-15657653 ] ASF GitHub Bot commented on FLINK-5048: --- Github user tzulitai commented on a diff in the pull

[jira] [Commented] (FLINK-5048) Kafka Consumer (0.9/0.10) threading model leads problematic cancellation behavior

2016-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15657654#comment-15657654 ] ASF GitHub Bot commented on FLINK-5048: --- Github user tzulitai commented on a diff in the pull

[jira] [Commented] (FLINK-5048) Kafka Consumer (0.9/0.10) threading model leads problematic cancellation behavior

2016-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15657657#comment-15657657 ] ASF GitHub Bot commented on FLINK-5048: --- Github user tzulitai commented on a diff in the pull

[GitHub] flink pull request #2789: [FLINK-5048] [Kafka Consumer] Change thread model ...

2016-11-11 Thread tzulitai
Github user tzulitai commented on a diff in the pull request: https://github.com/apache/flink/pull/2789#discussion_r87621040 --- Diff: flink-streaming-connectors/flink-connector-kafka-0.9/src/main/java/org/apache/flink/streaming/connectors/kafka/internal/KafkaConsumerThread.java ---

[jira] [Commented] (FLINK-4900) Implement Docker image support

2016-11-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15658508#comment-15658508 ] ASF GitHub Bot commented on FLINK-4900: --- Github user EronWright commented on a diff in the pull

  1   2   >