[GitHub] flink issue #2260: [FLINK-4222] Allow Kinesis configuration to get credentia...

2016-08-18 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/2260 @rmetzger Sure, that would be great. Thanks for your help with merging this. Thanks for your contribution @chadnickbok :) --- If your project is set up for it, you can reply to this email and

[GitHub] flink pull request #2369: [FLINK-4035] Add a streaming connector for Apache ...

2016-08-19 Thread tzulitai
Github user tzulitai commented on a diff in the pull request: https://github.com/apache/flink/pull/2369#discussion_r75569347 --- Diff: flink-streaming-connectors/flink-connector-kafka-base/src/main/java/org/apache/flink/streaming/connectors/kafka/internals/AbstractFetcher.java

[GitHub] flink pull request #2369: [FLINK-4035] Add a streaming connector for Apache ...

2016-08-19 Thread tzulitai
Github user tzulitai commented on a diff in the pull request: https://github.com/apache/flink/pull/2369#discussion_r75569873 --- Diff: flink-streaming-connectors/flink-connector-kafka-0.10/src/main/java/org/apache/flink/streaming/connectors/kafka/internal/Kafka010Fetcher.java

[GitHub] flink pull request #2369: [FLINK-4035] Add a streaming connector for Apache ...

2016-08-19 Thread tzulitai
Github user tzulitai commented on a diff in the pull request: https://github.com/apache/flink/pull/2369#discussion_r75571320 --- Diff: flink-streaming-connectors/flink-connector-kafka-0.10/src/main/java/org/apache/flink/streaming/connectors/kafka/FlinkKafkaProducer010.java

[GitHub] flink pull request #2369: [FLINK-4035] Add a streaming connector for Apache ...

2016-08-19 Thread tzulitai
Github user tzulitai commented on a diff in the pull request: https://github.com/apache/flink/pull/2369#discussion_r75571478 --- Diff: flink-streaming-connectors/flink-connector-kafka-0.10/src/main/java/org/apache/flink/streaming/connectors/kafka/FlinkKafkaProducer010.java

[GitHub] flink pull request #2369: [FLINK-4035] Add a streaming connector for Apache ...

2016-08-19 Thread tzulitai
Github user tzulitai commented on a diff in the pull request: https://github.com/apache/flink/pull/2369#discussion_r75572212 --- Diff: flink-streaming-connectors/flink-connector-kafka-0.10/src/main/java/org/apache/flink/streaming/connectors/kafka/FlinkKafkaProducer010.java

[GitHub] flink pull request #2369: [FLINK-4035] Add a streaming connector for Apache ...

2016-08-19 Thread tzulitai
Github user tzulitai commented on a diff in the pull request: https://github.com/apache/flink/pull/2369#discussion_r75572263 --- Diff: docs/apis/streaming/connectors/kafka.md --- @@ -291,3 +301,35 @@ higher value. There is currently no transactional producer for Kafka, so

[GitHub] flink issue #2369: [FLINK-4035] Add a streaming connector for Apache Kafka 0...

2016-08-19 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/2369 Left a few comments on some high-level design choices for a first review. Mostly on `FlinkKafkaProducer010`, I wonder if there are other better possibilities over there? --- If your project is

[GitHub] flink pull request #2414: [FLINK-4341] Let idle consumer subtasks emit max v...

2016-08-24 Thread tzulitai
GitHub user tzulitai opened a pull request: https://github.com/apache/flink/pull/2414 [FLINK-4341] Let idle consumer subtasks emit max value watermarks and fail on resharding This is a short-term fix, until the min-watermark service for the JobManager described in the JIRA

[GitHub] flink issue #2416: FLINK-4480: Incorrect link to elastic.co in documentation

2016-08-24 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/2416 Hi @smarthi, Thank you for picking this up. The changes LGTM :) Also tested the 2.3.5 ES version bump. Good catches on the Guava and broken example also! --- If your project is set up for

[GitHub] flink issue #2414: [FLINK-4341] Let idle consumer subtasks emit max value wa...

2016-08-25 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/2414 Ah yes, correct. I'll update this soon. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fe

[GitHub] flink pull request #2369: [FLINK-4035] Add a streaming connector for Apache ...

2016-08-25 Thread tzulitai
Github user tzulitai commented on a diff in the pull request: https://github.com/apache/flink/pull/2369#discussion_r76264614 --- Diff: flink-streaming-connectors/flink-connector-kafka-0.10/src/main/java/org/apache/flink/streaming/connectors/kafka/FlinkKafkaProducer010.java

[GitHub] flink pull request #2369: [FLINK-4035] Add a streaming connector for Apache ...

2016-08-25 Thread tzulitai
Github user tzulitai commented on a diff in the pull request: https://github.com/apache/flink/pull/2369#discussion_r76268268 --- Diff: flink-streaming-connectors/flink-connector-kafka-0.10/src/main/java/org/apache/flink/streaming/connectors/kafka/FlinkKafkaProducer010.java

[GitHub] flink pull request #2369: [FLINK-4035] Add a streaming connector for Apache ...

2016-08-25 Thread tzulitai
Github user tzulitai commented on a diff in the pull request: https://github.com/apache/flink/pull/2369#discussion_r76268687 --- Diff: flink-streaming-connectors/flink-connector-kafka-0.10/src/main/java/org/apache/flink/streaming/connectors/kafka/FlinkKafkaProducer010.java

[GitHub] flink pull request #2369: [FLINK-4035] Add a streaming connector for Apache ...

2016-08-25 Thread tzulitai
Github user tzulitai commented on a diff in the pull request: https://github.com/apache/flink/pull/2369#discussion_r76274826 --- Diff: flink-streaming-connectors/flink-connector-kafka-0.10/src/main/java/org/apache/flink/streaming/connectors/kafka/internal/Kafka010Fetcher.java

[GitHub] flink pull request #2369: [FLINK-4035] Add a streaming connector for Apache ...

2016-08-25 Thread tzulitai
Github user tzulitai commented on a diff in the pull request: https://github.com/apache/flink/pull/2369#discussion_r76275805 --- Diff: flink-streaming-connectors/flink-connector-kafka-0.8/src/main/java/org/apache/flink/streaming/connectors/kafka/internals/SimpleConsumerThread.java

[GitHub] flink pull request #2369: [FLINK-4035] Add a streaming connector for Apache ...

2016-08-25 Thread tzulitai
Github user tzulitai commented on a diff in the pull request: https://github.com/apache/flink/pull/2369#discussion_r76275879 --- Diff: flink-streaming-connectors/flink-connector-kafka-0.9/src/main/java/org/apache/flink/streaming/connectors/kafka/internal/Kafka09Fetcher.java

[GitHub] flink pull request #2369: [FLINK-4035] Add a streaming connector for Apache ...

2016-08-25 Thread tzulitai
Github user tzulitai commented on a diff in the pull request: https://github.com/apache/flink/pull/2369#discussion_r76277062 --- Diff: flink-streaming-connectors/flink-connector-kafka-base/src/test/java/org/apache/flink/streaming/connectors/kafka/internals

[GitHub] flink issue #2369: [FLINK-4035] Add a streaming connector for Apache Kafka 0...

2016-08-25 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/2369 Thanks Robert for addressing my comments :) Overall, I like the new hybrid producer approach. However, I'm still curious whether or not it is possible / reasonable to dro

[GitHub] flink issue #2414: [FLINK-4341] Let idle consumer subtasks emit max value wa...

2016-08-27 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/2414 To include the missing case @rmetzger mentioned, it turns out the fix is actually more complicated than I expected due to correct state determination after every reshard, and requires a bit of

[GitHub] flink issue #2414: [FLINK-4341] Let idle consumer subtasks emit max value wa...

2016-08-28 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/2414 @rmetzger, @aljoscha the changes are ready for another review now, thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] flink issue #2414: [FLINK-4341] Let idle consumer subtasks emit max value wa...

2016-08-29 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/2414 Thanks @rmetzger ! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

[GitHub] flink pull request #2432: [FLINK-4514][kinesis-connector] Handle unexpected ...

2016-08-29 Thread tzulitai
GitHub user tzulitai opened a pull request: https://github.com/apache/flink/pull/2432 [FLINK-4514][kinesis-connector] Handle unexpected ExpiredIteratorExceptions Handle any unexpected {{ExpiredIteratorException}}s on {{getRecords()}} calls be refreshing the failing shard iterator

[GitHub] flink issue #2432: [FLINK-4514][kinesis-connector] Handle unexpected Expired...

2016-08-29 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/2432 @rmetzger I know it might be a bit of a rush, but could you have a quick look at this too? It's not a critical blocker, but might as well would be good to make it into the 1.1.2 patch f

[GitHub] flink pull request #:

2016-08-29 Thread tzulitai
Github user tzulitai commented on the pull request: https://github.com/apache/flink/commit/7b574cf5b6e7549ae53ea0846022c4430a979a01#commitcomment-18811598 From the original Kinesis consumer documentation, I don't think it's necessary to mention this, because there's

[GitHub] flink pull request #:

2016-08-29 Thread tzulitai
Github user tzulitai commented on the pull request: https://github.com/apache/flink/commit/7b574cf5b6e7549ae53ea0846022c4430a979a01#commitcomment-18811645 AFAIK, the original issue reporters set the parallelism to the number of Kinesis shards because they realized only then will the

[GitHub] flink issue #2432: [FLINK-4514][kinesis-connector] Handle unexpected Expired...

2016-08-29 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/2432 I think it'll also make sense to limit the config setting `ConsumerConfigConstants.SHARD_GETRECORDS_INTERVAL_MILLIS` to be lower than the shard iterator expire time, otherwise the shard ite

[GitHub] flink issue #2432: [FLINK-4514][kinesis-connector] Handle unexpected Expired...

2016-08-29 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/2432 The latest commit sets the check to be less than 5 minutes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] flink pull request #2432: [FLINK-4514][kinesis-connector] Handle unexpected ...

2016-08-29 Thread tzulitai
Github user tzulitai commented on a diff in the pull request: https://github.com/apache/flink/pull/2432#discussion_r76620194 --- Diff: flink-streaming-connectors/flink-connector-kinesis/src/main/java/org/apache/flink/streaming/connectors/kinesis/internals/ShardConsumer.java

[GitHub] flink issue #2432: [FLINK-4514][kinesis-connector] Handle unexpected Expired...

2016-08-30 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/2432 Max seems to have just hotfixed the failing flink-mesos tests. Rebasing this PR on latest master. Merging this once Travis turns green. I'll open a separate JIRA to improve the fetch int

[GitHub] flink issue #2432: [FLINK-4514][kinesis-connector] Handle unexpected Expired...

2016-08-30 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/2432 Thanks for the confirmation. The build will probably fail again due to an unused import: https://travis-ci.org/tzulitai/flink/jobs/156191304, which was just hotfixed, so we need to rebase again

[GitHub] flink issue #2432: [FLINK-4514][kinesis-connector] Handle unexpected Expired...

2016-08-30 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/2432 Merging ... --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] flink pull request #2470: [FLINK-4559][kinesis-connector] Fix AWSUtil.getCre...

2016-09-03 Thread tzulitai
GitHub user tzulitai opened a pull request: https://github.com/apache/flink/pull/2470 [FLINK-4559][kinesis-connector] Fix AWSUtil.getCredentialsProvider() to not return null Let `AWSUtil#getCredentialsProvider` return a `DefaultAWSCredentialsProviderChain` instead of `null` when

[GitHub] flink issue #2470: [FLINK-4559][kinesis-connector] Fix AWSUtil.getCredential...

2016-09-03 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/2470 Thanks for the review @greghogan. I think it makes sense to let `AUTO` be the default, as the usual use case for most AWS users is to auto-detect the credentials delivered to instances by AWS&#

[GitHub] flink issue #2470: [FLINK-4559][kinesis-connector] Fix AWSUtil.getCredential...

2016-09-06 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/2470 Merging ... --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] flink issue #1962: [FLINK-3857][Streaming Connectors]Add reconnect attempt t...

2016-09-14 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/1962 Thanks @HungUnicorn, thats useful info. I wonder though if this config should be set by the user, instead of letting the connector internally set this. --- If your project is set up for it, you

[GitHub] flink pull request #2509: [FLINK-4280][kafka-connector] Explicit start posit...

2016-09-17 Thread tzulitai
GitHub user tzulitai opened a pull request: https://github.com/apache/flink/pull/2509 [FLINK-4280][kafka-connector] Explicit start position configuration for Kafka Consumer This PR adds the following new explicit setter methods to configure the starting position for the Kafka

[GitHub] flink issue #2452: [Flink-4450] add a new module "flink-apache-storm" to sup...

2016-09-19 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/2452 Sorry for chiming in late. Left some comments on the ML thread. Overall I think it's ok to switch focus on supporting 1.0+ Storm versions only. --- If your project is set up for it, yo

[GitHub] flink issue #2369: [FLINK-4035] Add a streaming connector for Apache Kafka 0...

2016-09-20 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/2369 Looks like we need to rebase this PR on the recently merged Kerberos support. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] flink issue #2369: [FLINK-4035] Add a streaming connector for Apache Kafka 0...

2016-09-20 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/2369 @cjstehno I would expect this to be in the 1.2.0 major release, which would probably be ~2 months from now according to Flink's past release cycle. The Flink community usually doesn't rel

[GitHub] flink pull request #3505: [backport-1.2] [FLINK-6006] [kafka] Always use com...

2017-03-09 Thread tzulitai
GitHub user tzulitai opened a pull request: https://github.com/apache/flink/pull/3505 [backport-1.2] [FLINK-6006] [kafka] Always use complete restored state in FlinkKafkaConsumer (This PR is the fix of FLINK-6006 for Flink 1.2) Previously, the Kafka Consumer performs

[GitHub] flink pull request #3507: [FLINK-6006] [kafka] Always use complete restored ...

2017-03-10 Thread tzulitai
GitHub user tzulitai opened a pull request: https://github.com/apache/flink/pull/3507 [FLINK-6006] [kafka] Always use complete restored state in FlinkKafkaConsumer (This PR is the fix of FLINK-6006 for Flink 1.1) Previously, the Kafka Consumer performs partition list

[GitHub] flink issue #3508: [FLINK-5991] [state-backend, streaming] Expose Broadcast ...

2017-03-10 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/3508 R: @aljoscha @StefanRRichter --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] flink pull request #3508: [FLINK-5991] [state-backend, streaming] Expose Bro...

2017-03-10 Thread tzulitai
GitHub user tzulitai opened a pull request: https://github.com/apache/flink/pull/3508 [FLINK-5991] [state-backend, streaming] Expose Broadcast Operator State This PR exposes broadcast operator state through the `CheckpointedFunction` interface, by adding broadcast state access

[GitHub] flink issue #2687: [FLINK-3123] [kafka] Allow custom specific start offsets ...

2017-03-10 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/2687 Rebased on the latest Kafka consumer changes in `master`. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] flink pull request #3517: [FLINK-6025] [core] Add Flink's own JavaSerializer...

2017-03-12 Thread tzulitai
GitHub user tzulitai opened a pull request: https://github.com/apache/flink/pull/3517 [FLINK-6025] [core] Add Flink's own JavaSerializer for Kryo serialization (This PR should also be backported for `release-1.1` and `release-1.2`. Separate PRs are not opened for the back

[GitHub] flink pull request #3518: [backport-1.2] [FLINK-6025] [core] Add Flink's own...

2017-03-12 Thread tzulitai
GitHub user tzulitai opened a pull request: https://github.com/apache/flink/pull/3518 [backport-1.2] [FLINK-6025] [core] Add Flink's own JavaSerializer for Kryo serialization This is a backport of #3517 for `release-1.2`. You can merge this pull request into a Git reposito

[GitHub] flink pull request #3519: [backport-1.1] [FLINK-6025] [core] Add Flink's own...

2017-03-12 Thread tzulitai
GitHub user tzulitai opened a pull request: https://github.com/apache/flink/pull/3519 [backport-1.1] [FLINK-6025] [core] Add Flink's own JavaSerializer for Kryo serialization This is a backport of #3518 for `release-1.1`. You can merge this pull request into a Git reposito

[GitHub] flink pull request #2687: [FLINK-3123] [kafka] Allow custom specific start o...

2017-03-13 Thread tzulitai
Github user tzulitai commented on a diff in the pull request: https://github.com/apache/flink/pull/2687#discussion_r105687880 --- Diff: flink-connectors/flink-connector-kafka-base/src/main/java/org/apache/flink/streaming/connectors/kafka/FlinkKafkaConsumerBase.java --- @@ -558,11

[GitHub] flink pull request #2687: [FLINK-3123] [kafka] Allow custom specific start o...

2017-03-13 Thread tzulitai
Github user tzulitai commented on a diff in the pull request: https://github.com/apache/flink/pull/2687#discussion_r105688259 --- Diff: flink-connectors/flink-connector-kafka-base/src/main/java/org/apache/flink/streaming/connectors/kafka/FlinkKafkaConsumerBase.java --- @@ -558,11

[GitHub] flink pull request #3527: [FLINK-3398] [kafka] Allow disabling offset commit...

2017-03-13 Thread tzulitai
GitHub user tzulitai opened a pull request: https://github.com/apache/flink/pull/3527 [FLINK-3398] [kafka] Allow disabling offset committing for FlinkKafkaConsumer This PR allows users to completely disable offset committing back to Kafka. The way configuration works

[GitHub] flink issue #3517: [FLINK-6025] [core] Add Flink's own JavaSerializer for Kr...

2017-03-13 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/3517 Thank you for the reviews @rmetzger! I'll proceed to merge this and the backport PRs. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] flink issue #2687: [FLINK-3123] [kafka] Allow custom specific start offsets ...

2017-03-13 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/2687 Thanks for the fast reviews :-) Merging .. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] flink pull request #3528: [FLINK-5949] [yarn] Don't check Kerberos credentia...

2017-03-14 Thread tzulitai
GitHub user tzulitai opened a pull request: https://github.com/apache/flink/pull/3528 [FLINK-5949] [yarn] Don't check Kerberos credentials for non-Kerberos… Additionally uses the `UserGroupInformation#getAuthenticationMethod()` to determine whether `KERBEROS` is use

[GitHub] flink pull request #3505: [backport-1.2] [FLINK-6006] [kafka] Always use com...

2017-03-14 Thread tzulitai
Github user tzulitai commented on a diff in the pull request: https://github.com/apache/flink/pull/3505#discussion_r105860279 --- Diff: flink-connectors/flink-connector-kafka-base/src/main/java/org/apache/flink/streaming/connectors/kafka/internals/AbstractFetcher.java

[GitHub] flink pull request #3505: [backport-1.2] [FLINK-6006] [kafka] Always use com...

2017-03-14 Thread tzulitai
Github user tzulitai commented on a diff in the pull request: https://github.com/apache/flink/pull/3505#discussion_r105860440 --- Diff: flink-connectors/flink-connector-kafka-base/src/main/java/org/apache/flink/streaming/connectors/kafka/FlinkKafkaConsumerBase.java --- @@ -489,16

[GitHub] flink pull request #3518: [backport-1.2] [FLINK-6025] [core] Add Flink's own...

2017-03-14 Thread tzulitai
Github user tzulitai closed the pull request at: https://github.com/apache/flink/pull/3518 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] flink issue #3518: [backport-1.2] [FLINK-6025] [core] Add Flink's own JavaSe...

2017-03-14 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/3518 Thanks for the reminder :-D --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] flink pull request #3519: [backport-1.1] [FLINK-6025] [core] Add Flink's own...

2017-03-14 Thread tzulitai
Github user tzulitai closed the pull request at: https://github.com/apache/flink/pull/3519 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] flink issue #3505: [backport-1.2] [FLINK-6006] [kafka] Always use complete r...

2017-03-14 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/3505 Merging .. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] flink issue #3528: [FLINK-5949] [yarn] Don't check Kerberos credentials for ...

2017-03-14 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/3528 Thanks for the review :-) Failing tests seem to be something instable with Maven. Merging this to `master` and `release-1.2` .. --- If your project is set up for it, you can reply to this

[GitHub] flink issue #3527: [FLINK-3398] [kafka] Allow disabling offset committing fo...

2017-03-14 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/3527 Did a final test run on a Kafka installation, and things worked as expected. One minor improvement would be to add logs for what exactly the commit mode is used when it is determined in `open

[GitHub] flink pull request #3505: [backport-1.2] [FLINK-6006] [kafka] Always use com...

2017-03-14 Thread tzulitai
Github user tzulitai closed the pull request at: https://github.com/apache/flink/pull/3505 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] flink issue #3507: [backport-1.1] [FLINK-6006] [kafka] Always use complete r...

2017-03-14 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/3507 Doing another Travis run locally before merging just to be safe: https://travis-ci.org/tzulitai/flink/builds/211031758 --- If your project is set up for it, you can reply to this email and have

[GitHub] flink issue #3507: [backport-1.1] [FLINK-6006] [kafka] Always use complete r...

2017-03-15 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/3507 Merging .. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] flink pull request #3507: [backport-1.1] [FLINK-6006] [kafka] Always use com...

2017-03-15 Thread tzulitai
Github user tzulitai closed the pull request at: https://github.com/apache/flink/pull/3507 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] flink pull request #3549: [FLINK-5701] [kafka] FlinkKafkaProducer should che...

2017-03-15 Thread tzulitai
GitHub user tzulitai opened a pull request: https://github.com/apache/flink/pull/3549 [FLINK-5701] [kafka] FlinkKafkaProducer should check asyncException on checkpoints This is a backport of FLINK-5701 for `release-1.1`. The added tests are identical to #3278, with only

[GitHub] flink pull request #3549: [backport-1.1] [FLINK-5701] [kafka] FlinkKafkaProd...

2017-03-15 Thread tzulitai
Github user tzulitai commented on a diff in the pull request: https://github.com/apache/flink/pull/3549#discussion_r106221523 --- Diff: flink-streaming-connectors/flink-connector-kafka-base/src/main/java/org/apache/flink/streaming/connectors/kafka/FlinkKafkaProducerBase.java

[GitHub] flink pull request #3549: [backport-1.1] [FLINK-5701] [kafka] FlinkKafkaProd...

2017-03-15 Thread tzulitai
Github user tzulitai commented on a diff in the pull request: https://github.com/apache/flink/pull/3549#discussion_r106221979 --- Diff: flink-streaming-connectors/flink-connector-kafka-base/src/main/java/org/apache/flink/streaming/connectors/kafka/FlinkKafkaProducerBase.java

[GitHub] flink pull request #3549: [backport-1.1] [FLINK-5701] [kafka] FlinkKafkaProd...

2017-03-15 Thread tzulitai
Github user tzulitai commented on a diff in the pull request: https://github.com/apache/flink/pull/3549#discussion_r106222066 --- Diff: flink-streaming-connectors/flink-connector-kafka-base/src/main/java/org/apache/flink/streaming/connectors/kafka/FlinkKafkaProducerBase.java

[GitHub] flink issue #3549: [backport-1.1] [FLINK-5701] [kafka] FlinkKafkaProducer sh...

2017-03-15 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/3549 Thanks for the review! Travis is green (local branch), with only test timeouts: https://travis-ci.org/tzulitai/flink Merging this .. --- If your project is set up for it, you can

[GitHub] flink pull request #3549: [backport-1.1] [FLINK-5701] [kafka] FlinkKafkaProd...

2017-03-15 Thread tzulitai
Github user tzulitai closed the pull request at: https://github.com/apache/flink/pull/3549 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] flink issue #3458: [FLINK-4577] [kinesis] Transparent reshard handling for F...

2017-03-17 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/3458 @StephanEwen yes, I think that would be nice. I'll try to reach out to some of the Kinesis Flink users I know of. --- If your project is set up for it, you can reply to this email and have

[GitHub] flink issue #3508: [FLINK-5991] [state-backend, streaming] Expose Broadcast ...

2017-03-17 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/3508 Nice following the discussion here :) I think I'm also leaning a bit more towards naming it `UnionListState`. From the user's prospective, it seems to be more clearer if the n

[GitHub] flink issue #3562: [FLINK-6018] Add tests for KryoSerializer restore with re...

2017-03-17 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/3562 +1 to the rename. I was thinking the same here :-) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] flink pull request #3562: [FLINK-6018] Add tests for KryoSerializer restore ...

2017-03-18 Thread tzulitai
Github user tzulitai commented on a diff in the pull request: https://github.com/apache/flink/pull/3562#discussion_r106776351 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/state/StateBackendTestBase.java --- @@ -162,22 +176,422 @@ protected

[GitHub] flink pull request #3562: [FLINK-6018] Add tests for KryoSerializer restore ...

2017-03-18 Thread tzulitai
Github user tzulitai commented on a diff in the pull request: https://github.com/apache/flink/pull/3562#discussion_r106776283 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/state/StateBackendTestBase.java --- @@ -162,22 +176,422 @@ protected

[GitHub] flink pull request #3562: [FLINK-6018] Add tests for KryoSerializer restore ...

2017-03-18 Thread tzulitai
Github user tzulitai commented on a diff in the pull request: https://github.com/apache/flink/pull/3562#discussion_r106776232 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/state/StateBackendTestBase.java --- @@ -82,13 +90,19 @@ import static

[GitHub] flink pull request #3562: [FLINK-6018] Add tests for KryoSerializer restore ...

2017-03-18 Thread tzulitai
Github user tzulitai commented on a diff in the pull request: https://github.com/apache/flink/pull/3562#discussion_r106776337 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/state/StateBackendTestBase.java --- @@ -162,22 +176,422 @@ protected

[GitHub] flink pull request #3562: [FLINK-6018] Add tests for KryoSerializer restore ...

2017-03-18 Thread tzulitai
Github user tzulitai commented on a diff in the pull request: https://github.com/apache/flink/pull/3562#discussion_r106776326 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/state/StateBackendTestBase.java --- @@ -162,22 +176,422 @@ protected

[GitHub] flink pull request #3562: [FLINK-6018] Add tests for KryoSerializer restore ...

2017-03-18 Thread tzulitai
Github user tzulitai commented on a diff in the pull request: https://github.com/apache/flink/pull/3562#discussion_r106776607 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/state/StateBackendTestBase.java --- @@ -162,22 +176,422 @@ protected

[GitHub] flink pull request #3562: [FLINK-6018] Add tests for KryoSerializer restore ...

2017-03-18 Thread tzulitai
Github user tzulitai commented on a diff in the pull request: https://github.com/apache/flink/pull/3562#discussion_r106775966 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/state/StateBackendTestBase.java --- @@ -162,22 +176,422 @@ protected

[GitHub] flink pull request #3562: [FLINK-6018] Add tests for KryoSerializer restore ...

2017-03-18 Thread tzulitai
Github user tzulitai commented on a diff in the pull request: https://github.com/apache/flink/pull/3562#discussion_r106776304 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/state/StateBackendTestBase.java --- @@ -162,22 +176,422 @@ protected

[GitHub] flink pull request #3562: [FLINK-6018] Add tests for KryoSerializer restore ...

2017-03-18 Thread tzulitai
Github user tzulitai commented on a diff in the pull request: https://github.com/apache/flink/pull/3562#discussion_r106776621 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/state/StateBackendTestBase.java --- @@ -162,22 +176,422 @@ protected

[GitHub] flink pull request #3562: [FLINK-6018] Add tests for KryoSerializer restore ...

2017-03-18 Thread tzulitai
Github user tzulitai commented on a diff in the pull request: https://github.com/apache/flink/pull/3562#discussion_r106776349 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/state/StateBackendTestBase.java --- @@ -162,22 +176,422 @@ protected

[GitHub] flink pull request #3562: [FLINK-6018] Add tests for KryoSerializer restore ...

2017-03-18 Thread tzulitai
Github user tzulitai commented on a diff in the pull request: https://github.com/apache/flink/pull/3562#discussion_r106776563 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/state/StateBackendTestBase.java --- @@ -162,22 +176,422 @@ protected

[GitHub] flink pull request #3562: [FLINK-6018] Add tests for KryoSerializer restore ...

2017-03-18 Thread tzulitai
Github user tzulitai commented on a diff in the pull request: https://github.com/apache/flink/pull/3562#discussion_r106776658 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/state/StateBackendTestBase.java --- @@ -162,22 +176,422 @@ protected

[GitHub] flink pull request #3562: [FLINK-6018] Add tests for KryoSerializer restore ...

2017-03-18 Thread tzulitai
Github user tzulitai commented on a diff in the pull request: https://github.com/apache/flink/pull/3562#discussion_r106776518 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/state/StateBackendTestBase.java --- @@ -162,22 +176,422 @@ protected

[GitHub] flink issue #3562: [FLINK-6018] Add tests for KryoSerializer restore with re...

2017-03-20 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/3562 @aljoscha I've been trying out this PR to also test some Kryo behaviours. I can address the above comments along the way and open a PR against this one :-) --- If your project is set up f

[GitHub] flink pull request #3582: [FLINK-6139] [doc] Documentation for running Flink...

2017-03-20 Thread tzulitai
GitHub user tzulitai opened a pull request: https://github.com/apache/flink/pull/3582 [FLINK-6139] [doc] Documentation for running Flink with MapR Includes how to properly build Flink & setup job client to be able to run Flink on YARN with a MapR cluster. You can merge this

[GitHub] flink issue #3556: [FLINK-6084][Cassandra] Promote transitive dependencies

2017-03-21 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/3556 Thanks for the fix, LGTM. @rmetzger could you proceed to merge this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] flink pull request #3587: [FLINK-5972] Don't allow shrinking merging windows

2017-03-22 Thread tzulitai
Github user tzulitai commented on a diff in the pull request: https://github.com/apache/flink/pull/3587#discussion_r107450020 --- Diff: flink-streaming-java/src/main/java/org/apache/flink/streaming/runtime/operators/windowing/WindowOperator.java --- @@ -138,7 +138,7

[GitHub] flink issue #3587: [FLINK-5972] Don't allow shrinking merging windows

2017-03-22 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/3587 Thanks a lot for addressing my comments @aljoscha! That's so much cleaner now :-D Really like the refactoring in the fixes. I actually didn't realize the mock stubs and util me

[GitHub] flink pull request #3587: [FLINK-5972] Don't allow shrinking merging windows

2017-03-22 Thread tzulitai
Github user tzulitai commented on a diff in the pull request: https://github.com/apache/flink/pull/3587#discussion_r107506662 --- Diff: flink-streaming-java/src/main/java/org/apache/flink/streaming/runtime/operators/windowing/EvictingWindowOperator.java --- @@ -122,6 +121,19

[GitHub] flink issue #3562: [FLINK-6018] Add tests for KryoSerializer restore with re...

2017-03-23 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/3562 Here's my follow-up fixes for this: https://github.com/tzulitai/flink/tree/FLINK-6018 It also includes a rebase for the merge conflict + test fixes. We can continue with this

[GitHub] flink issue #3562: [FLINK-6018] Add tests for KryoSerializer restore with re...

2017-03-23 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/3562 @aljoscha sure, I'll do that. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enable

[GitHub] flink pull request #3603: [FLINK-6018] Add tests for KryoSerializer restore ...

2017-03-23 Thread tzulitai
GitHub user tzulitai opened a pull request: https://github.com/apache/flink/pull/3603 [FLINK-6018] Add tests for KryoSerializer restore with registered types (This PR is a re-opened version of #3562, including @aljoscha's initial work and my follow-up fixes. The below descri

[GitHub] flink issue #3562: [FLINK-6018] Add tests for KryoSerializer restore with re...

2017-03-23 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/3562 Done. Re-opened at #3603. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] flink issue #3587: [FLINK-5972] Don't allow shrinking merging windows

2017-03-23 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/3587 Thanks a lot for the extra pair of eyes on this @kl0u! I can fix the typo and proceed to merge this to `master` and `release-1-2`. --- If your project is set up for it, you can reply to this

[GitHub] flink issue #3587: [FLINK-5972] Don't allow shrinking merging windows

2017-03-23 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/3587 Merging .. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

  1   2   3   4   5   6   7   8   9   10   >