[GitHub] flink issue #3029: [FLINK-5369] [build] Rework jsr305 and logging dependenci...

2016-12-20 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/3029 (quickstart worked as well!) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] flink issue #3029: [FLINK-5369] [build] Rework jsr305 and logging dependenci...

2016-12-20 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/3029 I've tested the change on a YARN cluster (I know there are tests for that). I'm currently trying out the quickstarts as well. --- If your project is set up for it, you can reply to this email

[GitHub] flink pull request #3029: [FLINK-5369] [build] Rework jsr305 and logging dep...

2016-12-20 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/3029#discussion_r93206487 --- Diff: pom.xml --- @@ -91,7 +91,6 @@ under the License. 1C true log4j-test.properties

[GitHub] flink issue #2767: [FLINK-4988] Elasticsearch 5.x support

2016-12-19 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2767 @StephanEwen I'll start a discussion on the mailing list to decide how we want to proceed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] flink pull request #2767: [FLINK-4988] Elasticsearch 5.x support

2016-12-19 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2767#discussion_r93053073 --- Diff: flink-streaming-connectors/flink-connector-elasticsearch5/pom.xml --- @@ -0,0 +1,93 @@ + + +http://maven.apache.org/POM/4.0.0

[GitHub] flink pull request #2767: [FLINK-4988] Elasticsearch 5.x support

2016-12-19 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2767#discussion_r93052912 --- Diff: flink-streaming-connectors/flink-connector-elasticsearch5/pom.xml --- @@ -0,0 +1,93 @@ + + +http://maven.apache.org/POM/4.0.0

[GitHub] flink issue #2861: [FLINK-5122] Index requests will be retried if the error ...

2016-12-19 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2861 @fpompermaier I guess logstash is just a client to ES that implement its own retry logic (similar to Flink). I'll check out the JIRA. --- If your project is set up for it, you can reply

[GitHub] flink pull request #2861: [FLINK-5122] Index requests will be retried if the...

2016-12-19 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2861#discussion_r93049169 --- Diff: flink-streaming-connectors/flink-connector-elasticsearch2/src/main/java/org/apache/flink/streaming/connectors/elasticsearch2/ElasticsearchSink.java

[GitHub] flink pull request #2861: [FLINK-5122] Index requests will be retried if the...

2016-12-19 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2861#discussion_r93048695 --- Diff: flink-streaming-connectors/flink-connector-elasticsearch2/src/main/java/org/apache/flink/streaming/connectors/elasticsearch2/ElasticsearchSink.java

[GitHub] flink issue #2861: [FLINK-5122] Index requests will be retried if the error ...

2016-12-19 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2861 @fpompermaier Why is throwing exceptions in close causing document losses? As far as I can see ES is flushing all outstanding batches on close(). --- If your project is set up for it, you can

[GitHub] flink pull request #2861: [FLINK-5122] Index requests will be retried if the...

2016-12-19 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2861#discussion_r93045771 --- Diff: flink-streaming-connectors/flink-connector-elasticsearch2/src/main/java/org/apache/flink/streaming/connectors/elasticsearch2/ElasticsearchSink.java

[GitHub] flink pull request #2861: [FLINK-5122] Index requests will be retried if the...

2016-12-19 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2861#discussion_r93043759 --- Diff: flink-streaming-connectors/flink-connector-elasticsearch2/src/main/java/org/apache/flink/streaming/connectors/elasticsearch2/ElasticsearchSink.java

[GitHub] flink issue #2861: [FLINK-5122] Index requests will be retried if the error ...

2016-12-19 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2861 I checked the elasticsearch documentation and some user forum from ES, and indeed it seems that they do not include any retry logic into their clients. --- If your project is set up for it, you

[GitHub] flink issue #3008: [FLINK-4973] Let LatencyMarksEmitter use StreamTask's Pro...

2016-12-15 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/3008 +1 to merge. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

[GitHub] flink issue #3006: [FLINK-5323] CheckpointNotifier should be removed from do...

2016-12-14 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/3006 +1 to merge --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

[GitHub] flink issue #2867: [FLINK-5145] WebInterface only polls selected metrics

2016-12-13 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2867 +1 to merge --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

[GitHub] flink issue #2859: [FLINK-5147] Prevent NPE in LocalFS#delete()

2016-12-09 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2859 +1 to merge --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

[GitHub] flink issue #2890: [hotfix] properly encapsulate the original exception in J...

2016-12-09 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2890 Final travis build: https://travis-ci.org/rmetzger/flink/builds/182582571 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] flink issue #2890: [hotfix] properly encapsulate the original exception in J...

2016-12-09 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2890 +1 to merge. I'll merge it now --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] flink issue #2953: [FLINK-5039] Bump Avro version

2016-12-08 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2953 Rebased to master to include fixed build. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] flink issue #2509: [FLINK-4280][kafka-connector] Explicit start position con...

2016-12-08 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2509 Thanks a lot! I have your Kafka pull requests on my todo list. I hope I get to it soon. I'm really sorry. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] flink issue #2737: [FLINK-4983] Web UI: Add favicon

2016-12-06 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2737 I've created a fix: https://github.com/rmetzger/flink/commit/28a3aed8633246717c52599c25ced928436a6f97 and pushed it to my travis account (Github has a service outage, that's why travis builds

[GitHub] flink pull request #2953: [FLINK-5039] Bump Avro version

2016-12-06 Thread rmetzger
GitHub user rmetzger opened a pull request: https://github.com/apache/flink/pull/2953 [FLINK-5039] Bump Avro version This is a critical issue for some of our users. You can merge this pull request into a Git repository by running: $ git pull https://github.com/rmetzger/flink

[GitHub] flink issue #2950: [hotfix] Check for null in OperatorSnapshotResult#cancel

2016-12-06 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2950 +1 I'll merge it --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

[GitHub] flink pull request #2861: [FLINK-5122] Index requests will be retried if the...

2016-12-05 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2861#discussion_r90916177 --- Diff: flink-streaming-connectors/flink-connector-elasticsearch2/src/main/java/org/apache/flink/streaming/connectors/elasticsearch2/ElasticsearchSink.java

[GitHub] flink pull request #2861: [FLINK-5122] Index requests will be retried if the...

2016-12-05 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2861#discussion_r90916759 --- Diff: flink-streaming-connectors/flink-connector-elasticsearch2/src/main/java/org/apache/flink/streaming/connectors/elasticsearch2/ElasticsearchSink.java

[GitHub] flink pull request #2861: [FLINK-5122] Index requests will be retried if the...

2016-12-05 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2861#discussion_r90917049 --- Diff: flink-streaming-connectors/flink-connector-elasticsearch2/src/main/java/org/apache/flink/streaming/connectors/elasticsearch2/ElasticsearchSink.java

[GitHub] flink pull request #2861: [FLINK-5122] Index requests will be retried if the...

2016-12-05 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2861#discussion_r90916979 --- Diff: flink-streaming-connectors/flink-connector-elasticsearch2/src/main/java/org/apache/flink/streaming/connectors/elasticsearch2/ElasticsearchSink.java

[GitHub] flink pull request #2861: [FLINK-5122] Index requests will be retried if the...

2016-12-05 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2861#discussion_r90917303 --- Diff: flink-streaming-connectors/flink-connector-elasticsearch2/src/main/java/org/apache/flink/streaming/connectors/elasticsearch2/ElasticsearchSink.java

[GitHub] flink pull request #2861: [FLINK-5122] Index requests will be retried if the...

2016-12-05 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2861#discussion_r90917039 --- Diff: flink-streaming-connectors/flink-connector-elasticsearch2/src/main/java/org/apache/flink/streaming/connectors/elasticsearch2/ElasticsearchSink.java

[GitHub] flink issue #2893: [FLINK-5128]Get Kafka partitions in FlinkKafkaProducer on...

2016-12-02 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2893 +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

[GitHub] flink issue #2886: [FLINK-5179] Correct TM MetricRegistry and TmMG lifecycle

2016-12-02 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2886 I wonder if there is an easy way to add a test case for this? Maybe you could add a check to one of the HA tests? --- If your project is set up for it, you can reply to this email and have your

[GitHub] flink pull request #2899: Various logging improvements

2016-11-30 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2899#discussion_r90234726 --- Diff: flink-dist/src/main/flink-bin/conf/log4j.properties --- @@ -16,14 +16,26 @@ # limitations under the License

[GitHub] flink issue #2850: [FLINK-4895] Drop Hadoop1 support

2016-11-28 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2850 Thank you for the review. I'll merge it once travis is green. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] flink issue #2795: Revert "[FLINK-4913][yarn] include user jars in system cl...

2016-11-25 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2795 Merging ... --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

[GitHub] flink issue #2795: Revert "[FLINK-4913][yarn] include user jars in system cl...

2016-11-24 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2795 Rebased and pushed to travis again: https://travis-ci.org/rmetzger/flink/builds/178664750 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] flink issue #2664: [FLINK-4861] [build] Package optional project artifacts

2016-11-24 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2664 I had the same thought. We could add the maven assembly plugin / shade plugin to each connector / library to build a fat jar, and then add some logic to flink-dist to collect these fat jars

[GitHub] flink issue #2664: [FLINK-4861] [build] Package optional project artifacts

2016-11-24 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2664 I thought that transitive dependencies are resolved in the scope of assembly descriptors. But I'm not so sure about that anymore. --- If your project is set up for it, you can reply to this email

[GitHub] flink issue #2850: [FLINK-4895] Drop Hadoop1 support

2016-11-23 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2850 Good catch. I removed the reflection magic from the class. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] flink pull request #2790: [FLINK-4491] Handle index.number_of_shards in the ...

2016-11-23 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2790#discussion_r89341178 --- Diff: flink-streaming-connectors/flink-connector-elasticsearch2/src/main/java/org/apache/flink/streaming/connectors/elasticsearch2/ElasticsearchSink.java

[GitHub] flink issue #2790: [FLINK-4491] Handle index.number_of_shards in the ES conn...

2016-11-23 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2790 I agree with Fabian here. The ESHelper does not use any Flink code at all, so the relation to Flink is not clear. A user of Hadoop would equally benefit from such a utility. I would expect that ES

[GitHub] flink issue #2687: [FLINK-3123] [kafka] Allow custom specific start offsets ...

2016-11-23 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2687 I'll review this PR once https://github.com/apache/flink/pull/2509 has been merged. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well

[GitHub] flink pull request #2509: [FLINK-4280][kafka-connector] Explicit start posit...

2016-11-23 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2509#discussion_r89275454 --- Diff: flink-streaming-connectors/flink-connector-kafka-0.9/src/test/java/org/apache/flink/streaming/connectors/kafka/KafkaTestEnvironmentImpl.java

[GitHub] flink pull request #2509: [FLINK-4280][kafka-connector] Explicit start posit...

2016-11-23 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2509#discussion_r89283859 --- Diff: flink-streaming-connectors/flink-connector-kafka-0.9/src/main/java/org/apache/flink/streaming/connectors/kafka/internal/Kafka09Fetcher.java

[GitHub] flink pull request #2509: [FLINK-4280][kafka-connector] Explicit start posit...

2016-11-23 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2509#discussion_r89283319 --- Diff: flink-streaming-connectors/flink-connector-kafka-0.8/src/main/java/org/apache/flink/streaming/connectors/kafka/internals/SimpleConsumerThread.java

[GitHub] flink pull request #2509: [FLINK-4280][kafka-connector] Explicit start posit...

2016-11-23 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2509#discussion_r89284541 --- Diff: flink-streaming-connectors/flink-connector-kafka-0.9/src/main/java/org/apache/flink/streaming/connectors/kafka/internal/Kafka09Fetcher.java

[GitHub] flink pull request #2509: [FLINK-4280][kafka-connector] Explicit start posit...

2016-11-23 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2509#discussion_r89276062 --- Diff: flink-streaming-connectors/flink-connector-kafka-base/src/test/java/org/apache/flink/streaming/connectors/kafka/KafkaConsumerTestBase.java

[GitHub] flink pull request #2509: [FLINK-4280][kafka-connector] Explicit start posit...

2016-11-23 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2509#discussion_r89275211 --- Diff: flink-streaming-connectors/flink-connector-kafka-0.8/src/main/java/org/apache/flink/streaming/connectors/kafka/internals/SimpleConsumerThread.java

[GitHub] flink pull request #2509: [FLINK-4280][kafka-connector] Explicit start posit...

2016-11-23 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2509#discussion_r89282863 --- Diff: flink-streaming-connectors/flink-connector-kafka-0.8/src/main/java/org/apache/flink/streaming/connectors/kafka/internals/Kafka08Fetcher.java

[GitHub] flink pull request #2509: [FLINK-4280][kafka-connector] Explicit start posit...

2016-11-23 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2509#discussion_r89150327 --- Diff: flink-streaming-connectors/flink-connector-kafka-0.10/src/test/java/org/apache/flink/streaming/connectors/kafka/Kafka010FetcherTest.java

[GitHub] flink pull request #2509: [FLINK-4280][kafka-connector] Explicit start posit...

2016-11-23 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2509#discussion_r89275431 --- Diff: flink-streaming-connectors/flink-connector-kafka-0.9/src/test/java/org/apache/flink/streaming/connectors/kafka/Kafka09ITCase.java --- @@ -110,6

[GitHub] flink pull request #2509: [FLINK-4280][kafka-connector] Explicit start posit...

2016-11-23 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2509#discussion_r89275697 --- Diff: flink-streaming-connectors/flink-connector-kafka-base/src/test/java/org/apache/flink/streaming/connectors/kafka/KafkaConsumerTestBase.java

[GitHub] flink pull request #2509: [FLINK-4280][kafka-connector] Explicit start posit...

2016-11-23 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2509#discussion_r89284524 --- Diff: flink-streaming-connectors/flink-connector-kafka-0.9/src/main/java/org/apache/flink/streaming/connectors/kafka/internal/Kafka09Fetcher.java

[GitHub] flink pull request #2509: [FLINK-4280][kafka-connector] Explicit start posit...

2016-11-23 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2509#discussion_r89274682 --- Diff: flink-streaming-connectors/flink-connector-kafka-0.10/src/test/java/org/apache/flink/streaming/connectors/kafka/KafkaTestEnvironmentImpl.java

[GitHub] flink pull request #2509: [FLINK-4280][kafka-connector] Explicit start posit...

2016-11-23 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2509#discussion_r89276937 --- Diff: flink-streaming-connectors/flink-connector-kafka-0.10/src/main/java/org/apache/flink/streaming/connectors/kafka/internal/Kafka010Fetcher.java

[GitHub] flink pull request #2509: [FLINK-4280][kafka-connector] Explicit start posit...

2016-11-23 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2509#discussion_r89274555 --- Diff: flink-streaming-connectors/flink-connector-kafka-0.10/src/test/java/org/apache/flink/streaming/connectors/kafka/Kafka010ITCase.java --- @@ -131,6

[GitHub] flink issue #2850: [FLINK-4895] Drop Hadoop1 support

2016-11-22 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2850 I haven't tried it yet. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] flink issue #2664: [FLINK-4861] [build] Package optional project artifacts

2016-11-22 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2664 Thank you for fixing the issue so quickly. I'm wondering whether the current approach is a good idea, because it requires manual checking of all transitive dependencies. We have something

[GitHub] flink pull request #2850: [FLINK-4895] Drop Hadoop1 support

2016-11-22 Thread rmetzger
GitHub user rmetzger opened a pull request: https://github.com/apache/flink/pull/2850 [FLINK-4895] Drop Hadoop1 support I've removed all the infrastructure in Maven and the `tools/` directory to get rid of Hadoop1. I didn't test the update to the release script. So

[GitHub] flink issue #2681: [FLINK-4155] [kafka] Move partition list fetching to open...

2016-11-22 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2681 Cool, thx. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

[GitHub] flink issue #2664: [FLINK-4861] [build] Package optional project artifacts

2016-11-22 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2664 I tried out the change and I like the idea. One issue I found is that transitive dependencies are not properly added: Kafka 0.10 depends on the Kafka 0.9 code, but that one (and its dependencies

[GitHub] flink issue #2681: [FLINK-4155] [kafka] Move partition list fetching to open...

2016-11-21 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2681 Did you refactor the table tests? If not, we can also merge this PR as is and file a follow up JIRA. One other thing I thought about while looking over the PR: We need the partition list only

[GitHub] flink issue #2787: [FLINK-5013] [kinesis] Shade AWS dependencies to work wit...

2016-11-14 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2787 I agree that we should try to get this into the RC. +1 to merge --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] flink issue #2724: [FLINK-4221] Show metrics in WebFrontend + general improv...

2016-11-04 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2724 I'll merge the change ... --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] flink pull request #2755: [hotfix][docs] Stream joins don't support tuple po...

2016-11-04 Thread rmetzger
GitHub user rmetzger opened a pull request: https://github.com/apache/flink/pull/2755 [hotfix][docs] Stream joins don't support tuple position keys You can merge this pull request into a Git repository by running: $ git pull https://github.com/rmetzger/flink

[GitHub] flink issue #2724: [FLINK-4221] Show metrics in WebFrontend + general improv...

2016-11-04 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2724 Thank you. I'll wait for Greg. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] flink pull request #2724: [FLINK-4221] Show metrics in WebFrontend + general...

2016-11-04 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2724#discussion_r86549923 --- Diff: flink-runtime-web/web-dashboard/app/partials/jobs/job.plan.node-list.metrics.jade --- @@ -0,0 +1,47 @@ +// + Licensed to the Apache

[GitHub] flink pull request #2724: [FLINK-4221] Show metrics in WebFrontend + general...

2016-11-04 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2724#discussion_r86548295 --- Diff: flink-runtime-web/web-dashboard/app/partials/jobs/job.jade --- @@ -50,19 +50,15 @@ nav.navbar.navbar-default.navbar-fixed-top.navbar-main(ng

[GitHub] flink issue #2724: [FLINK-4221] Show metrics in WebFrontend + general improv...

2016-11-04 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2724 Thank you for the review. I'm going to address your inline comments. However, if you are okay with it, I would like to address your general comments with the next web interface pull request

[GitHub] flink pull request #2683: [FLINK-4888][metrics] instantiated job manager met...

2016-11-02 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2683#discussion_r86119642 --- Diff: flink-runtime/src/main/scala/org/apache/flink/runtime/jobmanager/JobManager.scala --- @@ -1828,6 +1828,33 @@ class JobManager

[GitHub] flink issue #2706: [FLINK-4945] KafkaConsumer logs wrong warning about confi...

2016-11-02 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2706 Thank you for fixing this. I'll merge the change. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] flink issue #2724: [FLINK-4221] Show metrics in WebFrontend + general improv...

2016-10-31 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2724 Thank you for the review @zentol. I addressed your comments and rebased to master again. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] flink pull request #2724: [FLINK-4221] Show metrics in WebFrontend + general...

2016-10-28 Thread rmetzger
GitHub user rmetzger opened a pull request: https://github.com/apache/flink/pull/2724 [FLINK-4221] Show metrics in WebFrontend + general improvements Other included changes: - Removed Properties tab - Renamed plan to overview - Added parallelism to task list

[GitHub] flink issue #2616: [FLINK-4733] Port WebInterface to metric system

2016-10-28 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2616 The `CoordinatorShutdownTest` fixes look reasonable. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] flink issue #2616: [FLINK-4733] Port WebInterface to metric system

2016-10-27 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2616 I tested the change locally, it works. +1 to merge. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] flink issue #2616: [FLINK-4733] Port WebInterface to metric system

2016-10-27 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2616 Thank you for rebasing. This run: had the following error: https://s3.amazonaws.com/archive.travis-ci.org/jobs/170428661/log.txt ``` Failed tests

[GitHub] flink issue #2694: [FLINK-4925] [metrics] Integrate meters into IOMetricGrou...

2016-10-27 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2694 +1 to merge. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

[GitHub] flink pull request #2705: [FLINK-2597][FLINK-4050] Add wrappers for Kafka se...

2016-10-27 Thread rmetzger
GitHub user rmetzger opened a pull request: https://github.com/apache/flink/pull/2705 [FLINK-2597][FLINK-4050] Add wrappers for Kafka serializers, test for partitioner and documentation This pull requests addresses the following JIRAs: - [FLINK-2597 Add a test for Avro

[GitHub] flink issue #2644: [FLINK-4837] flink-streaming-akka source connector

2016-10-25 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2644 Thank you! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

[GitHub] flink issue #2673: [FLINK-4864] [table] Shade Calcite dependency in flink-ta...

2016-10-25 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2673 Thank you for looking into the details of this. If the user who ran into the issue is using Java, they can fix the issue themselves by relocating our or their Calcite version locally

[GitHub] flink pull request #2616: [FLINK-4733] Port WebInterface to metric system

2016-10-25 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2616#discussion_r84696513 --- Diff: flink-runtime-web/src/main/java/org/apache/flink/runtime/webmonitor/handlers/JobDetailsHandler.java --- @@ -147,11 +143,36 @@ public String

[GitHub] flink pull request #2616: [FLINK-4733] Port WebInterface to metric system

2016-10-25 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2616#discussion_r84697528 --- Diff: flink-runtime-web/src/main/java/org/apache/flink/runtime/webmonitor/handlers/JobVertexDetailsHandler.java --- @@ -99,11 +83,34 @@ public String

[GitHub] flink issue #2626: [FLINK-4787] [runtime-web] Expose cancel-with-savepoint v...

2016-10-24 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2626 Looks like the tests are failing. I quickly scrolled over the changes. +1 to merge. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] flink issue #2654: [hotfix] [kafka] Fix RackAwareMode instantiation in Kafka...

2016-10-24 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2654 Nice fix, thank you +1 to merge. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] flink issue #2680: [FLINK-4876] Allow web interface to be bound to a specifi...

2016-10-24 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2680 Thank you for opening a PR for fixing this. +1 to merge. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] flink issue #2683: [FLINK-4888][metrics] instantiated job manager metrics mi...

2016-10-24 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2683 Thank you for opening a pull request. I agree that we should expose all numbers we show in the web interface as a metric as well. --- If your project is set up for it, you can reply to this email

[GitHub] flink pull request #2683: [FLINK-4888][metrics] instantiated job manager met...

2016-10-24 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2683#discussion_r84689406 --- Diff: flink-runtime/src/main/scala/org/apache/flink/runtime/jobmanager/JobManager.scala --- @@ -1828,6 +1828,33 @@ class JobManager

[GitHub] flink issue #2487: [FLINK-4520][flink-siddhi] Integrate Siddhi as a light-we...

2016-10-24 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2487 Hi @haoch, thanks alot for this contribution. I recently started moving some of the streaming connectors of Flink to Apache Bahir, a community for extensions to Spark, Flink (and maybe

[GitHub] flink issue #2673: [FLINK-4864] [table] Shade Calcite dependency in flink-ta...

2016-10-24 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2673 I tried reproducing the issue reported by @fhueske. The only issue I got was `Caused by: org.codehaus.commons.compiler.CompileException: Line 8, Column 13: Class

[GitHub] flink issue #2448: [FLINK-3030][web frontend] Enhance dashboard to show exec...

2016-10-24 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2448 Okay, I'll run gulp when merging. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] flink issue #2644: [FLINK-4837] flink-streaming-akka source connector

2016-10-24 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2644 Thank you for opening a pull request for adding a new streaming connector. I also think that this connector is a good candidate to go into Apache Bahir. You find the GitHub repository of Bahir

[GitHub] flink issue #2676: [FLINK-4875] [metrics] Use correct operator name

2016-10-21 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2676 +1 to merge this change. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] flink issue #2614: [FLINK-4773] Intoduce OperatorIOMetricGroup

2016-10-21 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2614 I think this is a good refactoring. +1 to merge. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] flink issue #2615: [FLINK-4772] [FLINK-4775] Metric Store enhancements

2016-10-21 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2615 Storing numbers as strings is not terribly efficient, but since this only affects the web frontend, its okay. +1 to merge. --- If your project is set up for it, you can reply

[GitHub] flink pull request #2448: [FLINK-3030][web frontend] Enhance dashboard to sh...

2016-10-21 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2448#discussion_r84459904 --- Diff: flink-runtime-web/src/main/java/org/apache/flink/runtime/webmonitor/handlers/JsonGenerators.java --- @@ -0,0 +1,86 @@ +/* + * Licensed

[GitHub] flink issue #2678: [FLINK-4879] [Kafka-Connector] class KafkaTableSource sho...

2016-10-21 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2678 Thank you for opening a pull request. @fhueske @twalthr @uce I think its okay to make the class public, in case users want to use a custom Kafka consumer, right? --- If your project

[GitHub] flink issue #2677: [FLINK-4780] Make GraphiteReporter protocol configurable

2016-10-21 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2677 +1 change is good to merge. The user who reported the issue tested the fix. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well

[GitHub] flink issue #2636: [FLINK-4784] Unique MetricQueryService actor names

2016-10-21 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2636 Thank you The change is good to merge! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] flink issue #2636: [FLINK-4784] Unique MetricQueryService actor names

2016-10-20 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2636 I tested the change this morning, and its not working: ``` 2016-10-20 11:08:28,216 WARN org.apache.flink.runtime.metrics.MetricRegistry - Could not start Metr

[GitHub] flink pull request #2636: [FLINK-4784] Unique MetricQueryService actor names

2016-10-19 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2636#discussion_r84115204 --- Diff: flink-runtime-web/src/main/java/org/apache/flink/runtime/webmonitor/metrics/MetricFetcher.java --- @@ -148,7 +148,7 @@ public void onSuccess

<    1   2   3   4   5   6   7   8   9   10   >