[jira] [Commented] (FLINK-4616) Kafka consumer doesn't store last emmited watermarks per partition in state

2016-12-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15763551#comment-15763551 ] ASF GitHub Bot commented on FLINK-4616: --- GitHub user MayerRoman opened a pull request:

[GitHub] flink pull request #3031: [FLINK-4616] Added functionality through which wat...

2016-12-19 Thread MayerRoman
GitHub user MayerRoman opened a pull request: https://github.com/apache/flink/pull/3031 [FLINK-4616] Added functionality through which watermarks for each pa… …rtition are saved and loaded via checkpointing mechanism [FLINK-4616] Kafka consumer doesn't store last

[jira] [Commented] (FLINK-4391) Provide support for asynchronous operations over streams

2016-12-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15763277#comment-15763277 ] ASF GitHub Bot commented on FLINK-4391: --- Github user asfgit closed the pull request at:

[GitHub] flink pull request #2629: [FLINK-4391] Provide support for asynchronous oper...

2016-12-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/2629 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Resolved] (FLINK-4391) Provide support for asynchronous operations over streams

2016-12-19 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann resolved FLINK-4391. -- Resolution: Fixed Added via f52830763d8f95a955c10265e2c3543a5890e719 > Provide support for

[jira] [Updated] (FLINK-5370) build failure for unit test of FileInputFormatTest and GlobFilePathFilterTest

2016-12-19 Thread shijinkui (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shijinkui updated FLINK-5370: - Description: mvn clean package head commit 4a27d2105dd08f323c0be26e79a55986aa97e7bd Results : Failed

[jira] [Created] (FLINK-5370) build failure for unit test of FileInputFormatTest and GlobFilePathFilterTest

2016-12-19 Thread shijinkui (JIRA)
shijinkui created FLINK-5370: Summary: build failure for unit test of FileInputFormatTest and GlobFilePathFilterTest Key: FLINK-5370 URL: https://issues.apache.org/jira/browse/FLINK-5370 Project: Flink

[jira] [Commented] (FLINK-5342) Setting the parallelism automatically for operators base on cost model

2016-12-19 Thread godfrey he (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15762989#comment-15762989 ] godfrey he commented on FLINK-5342: --- I think it's difficult and unintuitive about tuning the parallelism

[jira] [Comment Edited] (FLINK-4848) keystoreFilePath should be checked against null in SSLUtils#createSSLServerContext

2016-12-19 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15582930#comment-15582930 ] Ted Yu edited comment on FLINK-4848 at 12/20/16 2:12 AM: - There is similar issue

[jira] [Commented] (FLINK-5358) Support RowTypeInfo extraction in TypeExtractor by Row instance

2016-12-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15762944#comment-15762944 ] ASF GitHub Bot commented on FLINK-5358: --- Github user wuchong commented on a diff in the pull

[GitHub] flink pull request #3027: [FLINK-5358] add RowTypeInfo exctraction in TypeEx...

2016-12-19 Thread wuchong
Github user wuchong commented on a diff in the pull request: https://github.com/apache/flink/pull/3027#discussion_r93159119 --- Diff: flink-core/src/test/java/org/apache/flink/api/java/typeutils/TypeExtractorTest.java --- @@ -345,8 +346,22 @@ public CustomType cross(CustomType

[jira] [Commented] (FLINK-5358) Support RowTypeInfo extraction in TypeExtractor by Row instance

2016-12-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15762945#comment-15762945 ] ASF GitHub Bot commented on FLINK-5358: --- Github user wuchong commented on a diff in the pull

[GitHub] flink pull request #3027: [FLINK-5358] add RowTypeInfo exctraction in TypeEx...

2016-12-19 Thread wuchong
Github user wuchong commented on a diff in the pull request: https://github.com/apache/flink/pull/3027#discussion_r93159264 --- Diff: flink-core/src/test/java/org/apache/flink/api/java/typeutils/TypeExtractorTest.java --- @@ -345,8 +346,22 @@ public CustomType cross(CustomType

[GitHub] flink pull request #3030: Updated version of #3014

2016-12-19 Thread StephanEwen
GitHub user StephanEwen opened a pull request: https://github.com/apache/flink/pull/3030 Updated version of #3014 Updated version of #3014 You can merge this pull request into a Git repository by running: $ git pull https://github.com/StephanEwen/incubator-flink greg

[jira] [Commented] (FLINK-5369) Rework jsr305 and logging dependencies

2016-12-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15762228#comment-15762228 ] ASF GitHub Bot commented on FLINK-5369: --- Github user StephanEwen commented on the issue:

[GitHub] flink issue #3029: [FLINK-5369] [build] Rework jsr305 and logging dependenci...

2016-12-19 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/3029 I think this is a quite crucial change for 1.2, because dependency structure cannot be changed in minor releases. @rmetzger to your attention --- If your project is set up for it, you

[jira] [Commented] (FLINK-4861) Package optional project artifacts

2016-12-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15762227#comment-15762227 ] ASF GitHub Bot commented on FLINK-4861: --- Github user StephanEwen commented on the issue:

[GitHub] flink issue #3014: [FLINK-4861] [build] Package optional project artifacts

2016-12-19 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/3014 I have an update with the mentioned changes. Will push that once #3029 gets approval. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[jira] [Commented] (FLINK-4861) Package optional project artifacts

2016-12-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15762168#comment-15762168 ] ASF GitHub Bot commented on FLINK-4861: --- Github user StephanEwen commented on the issue:

[GitHub] flink issue #3014: [FLINK-4861] [build] Package optional project artifacts

2016-12-19 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/3014 Actually, just saw that `flink-gelly-scala` does not build a "jar-with-dependencies". Also, gelly and gelly-scala still have the ASM dependency (which seems not necessary any more). We

[jira] [Updated] (FLINK-5369) Rework jsr305 and logging dependencies

2016-12-19 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen updated FLINK-5369: Summary: Rework jsr305 and logging dependencies (was: jsr305 and logging dependencies should be

[jira] [Closed] (FLINK-4782) log4j & slf4j-log4j are present in jar-with-dependencies artifacts

2016-12-19 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen closed FLINK-4782. --- Resolution: Duplicate > log4j & slf4j-log4j are present in jar-with-dependencies artifacts >

[jira] [Updated] (FLINK-5369) jsr305 and logging dependencies should be 'provided' by default

2016-12-19 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen updated FLINK-5369: Description: Currently, every project in Flink has a hard (compile scope) dependency on the

[jira] [Commented] (FLINK-5364) Rework JAAS configuration to support user-supplied entries

2016-12-19 Thread Eron Wright (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15761960#comment-15761960 ] Eron Wright commented on FLINK-5364: - [~trohrm...@apache.org] [~mxm] Bringing this to your attention

[jira] [Updated] (FLINK-5364) Rework JAAS configuration to support user-supplied entries

2016-12-19 Thread Eron Wright (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eron Wright updated FLINK-5364: Description: Recent issues (see linked) have brought to light a critical deficiency in the

[jira] [Updated] (FLINK-5364) Rework JAAS configuration to support user-supplied entries

2016-12-19 Thread Eron Wright (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eron Wright updated FLINK-5364: Description: Recent issues (see linked) have brought to light a critical deficiency in the

[jira] [Commented] (FLINK-4988) Elasticsearch 5.x support

2016-12-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15761814#comment-15761814 ] ASF GitHub Bot commented on FLINK-4988: --- Github user mikedias commented on the issue:

[GitHub] flink issue #2767: [FLINK-4988] Elasticsearch 5.x support

2016-12-19 Thread mikedias
Github user mikedias commented on the issue: https://github.com/apache/flink/pull/2767 I have no problem in hosting the connector in my github account. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[jira] [Commented] (FLINK-4782) log4j & slf4j-log4j are present in jar-with-dependencies artifacts

2016-12-19 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15761758#comment-15761758 ] Stephan Ewen commented on FLINK-4782: - This is subsumed by FLINK-5369 > log4j & slf4j-log4j are

[jira] [Commented] (FLINK-4861) Package optional project artifacts

2016-12-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15761753#comment-15761753 ] ASF GitHub Bot commented on FLINK-4861: --- Github user StephanEwen commented on the issue:

[GitHub] flink issue #3014: [FLINK-4861] [build] Package optional project artifacts

2016-12-19 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/3014 Pull request #3029 is the prerequisite for this pull request to work nicely. Once that is merged, we can merge this one here as is. --- If your project is set up for it, you can reply to this

[jira] [Commented] (FLINK-5369) jsr305 and logging dependencies should be 'provided' by default

2016-12-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15761749#comment-15761749 ] ASF GitHub Bot commented on FLINK-5369: --- GitHub user StephanEwen opened a pull request:

[GitHub] flink pull request #3029: [FLINK-5369] [build] Set jsr305 and logging depend...

2016-12-19 Thread StephanEwen
GitHub user StephanEwen opened a pull request: https://github.com/apache/flink/pull/3029 [FLINK-5369] [build] Set jsr305 and logging dependencies to 'provided' by default. Currently, every project in Flink has a hard (compile scope) dependency on the `jsr305`, `slf4j`, `log4j`,

[jira] [Comment Edited] (FLINK-5256) Extend DataSetSingleRowJoin to support Left and Right joins

2016-12-19 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15761740#comment-15761740 ] Fabian Hueske edited comment on FLINK-5256 at 12/19/16 5:21 PM: Sure, the

[jira] [Commented] (FLINK-5256) Extend DataSetSingleRowJoin to support Left and Right joins

2016-12-19 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15761740#comment-15761740 ] Fabian Hueske commented on FLINK-5256: -- Sure, the plan I got was the logical plan before optimization

[jira] [Commented] (FLINK-5256) Extend DataSetSingleRowJoin to support Left and Right joins

2016-12-19 Thread Anton Mushin (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15761698#comment-15761698 ] Anton Mushin commented on FLINK-5256: - Hi [~fhueske], Where did you get the plan? i tried execute your

[jira] [Created] (FLINK-5369) jsr305 and logging dependencies should be 'provided' by default

2016-12-19 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-5369: --- Summary: jsr305 and logging dependencies should be 'provided' by default Key: FLINK-5369 URL: https://issues.apache.org/jira/browse/FLINK-5369 Project: Flink

[jira] [Commented] (FLINK-5353) Elasticsearch Sink loses well-formed documents when there are malformed documents

2016-12-19 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15761537#comment-15761537 ] Robert Metzger commented on FLINK-5353: --- Okay, I will do some experiments to see what's going on >

[GitHub] flink issue #2861: [FLINK-5122] Index requests will be retried if the error ...

2016-12-19 Thread fpompermaier
Github user fpompermaier commented on the issue: https://github.com/apache/flink/pull/2861 Indeed my goal is to replace completely Logstash with Flink becuase Flink is much faster (Logstash is the official Elasticsearch indexer). On a 10 M docs Flink takes 10 min while Logstash 30

[jira] [Commented] (FLINK-5122) Elasticsearch Sink loses documents when cluster has high load

2016-12-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15761480#comment-15761480 ] ASF GitHub Bot commented on FLINK-5122: --- Github user fpompermaier commented on the issue:

[jira] [Commented] (FLINK-4988) Elasticsearch 5.x support

2016-12-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15761459#comment-15761459 ] ASF GitHub Bot commented on FLINK-4988: --- Github user rmetzger commented on the issue:

[jira] [Commented] (FLINK-4988) Elasticsearch 5.x support

2016-12-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15761456#comment-15761456 ] ASF GitHub Bot commented on FLINK-4988: --- Github user rmetzger commented on a diff in the pull

[jira] [Commented] (FLINK-5353) Elasticsearch Sink loses well-formed documents when there are malformed documents

2016-12-19 Thread Flavio Pompermaier (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15761472#comment-15761472 ] Flavio Pompermaier commented on FLINK-5353: --- I just remember that in the afterBulk the error was

[GitHub] flink pull request #3028: [FLINK-5367] Restore doc changes that were lost wh...

2016-12-19 Thread alpinegizmo
GitHub user alpinegizmo opened a pull request: https://github.com/apache/flink/pull/3028 [FLINK-5367] Restore doc changes that were lost when merging ... These doc updates were unfortunately lost when merging the recent documentation refactoring. This PR puts those missing edits

[jira] [Commented] (FLINK-5367) restore updates lost when merging recent doc refactoring

2016-12-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15761466#comment-15761466 ] ASF GitHub Bot commented on FLINK-5367: --- GitHub user alpinegizmo opened a pull request:

[GitHub] flink issue #2767: [FLINK-4988] Elasticsearch 5.x support

2016-12-19 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2767 @StephanEwen I'll start a discussion on the mailing list to decide how we want to proceed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] flink pull request #2767: [FLINK-4988] Elasticsearch 5.x support

2016-12-19 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2767#discussion_r93053073 --- Diff: flink-streaming-connectors/flink-connector-elasticsearch5/pom.xml --- @@ -0,0 +1,93 @@ + + +http://maven.apache.org/POM/4.0.0; +

[jira] [Commented] (FLINK-4988) Elasticsearch 5.x support

2016-12-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15761458#comment-15761458 ] ASF GitHub Bot commented on FLINK-4988: --- Github user rmetzger commented on a diff in the pull

[GitHub] flink pull request #2767: [FLINK-4988] Elasticsearch 5.x support

2016-12-19 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2767#discussion_r93052912 --- Diff: flink-streaming-connectors/flink-connector-elasticsearch5/pom.xml --- @@ -0,0 +1,93 @@ + + +http://maven.apache.org/POM/4.0.0; +

[jira] [Commented] (FLINK-5353) Elasticsearch Sink loses well-formed documents when there are malformed documents

2016-12-19 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15761442#comment-15761442 ] Robert Metzger commented on FLINK-5353: --- Do you have any information why ES is loosing those

[jira] [Commented] (FLINK-5122) Elasticsearch Sink loses documents when cluster has high load

2016-12-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15761439#comment-15761439 ] ASF GitHub Bot commented on FLINK-5122: --- Github user rmetzger commented on the issue:

[GitHub] flink issue #2861: [FLINK-5122] Index requests will be retried if the error ...

2016-12-19 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2861 @fpompermaier I guess logstash is just a client to ES that implement its own retry logic (similar to Flink). I'll check out the JIRA. --- If your project is set up for it, you can reply to

[jira] [Commented] (FLINK-5122) Elasticsearch Sink loses documents when cluster has high load

2016-12-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15761429#comment-15761429 ] ASF GitHub Bot commented on FLINK-5122: --- Github user rmetzger commented on a diff in the pull

[jira] [Commented] (FLINK-5122) Elasticsearch Sink loses documents when cluster has high load

2016-12-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15761430#comment-15761430 ] ASF GitHub Bot commented on FLINK-5122: --- Github user rmetzger commented on a diff in the pull

[GitHub] flink pull request #2861: [FLINK-5122] Index requests will be retried if the...

2016-12-19 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2861#discussion_r93049169 --- Diff: flink-streaming-connectors/flink-connector-elasticsearch2/src/main/java/org/apache/flink/streaming/connectors/elasticsearch2/ElasticsearchSink.java

[jira] [Commented] (FLINK-5122) Elasticsearch Sink loses documents when cluster has high load

2016-12-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15761427#comment-15761427 ] ASF GitHub Bot commented on FLINK-5122: --- Github user fpompermaier commented on the issue:

[GitHub] flink pull request #2861: [FLINK-5122] Index requests will be retried if the...

2016-12-19 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2861#discussion_r93048695 --- Diff: flink-streaming-connectors/flink-connector-elasticsearch2/src/main/java/org/apache/flink/streaming/connectors/elasticsearch2/ElasticsearchSink.java

[GitHub] flink issue #2861: [FLINK-5122] Index requests will be retried if the error ...

2016-12-19 Thread fpompermaier
Github user fpompermaier commented on the issue: https://github.com/apache/flink/pull/2861 @rmetzger Are you sure that Logstash doesn't perform any retry logic..? For example https://logstash.jira.com/browse/LOGSTASH-720 seems to implement that.. You can test document loss in the

[GitHub] flink issue #3014: [FLINK-4861] [build] Package optional project artifacts

2016-12-19 Thread greghogan
Github user greghogan commented on the issue: https://github.com/apache/flink/pull/3014 Thanks @StephanEwen. FLINK-4782 may be related in the handling of provided dependencies (external, in that case). --- If your project is set up for it, you can reply to this email and have your

[jira] [Updated] (FLINK-5368) Let Kafka consumer show something when it fails to read one topic out of topic list

2016-12-19 Thread Sendoh (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sendoh updated FLINK-5368: -- Description: As a developer when reading data from many topics, I want Kafka consumer to throw Exception or

[jira] [Updated] (FLINK-5368) Let Kafka consumer show something when it fails to read one topic out of topic list

2016-12-19 Thread Sendoh (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sendoh updated FLINK-5368: -- Priority: Critical (was: Minor) > Let Kafka consumer show something when it fails to read one topic out of >

[jira] [Updated] (FLINK-5368) Let Kafka consumer show something when it fails to read one topic out of topic list

2016-12-19 Thread Sendoh (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sendoh updated FLINK-5368: -- Description: As a developer when reading data from many topics, I want Kafka consumer to show something if any

[jira] [Updated] (FLINK-5368) Let Kafka consumer show something when it fails to read one topic out of topic list

2016-12-19 Thread Sendoh (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sendoh updated FLINK-5368: -- Description: As a developer when reading data from many topics, I want Kafka consumer show something if any

[jira] [Created] (FLINK-5368) Let Kafka consumer show something when it fails to read one topic out of topic list

2016-12-19 Thread Sendoh (JIRA)
Sendoh created FLINK-5368: - Summary: Let Kafka consumer show something when it fails to read one topic out of topic list Key: FLINK-5368 URL: https://issues.apache.org/jira/browse/FLINK-5368 Project: Flink

[jira] [Updated] (FLINK-5368) Let Kafka consumer show something when it fails to read one topic out of topic list

2016-12-19 Thread Sendoh (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sendoh updated FLINK-5368: -- Description: As a developer when reading data from many topics, I want Kafka consumer to throw Exception or

[GitHub] flink issue #2861: [FLINK-5122] Index requests will be retried if the error ...

2016-12-19 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2861 @fpompermaier Why is throwing exceptions in close causing document losses? As far as I can see ES is flushing all outstanding batches on close(). --- If your project is set up for it, you can

[jira] [Commented] (FLINK-5122) Elasticsearch Sink loses documents when cluster has high load

2016-12-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15761400#comment-15761400 ] ASF GitHub Bot commented on FLINK-5122: --- Github user rmetzger commented on the issue:

[jira] [Commented] (FLINK-5122) Elasticsearch Sink loses documents when cluster has high load

2016-12-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15761341#comment-15761341 ] ASF GitHub Bot commented on FLINK-5122: --- Github user rmetzger commented on a diff in the pull

[GitHub] flink pull request #2861: [FLINK-5122] Index requests will be retried if the...

2016-12-19 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2861#discussion_r93045771 --- Diff: flink-streaming-connectors/flink-connector-elasticsearch2/src/main/java/org/apache/flink/streaming/connectors/elasticsearch2/ElasticsearchSink.java

[GitHub] flink pull request #2861: [FLINK-5122] Index requests will be retried if the...

2016-12-19 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2861#discussion_r93043759 --- Diff: flink-streaming-connectors/flink-connector-elasticsearch2/src/main/java/org/apache/flink/streaming/connectors/elasticsearch2/ElasticsearchSink.java

[jira] [Commented] (FLINK-5122) Elasticsearch Sink loses documents when cluster has high load

2016-12-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15761324#comment-15761324 ] ASF GitHub Bot commented on FLINK-5122: --- Github user rmetzger commented on a diff in the pull

[GitHub] flink issue #3014: [FLINK-4861] [build] Package optional project artifacts

2016-12-19 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/3014 Okay, the approach of this pull request looks good, but there are two things we need to adjust: - The fat jar from the `flink-ml` project contains all dependencies. I think that is

[GitHub] flink issue #3014: [FLINK-4861] [build] Package optional project artifacts

2016-12-19 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/3014 I'll try to address that, then merge this pull request... --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] flink issue #2861: [FLINK-5122] Index requests will be retried if the error ...

2016-12-19 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2861 I checked the elasticsearch documentation and some user forum from ES, and indeed it seems that they do not include any retry logic into their clients. --- If your project is set up for it, you

[jira] [Commented] (FLINK-4861) Package optional project artifacts

2016-12-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15761292#comment-15761292 ] ASF GitHub Bot commented on FLINK-4861: --- Github user StephanEwen commented on the issue:

[jira] [Commented] (FLINK-5122) Elasticsearch Sink loses documents when cluster has high load

2016-12-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15761291#comment-15761291 ] ASF GitHub Bot commented on FLINK-5122: --- Github user rmetzger commented on the issue:

[jira] [Commented] (FLINK-4861) Package optional project artifacts

2016-12-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15761294#comment-15761294 ] ASF GitHub Bot commented on FLINK-4861: --- Github user StephanEwen commented on the issue:

[jira] [Commented] (FLINK-4988) Elasticsearch 5.x support

2016-12-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15761242#comment-15761242 ] ASF GitHub Bot commented on FLINK-4988: --- Github user StephanEwen commented on the issue:

[GitHub] flink issue #2767: [FLINK-4988] Elasticsearch 5.x support

2016-12-19 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/2767 @mikedias @rmetzger How do we proceed with this pull request? Should it become part of Flink, Bahir, or should hosted in the contributor's repository? --- If your project is set up for it,

[jira] [Commented] (FLINK-4861) Package optional project artifacts

2016-12-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15761207#comment-15761207 ] ASF GitHub Bot commented on FLINK-4861: --- Github user StephanEwen commented on the issue:

[GitHub] flink issue #3014: [FLINK-4861] [build] Package optional project artifacts

2016-12-19 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/3014 Checking this out now... --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[jira] [Commented] (FLINK-5358) Support RowTypeInfo extraction in TypeExtractor by Row instance

2016-12-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15761162#comment-15761162 ] ASF GitHub Bot commented on FLINK-5358: --- GitHub user tonycox opened a pull request:

[GitHub] flink pull request #3027: [FLINK-5358] add RowTypeInfo exctraction in TypeEx...

2016-12-19 Thread tonycox
GitHub user tonycox opened a pull request: https://github.com/apache/flink/pull/3027 [FLINK-5358] add RowTypeInfo exctraction in TypeExtractor Thanks for contributing to Apache Flink. Before you open your pull request, please take the following check list into consideration. If

[jira] [Commented] (FLINK-2821) Change Akka configuration to allow accessing actors from different URLs

2016-12-19 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15761149#comment-15761149 ] Stephan Ewen commented on FLINK-2821: - I think most other endpoints are not affected by the same

[jira] [Commented] (FLINK-5258) reorganize the docs to improve navigation and reduce duplication

2016-12-19 Thread David Anderson (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15761105#comment-15761105 ] David Anderson commented on FLINK-5258: --- Thanks for tracking down what got lost. I'll take care of

[jira] [Commented] (FLINK-5342) Setting the parallelism automatically for operators base on cost model

2016-12-19 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15761106#comment-15761106 ] Fabian Hueske commented on FLINK-5342: -- Yes, I think the {{TableConfig}} would be a good place to add

[jira] [Updated] (FLINK-3150) Make YARN container invocation configurable

2016-12-19 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger updated FLINK-3150: -- Labels: qa (was: ) > Make YARN container invocation configurable >

[jira] [Commented] (FLINK-3150) Make YARN container invocation configurable

2016-12-19 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15761074#comment-15761074 ] Robert Metzger commented on FLINK-3150: --- I ran into this issue again. I'll try to open a PR for it

[jira] [Commented] (FLINK-5358) Support RowTypeInfo extraction in TypeExtractor by Row instance

2016-12-19 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15761069#comment-15761069 ] Fabian Hueske commented on FLINK-5358: -- Very good point [~jark], in that case the type extraction

[jira] [Created] (FLINK-5367) restore updates lost when merging recent doc refactoring

2016-12-19 Thread David Anderson (JIRA)
David Anderson created FLINK-5367: - Summary: restore updates lost when merging recent doc refactoring Key: FLINK-5367 URL: https://issues.apache.org/jira/browse/FLINK-5367 Project: Flink

[jira] [Commented] (FLINK-5358) Support RowTypeInfo extraction in TypeExtractor by Row instance

2016-12-19 Thread Jark Wu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15761026#comment-15761026 ] Jark Wu commented on FLINK-5358: If one of the fields is null, what is the {{TypeInformation}} of this

[jira] [Updated] (FLINK-5358) Support RowTypeInfo extraction in TypeExtractor by Row instance

2016-12-19 Thread Anton Solovev (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Solovev updated FLINK-5358: - Summary: Support RowTypeInfo extraction in TypeExtractor by Row instance (was: Support Row in

[jira] [Commented] (FLINK-5358) Support Row in TypeExtractor

2016-12-19 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15761003#comment-15761003 ] Fabian Hueske commented on FLINK-5358: -- Hi [~tonycox], I think we need to make the JIRA title a bit

[jira] [Comment Edited] (FLINK-5280) Extend TableSource to support nested data

2016-12-19 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15760985#comment-15760985 ] Fabian Hueske edited comment on FLINK-5280 at 12/19/16 11:58 AM: - Sorry

[jira] [Commented] (FLINK-5280) Extend TableSource to support nested data

2016-12-19 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15760985#comment-15760985 ] Fabian Hueske commented on FLINK-5280: -- Sorry for my late response. I'll try to answer your questions

[jira] [Comment Edited] (FLINK-5280) Extend TableSource to support nested data

2016-12-19 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15744952#comment-15744952 ] Fabian Hueske edited comment on FLINK-5280 at 12/19/16 11:05 AM: - Hi

[jira] [Commented] (FLINK-5258) reorganize the docs to improve navigation and reduce duplication

2016-12-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15760843#comment-15760843 ] ASF GitHub Bot commented on FLINK-5258: --- Github user fhueske commented on the issue:

[GitHub] flink pull request #3026: [FLINK-2980] [table] Support for GROUPING SETS cla...

2016-12-19 Thread chermenin
GitHub user chermenin opened a pull request: https://github.com/apache/flink/pull/3026 [FLINK-2980] [table] Support for GROUPING SETS clause in Table API. Support for operators GROUPING SETS / ROLLUP / CUBE in Table AP was added in this PR. Also added some tests for check

[GitHub] flink issue #2940: [FLINK-5258] [docs] reorganize the docs to improve naviga...

2016-12-19 Thread fhueske
Github user fhueske commented on the issue: https://github.com/apache/flink/pull/2940 Hi @mindprince, thanks a lot for pointing out this issue. I had a look at the diffs and found that the following changes got lost or refactored: - c024b0b :

[jira] [Commented] (FLINK-2980) Add CUBE/ROLLUP/GROUPING SETS operator in Table API.

2016-12-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15760838#comment-15760838 ] ASF GitHub Bot commented on FLINK-2980: --- GitHub user chermenin opened a pull request:

  1   2   >