[jira] [Commented] (FLINK-8922) Revert FLINK-8859 because it causes segfaults in testing

2018-03-16 Thread Sihua Zhou (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16401522#comment-16401522 ] Sihua Zhou commented on FLINK-8922: --- [~StephanEwen] I tried out your suggestion, still segfaulted, and

[GitHub] flink pull request #5675: [FLINK-7804][flip6] YarnResourceManager does not e...

2018-03-16 Thread GJL
Github user GJL commented on a diff in the pull request: https://github.com/apache/flink/pull/5675#discussion_r175020983 --- Diff: flink-yarn/src/main/java/org/apache/flink/yarn/YarnResourceManager.java --- @@ -395,10 +405,13 @@ public void onNodesUpdated(List list) {

[jira] [Commented] (FLINK-8945) Allow customization of the KinesisProxy

2018-03-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16401539#comment-16401539 ] ASF GitHub Bot commented on FLINK-8945: --- Github user tzulitai commented on the issue:

[jira] [Commented] (FLINK-7151) FLINK SQL support create temporary function and table

2018-03-16 Thread yinhua.dai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16401548#comment-16401548 ] yinhua.dai commented on FLINK-7151: --- [~yuemeng] Any update on this functionality, I would like to do

[GitHub] flink pull request #5675: [FLINK-7804][flip6] YarnResourceManager does not e...

2018-03-16 Thread GJL
Github user GJL commented on a diff in the pull request: https://github.com/apache/flink/pull/5675#discussion_r175020997 --- Diff: flink-yarn/src/main/java/org/apache/flink/yarn/YarnResourceManager.java --- @@ -325,67 +328,74 @@ public float getProgress() { @Override

[jira] [Commented] (FLINK-7804) YarnResourceManager does not execute AMRMClientAsync callbacks in main thread

2018-03-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16401580#comment-16401580 ] ASF GitHub Bot commented on FLINK-7804: --- Github user GJL commented on a diff in the pull request:

[GitHub] flink issue #5698: [FLINK-8945] [kinesis] Allow customization of KinesisProx...

2018-03-16 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/5698 I'm curious why we don't go directly for replacing `describeStreams` with `listShards`. Are there any other concerns for this? ---

[jira] [Commented] (FLINK-7151) FLINK SQL support create temporary function and table

2018-03-16 Thread Shuyi Chen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16401583#comment-16401583 ] Shuyi Chen commented on FLINK-7151: --- Hi [~yinhua], I am actively working on a design doc for Flink SQL

[jira] [Comment Edited] (FLINK-7151) FLINK SQL support create temporary function and table

2018-03-16 Thread Shuyi Chen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16401583#comment-16401583 ] Shuyi Chen edited comment on FLINK-7151 at 3/16/18 8:20 AM: Hi [~yinhua], I am

[jira] [Commented] (FLINK-7804) YarnResourceManager does not execute AMRMClientAsync callbacks in main thread

2018-03-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16401579#comment-16401579 ] ASF GitHub Bot commented on FLINK-7804: --- Github user GJL commented on a diff in the pull request:

[jira] [Commented] (FLINK-8919) Add KeyedProcessFunctionWIthCleanupState

2018-03-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16401686#comment-16401686 ] ASF GitHub Bot commented on FLINK-8919: --- Github user liurenjie1024 commented on the issue:

[jira] [Updated] (FLINK-5601) Window operator does not checkpoint watermarks

2018-03-16 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann updated FLINK-5601: - Affects Version/s: 1.6.0 1.5.0 > Window operator does not checkpoint

[jira] [Created] (FLINK-8970) Add more automated end-to-end tests

2018-03-16 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-8970: Summary: Add more automated end-to-end tests Key: FLINK-8970 URL: https://issues.apache.org/jira/browse/FLINK-8970 Project: Flink Issue Type: Improvement

[jira] [Updated] (FLINK-8910) Introduce automated end-to-end test for local recovery (including sticky scheduling)

2018-03-16 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann updated FLINK-8910: - Issue Type: Sub-task (was: Test) Parent: FLINK-8970 > Introduce automated end-to-end

[jira] [Assigned] (FLINK-8941) SpanningRecordSerializationTest fails on Travis

2018-03-16 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber reassigned FLINK-8941: -- Assignee: Nico Kruber > SpanningRecordSerializationTest fails on Travis >

[jira] [Created] (FLINK-8971) Create general purpose testing job

2018-03-16 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-8971: Summary: Create general purpose testing job Key: FLINK-8971 URL: https://issues.apache.org/jira/browse/FLINK-8971 Project: Flink Issue Type: Task

[jira] [Created] (FLINK-8972) Create general purpose DataSet testing job

2018-03-16 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-8972: Summary: Create general purpose DataSet testing job Key: FLINK-8972 URL: https://issues.apache.org/jira/browse/FLINK-8972 Project: Flink Issue Type: Task

[jira] [Updated] (FLINK-8972) Create general purpose DataSet testing job

2018-03-16 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann updated FLINK-8972: - Description: Likewise to FLINK-8971, we should have a general purpose testing job for the

[jira] [Updated] (FLINK-8971) Create general purpose testing job

2018-03-16 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann updated FLINK-8971: - Description: In order to write better end-to-end tests we need a general purpose testing job

[jira] [Created] (FLINK-8973) End-to-end test: Run general purpose job with failures in standalone mode

2018-03-16 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-8973: Summary: End-to-end test: Run general purpose job with failures in standalone mode Key: FLINK-8973 URL: https://issues.apache.org/jira/browse/FLINK-8973 Project:

[jira] [Updated] (FLINK-8973) End-to-end test: Run general purpose job with failures in standalone mode

2018-03-16 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann updated FLINK-8973: - Description: We should set up an end-to-end test which runs the general purpose job (FLINK-8971)

[jira] [Created] (FLINK-8974) End-to-end test: Run general purpose DataSet job with failures in standalone mode

2018-03-16 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-8974: Summary: End-to-end test: Run general purpose DataSet job with failures in standalone mode Key: FLINK-8974 URL: https://issues.apache.org/jira/browse/FLINK-8974

[jira] [Created] (FLINK-8975) End-to-end test: Resume from savepoint

2018-03-16 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-8975: Summary: End-to-end test: Resume from savepoint Key: FLINK-8975 URL: https://issues.apache.org/jira/browse/FLINK-8975 Project: Flink Issue Type: Sub-task

[jira] [Assigned] (FLINK-8972) Create general purpose DataSet testing job

2018-03-16 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabian Hueske reassigned FLINK-8972: Assignee: Fabian Hueske > Create general purpose DataSet testing job >

[jira] [Created] (FLINK-8976) End-to-end test: Resume with different parallelism

2018-03-16 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-8976: Summary: End-to-end test: Resume with different parallelism Key: FLINK-8976 URL: https://issues.apache.org/jira/browse/FLINK-8976 Project: Flink Issue Type:

[GitHub] flink pull request #5706: [FLINK-8903] [table] Fix VAR_SAMP, VAR_POP, STDDEV...

2018-03-16 Thread fhueske
Github user fhueske commented on a diff in the pull request: https://github.com/apache/flink/pull/5706#discussion_r175055646 --- Diff: flink-libraries/flink-table/src/main/java/org/apache/calcite/rel/rules/AggregateReduceFunctionsRule.java --- @@ -0,0 +1,590 @@ +/* + *

[jira] [Created] (FLINK-8977) End-to-end test: Manually resume job after terminal failure

2018-03-16 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-8977: Summary: End-to-end test: Manually resume job after terminal failure Key: FLINK-8977 URL: https://issues.apache.org/jira/browse/FLINK-8977 Project: Flink

[jira] [Created] (FLINK-8978) End-to-end test: Job upgrade

2018-03-16 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-8978: Summary: End-to-end test: Job upgrade Key: FLINK-8978 URL: https://issues.apache.org/jira/browse/FLINK-8978 Project: Flink Issue Type: Sub-task

[GitHub] flink pull request #5706: [FLINK-8903] [table] Fix VAR_SAMP, VAR_POP, STDDEV...

2018-03-16 Thread fhueske
Github user fhueske commented on a diff in the pull request: https://github.com/apache/flink/pull/5706#discussion_r175056688 --- Diff: flink-libraries/flink-table/src/main/scala/org/apache/flink/table/plan/nodes/logical/FlinkLogicalWindowAggregate.scala --- @@ -103,6 +106,19 @@

[jira] [Commented] (FLINK-8903) Built-in agg functions VAR_POP, VAR_SAMP, STDEV_POP, STDEV_SAMP are broken in Group Windows

2018-03-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16401746#comment-16401746 ] ASF GitHub Bot commented on FLINK-8903: --- Github user fhueske commented on a diff in the pull

[jira] [Commented] (FLINK-5601) Window operator does not checkpoint watermarks

2018-03-16 Thread Kostas Kloudas (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16401627#comment-16401627 ] Kostas Kloudas commented on FLINK-5601: --- This is an important and known issue. It was also

[jira] [Comment Edited] (FLINK-5601) Window operator does not checkpoint watermarks

2018-03-16 Thread Kostas Kloudas (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16401627#comment-16401627 ] Kostas Kloudas edited comment on FLINK-5601 at 3/16/18 9:13 AM: This is an

[jira] [Reopened] (FLINK-7851) Improve scheduling balance in case of fewer sub tasks than input operator

2018-03-16 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann reopened FLINK-7851: -- [~pnowojski] and [~NicoK] reported that this commit has subtle influences how tasks are co-located

[jira] [Comment Edited] (FLINK-7151) FLINK SQL support create temporary function and table

2018-03-16 Thread Shuyi Chen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16401583#comment-16401583 ] Shuyi Chen edited comment on FLINK-7151 at 3/16/18 8:20 AM: Hi [~yinhua], I am

[jira] [Commented] (FLINK-7151) FLINK SQL support create temporary function and table

2018-03-16 Thread yinhua.dai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16401595#comment-16401595 ] yinhua.dai commented on FLINK-7151: --- That's great, thanks [~suez1224] > FLINK SQL support create

[jira] [Comment Edited] (FLINK-7151) FLINK SQL support create temporary function and table

2018-03-16 Thread yinhua.dai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16401595#comment-16401595 ] yinhua.dai edited comment on FLINK-7151 at 3/16/18 8:36 AM: That's great,

[jira] [Updated] (FLINK-5601) Window operator does not checkpoint watermarks

2018-03-16 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann updated FLINK-5601: - Priority: Critical (was: Major) > Window operator does not checkpoint watermarks >

[jira] [Updated] (FLINK-5601) Window operator does not checkpoint watermarks

2018-03-16 Thread Kostas Kloudas (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kostas Kloudas updated FLINK-5601: -- Fix Version/s: 1.6.0 > Window operator does not checkpoint watermarks >

[GitHub] flink issue #5680: [FLINK-8919] Add KeyedProcessFunctionWithCleanupState.

2018-03-16 Thread liurenjie1024
Github user liurenjie1024 commented on the issue: https://github.com/apache/flink/pull/5680 Can anyone help to merge this? ---

[GitHub] flink issue #5624: [FLINK-8402][s3][tests] fix hadoop/presto S3 IT cases for...

2018-03-16 Thread NicoK
Github user NicoK commented on the issue: https://github.com/apache/flink/pull/5624 Unfortunately, this is not entirely under our control, since we rely on the underlying `FileSystem` implementation. I can probably reduce some parts of the tests that may lead to eventual consistent

[jira] [Commented] (FLINK-8402) HadoopS3FileSystemITCase.testDirectoryListing fails on Travis

2018-03-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402247#comment-16402247 ] ASF GitHub Bot commented on FLINK-8402: --- Github user NicoK commented on the issue:

[jira] [Commented] (FLINK-8948) RescalingITCase fails on Travis

2018-03-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402229#comment-16402229 ] ASF GitHub Bot commented on FLINK-8948: --- Github user NicoK commented on the issue:

[jira] [Updated] (FLINK-8993) Add a test operator with keyed state that uses Kryo serializer (registered/unregistered/custom)

2018-03-16 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-8993: -- Summary: Add a test operator with keyed state that uses Kryo serializer

[jira] [Created] (FLINK-8994) Add a test operator with keyed state that uses Avro serializer (from schema/by reflection)

2018-03-16 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-8994: - Summary: Add a test operator with keyed state that uses Avro serializer (from schema/by reflection) Key: FLINK-8994 URL: https://issues.apache.org/jira/browse/FLINK-8994

[jira] [Created] (FLINK-8993) Add a test operator with keyed state that uses Kryo serializer (registered/unregistered)

2018-03-16 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-8993: - Summary: Add a test operator with keyed state that uses Kryo serializer (registered/unregistered) Key: FLINK-8993 URL: https://issues.apache.org/jira/browse/FLINK-8993

[jira] [Created] (FLINK-9002) Add operators with input type that goes through Avro serialization (with schema/generic)

2018-03-16 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-9002: - Summary: Add operators with input type that goes through Avro serialization (with schema/generic) Key: FLINK-9002 URL: https://issues.apache.org/jira/browse/FLINK-9002

[jira] [Resolved] (FLINK-8945) Allow customization of the KinesisProxy

2018-03-16 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen resolved FLINK-8945. - Resolution: Fixed Assignee: Kailash Hassan Dayanand Fix Version/s: 1.5.0 Fixed in

[jira] [Created] (FLINK-9010) NoResourceAvailableException with FLIP-6

2018-03-16 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-9010: -- Summary: NoResourceAvailableException with FLIP-6 Key: FLINK-9010 URL: https://issues.apache.org/jira/browse/FLINK-9010 Project: Flink Issue Type: Improvement

[jira] [Updated] (FLINK-9010) NoResourceAvailableException with FLIP-6

2018-03-16 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-9010: --- Labels: flip-6 (was: ) > NoResourceAvailableException with FLIP-6 >

[jira] [Commented] (FLINK-8945) Allow customization of the KinesisProxy

2018-03-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402218#comment-16402218 ] ASF GitHub Bot commented on FLINK-8945: --- Github user tweise commented on the issue:

[GitHub] flink issue #5710: [FLINK-8948][runtime] Fix IllegalStateException when clos...

2018-03-16 Thread NicoK
Github user NicoK commented on the issue: https://github.com/apache/flink/pull/5710 it may be better to make `BufferBuilder#finish()` idempotent ---

[GitHub] flink issue #5698: [FLINK-8945] [kinesis] Allow customization of KinesisProx...

2018-03-16 Thread tweise
Github user tweise commented on the issue: https://github.com/apache/flink/pull/5698 @StephanEwen thanks for unblocking our work! ---

[jira] [Commented] (FLINK-8922) Revert FLINK-8859 because it causes segfaults in testing

2018-03-16 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402251#comment-16402251 ] Aljoscha Krettek commented on FLINK-8922: - [~sihuazhou] Unfortunately, I don't know why the

[jira] [Commented] (FLINK-8843) Decouple bind REST address from advertised address

2018-03-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16401809#comment-16401809 ] ASF GitHub Bot commented on FLINK-8843: --- Github user yanghua commented on a diff in the pull

[GitHub] flink pull request #5632: [FLINK-8843][REST] Decouple bind REST address from...

2018-03-16 Thread yanghua
Github user yanghua commented on a diff in the pull request: https://github.com/apache/flink/pull/5632#discussion_r175073202 --- Diff: flink-core/src/main/java/org/apache/flink/configuration/RestOptions.java --- @@ -33,7 +33,7 @@ */ public static final

[jira] [Created] (FLINK-8989) End-to-end test: ElasticSearch connector

2018-03-16 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-8989: Summary: End-to-end test: ElasticSearch connector Key: FLINK-8989 URL: https://issues.apache.org/jira/browse/FLINK-8989 Project: Flink Issue Type: Sub-task

[jira] [Updated] (FLINK-8998) Add user-defined watermark assigner and timestamp extractor to the test job

2018-03-16 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-8998: -- Affects Version/s: 1.5.0 > Add user-defined watermark assigner and timestamp extractor to the

[jira] [Updated] (FLINK-8998) Add user-defined watermark assigner and timestamp extractor to the test job

2018-03-16 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-8998: -- Component/s: Tests > Add user-defined watermark assigner and timestamp extractor to the test

[jira] [Created] (FLINK-9004) Cluster test: Run general purpose job with failures with Yarn session

2018-03-16 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-9004: Summary: Cluster test: Run general purpose job with failures with Yarn session Key: FLINK-9004 URL: https://issues.apache.org/jira/browse/FLINK-9004 Project: Flink

[jira] [Created] (FLINK-9007) Cluster test: Kinesis connector

2018-03-16 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-9007: Summary: Cluster test: Kinesis connector Key: FLINK-9007 URL: https://issues.apache.org/jira/browse/FLINK-9007 Project: Flink Issue Type: Sub-task

[jira] [Closed] (FLINK-8945) Allow customization of the KinesisProxy

2018-03-16 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen closed FLINK-8945. --- > Allow customization of the KinesisProxy > --- > >

[jira] [Commented] (FLINK-8922) Revert FLINK-8859 because it causes segfaults in testing

2018-03-16 Thread Sihua Zhou (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16401945#comment-16401945 ] Sihua Zhou commented on FLINK-8922: --- [~srichter] Yes, the downside is obvious and I also feel it should

[jira] [Commented] (FLINK-8968) Fix native resource leak caused by ReadOptions

2018-03-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16401952#comment-16401952 ] ASF GitHub Bot commented on FLINK-8968: --- Github user sihuazhou commented on the issue:

[GitHub] flink issue #5705: [FLINK-8968][state]Fix native resource leak caused by Rea...

2018-03-16 Thread sihuazhou
Github user sihuazhou commented on the issue: https://github.com/apache/flink/pull/5705 @StefanRRichter Sorry for pinging you again in this PR, but I found there maybe be another issue for `full checkpoint`. It's about the `kvStateInformation`, we should create a deep copy of

[jira] [Commented] (FLINK-8968) Fix native resource leak caused by ReadOptions

2018-03-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16401994#comment-16401994 ] ASF GitHub Bot commented on FLINK-8968: --- Github user StefanRRichter commented on the issue:

[jira] [Created] (FLINK-9013) Document yarn.containers.vcores only being effective when adapting YARN config

2018-03-16 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-9013: -- Summary: Document yarn.containers.vcores only being effective when adapting YARN config Key: FLINK-9013 URL: https://issues.apache.org/jira/browse/FLINK-9013 Project:

[GitHub] flink pull request #5632: [FLINK-8843][REST] Decouple bind REST address from...

2018-03-16 Thread GJL
Github user GJL commented on a diff in the pull request: https://github.com/apache/flink/pull/5632#discussion_r175072436 --- Diff: flink-core/src/main/java/org/apache/flink/configuration/RestOptions.java --- @@ -33,7 +33,7 @@ */ public static final ConfigOption

[jira] [Commented] (FLINK-8843) Decouple bind REST address from advertised address

2018-03-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16401806#comment-16401806 ] ASF GitHub Bot commented on FLINK-8843: --- Github user GJL commented on a diff in the pull request:

[jira] [Created] (FLINK-8985) End-to-end test: CLI

2018-03-16 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-8985: Summary: End-to-end test: CLI Key: FLINK-8985 URL: https://issues.apache.org/jira/browse/FLINK-8985 Project: Flink Issue Type: Sub-task

[GitHub] flink pull request #5708: [FLINK-8984][network] Drop taskmanager.exactly-onc...

2018-03-16 Thread pnowojski
GitHub user pnowojski opened a pull request: https://github.com/apache/flink/pull/5708 [FLINK-8984][network] Drop taskmanager.exactly-once.blocking.data.enabled config option Previously there were twe options: taskmanager.network.credit-based-flow-control.enabled

[jira] [Created] (FLINK-8995) Add a test operator with keyed state that uses custom, stateful serializer

2018-03-16 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-8995: - Summary: Add a test operator with keyed state that uses custom, stateful serializer Key: FLINK-8995 URL: https://issues.apache.org/jira/browse/FLINK-8995 Project:

[jira] [Updated] (FLINK-8993) Add a test operator with keyed state that uses Kryo serializer (registered/unregistered/custom)

2018-03-16 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter updated FLINK-8993: -- Description: Add an operator with keyed state that uses Kryo serializer

[jira] [Commented] (FLINK-8941) SpanningRecordSerializationTest fails on Travis

2018-03-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16401936#comment-16401936 ] ASF GitHub Bot commented on FLINK-8941: --- GitHub user NicoK opened a pull request:

[jira] [Commented] (FLINK-8073) Test instability FlinkKafkaProducer011ITCase.testScaleDownBeforeFirstCheckpoint()

2018-03-16 Thread Gary Yao (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16401958#comment-16401958 ] Gary Yao commented on FLINK-8073: - Another instance: https://travis-ci.org/apache/flink/jobs/354290449 >

[jira] [Created] (FLINK-8987) End-to-end test: Avro state evolution

2018-03-16 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-8987: Summary: End-to-end test: Avro state evolution Key: FLINK-8987 URL: https://issues.apache.org/jira/browse/FLINK-8987 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-9003) Add operators with input type that goes through custom, stateful serialization

2018-03-16 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-9003: - Summary: Add operators with input type that goes through custom, stateful serialization Key: FLINK-9003 URL: https://issues.apache.org/jira/browse/FLINK-9003

[jira] [Commented] (FLINK-8922) Revert FLINK-8859 because it causes segfaults in testing

2018-03-16 Thread Sihua Zhou (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16401925#comment-16401925 ] Sihua Zhou commented on FLINK-8922: --- Ah, happy to tell you guys that finally I find the way to make it

[jira] [Updated] (FLINK-8941) SpanningRecordSerializationTest fails on Travis

2018-03-16 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-8941: --- Affects Version/s: 1.6.0 1.5.0 > SpanningRecordSerializationTest fails on

[jira] [Updated] (FLINK-8941) SpanningRecordSerializationTest fails on Travis

2018-03-16 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-8941: --- Fix Version/s: 1.6.0 > SpanningRecordSerializationTest fails on Travis >

[GitHub] flink pull request #5709: [FLINK-8941][network][serializer] improve Spanning...

2018-03-16 Thread NicoK
GitHub user NicoK opened a pull request: https://github.com/apache/flink/pull/5709 [FLINK-8941][network][serializer] improve SpanningRecordSerializationTest and ensure unique spilling files ## What is the purpose of the change This PR contains two commits trying to tackle

[jira] [Created] (FLINK-9011) YarnResourceManager spamming log file at INFO level

2018-03-16 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-9011: -- Summary: YarnResourceManager spamming log file at INFO level Key: FLINK-9011 URL: https://issues.apache.org/jira/browse/FLINK-9011 Project: Flink Issue Type:

[jira] [Created] (FLINK-9012) Shaded Hadoop S3A end-to-end test failing with S3 bucket in Ireland

2018-03-16 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-9012: -- Summary: Shaded Hadoop S3A end-to-end test failing with S3 bucket in Ireland Key: FLINK-9012 URL: https://issues.apache.org/jira/browse/FLINK-9012 Project: Flink

[jira] [Assigned] (FLINK-9010) NoResourceAvailableException with FLIP-6

2018-03-16 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber reassigned FLINK-9010: -- Assignee: Nico Kruber > NoResourceAvailableException with FLIP-6 >

[jira] [Created] (FLINK-9001) Add operators with input type that goes through Kryo serialization (registered/generic/custom)

2018-03-16 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-9001: - Summary: Add operators with input type that goes through Kryo serialization (registered/generic/custom) Key: FLINK-9001 URL: https://issues.apache.org/jira/browse/FLINK-9001

[jira] [Assigned] (FLINK-9000) Add automated cluster framework tests

2018-03-16 Thread Gary Yao (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Yao reassigned FLINK-9000: --- Assignee: Gary Yao > Add automated cluster framework tests > - >

[jira] [Created] (FLINK-9005) Cluster test: Run general purpose job with failures with Mesos

2018-03-16 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-9005: Summary: Cluster test: Run general purpose job with failures with Mesos Key: FLINK-9005 URL: https://issues.apache.org/jira/browse/FLINK-9005 Project: Flink

[jira] [Updated] (FLINK-9005) Cluster test: Run general purpose job with failures with Mesos

2018-03-16 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann updated FLINK-9005: - Description: Similar to FLINK-9004, we should run the general purpose job (FLINK-8971) with

[GitHub] flink issue #5705: [FLINK-8968][state]Fix native resource leak caused by Rea...

2018-03-16 Thread StefanRRichter
Github user StefanRRichter commented on the issue: https://github.com/apache/flink/pull/5705 You can cover it here and I will review it again 👍 ---

[GitHub] flink pull request #5707: [FLINK-8843][flip6] Decouple bind REST address fro...

2018-03-16 Thread GJL
GitHub user GJL opened a pull request: https://github.com/apache/flink/pull/5707 [FLINK-8843][flip6] Decouple bind REST address from advertised address ## What is the purpose of the change *The `RestServerEndpoint` is currently bound to the same address which is also

[jira] [Created] (FLINK-8986) End-to-end test: REST

2018-03-16 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-8986: Summary: End-to-end test: REST Key: FLINK-8986 URL: https://issues.apache.org/jira/browse/FLINK-8986 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-8991) End-to-end test: Ganglia metrics reporter

2018-03-16 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-8991: Summary: End-to-end test: Ganglia metrics reporter Key: FLINK-8991 URL: https://issues.apache.org/jira/browse/FLINK-8991 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-8992) Implement source and operator that validate exactly-once

2018-03-16 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-8992: - Summary: Implement source and operator that validate exactly-once Key: FLINK-8992 URL: https://issues.apache.org/jira/browse/FLINK-8992 Project: Flink

[GitHub] flink pull request #5698: [FLINK-8945] [kinesis] Allow customization of Kine...

2018-03-16 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/5698 ---

[jira] [Created] (FLINK-9006) Cluster test: Run general purpose job with failures with Yarn and per-job mode

2018-03-16 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-9006: Summary: Cluster test: Run general purpose job with failures with Yarn and per-job mode Key: FLINK-9006 URL: https://issues.apache.org/jira/browse/FLINK-9006

[jira] [Commented] (FLINK-8922) Revert FLINK-8859 because it causes segfaults in testing

2018-03-16 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16401917#comment-16401917 ] Stephan Ewen commented on FLINK-8922: - [~srichter] and me had a discussion about this today. *Can we

[jira] [Closed] (FLINK-7851) Improve scheduling balance in case of fewer sub tasks than input operator

2018-03-16 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann closed FLINK-7851. Resolution: Won't Fix Reverted via 1.6.0: 91d346e9e7611be530509154cc7034cbde22653d 1.5.0:

[jira] [Updated] (FLINK-9010) NoResourceAvailableException with FLIP-6

2018-03-16 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-9010: --- Issue Type: Bug (was: Improvement) > NoResourceAvailableException with FLIP-6 >

[jira] [Updated] (FLINK-9011) YarnResourceManager spamming log file at INFO level

2018-03-16 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-9011: --- Labels: flip-6 (was: ) > YarnResourceManager spamming log file at INFO level >

[jira] [Commented] (FLINK-8915) CheckpointingStatisticsHandler fails to return PendingCheckpointStats

2018-03-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402054#comment-16402054 ] ASF GitHub Bot commented on FLINK-8915: --- Github user GJL commented on a diff in the pull request:

[GitHub] flink pull request #5703: [FLINK-8915] CheckpointingStatisticsHandler fails ...

2018-03-16 Thread GJL
Github user GJL commented on a diff in the pull request: https://github.com/apache/flink/pull/5703#discussion_r175125460 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/rest/messages/checkpoints/CheckpointStatistics.java --- @@ -438,4 +453,58 @@ public int

  1   2   >