[jira] [Commented] (FLINK-7002) Partitioning broken if enum is used in compound key specified using field expression

2019-10-04 Thread Sebastian Klemke (Jira)
[ https://issues.apache.org/jira/browse/FLINK-7002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944820#comment-16944820 ] Sebastian Klemke commented on FLINK-7002: - Thanks [~NicoK] for explaining this. > Partitioning

[jira] [Created] (FLINK-11086) flink-hadoop-compatibility tests fail for 3.x hadoop versions

2018-12-06 Thread Sebastian Klemke (JIRA)
Sebastian Klemke created FLINK-11086: Summary: flink-hadoop-compatibility tests fail for 3.x hadoop versions Key: FLINK-11086 URL: https://issues.apache.org/jira/browse/FLINK-11086 Project: Flink

[jira] [Commented] (FLINK-9891) Flink cluster is not shutdown in YARN mode when Flink client is stopped

2018-09-10 Thread Sebastian Klemke (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16608917#comment-16608917 ] Sebastian Klemke commented on FLINK-9891: - [~azagrebin] It's not only parsing log outputs -- it's

[jira] [Commented] (FLINK-9891) Flink cluster is not shutdown in YARN mode when Flink client is stopped

2018-08-13 Thread Sebastian Klemke (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16578017#comment-16578017 ] Sebastian Klemke commented on FLINK-9891: - Exactly, in the past, doing exactly that proved to be

[jira] [Commented] (FLINK-9891) Flink cluster is not shutdown in YARN mode when Flink client is stopped

2018-08-11 Thread Sebastian Klemke (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577359#comment-16577359 ] Sebastian Klemke commented on FLINK-9891: - Thanks [~till.rohrmann] for the detailed explanation.

[jira] [Commented] (FLINK-8230) NPE in OrcRowInputFormat on nested structs

2017-12-10 Thread Sebastian Klemke (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16285250#comment-16285250 ] Sebastian Klemke commented on FLINK-8230: - If possible, I'd like this change to also be merged to

[jira] [Created] (FLINK-8230) NPE in OrcRowInputFormat on nested structs

2017-12-10 Thread Sebastian Klemke (JIRA)
Sebastian Klemke created FLINK-8230: --- Summary: NPE in OrcRowInputFormat on nested structs Key: FLINK-8230 URL: https://issues.apache.org/jira/browse/FLINK-8230 Project: Flink Issue Type:

[jira] [Commented] (FLINK-8186) AvroInputFormat regression: fails to deserialize GenericRecords on standalone cluster with hadoop27 compat

2017-12-04 Thread Sebastian Klemke (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16276842#comment-16276842 ] Sebastian Klemke commented on FLINK-8186: - Thanks to all of you for looking into this. Does it

[jira] [Commented] (FLINK-8186) AvroInputFormat regression: fails to deserialize GenericRecords on standalone cluster with hadoop27 compat

2017-12-01 Thread Sebastian Klemke (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16274913#comment-16274913 ] Sebastian Klemke commented on FLINK-8186: - [~twalthr] Thanks for looking into it. To summarize:

[jira] [Commented] (FLINK-8186) AvroInputFormat regression: fails to deserialize GenericRecords on standalone cluster with hadoop27 compat

2017-12-01 Thread Sebastian Klemke (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16274656#comment-16274656 ] Sebastian Klemke commented on FLINK-8186: - With -Pbuild-jar, the job fat-jar includes avro,

[jira] [Commented] (FLINK-8186) AvroInputFormat regression: fails to deserialize GenericRecords on standalone cluster with hadoop27 compat

2017-12-01 Thread Sebastian Klemke (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16274628#comment-16274628 ] Sebastian Klemke commented on FLINK-8186: - The error only occurs if job jar was built with

[jira] [Commented] (FLINK-8186) AvroInputFormat regression: fails to deserialize GenericRecords on standalone cluster with hadoop27 compat

2017-12-01 Thread Sebastian Klemke (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16274609#comment-16274609 ] Sebastian Klemke commented on FLINK-8186: - Regarding binaries: Yes, this is the runtime I'm using.

[jira] [Commented] (FLINK-8186) AvroInputFormat regression: fails to deserialize GenericRecords on standalone cluster with hadoop27 compat

2017-12-01 Thread Sebastian Klemke (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16274601#comment-16274601 ] Sebastian Klemke commented on FLINK-8186: - What puzzles me is

[jira] [Updated] (FLINK-8186) AvroInputFormat regression: fails to deserialize GenericRecords on standalone cluster with hadoop27 compat

2017-12-01 Thread Sebastian Klemke (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sebastian Klemke updated FLINK-8186: Summary: AvroInputFormat regression: fails to deserialize GenericRecords on standalone

[jira] [Commented] (FLINK-8186) AvroInputFormat regression: fails to deserialize GenericRecords on cluster with hadoop27 compat

2017-12-01 Thread Sebastian Klemke (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16274503#comment-16274503 ] Sebastian Klemke commented on FLINK-8186: - Invocation: {code} flink-1.4.0/bin/jobmanager.sh start

[jira] [Updated] (FLINK-8186) AvroInputFormat regression: fails to deserialize GenericRecords on cluster with hadoop27 compat

2017-12-01 Thread Sebastian Klemke (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sebastian Klemke updated FLINK-8186: Attachment: pom.xml GenericRecordCount.java > AvroInputFormat regression:

[jira] [Commented] (FLINK-8186) AvroInputFormat regression: fails to deserialize GenericRecords on cluster with hadoop27 compat

2017-12-01 Thread Sebastian Klemke (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16274497#comment-16274497 ] Sebastian Klemke commented on FLINK-8186: - Hey [~twalthr], I used the flink-quickstart-java and

[jira] [Commented] (FLINK-8186) AvroInputFormat regression: fails to deserialize GenericRecords on cluster with hadoop27 compat

2017-12-01 Thread Sebastian Klemke (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16274435#comment-16274435 ] Sebastian Klemke commented on FLINK-8186: - Test program runs with Flink 1.4 hadoop27 on YARN. Is

[jira] [Updated] (FLINK-8186) AvroInputFormat regression: fails to deserialize GenericRecords on cluster with hadoop27 compat

2017-12-01 Thread Sebastian Klemke (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sebastian Klemke updated FLINK-8186: Priority: Minor (was: Major) > AvroInputFormat regression: fails to deserialize

[jira] [Created] (FLINK-8186) AvroInputFormat regression: fails to deserialize GenericRecords on cluster with hadoop27 compat

2017-12-01 Thread Sebastian Klemke (JIRA)
Sebastian Klemke created FLINK-8186: --- Summary: AvroInputFormat regression: fails to deserialize GenericRecords on cluster with hadoop27 compat Key: FLINK-8186 URL:

[jira] [Created] (FLINK-7579) Documentation of yarn.application-attempts is not accurate

2017-09-05 Thread Sebastian Klemke (JIRA)
Sebastian Klemke created FLINK-7579: --- Summary: Documentation of yarn.application-attempts is not accurate Key: FLINK-7579 URL: https://issues.apache.org/jira/browse/FLINK-7579 Project: Flink

[jira] [Created] (FLINK-7539) Make AvroOutputFormat default codec configurable

2017-08-27 Thread Sebastian Klemke (JIRA)
Sebastian Klemke created FLINK-7539: --- Summary: Make AvroOutputFormat default codec configurable Key: FLINK-7539 URL: https://issues.apache.org/jira/browse/FLINK-7539 Project: Flink Issue

[jira] [Commented] (FLINK-6965) Avro is missing snappy dependency

2017-07-01 Thread Sebastian Klemke (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16071454#comment-16071454 ] Sebastian Klemke commented on FLINK-6965: - flink-avro connector for DataSet API is also affected:

[jira] [Updated] (FLINK-7002) Partitioning broken if enum is used in compound key specified using field expression

2017-06-25 Thread Sebastian Klemke (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sebastian Klemke updated FLINK-7002: Attachment: TestJob.java WorkingTestJob.java testdata.avro

[jira] [Created] (FLINK-7002) Partitioning broken if enum is used in compound key specified using field expression

2017-06-25 Thread Sebastian Klemke (JIRA)
Sebastian Klemke created FLINK-7002: --- Summary: Partitioning broken if enum is used in compound key specified using field expression Key: FLINK-7002 URL: https://issues.apache.org/jira/browse/FLINK-7002

[jira] [Commented] (FLINK-4015) FlinkKafkaProducer08 fails when partition leader changes

2016-07-12 Thread Sebastian Klemke (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15372665#comment-15372665 ] Sebastian Klemke commented on FLINK-4015: - No, synchronous wouldn't be fast enough: We have ~11k

[jira] [Commented] (FLINK-4015) FlinkKafkaProducer08 fails when partition leader changes

2016-07-11 Thread Sebastian Klemke (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371216#comment-15371216 ] Sebastian Klemke commented on FLINK-4015: - For our use case, buffering the in-flight records and

[jira] [Commented] (FLINK-4015) FlinkKafkaProducer08 fails when partition leader changes

2016-06-14 Thread Sebastian Klemke (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15329371#comment-15329371 ] Sebastian Klemke commented on FLINK-4015: - For our application, order is more important than

[jira] [Commented] (FLINK-4015) FlinkKafkaProducer08 fails when partition leader changes

2016-06-07 Thread Sebastian Klemke (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15318949#comment-15318949 ] Sebastian Klemke commented on FLINK-4015: - For our application, it should never drop records.

[jira] [Commented] (FLINK-4015) FlinkKafkaProducer08 fails when partition leader changes

2016-06-03 Thread Sebastian Klemke (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15314042#comment-15314042 ] Sebastian Klemke commented on FLINK-4015: - We use default retries: 0. Also, we can't set retries

[jira] [Created] (FLINK-4015) FlinkKafkaProducer08 fails when partition leader changes

2016-06-03 Thread Sebastian Klemke (JIRA)
Sebastian Klemke created FLINK-4015: --- Summary: FlinkKafkaProducer08 fails when partition leader changes Key: FLINK-4015 URL: https://issues.apache.org/jira/browse/FLINK-4015 Project: Flink

[jira] [Updated] (FLINK-3937) Make flink cli list, savepoint, cancel and stop work on Flink-on-YARN clusters

2016-05-19 Thread Sebastian Klemke (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sebastian Klemke updated FLINK-3937: Attachment: improve_flink_cli_yarn_integration.patch Patch that implements -yid option.

[jira] [Created] (FLINK-3937) Make flink cli list, savepoint, cancel and stop work on Flink-on-YARN clusters

2016-05-19 Thread Sebastian Klemke (JIRA)
Sebastian Klemke created FLINK-3937: --- Summary: Make flink cli list, savepoint, cancel and stop work on Flink-on-YARN clusters Key: FLINK-3937 URL: https://issues.apache.org/jira/browse/FLINK-3937

[jira] [Created] (FLINK-3391) Typo in SavepointITCase

2016-02-11 Thread Sebastian Klemke (JIRA)
Sebastian Klemke created FLINK-3391: --- Summary: Typo in SavepointITCase Key: FLINK-3391 URL: https://issues.apache.org/jira/browse/FLINK-3391 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-3390) Savepoint resume is not retried

2016-02-11 Thread Sebastian Klemke (JIRA)
Sebastian Klemke created FLINK-3390: --- Summary: Savepoint resume is not retried Key: FLINK-3390 URL: https://issues.apache.org/jira/browse/FLINK-3390 Project: Flink Issue Type: Bug

[jira] [Updated] (FLINK-3390) Savepoint resume is not retried

2016-02-11 Thread Sebastian Klemke (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sebastian Klemke updated FLINK-3390: Attachment: savepoint_restore_violates_exactly_once.patch Test case to reproduce this

[jira] [Created] (FLINK-3304) AvroOutputFormat.setSchema() doesn't work in yarn-cluster mode

2016-01-29 Thread Sebastian Klemke (JIRA)
Sebastian Klemke created FLINK-3304: --- Summary: AvroOutputFormat.setSchema() doesn't work in yarn-cluster mode Key: FLINK-3304 URL: https://issues.apache.org/jira/browse/FLINK-3304 Project: Flink

[jira] [Updated] (FLINK-3188) Deletes in Kafka source should be passed on to KeyedDeserializationSchema

2016-01-04 Thread Sebastian Klemke (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sebastian Klemke updated FLINK-3188: Attachment: testcase.patch Test case for the patch > Deletes in Kafka source should be

[jira] [Created] (FLINK-3190) Retry rate limits for DataStream API

2015-12-23 Thread Sebastian Klemke (JIRA)
Sebastian Klemke created FLINK-3190: --- Summary: Retry rate limits for DataStream API Key: FLINK-3190 URL: https://issues.apache.org/jira/browse/FLINK-3190 Project: Flink Issue Type:

[jira] [Commented] (FLINK-3188) Deletes in Kafka source should be passed on to KeyedDeserializationSchema

2015-12-21 Thread Sebastian Klemke (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15066657#comment-15066657 ] Sebastian Klemke commented on FLINK-3188: - Unfortunately, we also didn't have the time to look

[jira] [Created] (FLINK-3188) Deletes in Kafka source should be passed on to KeyedDeserializationSchema

2015-12-18 Thread Sebastian Klemke (JIRA)
Sebastian Klemke created FLINK-3188: --- Summary: Deletes in Kafka source should be passed on to KeyedDeserializationSchema Key: FLINK-3188 URL: https://issues.apache.org/jira/browse/FLINK-3188