[jira] [Comment Edited] (FLINK-9061) S3 checkpoint data not partitioned well -- causes errors and poor performance

[ https://issues.apache.org/jira/browse/FLINK-9061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16423335#comment-16423335 ] Steven Zhen Wu edited comment on FLINK-9061 at 4/3/18 5:53 AM: --- I don't know

[jira] [Commented] (FLINK-9120) Task Manager Fault Tolerance issue

[ https://issues.apache.org/jira/browse/FLINK-9120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16423508#comment-16423508 ] dhiraj prajapati commented on FLINK-9120: - Please find the logs attached

[jira] [Updated] (FLINK-9120) Task Manager Fault Tolerance issue

[ https://issues.apache.org/jira/browse/FLINK-9120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhiraj prajapati updated FLINK-9120: Attachment: flink-dhiraj.prajapati-client-ip-10-14-25-115.log

[jira] [Updated] (FLINK-8771) Upgrade scalastyle to 1.0.0

[ https://issues.apache.org/jira/browse/FLINK-8771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bowen Li updated FLINK-8771: Description: scalastyle 1.0.0 fixes issue with import order, explicit type for public methods, line length

[jira] [Updated] (FLINK-8771) Upgrade scalastyle to 1.0.0

[ https://issues.apache.org/jira/browse/FLINK-8771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bowen Li updated FLINK-8771: Priority: Blocker (was: Major) > Upgrade scalastyle to 1.0.0 > --- > >

[jira] [Commented] (FLINK-9124) Allow customization of KinesisProxy.getRecords read timeout and retry

[ https://issues.apache.org/jira/browse/FLINK-9124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16423485#comment-16423485 ] ASF GitHub Bot commented on FLINK-9124: --- GitHub user tweise opened a pull request:

[GitHub] flink pull request #5803: [FLINK-9124] [kinesis] Allow customization of Kine...

GitHub user tweise opened a pull request: https://github.com/apache/flink/pull/5803 [FLINK-9124] [kinesis] Allow customization of KinesisProxy.getRecords read timeout and retry. ## What is the purpose of the change This pull request enables overrides for the AWS

[jira] [Updated] (FLINK-9124) Allow customization of KinesisProxy.getRecords read timeout and retry

[ https://issues.apache.org/jira/browse/FLINK-9124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise updated FLINK-9124: Component/s: Kinesis Connector > Allow customization of KinesisProxy.getRecords read timeout and

[jira] [Created] (FLINK-9124) Allow customization of KinesisProxy.getRecords read timeout and retry

Thomas Weise created FLINK-9124: --- Summary: Allow customization of KinesisProxy.getRecords read timeout and retry Key: FLINK-9124 URL: https://issues.apache.org/jira/browse/FLINK-9124 Project: Flink

[jira] [Assigned] (FLINK-9087) Return value of broadcastEvent should be closed in StreamTask#performCheckpoint

[ https://issues.apache.org/jira/browse/FLINK-9087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mingleizhang reassigned FLINK-9087: --- Assignee: (was: mingleizhang) > Return value of broadcastEvent should be closed in >

[GitHub] flink pull request #5802: [FLINK-9087] [runtime] close the BufferConsumer in...

Github user zhangminglei commented on a diff in the pull request: https://github.com/apache/flink/pull/5802#discussion_r178707684 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/io/network/api/writer/RecordWriterTest.java --- @@ -309,8 +309,6 @@ public void

[jira] [Commented] (FLINK-9087) Return value of broadcastEvent should be closed in StreamTask#performCheckpoint

[ https://issues.apache.org/jira/browse/FLINK-9087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16423441#comment-16423441 ] ASF GitHub Bot commented on FLINK-9087: --- Github user zhangminglei commented on a diff in the pull

[GitHub] flink pull request #5802: [FLINK-9087] [runtime] close the BufferConsumer in...

GitHub user trionesadam opened a pull request: https://github.com/apache/flink/pull/5802 [FLINK-9087] [runtime] close the BufferConsumer in RecordWriter.broad… ## What is the purpose of the change BufferConsumer is Closeable, we'd better close it at last,

[jira] [Commented] (FLINK-9087) Return value of broadcastEvent should be closed in StreamTask#performCheckpoint

[ https://issues.apache.org/jira/browse/FLINK-9087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16423431#comment-16423431 ] ASF GitHub Bot commented on FLINK-9087: --- GitHub user trionesadam opened a pull request:

[jira] [Comment Edited] (FLINK-9087) Return value of broadcastEvent should be closed in StreamTask#performCheckpoint

[ https://issues.apache.org/jira/browse/FLINK-9087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16423367#comment-16423367 ] Triones Deng edited comment on FLINK-9087 at 4/3/18 1:59 AM: -

[jira] [Commented] (FLINK-9087) Return value of broadcastEvent should be closed in StreamTask#performCheckpoint

[ https://issues.apache.org/jira/browse/FLINK-9087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16423370#comment-16423370 ] Ted Yu commented on FLINK-9087: --- Sounds good. > Return value of broadcastEvent should be closed in >

[jira] [Commented] (FLINK-9087) Return value of broadcastEvent should be closed in StreamTask#performCheckpoint

[ https://issues.apache.org/jira/browse/FLINK-9087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16423367#comment-16423367 ] Triones Deng commented on FLINK-9087: - [~yuzhih...@gmail.com] notice that

[jira] [Assigned] (FLINK-9123) Scala version of ProcessFunction doesn't work

[ https://issues.apache.org/jira/browse/FLINK-9123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang reassigned FLINK-9123: --- Assignee: vinoyang > Scala version of ProcessFunction doesn't work >

[jira] [Commented] (FLINK-9061) S3 checkpoint data not partitioned well -- causes errors and poor performance

[ https://issues.apache.org/jira/browse/FLINK-9061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16423335#comment-16423335 ] Steven Zhen Wu commented on FLINK-9061: --- I don't know if it has to be "the very first characters".

[jira] [Comment Edited] (FLINK-7795) Utilize error-prone to discover common coding mistakes

[ https://issues.apache.org/jira/browse/FLINK-7795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16345955#comment-16345955 ] Ted Yu edited comment on FLINK-7795 at 4/3/18 12:38 AM: error-prone has JDK 8

[jira] [Comment Edited] (FLINK-9061) S3 checkpoint data not partitioned well -- causes errors and poor performance

[ https://issues.apache.org/jira/browse/FLINK-9061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16422976#comment-16422976 ] Steven Zhen Wu edited comment on FLINK-9061 at 4/2/18 9:22 PM: --- I think S3

[jira] [Updated] (FLINK-9118) Support a time based rollover of part file in Bucketing Sink

[ https://issues.apache.org/jira/browse/FLINK-9118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lakshmi Rao updated FLINK-9118: --- Priority: Major (was: Minor) > Support a time based rollover of part file in Bucketing Sink >

[jira] [Commented] (FLINK-9115) Support addition of part suffix in BucketingSink

[ https://issues.apache.org/jira/browse/FLINK-9115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16423131#comment-16423131 ] Lakshmi Rao commented on FLINK-9115: I see a similar ask on this thread here earlier this year: 

[jira] [Commented] (FLINK-9061) S3 checkpoint data not partitioned well -- causes errors and poor performance

[ https://issues.apache.org/jira/browse/FLINK-9061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16423089#comment-16423089 ] Jamie Grier commented on FLINK-9061: As I understand it the above doesn't work – maybe if you ask

[jira] [Comment Edited] (FLINK-9061) S3 checkpoint data not partitioned well -- causes errors and poor performance

[ https://issues.apache.org/jira/browse/FLINK-9061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16423080#comment-16423080 ] Steven Zhen Wu edited comment on FLINK-9061 at 4/2/18 8:25 PM: --- reversing

[jira] [Commented] (FLINK-9061) S3 checkpoint data not partitioned well -- causes errors and poor performance

[ https://issues.apache.org/jira/browse/FLINK-9061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16423080#comment-16423080 ] Steven Zhen Wu commented on FLINK-9061: --- reversing the components (split by slash char) doesn't give 

[jira] [Comment Edited] (FLINK-9061) S3 checkpoint data not partitioned well -- causes errors and poor performance

[ https://issues.apache.org/jira/browse/FLINK-9061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16423072#comment-16423072 ] Jamie Grier edited comment on FLINK-9061 at 4/2/18 8:17 PM: So, what I'm

[jira] [Commented] (FLINK-9061) S3 checkpoint data not partitioned well -- causes errors and poor performance

[ https://issues.apache.org/jira/browse/FLINK-9061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16423072#comment-16423072 ] Jamie Grier commented on FLINK-9061: So, what I'm suggesting is that we, optionally, split on '/' and

[jira] [Created] (FLINK-9123) Scala version of ProcessFunction doesn't work

Julio Biason created FLINK-9123: --- Summary: Scala version of ProcessFunction doesn't work Key: FLINK-9123 URL: https://issues.apache.org/jira/browse/FLINK-9123 Project: Flink Issue Type: Bug

[jira] [Commented] (FLINK-7786) JarActionHandler.tokenizeArguments removes all quotes from program arguments

[ https://issues.apache.org/jira/browse/FLINK-7786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16423028#comment-16423028 ] Cristian commented on FLINK-7786: - It would be awesome if this were fixed/implemented. In our case, one

[jira] [Commented] (FLINK-9061) S3 checkpoint data not partitioned well -- causes errors and poor performance

[ https://issues.apache.org/jira/browse/FLINK-9061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16422976#comment-16422976 ] Steven Zhen Wu commented on FLINK-9061: --- I think S3 has more sophisticated pattern searching for

[jira] [Commented] (FLINK-8837) add @Experimental annotation and properly annotate some classes

[ https://issues.apache.org/jira/browse/FLINK-8837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16422906#comment-16422906 ] ASF GitHub Bot commented on FLINK-8837: --- Github user bowenli86 commented on the issue:

[GitHub] flink issue #5800: [FLINK-8837] add @Experimental annotation and properly an...

Github user bowenli86 commented on the issue: https://github.com/apache/flink/pull/5800 cc @StephanEwen @tillrohrmann @zentol ---

[GitHub] flink issue #5760: [hotfix] [doc] update maven versions in building flink pa...

Github user bowenli86 commented on the issue: https://github.com/apache/flink/pull/5760 cc @zentol ---

[jira] [Commented] (FLINK-9061) S3 checkpoint data not partitioned well -- causes errors and poor performance

[ https://issues.apache.org/jira/browse/FLINK-9061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16422890#comment-16422890 ] Greg Hogan commented on FLINK-9061: --- Since S3 key names are opaque it sounds like any "prefix" is

[jira] [Comment Edited] (FLINK-9061) S3 checkpoint data not partitioned well -- causes errors and poor performance

[ https://issues.apache.org/jira/browse/FLINK-9061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16422843#comment-16422843 ] Steven Zhen Wu edited comment on FLINK-9061 at 4/2/18 5:50 PM: --- Usually

[jira] [Commented] (FLINK-9061) S3 checkpoint data not partitioned well -- causes errors and poor performance

[ https://issues.apache.org/jira/browse/FLINK-9061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16422843#comment-16422843 ] Steven Zhen Wu commented on FLINK-9061: --- Usually 4-char random prefix can go a long way. Even 2-char

[jira] [Commented] (FLINK-9120) Task Manager Fault Tolerance issue

[ https://issues.apache.org/jira/browse/FLINK-9120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16422768#comment-16422768 ] Ken Krugler commented on FLINK-9120: Hi [~dhirajpraj] - this _might_ be a bug, but it's best to first

[jira] [Commented] (FLINK-9061) S3 checkpoint data not partitioned well -- causes errors and poor performance

[ https://issues.apache.org/jira/browse/FLINK-9061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16422645#comment-16422645 ] Steve Loughran commented on FLINK-9061: --- something less than 8, maybe 5, though it's mostly all

[jira] [Commented] (FLINK-9121) Remove Flip-6 prefixes from code base

[ https://issues.apache.org/jira/browse/FLINK-9121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16422604#comment-16422604 ] ASF GitHub Bot commented on FLINK-9121: --- Github user asfgit closed the pull request at:

[GitHub] flink pull request #5801: [FLINK-9121] [flip6] Remove Flip6 prefixes and oth...

Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/5801 ---

[jira] [Closed] (FLINK-9121) Remove Flip-6 prefixes from code base

[ https://issues.apache.org/jira/browse/FLINK-9121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann closed FLINK-9121. Resolution: Fixed Fixed via master: af5279e9bd3dec18512a54c59982e3dc1f253cd2 1.5.0:

[jira] [Commented] (FLINK-9034) State Descriptors drop TypeInformation on serialization

[ https://issues.apache.org/jira/browse/FLINK-9034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16422551#comment-16422551 ] ASF GitHub Bot commented on FLINK-9034: --- Github user StephanEwen closed the pull request at:

[jira] [Commented] (FLINK-9034) State Descriptors drop TypeInformation on serialization

[ https://issues.apache.org/jira/browse/FLINK-9034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16422550#comment-16422550 ] ASF GitHub Bot commented on FLINK-9034: --- Github user StephanEwen commented on the issue:

[GitHub] flink issue #5732: [FLINK-9034] [FLINK-9035] [core] Fix state descriptors

Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/5732 Manually merged in f3a519712fb31f7b71181e876c3c3d5fff08eb71 ---

[GitHub] flink pull request #5732: [FLINK-9034] [FLINK-9035] [core] Fix state descrip...

Github user StephanEwen closed the pull request at: https://github.com/apache/flink/pull/5732 ---

[jira] [Commented] (FLINK-9061) S3 checkpoint data not partitioned well -- causes errors and poor performance

[ https://issues.apache.org/jira/browse/FLINK-9061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16422534#comment-16422534 ] Stephan Ewen commented on FLINK-9061: - Do we know how many characters are used for the partitioning?

[jira] [Commented] (FLINK-9121) Remove Flip-6 prefixes from code base

[ https://issues.apache.org/jira/browse/FLINK-9121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1645#comment-1645 ] ASF GitHub Bot commented on FLINK-9121: --- GitHub user tillrohrmann opened a pull request:

[GitHub] flink pull request #5801: [FLINK-9121] [flip6] Remove Flip6 prefixes and oth...

GitHub user tillrohrmann opened a pull request: https://github.com/apache/flink/pull/5801 [FLINK-9121] [flip6] Remove Flip6 prefixes and other references ## What is the purpose of the change Remove Flip6 prefixes and references to make Flip-6 the proper default:

[jira] [Created] (FLINK-9122) NFASerialize deserailze failed and cause other exception

aitozi created FLINK-9122: - Summary: NFASerialize deserailze failed and cause other exception Key: FLINK-9122 URL: https://issues.apache.org/jira/browse/FLINK-9122 Project: Flink Issue Type: Bug

[jira] [Commented] (FLINK-9104) Re-generate REST API documentation for FLIP-6

[ https://issues.apache.org/jira/browse/FLINK-9104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16422173#comment-16422173 ] Chesnay Schepler commented on FLINK-9104: - [~walterddr] Please follow the instruction at

[jira] [Commented] (FLINK-9120) Task Manager Fault Tolerance issue

[ https://issues.apache.org/jira/browse/FLINK-9120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16422061#comment-16422061 ] miki haiat commented on FLINK-9120: ---   can you upload logs please  > Task Manager Fault Tolerance

[jira] [Created] (FLINK-9121) Remove Flip-6 prefixes from code base

Till Rohrmann created FLINK-9121: Summary: Remove Flip-6 prefixes from code base Key: FLINK-9121 URL: https://issues.apache.org/jira/browse/FLINK-9121 Project: Flink Issue Type: Improvement

[jira] [Commented] (FLINK-8837) add @Experimental annotation and properly annotate some classes

[ https://issues.apache.org/jira/browse/FLINK-8837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16422006#comment-16422006 ] ASF GitHub Bot commented on FLINK-8837: --- GitHub user bowenli86 opened a pull request:

[GitHub] flink pull request #5800: [FLINK-8837] add @Experimental annotation and prop...

GitHub user bowenli86 opened a pull request: https://github.com/apache/flink/pull/5800 [FLINK-8837] add @Experimental annotation and properly annotate some classes ## What is the purpose of the change - add @Experimental annotation - properly annotate some classes

[jira] [Updated] (FLINK-8837) add @Experimental annotation and properly annotate some classes

[ https://issues.apache.org/jira/browse/FLINK-8837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bowen Li updated FLINK-8837: Summary: add @Experimental annotation and properly annotate some classes (was: add ano) > add

[jira] [Updated] (FLINK-8837) add ano

[ https://issues.apache.org/jira/browse/FLINK-8837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bowen Li updated FLINK-8837: Summary: add ano (was: Move DataStreamUtils to package 'experimental'.) > add ano > --- > >

[jira] [Created] (FLINK-9120) Task Manager Fault Tolerance issue

dhiraj prajapati created FLINK-9120: --- Summary: Task Manager Fault Tolerance issue Key: FLINK-9120 URL: https://issues.apache.org/jira/browse/FLINK-9120 Project: Flink Issue Type: Bug