[jira] [Closed] (FLINK-9761) Potential buffer leak in PartitionRequestClientHandler during job failures

2019-11-20 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-9761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang closed FLINK-9761. --- Resolution: Won't Fix It was out of date. PartitionRequestClientHandler would not be used by default and be

[jira] [Closed] (FLINK-12994) Improve the buffer processing performance in SpilledBufferOrEventSequence#getNext

2019-11-20 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-12994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang closed FLINK-12994. Resolution: Won't Fix > Improve the buffer processing performance in >

[jira] [Commented] (FLINK-12994) Improve the buffer processing performance in SpilledBufferOrEventSequence#getNext

2019-11-20 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-12994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16978992#comment-16978992 ] zhijiang commented on FLINK-12994: -- I guess this issue is not worth improving, because

[jira] [Assigned] (FLINK-14877) Enable FRocksDB to optimize performance via options when bounding total memory

2019-11-20 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang reassigned FLINK-14877: Assignee: Yun Tang > Enable FRocksDB to optimize performance via options when bounding total

[jira] [Assigned] (FLINK-14818) StreamNetworkBenchmarkEnvironment incorrectly setups a receiving InputGate

2019-11-18 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang reassigned FLINK-14818: Assignee: Yingjie Cao > StreamNetworkBenchmarkEnvironment incorrectly setups a receiving

[jira] [Resolved] (FLINK-14553) Respect non-blocking output in StreamTask#processInput

2019-11-16 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang resolved FLINK-14553. -- Resolution: Fixed Merged in master : 2c8b4ef572f05bf4740b7e204af1e5e709cd945c > Respect non-blocking

[jira] [Closed] (FLINK-14472) Implement back-pressure monitor with non-blocking outputs

2019-11-14 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang closed FLINK-14472. Resolution: Fixed Merged in master: a9b126640c41b767c26b5a1537a45c3102574a3c > Implement back-pressure

[jira] [Commented] (FLINK-14712) Add NetWork metric for IOMetricsInfo

2019-11-13 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16973889#comment-16973889 ] zhijiang commented on FLINK-14712: -- As [~pnowojski] mentioned above, the current progressing work for

[jira] [Updated] (FLINK-14603) NetworkBufferPoolTest.testBlockingRequestFromMultiLocalBufferPool timeout in travis

2019-11-06 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-14603: - Fix Version/s: 1.10.0 > NetworkBufferPoolTest.testBlockingRequestFromMultiLocalBufferPool timeout in >

[jira] [Resolved] (FLINK-14603) NetworkBufferPoolTest.testBlockingRequestFromMultiLocalBufferPool timeout in travis

2019-11-06 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang resolved FLINK-14603. -- Resolution: Fixed Merged in master : 9b43f13a50848382fbd634081b82509f464e62ca >

[jira] [Commented] (FLINK-14603) NetworkBufferPoolTest.testBlockingRequestFromMultiLocalBufferPool timeout in travis

2019-11-05 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968035#comment-16968035 ] zhijiang commented on FLINK-14603: -- We already found the root cause and would submit a fix for it

[jira] [Assigned] (FLINK-14603) NetworkBufferPoolTest.testBlockingRequestFromMultiLocalBufferPool timeout in travis

2019-11-05 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang reassigned FLINK-14603: Assignee: Yingjie Cao > NetworkBufferPoolTest.testBlockingRequestFromMultiLocalBufferPool

[jira] [Resolved] (FLINK-14498) Introduce NetworkBufferPool#isAvailable() for non-blocking output

2019-11-03 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang resolved FLINK-14498. -- Resolution: Fixed Merged in master : 7ffe265f65becbca94cc0bb585297ee000ba735c > Introduce

[jira] [Updated] (FLINK-14498) Introduce NetworkBufferPool#isAvailable() for non-blocking output

2019-11-03 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-14498: - Description: In order to best-effort implement non-blocking output, we need to further improve the

[jira] [Updated] (FLINK-14498) Introduce NetworkBufferPool#isAvailable() for non-blocking output

2019-11-03 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-14498: - Description: In order to best-effort implement non-blocking output, we need to further improve the

[jira] [Updated] (FLINK-14498) Introduce NetworkBufferPool#isAvailable() for non-blocking output

2019-11-03 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-14498: - Description:   If the LocalBufferPool can not request available buffer from NetworkBufferPool, it

[jira] [Updated] (FLINK-14498) Introduce NetworkBufferPool#isAvailable() for non-blocking output

2019-11-03 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-14498: - Summary: Introduce NetworkBufferPool#isAvailable() for non-blocking output (was: Introduce

[jira] [Commented] (FLINK-14536) Make clear the way to aggregate specified cpuCores resources

2019-10-30 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16963630#comment-16963630 ] zhijiang commented on FLINK-14536: -- For the chained operators, the final aggregated cpu resource chose

[jira] [Assigned] (FLINK-14546) Support map type in flink-json

2019-10-30 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang reassigned FLINK-14546: Assignee: Benchao Li > Support map type in flink-json > -- > >

[jira] [Created] (FLINK-14553) Respect non-blocking output in StreamTask#processInput

2019-10-29 Thread zhijiang (Jira)
zhijiang created FLINK-14553: Summary: Respect non-blocking output in StreamTask#processInput Key: FLINK-14553 URL: https://issues.apache.org/jira/browse/FLINK-14553 Project: Flink Issue Type:

[jira] [Updated] (FLINK-14472) Implement back-pressure monitor with non-blocking outputs

2019-10-29 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-14472: - Parent: FLINK-14551 Issue Type: Sub-task (was: Task) > Implement back-pressure monitor with

[jira] [Updated] (FLINK-14396) Implement rudimentary non-blocking network output

2019-10-29 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-14396: - Parent: FLINK-14551 Issue Type: Sub-task (was: Task) > Implement rudimentary non-blocking

[jira] [Updated] (FLINK-14394) Remove unnecessary interface method BufferProvider#requestBufferBlocking

2019-10-29 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-14394: - Parent: FLINK-14551 Issue Type: Sub-task (was: Task) > Remove unnecessary interface method

[jira] [Created] (FLINK-14551) Unaligned checkpoints

2019-10-29 Thread zhijiang (Jira)
zhijiang created FLINK-14551: Summary: Unaligned checkpoints Key: FLINK-14551 URL: https://issues.apache.org/jira/browse/FLINK-14551 Project: Flink Issue Type: New Feature Components:

[jira] [Updated] (FLINK-14551) Unaligned checkpoints

2019-10-29 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-14551: - Fix Version/s: 1.10.0 > Unaligned checkpoints > - > > Key:

[jira] [Commented] (FLINK-14525) buffer pool is destroyed

2019-10-28 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16960815#comment-16960815 ] zhijiang commented on FLINK-14525: -- The above stack trace is not helpful for tracing the root cause. If

[jira] [Updated] (FLINK-14230) Change the endInput call of the downstream operator to after the upstream operator closes

2019-10-28 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-14230: - Fix Version/s: 1.10.0 > Change the endInput call of the downstream operator to after the upstream >

[jira] [Resolved] (FLINK-14230) Change the endInput call of the downstream operator to after the upstream operator closes

2019-10-28 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang resolved FLINK-14230. -- Resolution: Fixed Merged in master: ecc802064d35d22162a3bd57a522b4c77c56e390 > Change the endInput

[jira] [Updated] (FLINK-14230) Change the endInput call of the downstream operator to after the upstream operator closes

2019-10-28 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-14230: - Description: This ticket is for fixing the error of propagating "endInput" on the chain immediately

[jira] [Resolved] (FLINK-14396) Implement rudimentary non-blocking network output

2019-10-28 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang resolved FLINK-14396. -- Resolution: Fixed Merged in master : ad70e062c1d4a867b7eec7a03239c5a6ce52c23e > Implement

[jira] [Commented] (FLINK-14525) buffer pool is destroyed

2019-10-25 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16959508#comment-16959508 ] zhijiang commented on FLINK-14525: -- As [~wind_ljy] mentioned above, there exists some other failures in

[jira] [Assigned] (FLINK-14516) Remove non credit based network code

2019-10-24 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang reassigned FLINK-14516: Assignee: zhijiang > Remove non credit based network code >

[jira] [Updated] (FLINK-14498) Introduce NetworkBufferPool#isAvailable() for interacting with LocalBufferPool

2019-10-22 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-14498: - Fix Version/s: 1.10.0 > Introduce NetworkBufferPool#isAvailable() for interacting with LocalBufferPool

[jira] [Assigned] (FLINK-14498) Introduce NetworkBufferPool#isAvailable() for interacting with LocalBufferPool

2019-10-22 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang reassigned FLINK-14498: Assignee: Yingjie Cao > Introduce NetworkBufferPool#isAvailable() for interacting with

[jira] [Created] (FLINK-14498) Introduce NetworkBufferPool#isAvailable() for interacting with LocalBufferPool

2019-10-22 Thread zhijiang (Jira)
zhijiang created FLINK-14498: Summary: Introduce NetworkBufferPool#isAvailable() for interacting with LocalBufferPool Key: FLINK-14498 URL: https://issues.apache.org/jira/browse/FLINK-14498 Project:

[jira] [Updated] (FLINK-14472) Implement back-pressure monitor with non-blocking outputs

2019-10-22 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-14472: - Description: Currently back-pressure monitor relies on detecting task threads that are stuck in

[jira] [Comment Edited] (FLINK-14472) Implement back-pressure monitor with non-blocking outputs

2019-10-21 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16956654#comment-16956654 ] zhijiang edited comment on FLINK-14472 at 10/22/19 5:05 AM: Thanks for

[jira] [Commented] (FLINK-14472) Implement back-pressure monitor with non-blocking outputs

2019-10-21 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16956654#comment-16956654 ] zhijiang commented on FLINK-14472: -- Thanks for concerning on this issue. You are right that some known

[jira] [Assigned] (FLINK-14472) Implement back-pressure monitor with non-blocking outputs

2019-10-21 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang reassigned FLINK-14472: Assignee: Yingjie Cao > Implement back-pressure monitor with non-blocking outputs >

[jira] [Created] (FLINK-14472) Implement back-pressure monitor with non-blocking outputs

2019-10-21 Thread zhijiang (Jira)
zhijiang created FLINK-14472: Summary: Implement back-pressure monitor with non-blocking outputs Key: FLINK-14472 URL: https://issues.apache.org/jira/browse/FLINK-14472 Project: Flink Issue

[jira] [Closed] (FLINK-14394) Remove unnecessary interface method BufferProvider#requestBufferBlocking

2019-10-20 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang closed FLINK-14394. Resolution: Fixed Fixed in master: 47e9a82a4d3be085bd8bc906e4de3765e99a3a7b > Remove unnecessary

[jira] [Closed] (FLINK-8523) Stop assigning floating buffers for blocked input channels in exactly-once mode

2019-10-18 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-8523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang closed FLINK-8523. --- Resolution: Pending Closed > Stop assigning floating buffers for blocked input channels in exactly-once >

[jira] [Created] (FLINK-14396) Implement rudimentary non-blocking network output

2019-10-15 Thread zhijiang (Jira)
zhijiang created FLINK-14396: Summary: Implement rudimentary non-blocking network output Key: FLINK-14396 URL: https://issues.apache.org/jira/browse/FLINK-14396 Project: Flink Issue Type: Task

[jira] [Updated] (FLINK-14394) Remove unnecessary interface method BufferProvider#requestBufferBlocking

2019-10-15 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-14394: - Description: Currently BufferProvider#requestBufferBlocking method is only used for unit tests, so we

[jira] [Assigned] (FLINK-14394) Remove unnecessary interface method BufferProvider#requestBufferBlocking

2019-10-15 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang reassigned FLINK-14394: Assignee: zhijiang > Remove unnecessary interface method BufferProvider#requestBufferBlocking >

[jira] [Updated] (FLINK-14394) Remove unnecessary interface method BufferProvider#requestBufferBlocking

2019-10-15 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-14394: - Priority: Minor (was: Major) > Remove unnecessary interface method

[jira] [Updated] (FLINK-14394) Remove unnecessary interface method BufferProvider#requestBufferBlocking

2019-10-15 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-14394: - Summary: Remove unnecessary interface method BufferProvider#requestBufferBlocking (was: Remove

[jira] [Updated] (FLINK-14394) Remove unnecessary interface method BufferProvider#requestBufferBlocking

2019-10-15 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-14394: - Fix Version/s: 1.10.0 > Remove unnecessary interface method BufferProvider#requestBufferBlocking >

[jira] [Updated] (FLINK-14394) Remove unnecessary interface method BufferProvider#requestBufferBlocking

2019-10-15 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-14394: - Component/s: Runtime / Network > Remove unnecessary interface method

[jira] [Created] (FLINK-14394) Remove unnecessary notifySubpartitionConsumed method from view reader

2019-10-15 Thread zhijiang (Jira)
zhijiang created FLINK-14394: Summary: Remove unnecessary notifySubpartitionConsumed method from view reader Key: FLINK-14394 URL: https://issues.apache.org/jira/browse/FLINK-14394 Project: Flink

[jira] [Updated] (FLINK-14004) Define SourceReader interface to verify the integration with StreamOneInputProcessor

2019-10-12 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-14004: - Affects Version/s: 1.8.0 1.9.0 > Define SourceReader interface to verify the

[jira] [Updated] (FLINK-14004) Define SourceReaderOperator to verify the integration with StreamOneInputProcessor

2019-10-12 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-14004: - Summary: Define SourceReaderOperator to verify the integration with StreamOneInputProcessor (was:

[jira] [Updated] (FLINK-14004) Define SourceReaderOperator to verify the integration with StreamOneInputProcessor

2019-10-12 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-14004: - Description: We already refactored the task input and output in runtime stack for considering the

[jira] [Updated] (FLINK-14004) Define SourceReader interface to verify the integration with StreamOneInputProcessor

2019-10-12 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-14004: - Fix Version/s: 1.10.0 > Define SourceReader interface to verify the integration with >

[jira] [Resolved] (FLINK-14004) Define SourceReader interface to verify the integration with StreamOneInputProcessor

2019-10-12 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang resolved FLINK-14004. -- Resolution: Fixed Merged in master: cee9bf0ab6c1d6b1678070ff2e05f0aa34f26dc0 > Define SourceReader

[jira] [Updated] (FLINK-14289) Remove Optional fields from RecordWriter relevant classes

2019-10-10 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-14289: - Affects Version/s: 1.8.0 1.9.0 > Remove Optional fields from RecordWriter

[jira] [Updated] (FLINK-14289) Remove Optional fields from RecordWriter relevant classes

2019-10-10 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-14289: - Fix Version/s: 1.10.0 > Remove Optional fields from RecordWriter relevant classes >

[jira] [Resolved] (FLINK-14289) Remove Optional fields from RecordWriter relevant classes

2019-10-10 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang resolved FLINK-14289. -- Resolution: Fixed Fixed in master : 71e440d5f62fbd43df18f999b7818de48a279eb0 > Remove Optional

[jira] [Updated] (FLINK-14289) Remove Optional fields from RecordWriter relevant classes

2019-09-29 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-14289: - Description: Based on the code style guides for [Jave Optional|#java-optional] , the optional should

[jira] [Updated] (FLINK-14289) Remove Optional fields from RecordWriter relevant classes

2019-09-29 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-14289: - Description: Based on the code style guides for [Jave Optional|#java-optional]] , the optional should

[jira] [Created] (FLINK-14289) Remove Optional fields from RecordWriter relevant classes

2019-09-29 Thread zhijiang (Jira)
zhijiang created FLINK-14289: Summary: Remove Optional fields from RecordWriter relevant classes Key: FLINK-14289 URL: https://issues.apache.org/jira/browse/FLINK-14289 Project: Flink Issue

[jira] [Updated] (FLINK-10745) Serialization and copy improvements for record writer

2019-09-27 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-10745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-10745: - Component/s: Runtime / Task > Serialization and copy improvements for record writer >

[jira] [Resolved] (FLINK-10745) Serialization and copy improvements for record writer

2019-09-27 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-10745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang resolved FLINK-10745. -- Resolution: Fixed > Serialization and copy improvements for record writer >

[jira] [Resolved] (FLINK-10995) Copy intermediate serialization results only once for broadcast mode

2019-09-27 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-10995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang resolved FLINK-10995. -- Resolution: Fixed Merged in master : 7f2382a532ab72e6ead12945eb2395e6af829eb5 > Copy intermediate

[jira] [Commented] (FLINK-10672) Task stuck while writing output to flink

2019-09-26 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-10672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938443#comment-16938443 ] zhijiang commented on FLINK-10672: -- I think [~gaoyunhaii] would continue helping trace this issue . >

[jira] [Assigned] (FLINK-10672) Task stuck while writing output to flink

2019-09-26 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-10672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang reassigned FLINK-10672: Assignee: Yun Gao > Task stuck while writing output to flink >

[jira] [Commented] (FLINK-12576) inputQueueLength metric does not work for LocalInputChannels

2019-09-26 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-12576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938424#comment-16938424 ] zhijiang commented on FLINK-12576: -- Thanks for reproducing the case [~kevin.cyj] My previous concern

[jira] [Commented] (FLINK-12576) inputQueueLength metric does not work for LocalInputChannels

2019-09-23 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-12576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16936348#comment-16936348 ] zhijiang commented on FLINK-12576: -- Thanks for reporting this [~alpinegizmo] I want to confirm two

[jira] [Updated] (FLINK-10995) Copy intermediate serialization results only once for broadcast mode

2019-09-23 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-10995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-10995: - Component/s: (was: Runtime / Network) Runtime / Task > Copy intermediate

[jira] [Commented] (FLINK-14124) potential memory leak in netty server

2019-09-19 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16933568#comment-16933568 ] zhijiang commented on FLINK-14124: -- I think it is better for you to upgrade the flink version. The

[jira] [Comment Edited] (FLINK-14087) throws java.lang.ArrayIndexOutOfBoundsException when emiting the data using RebalancePartitioner.

2019-09-17 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931289#comment-16931289 ] zhijiang edited comment on FLINK-14087 at 9/17/19 10:48 AM: Thanks for the

[jira] [Commented] (FLINK-14087) throws java.lang.ArrayIndexOutOfBoundsException when emiting the data using RebalancePartitioner.

2019-09-17 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931289#comment-16931289 ] zhijiang commented on FLINK-14087: -- Thanks for the quick response [~aljoscha]! The topology from

[jira] [Commented] (FLINK-14087) throws java.lang.ArrayIndexOutOfBoundsException when emiting the data using RebalancePartitioner.

2019-09-17 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931227#comment-16931227 ] zhijiang commented on FLINK-14087: -- Thanks for the replies [~pnowojski]! Unless there are some

[jira] [Commented] (FLINK-14087) throws java.lang.ArrayIndexOutOfBoundsException when emiting the data using RebalancePartitioner.

2019-09-17 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931171#comment-16931171 ] zhijiang commented on FLINK-14087: -- Thanks for the further offline confirmation with me [~jiangyu].

[jira] [Commented] (FLINK-14087) throws java.lang.ArrayIndexOutOfBoundsException when emiting the data using RebalancePartitioner.

2019-09-16 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930432#comment-16930432 ] zhijiang commented on FLINK-14087: -- Thanks for reporting this [~jiangyu]. We actually refactored the

[jira] [Updated] (FLINK-13767) Refactor StreamInputProcessor#processInput based on InputStatus

2019-09-12 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-13767: - Description: StreamInputProcessor#processInput could return InputStatus instead of current boolean

[jira] [Updated] (FLINK-13767) Refactor StreamInputProcessor#processInput based on InputStatus

2019-09-12 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-13767: - Summary: Refactor StreamInputProcessor#processInput based on InputStatus (was: Migrate isFinished

[jira] [Commented] (FLINK-13992) Refactor Optional parameter in InputGateWithMetrics#updateMetrics

2019-09-11 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928140#comment-16928140 ] zhijiang commented on FLINK-13992: -- Sorry for the late response because of traveling these days. I

[jira] [Created] (FLINK-14004) Define SourceReader interface to verify the integration with StreamOneInputProcessor

2019-09-08 Thread zhijiang (Jira)
zhijiang created FLINK-14004: Summary: Define SourceReader interface to verify the integration with StreamOneInputProcessor Key: FLINK-14004 URL: https://issues.apache.org/jira/browse/FLINK-14004

[jira] [Updated] (FLINK-10653) Introduce Pluggable Shuffle Service Architecture

2019-09-01 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-10653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-10653: - Summary: Introduce Pluggable Shuffle Service Architecture (was: Introduce Pluggable Shuffle Manager

[jira] [Closed] (FLINK-13765) Introduce TwoInputSelectionHandler for selecting input in StreamTwoInputSelectableProcessor

2019-08-27 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang closed FLINK-13765. Resolution: Fixed Fixed in master : 261c2dc8ed247a5b49594b87b1e8c2dc84dd5206 > Introduce

[jira] [Commented] (FLINK-10995) Copy intermediate serialization results only once for broadcast mode

2019-08-26 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-10995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16916401#comment-16916401 ] zhijiang commented on FLINK-10995: -- I think it was not planned in release-1.10 before. We could discuss

[jira] [Updated] (FLINK-13765) Introduce TwoInputSelectionHandler for selecting input in StreamTwoInputSelectableProcessor

2019-08-26 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-13765: - Description: In StreamTwoInputSelectableProcessor there are three fields \{InputSelectable, 

[jira] [Updated] (FLINK-13765) Introduce TwoInputSelectionHandler for selecting input in StreamTwoInputSelectableProcessor

2019-08-26 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-13765: - Description: In StreamTwoInputSelectableProcessor there are three fields \{InputSelectable, 

[jira] [Updated] (FLINK-13765) Introduce TwoInputSelectionHandler for selecting input in StreamTwoInputSelectableProcessor

2019-08-26 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-13765: - Summary: Introduce TwoInputSelectionHandler for selecting input in StreamTwoInputSelectableProcessor

[jira] [Updated] (FLINK-13765) Introduce the TwoInputSelectionHandler for selecting input in StreamTwoInputSelectableProcessor

2019-08-26 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-13765: - Summary: Introduce the TwoInputSelectionHandler for selecting input in

[jira] [Commented] (FLINK-10995) Copy intermediate serialization results only once for broadcast mode

2019-08-26 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-10995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16916286#comment-16916286 ] zhijiang commented on FLINK-10995: -- [~ykt836], this Jira is for improving the serialization stack in

[jira] [Closed] (FLINK-13442) Remove unnecessary notifySubpartitionConsumed method from view reader

2019-08-23 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang closed FLINK-13442. Resolution: Fixed Fixed in master : 482462f2855ea68667146491b61c347d11c52298 > Remove unnecessary

[jira] [Closed] (FLINK-10790) Refactor all the StreamPartitioner implementations into runtime module

2019-08-23 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-10790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang closed FLINK-10790. Resolution: Won't Fix It is not very necessary/feasible to do this now. Close it now and if necessary we

[jira] [Resolved] (FLINK-13764) Pass the counter of numRecordsIn into the constructor of StreamInputProcessor

2019-08-23 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang resolved FLINK-13764. -- Resolution: Fixed Fixed in master : a7f1fee876cde130d3b84848685ba78ba0fb6c11 > Pass the counter of

[jira] [Updated] (FLINK-13762) Implement a unified ForwardingValveOutputHandler for StreamOne/TwoInputSelectableProcessor

2019-08-23 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-13762: - Description: It is only for simplifying the implementations of specific methods to not wrap the

[jira] [Updated] (FLINK-13762) Add the exception throwable in the interface methods of ValveOutputHandler

2019-08-23 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-13762: - Summary: Add the exception throwable in the interface methods of ValveOutputHandler (was: Implement a

[jira] [Commented] (FLINK-13798) Refactor the process of checking stream status while emitting watermark in source

2019-08-23 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16914044#comment-16914044 ] zhijiang commented on FLINK-13798: -- After further researching on this issue, it seems not feasible to

[jira] [Closed] (FLINK-13798) Refactor the process of checking stream status while emitting watermark in source

2019-08-23 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang closed FLINK-13798. Resolution: Won't Fix > Refactor the process of checking stream status while emitting watermark in >

[jira] [Updated] (FLINK-13764) Pass the counter of numRecordsIn into the constructor of StreamInputProcessor

2019-08-22 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-13764: - Summary: Pass the counter of numRecordsIn into the constructor of StreamInputProcessor (was: Pass the

[jira] [Updated] (FLINK-13764) Pass the counter of numRecordsIn into the constructors of StreamOne/TwoInputProcessor

2019-08-22 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-13764: - Description: Currently the counter of numRecordsIn is setup while processing input in processor. In

[jira] [Updated] (FLINK-13762) Implement a unified ForwardingValveOutputHandler for StreamOne/TwoInputSelectableProcessor

2019-08-22 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-13762: - Description: Currently StreamOneInputProcessor and StreamTwoInputSelectableProcessor have separate

[jira] [Updated] (FLINK-13762) Implement a unified ForwardingValveOutputHandler for StreamOne/TwoInputSelectableProcessor

2019-08-22 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-13762: - Summary: Implement a unified ForwardingValveOutputHandler for StreamOne/TwoInputSelectableProcessor

[jira] [Updated] (FLINK-13754) Decouple OperatorChain with StreamStatusMaintainer

2019-08-20 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-13754: - Description: The current OperatorChain is heavy-weight to take some unrelated roles like 

[jira] [Updated] (FLINK-13754) Decouple OperatorChain with StreamStatusMaintainer

2019-08-20 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-13754: - Description: The current OperatorChain is heavy-weight to take some unrelated roles like 

<    2   3   4   5   6   7   8   9   10   11   >