[jira] [Created] (FLINK-15962) Reduce the default chunk size in netty stack

2020-02-09 Thread zhijiang (Jira)
zhijiang created FLINK-15962: Summary: Reduce the default chunk size in netty stack Key: FLINK-15962 URL: https://issues.apache.org/jira/browse/FLINK-15962 Project: Flink Issue Type: Improvement

[jira] [Closed] (FLINK-15914) Miss the barrier alignment metric for the case of two inputs

2020-02-05 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang closed FLINK-15914. Resolution: Fixed Merged in release-1.10: 72b076cbcbfd2636d4980a9fca979e7482b2729c > Miss the barrier

[jira] [Created] (FLINK-15914) Miss the barrier alignment metric for the case of two inputs

2020-02-05 Thread zhijiang (Jira)
zhijiang created FLINK-15914: Summary: Miss the barrier alignment metric for the case of two inputs Key: FLINK-15914 URL: https://issues.apache.org/jira/browse/FLINK-15914 Project: Flink Issue

[jira] [Updated] (FLINK-15010) Temp directories flink-netty-shuffle-* are not cleaned up

2020-02-03 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-15010: - Fix Version/s: 1.9.3 > Temp directories flink-netty-shuffle-* are not cleaned up >

[jira] [Updated] (FLINK-15010) Temp directories flink-netty-shuffle-* are not cleaned up

2020-02-03 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-15010: - Affects Version/s: 1.9.0 1.9.2 > Temp directories flink-netty-shuffle-* are not

[jira] [Closed] (FLINK-15010) Temp directories flink-netty-shuffle-* are not cleaned up

2020-02-03 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang closed FLINK-15010. Resolution: Fixed Merged in master: 5036334ca00405cd4cdd5a798dca012bb3cc7bbf Merged in release-1.10: 

[jira] [Assigned] (FLINK-15873) Matched result may not be output if existing earlier partial matches

2020-02-03 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang reassigned FLINK-15873: Assignee: shuai.xu > Matched result may not be output if existing earlier partial matches >

[jira] [Closed] (FLINK-15444) Make the component AbstractInvokable in CheckpointBarrierHandler NonNull

2020-01-21 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang closed FLINK-15444. Resolution: Fixed Merged in master : 9f92ddfecad6e056cc4b58311e493cbb0884357b > Make the component

[jira] [Commented] (FLINK-14163) Execution#producedPartitions is possibly not assigned when used

2020-01-12 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17014085#comment-17014085 ] zhijiang commented on FLINK-14163: -- Thanks for the above good suggestions from you guys! Sorry for

[jira] [Comment Edited] (FLINK-15355) Nightly streaming file sink fails with unshaded hadoop

2020-01-10 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012387#comment-17012387 ] zhijiang edited comment on FLINK-15355 at 1/10/20 11:29 AM: Merged in

[jira] [Closed] (FLINK-15306) Adjust the default netty transport option from nio to auto

2020-01-09 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang closed FLINK-15306. Resolution: Fixed Merged in master: 169edef4b5e4381626b7405947ebfe3f49aff2ac > Adjust the default netty

[jira] [Closed] (FLINK-15355) Nightly streaming file sink fails with unshaded hadoop

2020-01-09 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang closed FLINK-15355. Resolution: Fixed Merged in release-1.10: aa37c0cd89053e68e72a19d51715b3a31b74163c > Nightly streaming

[jira] [Updated] (FLINK-15021) Remove the setting of netty channel watermark in NettyServer

2020-01-06 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-15021: - Summary: Remove the setting of netty channel watermark in NettyServer (was: Remove setting of netty

[jira] [Closed] (FLINK-15021) Remove setting of netty channel watermark and logic of writability changed

2020-01-06 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang closed FLINK-15021. Resolution: Fixed Merged in master: 12d095028d54f842c7cc0f8efd3bac476fc5d9f7 > Remove setting of netty

[jira] [Updated] (FLINK-15021) Remove setting of netty channel watermark and logic of writability changed

2020-01-06 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-15021: - Fix Version/s: 1.11.0 > Remove setting of netty channel watermark and logic of writability changed >

[jira] [Updated] (FLINK-15021) Remove setting of netty channel watermark and logic of writability changed

2020-01-06 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-15021: - Description: The high and low watermark setting in NetterServer before was mainly used for network

[jira] [Commented] (FLINK-10462) Remove ConnectionIndex for further sharing tcp connection in credit-based mode

2020-01-06 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-10462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17008630#comment-17008630 ] zhijiang commented on FLINK-10462: -- [~kevin.cyj] I think there are two requirements from your

[jira] [Commented] (FLINK-14163) Execution#producedPartitions is possibly not assigned when used

2020-01-05 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17008582#comment-17008582 ] zhijiang commented on FLINK-14163: -- In addition, no matter which way we take to solve this issue, I

[jira] [Commented] (FLINK-14163) Execution#producedPartitions is possibly not assigned when used

2020-01-05 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17008580#comment-17008580 ] zhijiang commented on FLINK-14163: -- Thanks for reporting this potential issue [~zhuzh]! After double

[jira] [Updated] (FLINK-15444) Make the component AbstractInvokable in CheckpointBarrierHandler NonNull

2019-12-30 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-15444: - Fix Version/s: 1.11.0 > Make the component AbstractInvokable in CheckpointBarrierHandler NonNull >

[jira] [Created] (FLINK-15444) Make the component AbstractInvokable in CheckpointBarrierHandler NonNull

2019-12-30 Thread zhijiang (Jira)
zhijiang created FLINK-15444: Summary: Make the component AbstractInvokable in CheckpointBarrierHandler NonNull Key: FLINK-15444 URL: https://issues.apache.org/jira/browse/FLINK-15444 Project: Flink

[jira] [Assigned] (FLINK-15442) Harden the Avro Confluent Schema Registry nightly end-to-end test

2019-12-30 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang reassigned FLINK-15442: Assignee: Yangze Guo > Harden the Avro Confluent Schema Registry nightly end-to-end test >

[jira] [Assigned] (FLINK-15437) Start session with property of "-Dtaskmanager.memory.process.size" not work

2019-12-30 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang reassigned FLINK-15437: Assignee: Xintong Song > Start session with property of "-Dtaskmanager.memory.process.size" not

[jira] [Assigned] (FLINK-15428) Avro Confluent Schema Registry nightly end-to-end test fails on travis

2019-12-29 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang reassigned FLINK-15428: Assignee: Yangze Guo > Avro Confluent Schema Registry nightly end-to-end test fails on travis >

[jira] [Assigned] (FLINK-15387) Expose missing RocksDB properties out via RocksDBNativeMetricOptions

2019-12-25 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang reassigned FLINK-15387: Assignee: Yun Tang > Expose missing RocksDB properties out via RocksDBNativeMetricOptions >

[jira] [Assigned] (FLINK-15370) Configured write buffer manager actually not take effect in RocksDB's DBOptions

2019-12-23 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang reassigned FLINK-15370: Assignee: Yu Li > Configured write buffer manager actually not take effect in RocksDB's >

[jira] [Assigned] (FLINK-15368) Add end-to-end test for controlling RocksDB memory usage

2019-12-23 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang reassigned FLINK-15368: Assignee: Yun Tang > Add end-to-end test for controlling RocksDB memory usage >

[jira] [Closed] (FLINK-15360) Yarn e2e test is broken with building docker image

2019-12-23 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang closed FLINK-15360. Resolution: Fixed Merged in master: e30bcfd9c8cbe56c1072fe9895f1e6d03389c31e Merged in release-1.10: 

[jira] [Updated] (FLINK-15306) Adjust the default netty transport option from nio to auto

2019-12-23 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-15306: - Component/s: Runtime / Configuration > Adjust the default netty transport option from nio to auto >

[jira] [Assigned] (FLINK-15355) Nightly streaming file sink fails with unshaded hadoop

2019-12-23 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang reassigned FLINK-15355: Assignee: PengFei Li > Nightly streaming file sink fails with unshaded hadoop >

[jira] [Closed] (FLINK-15340) Remove the executor of pipelined compression benchmark

2019-12-20 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang closed FLINK-15340. Resolution: Fixed Merged in benchmark repo: a92f9d5d492b97fe0e601567bfe0c021be819306 > Remove the

[jira] [Created] (FLINK-15340) Remove the executor of pipelined compression benchmark

2019-12-19 Thread zhijiang (Jira)
zhijiang created FLINK-15340: Summary: Remove the executor of pipelined compression benchmark Key: FLINK-15340 URL: https://issues.apache.org/jira/browse/FLINK-15340 Project: Flink Issue Type:

[jira] [Assigned] (FLINK-14843) Streaming bucketing end-to-end test can fail with Output hash mismatch

2019-12-19 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang reassigned FLINK-14843: Assignee: PengFei Li > Streaming bucketing end-to-end test can fail with Output hash mismatch >

[jira] [Commented] (FLINK-15311) Lz4BlockCompressionFactory should use native compressor instead of java unsafe

2019-12-19 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16999889#comment-16999889 ] zhijiang commented on FLINK-15311: -- After discussed offline, this improvement is very critical for our

[jira] [Updated] (FLINK-15311) Lz4BlockCompressionFactory should use native compressor instead of java unsafe

2019-12-19 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-15311: - Issue Type: Improvement (was: Bug) > Lz4BlockCompressionFactory should use native compressor instead

[jira] [Updated] (FLINK-15308) Job failed when enable pipelined-shuffle.compression and numberOfTaskSlots > 1

2019-12-18 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-15308: - Fix Version/s: 1.10.0 > Job failed when enable pipelined-shuffle.compression and numberOfTaskSlots > 1

[jira] [Assigned] (FLINK-15311) Lz4BlockCompressionFactory should use native compressor instead of java unsafe

2019-12-18 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang reassigned FLINK-15311: Assignee: Yingjie Cao > Lz4BlockCompressionFactory should use native compressor instead of java

[jira] [Commented] (FLINK-15311) Lz4BlockCompressionFactory should use native compressor instead of java unsafe

2019-12-18 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16999797#comment-16999797 ] zhijiang commented on FLINK-15311: -- I guess it belongs to performance improvement, not a bug, because

[jira] [Assigned] (FLINK-15012) Checkpoint directory not cleaned up

2019-12-18 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang reassigned FLINK-15012: Assignee: Yun Tang > Checkpoint directory not cleaned up > --- >

[jira] [Assigned] (FLINK-15308) Job failed when enable pipelined-shuffle.compression and numberOfTaskSlots > 1

2019-12-18 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang reassigned FLINK-15308: Assignee: Yingjie Cao > Job failed when enable pipelined-shuffle.compression and

[jira] [Closed] (FLINK-1275) Add support to compress network I/O

2019-12-18 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-1275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang closed FLINK-1275. --- Resolution: Duplicate This issue was already done via 

[jira] [Commented] (FLINK-15010) Temp directories flink-netty-shuffle-* are not cleaned up

2019-12-17 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16998822#comment-16998822 ] zhijiang commented on FLINK-15010: -- Thanks for the information and it is easy to re-produce this issue.

[jira] [Assigned] (FLINK-15010) Temp directories flink-netty-shuffle-* are not cleaned up

2019-12-17 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang reassigned FLINK-15010: Assignee: Yun Gao > Temp directories flink-netty-shuffle-* are not cleaned up >

[jira] [Created] (FLINK-15306) Adjust the default netty transport option from nio to auto

2019-12-17 Thread zhijiang (Jira)
zhijiang created FLINK-15306: Summary: Adjust the default netty transport option from nio to auto Key: FLINK-15306 URL: https://issues.apache.org/jira/browse/FLINK-15306 Project: Flink Issue

[jira] [Updated] (FLINK-15021) Remove setting of netty channel watermark and logic of writability changed

2019-12-17 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-15021: - Parent: FLINK-7282 Issue Type: Sub-task (was: Task) > Remove setting of netty channel

[jira] [Updated] (FLINK-15021) Remove setting of netty channel watermark and logic of writability changed

2019-12-17 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-15021: - Summary: Remove setting of netty channel watermark and logic of writability changed (was: Refactor to

[jira] [Updated] (FLINK-15021) Remove setting of netty channel watermark and logic of writability changed

2019-12-17 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-15021: - Description: After removing the non credit-based flow control codes, the channel writability changed

[jira] [Closed] (FLINK-13589) DelimitedInputFormat index error on multi-byte delimiters with whole file input splits

2019-12-16 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang closed FLINK-13589. Resolution: Fixed Merged in master: 0bd083e5eeb5eb5adeddfbe3a9928860f3b4a6eb Merged in release-1.9: 

[jira] [Comment Edited] (FLINK-15010) Temp directories flink-netty-shuffle-* are not cleaned up

2019-12-16 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16997108#comment-16997108 ] zhijiang edited comment on FLINK-15010 at 12/16/19 9:26 AM: Hey [~NicoK],

[jira] [Comment Edited] (FLINK-15010) Temp directories flink-netty-shuffle-* are not cleaned up

2019-12-16 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16997108#comment-16997108 ] zhijiang edited comment on FLINK-15010 at 12/16/19 9:19 AM: Hey [~NicoK],

[jira] [Commented] (FLINK-15010) Temp directories flink-netty-shuffle-* are not cleaned up

2019-12-16 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16997108#comment-16997108 ] zhijiang commented on FLINK-15010: -- Hey [~NicoK], thanks for reporting this. I want to further confirm

[jira] [Assigned] (FLINK-15105) Resuming Externalized Checkpoint after terminal failure (rocks, incremental) end-to-end test stalls on travis

2019-12-15 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang reassigned FLINK-15105: Assignee: Congxian Qiu(klion26) > Resuming Externalized Checkpoint after terminal failure

[jira] [Comment Edited] (FLINK-15069) Supplement the pipelined shuffle compression case for benchmark

2019-12-15 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16993600#comment-16993600 ] zhijiang edited comment on FLINK-15069 at 12/16/19 5:27 AM: Fixed in master: 

[jira] [Closed] (FLINK-15069) Supplement the pipelined shuffle compression case for benchmark

2019-12-15 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang closed FLINK-15069. Resolution: Fixed > Supplement the pipelined shuffle compression case for benchmark >

[jira] [Updated] (FLINK-14952) Yarn containers can exceed physical memory limits when using BoundedBlockingSubpartition.

2019-12-12 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-14952: - Release Note: This changes the option key and default value for the type of

[jira] [Closed] (FLINK-14952) Yarn containers can exceed physical memory limits when using BoundedBlockingSubpartition.

2019-12-12 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang closed FLINK-14952. Release Note: This changes the option key and default value for the type of BoundedBlockingSubpartition

[jira] [Reopened] (FLINK-15069) Supplement the pipelined shuffle compression case for benchmark

2019-12-11 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang reopened FLINK-15069: -- > Supplement the pipelined shuffle compression case for benchmark >

[jira] [Comment Edited] (FLINK-15069) Supplement the pipelined shuffle compression case for benchmark

2019-12-11 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16994090#comment-16994090 ] zhijiang edited comment on FLINK-15069 at 12/12/19 2:30 AM: Exactly, after

[jira] [Comment Edited] (FLINK-15069) Supplement the pipelined shuffle compression case for benchmark

2019-12-11 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16994090#comment-16994090 ] zhijiang edited comment on FLINK-15069 at 12/12/19 2:23 AM: Exactly, after

[jira] [Commented] (FLINK-15069) Supplement the pipelined shuffle compression case for benchmark

2019-12-11 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16994090#comment-16994090 ] zhijiang commented on FLINK-15069: -- Exactly, after this ticket merged I planed to submit a PR for

[jira] [Comment Edited] (FLINK-15153) Service selector needs to contain jobmanager component label

2019-12-11 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16993148#comment-16993148 ] zhijiang edited comment on FLINK-15153 at 12/12/19 2:16 AM: Fixed in master: 

[jira] [Closed] (FLINK-15069) Supplement the pipelined shuffle compression case for benchmark

2019-12-11 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang closed FLINK-15069. Resolution: Fixed Fixed in master: 04ab225056714013fa3bf4dfb590edac7b577d03 > Supplement the pipelined

[jira] [Assigned] (FLINK-14952) Yarn containers can exceed physical memory limits when using BoundedBlockingSubpartition.

2019-12-10 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang reassigned FLINK-14952: Assignee: zhijiang > Yarn containers can exceed physical memory limits when using >

[jira] [Assigned] (FLINK-15140) Shuffle data compression does not work with BroadcastRecordWriter.

2019-12-10 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang reassigned FLINK-15140: Assignee: Yingjie Cao > Shuffle data compression does not work with BroadcastRecordWriter. >

[jira] [Commented] (FLINK-14952) Yarn containers can exceed physical memory limits when using BoundedBlockingSubpartition.

2019-12-10 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16993207#comment-16993207 ] zhijiang commented on FLINK-14952: -- As [~kevin.cyj] mentioned above, the current blocking partition

[jira] [Created] (FLINK-15187) Reuse LocalBufferPool for FileBufferReader in blocking partition

2019-12-10 Thread zhijiang (Jira)
zhijiang created FLINK-15187: Summary: Reuse LocalBufferPool for FileBufferReader in blocking partition Key: FLINK-15187 URL: https://issues.apache.org/jira/browse/FLINK-15187 Project: Flink

[jira] [Assigned] (FLINK-15104) Performance regression on 4.12.2019 in RocksDB benchmarks

2019-12-10 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang reassigned FLINK-15104: Assignee: Yun Tang > Performance regression on 4.12.2019 in RocksDB benchmarks >

[jira] [Comment Edited] (FLINK-14952) Yarn containers can exceed physical memory limits when using BoundedBlockingSubpartition.

2019-12-10 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16993168#comment-16993168 ] zhijiang edited comment on FLINK-14952 at 12/11/19 3:48 AM: Generally

[jira] [Commented] (FLINK-14952) Yarn containers can exceed physical memory limits when using BoundedBlockingSubpartition.

2019-12-10 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16993168#comment-16993168 ] zhijiang commented on FLINK-14952: -- Generally we want to provide a better performance setting as a

[jira] [Assigned] (FLINK-15153) Service selector needs to contain jobmanager component label

2019-12-10 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang reassigned FLINK-15153: Assignee: Yang Wang > Service selector needs to contain jobmanager component label >

[jira] [Closed] (FLINK-15153) Service selector needs to contain jobmanager component label

2019-12-10 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang closed FLINK-15153. Resolution: Fixed Fixed in master: 4286fca12faf97e6089c7600896bb4a7af6f9c36 > Service selector needs to

[jira] [Commented] (FLINK-15166) Shuffle data compression wrongly decrease the buffer reference count.

2019-12-10 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992403#comment-16992403 ] zhijiang commented on FLINK-15166: -- Fixed in release-1.10 : 52a2f03eff658c5ec70b223a2c1551a96b4809dd >

[jira] [Resolved] (FLINK-15166) Shuffle data compression wrongly decrease the buffer reference count.

2019-12-10 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang resolved FLINK-15166. -- Resolution: Fixed Fixed in master : 4d693c4fbc5e6f3ff34ccb3cb3a1d9f35d6bbd76 > Shuffle data

[jira] [Assigned] (FLINK-15166) Shuffle data compression wrongly decrease the buffer reference count.

2019-12-10 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang reassigned FLINK-15166: Assignee: Yingjie Cao > Shuffle data compression wrongly decrease the buffer reference count. >

[jira] [Updated] (FLINK-14551) Unaligned checkpoints

2019-12-09 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-14551: - Fix Version/s: (was: 1.10.0) 1.11.0 > Unaligned checkpoints >

[jira] [Assigned] (FLINK-14032) Make the cache size of RocksDBPriorityQueueSetFactory configurable

2019-12-09 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang reassigned FLINK-14032: Assignee: Yun Tang > Make the cache size of RocksDBPriorityQueueSetFactory configurable >

[jira] [Updated] (FLINK-15070) Supplement cases of blocking partition with compression for benchmark

2019-12-09 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-15070: - Summary: Supplement cases of blocking partition with compression for benchmark (was: Supplement the

[jira] [Updated] (FLINK-15070) Supplement the case of blocking partition with compression for benchmark

2019-12-09 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-15070: - Description: ATM the benchmark only covers the case of pipelined partition used in streaming job, so

[jira] [Updated] (FLINK-15070) Supplement the case of blocking partition with compression for benchmark

2019-12-09 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-15070: - Summary: Supplement the case of blocking partition with compression for benchmark (was: Supplement the

[jira] [Updated] (FLINK-15069) Supplement the pipelined shuffle compression case for benchmark

2019-12-09 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-15069: - Description: While reviewing the [PR|

[jira] [Updated] (FLINK-15069) Supplement the pipelined shuffle compression case for benchmark

2019-12-09 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-15069: - Summary: Supplement the pipelined shuffle compression case for benchmark (was: Supplement the

[jira] [Assigned] (FLINK-15069) Supplement the compression case for benchmark

2019-12-09 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang reassigned FLINK-15069: Assignee: zhijiang > Supplement the compression case for benchmark >

[jira] [Assigned] (FLINK-15070) Supplement the case of bounded blocking partition for benchmark

2019-12-09 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang reassigned FLINK-15070: Assignee: Haibo Sun > Supplement the case of bounded blocking partition for benchmark >

[jira] [Assigned] (FLINK-15109) InternalTimerServiceImpl references restored state after use, taking up resources unnecessarily

2019-12-08 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang reassigned FLINK-15109: Assignee: Roman Khachatryan > InternalTimerServiceImpl references restored state after use,

[jira] [Resolved] (FLINK-15109) InternalTimerServiceImpl references restored state after use, taking up resources unnecessarily

2019-12-08 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang resolved FLINK-15109. -- Resolution: Fixed Fixed in master: 59ac51814c46d790f1ae030e1a199bddf00a8b01 >

[jira] [Updated] (FLINK-15109) InternalTimerServiceImpl references restored state after use, taking up resources unnecessarily

2019-12-08 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-15109: - Fix Version/s: 1.10.0 > InternalTimerServiceImpl references restored state after use, taking up >

[jira] [Commented] (FLINK-14845) Introduce data compression to blocking shuffle.

2019-12-08 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16991107#comment-16991107 ] zhijiang commented on FLINK-14845: -- [~pnowojski] Yes, exactly we would verify the effects via benchmark

[jira] [Created] (FLINK-15070) Supplement the case of bounded blocking partition for benchmark

2019-12-05 Thread zhijiang (Jira)
zhijiang created FLINK-15070: Summary: Supplement the case of bounded blocking partition for benchmark Key: FLINK-15070 URL: https://issues.apache.org/jira/browse/FLINK-15070 Project: Flink

[jira] [Created] (FLINK-15069) Supplement the compression case for benchmark

2019-12-05 Thread zhijiang (Jira)
zhijiang created FLINK-15069: Summary: Supplement the compression case for benchmark Key: FLINK-15069 URL: https://issues.apache.org/jira/browse/FLINK-15069 Project: Flink Issue Type: Task

[jira] [Assigned] (FLINK-15030) Potential deadlock for bounded blocking ResultPartition.

2019-12-02 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang reassigned FLINK-15030: Assignee: Yingjie Cao > Potential deadlock for bounded blocking ResultPartition. >

[jira] [Created] (FLINK-15021) Refactor to remove channelWritabilityChanged from PartitionRequestQueue

2019-12-02 Thread zhijiang (Jira)
zhijiang created FLINK-15021: Summary: Refactor to remove channelWritabilityChanged from PartitionRequestQueue Key: FLINK-15021 URL: https://issues.apache.org/jira/browse/FLINK-15021 Project: Flink

[jira] [Updated] (FLINK-14516) Remove non credit based network code

2019-12-02 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang updated FLINK-14516: - Parent: FLINK-7282 Issue Type: Sub-task (was: Task) > Remove non credit based network code >

[jira] [Closed] (FLINK-14956) MemoryMappedBoundedData Compressed Buffer Slicer

2019-11-28 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang closed FLINK-14956. Resolution: Duplicate > MemoryMappedBoundedData Compressed Buffer Slicer >

[jira] [Commented] (FLINK-14956) MemoryMappedBoundedData Compressed Buffer Slicer

2019-11-28 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16984777#comment-16984777 ] zhijiang commented on FLINK-14956: -- I would close this duplicated issue to focus on FLINK-14845 only.

[jira] [Assigned] (FLINK-14920) Set up environment to run performance e2e tests

2019-11-22 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang reassigned FLINK-14920: Assignee: Aihua Li > Set up environment to run performance e2e tests >

[jira] [Assigned] (FLINK-14919) Add performance e2e test suite for basic operations

2019-11-22 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang reassigned FLINK-14919: Assignee: Aihua Li > Add performance e2e test suite for basic operations >

[jira] [Assigned] (FLINK-14918) Add performance e2e test module and scripts

2019-11-22 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang reassigned FLINK-14918: Assignee: Aihua Li > Add performance e2e test module and scripts >

[jira] [Assigned] (FLINK-14928) Documentation links check nightly run failed on travis

2019-11-22 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang reassigned FLINK-14928: Assignee: Congxian Qiu(klion26) (was: Yu Li) > Documentation links check nightly run failed on

[jira] [Assigned] (FLINK-14928) Documentation links check nightly run failed on travis

2019-11-22 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang reassigned FLINK-14928: Assignee: Yu Li > Documentation links check nightly run failed on travis >

[jira] [Assigned] (FLINK-14926) Make sure no resource leak of RocksObject

2019-11-22 Thread zhijiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhijiang reassigned FLINK-14926: Assignee: Yu Li > Make sure no resource leak of RocksObject >

<    1   2   3   4   5   6   7   8   9   10   >