[jira] [Commented] (FLINK-11972) The classpath is missing the `flink-shaded-hadoop2-uber-2.8.3-1.8.0.jar` JAR during the end-to-end test.

[ https://issues.apache.org/jira/browse/FLINK-11972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16797646#comment-16797646 ] Yu Li commented on FLINK-11972: --- Checked and confirmed with hadoop 2.6.5 the same test passed in both

[jira] [Commented] (FLINK-11972) The classpath is missing the `flink-shaded-hadoop2-uber-2.8.3-1.8.0.jar` JAR during the end-to-end test.

[ https://issues.apache.org/jira/browse/FLINK-11972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16797915#comment-16797915 ] Yu Li commented on FLINK-11972: --- Sure, let me open a JIRA for the left over issue. Thanks.

[jira] [Created] (FLINK-11990) Streaming bucketing end-to-end test fail with hadoop 2.8

Yu Li created FLINK-11990: - Summary: Streaming bucketing end-to-end test fail with hadoop 2.8 Key: FLINK-11990 URL: https://issues.apache.org/jira/browse/FLINK-11990 Project: Flink Issue Type: Bug

[jira] [Commented] (FLINK-11720) ES5: ElasticsearchSinkITCase failing

[ https://issues.apache.org/jira/browse/FLINK-11720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16811489#comment-16811489 ] Yu Li commented on FLINK-11720: --- Observed the same failure on Linux 3.10.0 when verifying release

[jira] [Updated] (FLINK-12064) RocksDBKeyedStateBackend snapshot uses incorrect key serializer if reconfigure happens during restore

[ https://issues.apache.org/jira/browse/FLINK-12064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated FLINK-12064: -- Summary: RocksDBKeyedStateBackend snapshot uses incorrect key serializer if reconfigure happens during

[jira] [Commented] (FLINK-12064) RocksDBKeyedStateBackend snapshot uses incorrect key serializer if reconfigure happens during restore

[ https://issues.apache.org/jira/browse/FLINK-12064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16805733#comment-16805733 ] Yu Li commented on FLINK-12064: --- bq. but the wrong one is snapshotted in checkpoints, is that correct?

[jira] [Commented] (FLINK-10819) JobManagerHAProcessFailureRecoveryITCase.testDispatcherProcessFailure is unstable

[ https://issues.apache.org/jira/browse/FLINK-10819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16806091#comment-16806091 ] Yu Li commented on FLINK-10819: --- Another instance: https://api.travis-ci.org/v3/job/513408208/log.txt

[jira] [Commented] (FLINK-10819) JobManagerHAProcessFailureRecoveryITCase.testDispatcherProcessFailure is unstable

[ https://issues.apache.org/jira/browse/FLINK-10819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16806094#comment-16806094 ] Yu Li commented on FLINK-10819: --- Two questions about issue here: 1. Why are we using scala

[jira] [Commented] (FLINK-12046) Increase records per invocation for serializerAvro benchmark to stabilize it

[ https://issues.apache.org/jira/browse/FLINK-12046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16803725#comment-16803725 ] Yu Li commented on FLINK-12046: --- [~pnowojski] [~tzulitai] FYI. > Increase records per invocation for

[jira] [Created] (FLINK-12045) Support force migration between incompatible state schemas/serializers

Yu Li created FLINK-12045: - Summary: Support force migration between incompatible state schemas/serializers Key: FLINK-12045 URL: https://issues.apache.org/jira/browse/FLINK-12045 Project: Flink

[jira] [Created] (FLINK-12046) Increase records per invocation for serializerAvro benchmark to stabilize it

Yu Li created FLINK-12046: - Summary: Increase records per invocation for serializerAvro benchmark to stabilize it Key: FLINK-12046 URL: https://issues.apache.org/jira/browse/FLINK-12046 Project: Flink

[jira] [Created] (FLINK-12064) RocksDBKeyedStateBackend uses incorrect key serializer if reconfigure happens during restore

Yu Li created FLINK-12064: - Summary: RocksDBKeyedStateBackend uses incorrect key serializer if reconfigure happens during restore Key: FLINK-12064 URL: https://issues.apache.org/jira/browse/FLINK-12064

[jira] [Commented] (FLINK-12064) RocksDBKeyedStateBackend uses incorrect key serializer if reconfigure happens during restore

[ https://issues.apache.org/jira/browse/FLINK-12064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16804874#comment-16804874 ] Yu Li commented on FLINK-12064: --- [~tzulitai] [~srichter] [~aljoscha] FYI. > RocksDBKeyedStateBackend uses

[jira] [Created] (FLINK-12066) Remove StateSerializerProvider field in keyed state backend

Yu Li created FLINK-12066: - Summary: Remove StateSerializerProvider field in keyed state backend Key: FLINK-12066 URL: https://issues.apache.org/jira/browse/FLINK-12066 Project: Flink Issue Type:

[jira] [Created] (FLINK-12121) Use composition instead of inheritance for the InternalKeyContext logic in backend

Yu Li created FLINK-12121: - Summary: Use composition instead of inheritance for the InternalKeyContext logic in backend Key: FLINK-12121 URL: https://issues.apache.org/jira/browse/FLINK-12121 Project: Flink

[jira] [Commented] (FLINK-12121) Use composition instead of inheritance for the InternalKeyContext logic in backend

[ https://issues.apache.org/jira/browse/FLINK-12121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16812243#comment-16812243 ] Yu Li commented on FLINK-12121: --- Mark as a blocker of FLINK-12066 > Use composition instead of

[jira] [Closed] (FLINK-10043) Refactor object construction/inititlization/restore code

[ https://issues.apache.org/jira/browse/FLINK-10043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li closed FLINK-10043. - Resolution: Implemented > Refactor object construction/inititlization/restore code >

[jira] [Reopened] (FLINK-10043) Refactor object construction/inititlization/restore code

[ https://issues.apache.org/jira/browse/FLINK-10043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li reopened FLINK-10043: --- Assignee: Yu Li (was: Stefan Richter) Reopening to add fix versions. > Refactor object

[jira] [Updated] (FLINK-10043) Refactor object construction/inititlization/restore code

[ https://issues.apache.org/jira/browse/FLINK-10043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated FLINK-10043: -- Fix Version/s: 1.8.0 Component/s: State Backends, Checkpointing > Refactor object

[jira] [Created] (FLINK-11804) Make sure the CloseableRegistry used in backend builder is registered with task

Yu Li created FLINK-11804: - Summary: Make sure the CloseableRegistry used in backend builder is registered with task Key: FLINK-11804 URL: https://issues.apache.org/jira/browse/FLINK-11804 Project: Flink

[jira] [Updated] (FLINK-11796) Remove Snapshotable interface

[ https://issues.apache.org/jira/browse/FLINK-11796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated FLINK-11796: -- Component/s: Runtime / State Backends > Remove Snapshotable interface > - > >

[jira] [Created] (FLINK-11796) Remove Snapshotable interface

Yu Li created FLINK-11796: - Summary: Remove Snapshotable interface Key: FLINK-11796 URL: https://issues.apache.org/jira/browse/FLINK-11796 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-11816) Changes of FLINK-11516 causes compilation failure

Yu Li created FLINK-11816: - Summary: Changes of FLINK-11516 causes compilation failure Key: FLINK-11816 URL: https://issues.apache.org/jira/browse/FLINK-11816 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-11814) Changes of FLINK-11516 causes compilation failure

Yu Li created FLINK-11814: - Summary: Changes of FLINK-11516 causes compilation failure Key: FLINK-11814 URL: https://issues.apache.org/jira/browse/FLINK-11814 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-11833) Cleanup unnecessary createKeyedStateBackend methods in StateBackend

Yu Li created FLINK-11833: - Summary: Cleanup unnecessary createKeyedStateBackend methods in StateBackend Key: FLINK-11833 URL: https://issues.apache.org/jira/browse/FLINK-11833 Project: Flink Issue

[jira] [Created] (FLINK-11730) Make HeapKeyedStateBackend follow the builder pattern

Yu Li created FLINK-11730: - Summary: Make HeapKeyedStateBackend follow the builder pattern Key: FLINK-11730 URL: https://issues.apache.org/jira/browse/FLINK-11730 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-11729) Make all state backends follow builder pattern

Yu Li created FLINK-11729: - Summary: Make all state backends follow builder pattern Key: FLINK-11729 URL: https://issues.apache.org/jira/browse/FLINK-11729 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-11731) Make DefaultOperatorStateBackend follow the builder pattern

Yu Li created FLINK-11731: - Summary: Make DefaultOperatorStateBackend follow the builder pattern Key: FLINK-11731 URL: https://issues.apache.org/jira/browse/FLINK-11731 Project: Flink Issue Type:

[jira] [Commented] (FLINK-11729) Make all state backends follow builder pattern

[ https://issues.apache.org/jira/browse/FLINK-11729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16775487#comment-16775487 ] Yu Li commented on FLINK-11729: --- The relative discussion in [PR of

[jira] [Commented] (FLINK-10044) Check proper RIA style and introduce it where missing

[ https://issues.apache.org/jira/browse/FLINK-10044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16775893#comment-16775893 ] Yu Li commented on FLINK-10044: --- It seems major target described here has been resolved along with 

[jira] [Commented] (FLINK-11892) Port conflict problem when do the end-to-end nightly-tests.

[ https://issues.apache.org/jira/browse/FLINK-11892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16791268#comment-16791268 ] Yu Li commented on FLINK-11892: --- +1, nice analysis on the root cause! I encountered the same issue on my

[jira] [Commented] (FLINK-11888) Refine document of how to run end-to-end tests

[ https://issues.apache.org/jira/browse/FLINK-11888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16791288#comment-16791288 ] Yu Li commented on FLINK-11888: --- [~sunjincheng121] has located the root cause of the port conflict issue

[jira] [Commented] (FLINK-11892) Port conflict when running nightly end-to-end tests

[ https://issues.apache.org/jira/browse/FLINK-11892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16791626#comment-16791626 ] Yu Li commented on FLINK-11892: --- More details about the difference between {{/usr/bin/env bash}} and

[jira] [Commented] (FLINK-11972) The classpath is missing the `flink-shaded-hadoop2-uber-2.8.3-1.8.0.jar` JAR during the end-to-end test.

[ https://issues.apache.org/jira/browse/FLINK-11972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16796935#comment-16796935 ] Yu Li commented on FLINK-11972: --- +1 on improving. Encountered the same issue in local Mac environment when

[jira] [Created] (FLINK-11986) Add micro benchmark for state operations

Yu Li created FLINK-11986: - Summary: Add micro benchmark for state operations Key: FLINK-11986 URL: https://issues.apache.org/jira/browse/FLINK-11986 Project: Flink Issue Type: Improvement

[jira] [Updated] (FLINK-11986) Add micro benchmark for state operations

[ https://issues.apache.org/jira/browse/FLINK-11986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated FLINK-11986: -- Component/s: Runtime / State Backends > Add micro benchmark for state operations >

[jira] [Created] (FLINK-11888) Refine document of how to run end-to-end tests

Yu Li created FLINK-11888: - Summary: Refine document of how to run end-to-end tests Key: FLINK-11888 URL: https://issues.apache.org/jira/browse/FLINK-11888 Project: Flink Issue Type: Improvement

[jira] [Commented] (FLINK-11888) Refine document of how to run end-to-end tests

[ https://issues.apache.org/jira/browse/FLINK-11888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16790567#comment-16790567 ] Yu Li commented on FLINK-11888: --- [~Zentol] Please let me know if you have any comments here, thanks in

[jira] [Updated] (FLINK-11937) Resolve small file problem in RocksDB incremental checkpoint

[ https://issues.apache.org/jira/browse/FLINK-11937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated FLINK-11937: -- Affects Version/s: (was: 1.7.2) > Resolve small file problem in RocksDB incremental checkpoint >

[jira] [Updated] (FLINK-11937) Resolve small file problem in RocksDB incremental checkpoint

[ https://issues.apache.org/jira/browse/FLINK-11937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated FLINK-11937: -- Fix Version/s: 1.9.0 > Resolve small file problem in RocksDB incremental checkpoint >

[jira] [Comment Edited] (FLINK-11990) Streaming bucketing end-to-end test fail with hadoop 2.8

[ https://issues.apache.org/jira/browse/FLINK-11990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16798106#comment-16798106 ] Yu Li edited comment on FLINK-11990 at 3/21/19 1:47 PM: Thanks for the double

[jira] [Commented] (FLINK-11990) Streaming bucketing end-to-end test fail with hadoop 2.8

[ https://issues.apache.org/jira/browse/FLINK-11990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16798106#comment-16798106 ] Yu Li commented on FLINK-11990: --- Thanks for the double check [~aljoscha]. Just ran locally with {{skip}}

[jira] [Commented] (FLINK-11990) Streaming bucketing end-to-end test fail with hadoop 2.8

[ https://issues.apache.org/jira/browse/FLINK-11990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16798408#comment-16798408 ] Yu Li commented on FLINK-11990: --- bq. The reason for this is that truncate support was first introduced in

[jira] [Commented] (FLINK-11972) The classpath is missing the `flink-shaded-hadoop2-uber-2.8.3-1.8.0.jar` JAR during the end-to-end test.

[ https://issues.apache.org/jira/browse/FLINK-11972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16797614#comment-16797614 ] Yu Li commented on FLINK-11972: --- I tried the streaming bucket case on two environments, Mac 10.14.3 and

[jira] [Commented] (FLINK-11972) The classpath is missing the `flink-shaded-hadoop2-uber-2.8.3-1.8.0.jar` JAR during the end-to-end test.

[ https://issues.apache.org/jira/browse/FLINK-11972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16797504#comment-16797504 ] Yu Li commented on FLINK-11972: --- There's another necessity to run the {{test_streaming_bucketing.sh}}

[jira] [Comment Edited] (FLINK-11972) The classpath is missing the `flink-shaded-hadoop2-uber-2.8.3-1.8.0.jar` JAR during the end-to-end test.

[ https://issues.apache.org/jira/browse/FLINK-11972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16797528#comment-16797528 ] Yu Li edited comment on FLINK-11972 at 3/20/19 8:37 PM: bq. I appreciate if you

[jira] [Assigned] (FLINK-11972) The classpath is missing the `flink-shaded-hadoop2-uber-2.8.3-1.8.0.jar` JAR during the end-to-end test.

[ https://issues.apache.org/jira/browse/FLINK-11972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li reassigned FLINK-11972: - Assignee: Yu Li > The classpath is missing the `flink-shaded-hadoop2-uber-2.8.3-1.8.0.jar` JAR >

[jira] [Commented] (FLINK-11972) The classpath is missing the `flink-shaded-hadoop2-uber-2.8.3-1.8.0.jar` JAR during the end-to-end test.

[ https://issues.apache.org/jira/browse/FLINK-11972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16797528#comment-16797528 ] Yu Li commented on FLINK-11972: --- bq. I appreciate if you want to take this ticket and fix all of them?

[jira] [Created] (FLINK-12688) Make serializer lazy initialization thread safe in StateDescriptor

Yu Li created FLINK-12688: - Summary: Make serializer lazy initialization thread safe in StateDescriptor Key: FLINK-12688 URL: https://issues.apache.org/jira/browse/FLINK-12688 Project: Flink Issue

[jira] [Commented] (FLINK-11987) Kafka producer occasionally throws NullpointerException

[ https://issues.apache.org/jira/browse/FLINK-11987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16852663#comment-16852663 ] Yu Li commented on FLINK-11987: --- Regarding the issue mentioned by [~chethanuk], from the posted stack the

[jira] [Commented] (FLINK-11987) Kafka producer occasionally throws NullpointerException

[ https://issues.apache.org/jira/browse/FLINK-11987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16852656#comment-16852656 ] Yu Li commented on FLINK-11987: --- Have created FLINK-12688 to fix the issue from inside {{StateDescriptor}}

[jira] [Created] (FLINK-12692) Support disk spilling in HeapKeyedStateBackend

Yu Li created FLINK-12692: - Summary: Support disk spilling in HeapKeyedStateBackend Key: FLINK-12692 URL: https://issues.apache.org/jira/browse/FLINK-12692 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-12696) Implement a MmapManager

Yu Li created FLINK-12696: - Summary: Implement a MmapManager Key: FLINK-12696 URL: https://issues.apache.org/jira/browse/FLINK-12696 Project: Flink Issue Type: Sub-task Components: Runtime

[jira] [Updated] (FLINK-12692) Support disk spilling in HeapKeyedStateBackend

[ https://issues.apache.org/jira/browse/FLINK-12692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated FLINK-12692: -- Fix Version/s: 1.9.0 We target at completing this work before the 1.9.0 release. > Support disk spilling in

[jira] [Created] (FLINK-12695) Implement a HeapStatusMonitor

Yu Li created FLINK-12695: - Summary: Implement a HeapStatusMonitor Key: FLINK-12695 URL: https://issues.apache.org/jira/browse/FLINK-12695 Project: Flink Issue Type: Sub-task Components:

[jira] [Created] (FLINK-12699) Reduce CPU consumption when snapshot/restore the spilled key-group

Yu Li created FLINK-12699: - Summary: Reduce CPU consumption when snapshot/restore the spilled key-group Key: FLINK-12699 URL: https://issues.apache.org/jira/browse/FLINK-12699 Project: Flink Issue

[jira] [Created] (FLINK-12694) Implement a HeapAccountingManager

Yu Li created FLINK-12694: - Summary: Implement a HeapAccountingManager Key: FLINK-12694 URL: https://issues.apache.org/jira/browse/FLINK-12694 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-12697) Support on-disk state storage for HeapKeyedStateBackend

Yu Li created FLINK-12697: - Summary: Support on-disk state storage for HeapKeyedStateBackend Key: FLINK-12697 URL: https://issues.apache.org/jira/browse/FLINK-12697 Project: Flink Issue Type:

[jira] [Created] (FLINK-12698) Implement a SpillLoadManager

Yu Li created FLINK-12698: - Summary: Implement a SpillLoadManager Key: FLINK-12698 URL: https://issues.apache.org/jira/browse/FLINK-12698 Project: Flink Issue Type: Sub-task Components:

[jira] [Created] (FLINK-12693) Store state per key-group in CopyOnWriteStateTable

Yu Li created FLINK-12693: - Summary: Store state per key-group in CopyOnWriteStateTable Key: FLINK-12693 URL: https://issues.apache.org/jira/browse/FLINK-12693 Project: Flink Issue Type: Sub-task

[jira] [Commented] (FLINK-12619) Support TERMINATE/SUSPEND Job with Checkpoint

[ https://issues.apache.org/jira/browse/FLINK-12619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16858747#comment-16858747 ] Yu Li commented on FLINK-12619: --- Thanks for the clarification about your thoughts [~aljoscha], but I still

[jira] [Assigned] (FLINK-12693) Store state per key-group in CopyOnWriteStateTable

[ https://issues.apache.org/jira/browse/FLINK-12693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li reassigned FLINK-12693: - Assignee: PengFei Li (was: Yu Li) > Store state per key-group in CopyOnWriteStateTable >

[jira] [Assigned] (FLINK-12699) Reduce CPU consumption when snapshot/restore the spilled key-group

[ https://issues.apache.org/jira/browse/FLINK-12699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li reassigned FLINK-12699: - Assignee: PengFei Li (was: Yu Li) > Reduce CPU consumption when snapshot/restore the spilled

[jira] [Comment Edited] (FLINK-12619) Support TERMINATE/SUSPEND Job with Checkpoint

[ https://issues.apache.org/jira/browse/FLINK-12619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16857585#comment-16857585 ] Yu Li edited comment on FLINK-12619 at 6/6/19 12:11 PM: Hi [~aljoscha], just saw

[jira] [Commented] (FLINK-12619) Support TERMINATE/SUSPEND Job with Checkpoint

[ https://issues.apache.org/jira/browse/FLINK-12619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16857585#comment-16857585 ] Yu Li commented on FLINK-12619: --- Hi [~aljoscha], just saw your comments. I agree that both checkpoint and

[jira] [Commented] (FLINK-12619) Support TERMINATE/SUSPEND Job with Checkpoint

[ https://issues.apache.org/jira/browse/FLINK-12619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16857579#comment-16857579 ] Yu Li commented on FLINK-12619: --- Although FLINK-6755 and this one are related, they actually don't block

[jira] [Commented] (FLINK-12619) Support TERMINATE/SUSPEND Job with Checkpoint

[ https://issues.apache.org/jira/browse/FLINK-12619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16857891#comment-16857891 ] Yu Li commented on FLINK-12619: --- bq. But users can choose to do a stop-with-savepoint using the optimized

[jira] [Comment Edited] (FLINK-12619) Support TERMINATE/SUSPEND Job with Checkpoint

[ https://issues.apache.org/jira/browse/FLINK-12619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16864068#comment-16864068 ] Yu Li edited comment on FLINK-12619 at 6/14/19 1:31 PM: Wrote a document to

[jira] [Commented] (FLINK-12619) Support TERMINATE/SUSPEND Job with Checkpoint

[ https://issues.apache.org/jira/browse/FLINK-12619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16864068#comment-16864068 ] Yu Li commented on FLINK-12619: --- Wrote a document to arrange and better share my thoughts, and below is a

[jira] [Comment Edited] (FLINK-12619) Support TERMINATE/SUSPEND Job with Checkpoint

[ https://issues.apache.org/jira/browse/FLINK-12619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16864068#comment-16864068 ] Yu Li edited comment on FLINK-12619 at 6/14/19 1:32 PM: Wrote a document to

[jira] [Comment Edited] (FLINK-8871) Checkpoint cancellation is not propagated to stop checkpointing threads on the task manager

[ https://issues.apache.org/jira/browse/FLINK-8871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16845585#comment-16845585 ] Yu Li edited comment on FLINK-8871 at 5/22/19 6:51 AM: --- bq. His solution (also

[jira] [Commented] (FLINK-8871) Checkpoint cancellation is not propagated to stop checkpointing threads on the task manager

[ https://issues.apache.org/jira/browse/FLINK-8871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16845507#comment-16845507 ] Yu Li commented on FLINK-8871: -- bq. Yun Tang Your solution sounds good, but it would wait for other things

[jira] [Commented] (FLINK-8871) Checkpoint cancellation is not propagated to stop checkpointing threads on the task manager

[ https://issues.apache.org/jira/browse/FLINK-8871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16845585#comment-16845585 ] Yu Li commented on FLINK-8871: -- bq. His solution (also proposed by us) is now meaningless, I just gave my

[jira] [Commented] (FLINK-8871) Checkpoint cancellation is not propagated to stop checkpointing threads on the task manager

[ https://issues.apache.org/jira/browse/FLINK-8871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16845747#comment-16845747 ] Yu Li commented on FLINK-8871: -- bq. Please pay attention to your words, I think you are close to attacking

[jira] [Commented] (FLINK-8871) Checkpoint cancellation is not propagated to stop checkpointing threads on the task manager

[ https://issues.apache.org/jira/browse/FLINK-8871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16845835#comment-16845835 ] Yu Li commented on FLINK-8871: -- bq. Can the word robbery be used at will? There's obvious a quote in my

[jira] [Commented] (FLINK-8871) Checkpoint cancellation is not propagated to stop checkpointing threads on the task manager

[ https://issues.apache.org/jira/browse/FLINK-8871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16844625#comment-16844625 ] Yu Li commented on FLINK-8871: -- [~yanghua] Could you please explain about the assignment of the JIRA? I

[jira] [Assigned] (FLINK-8871) Checkpoint cancellation is not propagated to stop checkpointing threads on the task manager

[ https://issues.apache.org/jira/browse/FLINK-8871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li reassigned FLINK-8871: Assignee: Yun Tang (was: vinoyang) [~yanghua] Watching an issue for a long time doesn't contribute to

[jira] [Resolved] (FLINK-11986) Add micro benchmark for state operations

[ https://issues.apache.org/jira/browse/FLINK-11986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li resolved FLINK-11986. --- Resolution: Implemented Fix Version/s: 1.9.0 PR already merged and integrated into our Jenkins and

[jira] [Commented] (FLINK-12350) RocksDBStateBackendTest doesn't cover the incremental checkpoint code path

[ https://issues.apache.org/jira/browse/FLINK-12350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16827807#comment-16827807 ] Yu Li commented on FLINK-12350: --- This issue is discovered during test of FLINK-12296 and thanks [~klion26]

[jira] [Created] (FLINK-12350) RocksDBStateBackendTest doesn't cover the incremental checkpoint code path

Yu Li created FLINK-12350: - Summary: RocksDBStateBackendTest doesn't cover the incremental checkpoint code path Key: FLINK-12350 URL: https://issues.apache.org/jira/browse/FLINK-12350 Project: Flink

[jira] [Created] (FLINK-12355) KafkaITCase.testTimestamps is unstable

Yu Li created FLINK-12355: - Summary: KafkaITCase.testTimestamps is unstable Key: FLINK-12355 URL: https://issues.apache.org/jira/browse/FLINK-12355 Project: Flink Issue Type: Test

[jira] [Updated] (FLINK-12355) KafkaITCase.testTimestamps is unstable

[ https://issues.apache.org/jira/browse/FLINK-12355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated FLINK-12355: -- Labels: test-stability (was: ) Component/s: (was: Tests) Test Infrastructure

[jira] [Updated] (FLINK-11820) SimpleStringSchema handle message record which value is null

[ https://issues.apache.org/jira/browse/FLINK-11820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated FLINK-11820: -- Affects Version/s: 1.8.0 Fix Version/s: (was: 1.7.3) Issue Type: Bug (was:

[jira] [Resolved] (FLINK-12400) NullpointerException using SimpleStringSchema with Kafka

[ https://issues.apache.org/jira/browse/FLINK-12400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li resolved FLINK-12400. --- Resolution: Duplicate > NullpointerException using SimpleStringSchema with Kafka >

[jira] [Commented] (FLINK-7289) Memory allocation of RocksDB can be problematic in container environments

[ https://issues.apache.org/jira/browse/FLINK-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16874752#comment-16874752 ] Yu Li commented on FLINK-7289: -- Thanks for the note [~srichter], I agree this is a great suggestion (thanks

[jira] [Commented] (FLINK-12054) HBaseConnectorITCase fails on Java 9

[ https://issues.apache.org/jira/browse/FLINK-12054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16882819#comment-16882819 ] Yu Li commented on FLINK-12054: --- Adding more background here, that HBase project decided to only support

[jira] [Commented] (FLINK-13251) Add bandwidth throttling for checkpoint uploading/downloading

[ https://issues.apache.org/jira/browse/FLINK-13251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884078#comment-16884078 ] Yu Li commented on FLINK-13251: --- W.r.t the design for implementation, plan to use a similar way like

[jira] [Created] (FLINK-13251) Add bandwidth throttling for checkpoint uploading/downloading

Yu Li created FLINK-13251: - Summary: Add bandwidth throttling for checkpoint uploading/downloading Key: FLINK-13251 URL: https://issues.apache.org/jira/browse/FLINK-13251 Project: Flink Issue Type:

[jira] [Commented] (FLINK-13034) Improve the performance when checking whether mapstate is empty for RocksDBStateBackend

[ https://issues.apache.org/jira/browse/FLINK-13034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884101#comment-16884101 ] Yu Li commented on FLINK-13034: --- bq. Modify RocksDBMapState back to previous design which would first load

[jira] [Updated] (FLINK-12916) KeyedComplexChainTest.testMigrationAndRestore failed on Travis

[ https://issues.apache.org/jira/browse/FLINK-12916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated FLINK-12916: -- Priority: Blocker (was: Critical) Marking as blocker since from comment history the case failed frequently

[jira] [Commented] (FLINK-13188) Flink runtime MockTtlStateTest failed 94

[ https://issues.apache.org/jira/browse/FLINK-13188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885080#comment-16885080 ] Yu Li commented on FLINK-13188: --- [~lunge] Mind explain how this is fixed? It seems to me the PR is not

[jira] [Commented] (FLINK-13034) Improve the performance when checking whether mapstate is empty for RocksDBStateBackend

[ https://issues.apache.org/jira/browse/FLINK-13034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884950#comment-16884950 ] Yu Li commented on FLINK-13034: --- After an offline check with [~yunta], we confirmed this is a regression

[jira] [Assigned] (FLINK-11428) BufferFileWriterFileSegmentReaderTest#testWriteRead failed on Travis

[ https://issues.apache.org/jira/browse/FLINK-11428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li reassigned FLINK-11428: - Assignee: Congxian Qiu(klion26) (was: Yu Li) > BufferFileWriterFileSegmentReaderTest#testWriteRead

[jira] [Updated] (FLINK-13034) Improve the performance when checking whether mapstate is empty for RocksDBStateBackend

[ https://issues.apache.org/jira/browse/FLINK-13034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated FLINK-13034: -- Affects Version/s: 1.6.3 1.7.2 1.8.1 Priority:

[jira] [Commented] (FLINK-12296) Data loss silently in RocksDBStateBackend when more than one operator(has states) chained in a single task

[ https://issues.apache.org/jira/browse/FLINK-12296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823988#comment-16823988 ] Yu Li commented on FLINK-12296: --- Thanks for filing the JIRA [~klion26]. Is this some regression issue or

[jira] [Commented] (FLINK-13436) Add TPC-H queries as E2E tests

[ https://issues.apache.org/jira/browse/FLINK-13436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16895843#comment-16895843 ] Yu Li commented on FLINK-13436: --- According to the [license

[jira] [Commented] (FLINK-13512) Kinesis connector missing jaxb-api dependency

[ https://issues.apache.org/jira/browse/FLINK-13512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16910810#comment-16910810 ] Yu Li commented on FLINK-13512: --- Checked the license of

[jira] [Updated] (FLINK-12697) Support on-disk state storage for spill-able heap backend

[ https://issues.apache.org/jira/browse/FLINK-12697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated FLINK-12697: -- Summary: Support on-disk state storage for spill-able heap backend (was: Support on-disk state storage for

[jira] [Created] (FLINK-13815) Implement the SpaceAllocator

Yu Li created FLINK-13815: - Summary: Implement the SpaceAllocator Key: FLINK-13815 URL: https://issues.apache.org/jira/browse/FLINK-13815 Project: Flink Issue Type: Sub-task Components:

[jira] [Created] (FLINK-13803) Introduce SpillableHeapKeyedStateBackend and all necessities

Yu Li created FLINK-13803: - Summary: Introduce SpillableHeapKeyedStateBackend and all necessities Key: FLINK-13803 URL: https://issues.apache.org/jira/browse/FLINK-13803 Project: Flink Issue Type:

  1   2   3   4   5   6   7   8   9   10   >