[jira] [Commented] (FLINK-22085) KafkaSourceLegacyITCase hangs/fails on azure

2021-06-14 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17363298#comment-17363298 ] Dong Lin commented on FLINK-22085: -- [~xintongsong] No... after spending 2+ hours over the weekend to

[jira] [Commented] (FLINK-22085) KafkaSourceLegacyITCase hangs/fails on azure

2021-06-14 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17363324#comment-17363324 ] Dong Lin commented on FLINK-22085: -- [~xintongsong] Sure, please feel free to un-assign me. Thanks! >

[jira] [Created] (FLINK-22915) Extend Flink ML API to support Estimator/Transformer DAG

2021-06-08 Thread Dong Lin (Jira)
Dong Lin created FLINK-22915: Summary: Extend Flink ML API to support Estimator/Transformer DAG Key: FLINK-22915 URL: https://issues.apache.org/jira/browse/FLINK-22915 Project: Flink Issue Type:

[jira] [Commented] (FLINK-22085) KafkaSourceLegacyITCase hangs/fails on azure

2021-06-20 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17366359#comment-17366359 ] Dong Lin commented on FLINK-22085: -- [~gaoyunhaii] Thanks for the investigation. Previously I have

[jira] [Updated] (FLINK-22915) Update Flink ML library to support Estimator/Transformer DAG and online learning

2021-06-22 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated FLINK-22915: - Description: The existing Flink ML library allows users to compose an Estimator/Transformer from a

[jira] [Updated] (FLINK-22915) Update Flink ML library to support Estimator/Transformer DAG and online learning

2021-06-22 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated FLINK-22915: - Description: The existing Flink ML API allows users to compose an Estimator/Transformer from a

[jira] [Updated] (FLINK-22915) Update Flink ML library to support Estimator/Transformer DAG and online learning

2021-06-22 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated FLINK-22915: - Description: Currently Flink ML API allows users to compose an Estimator/Transformer from a pipeline

[jira] [Updated] (FLINK-22915) Update Flink ML library to support Estimator/Transformer DAG and online learning

2021-06-23 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated FLINK-22915: - Description: The existing Flink ML library allows users to compose an Estimator/Transformer from a

[jira] [Updated] (FLINK-22915) FLIP-173: Update Flink ML library to support Estimator/Transformer DAG and online learning

2021-07-06 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated FLINK-22915: - Description: The FLIP design doc can be found at

[jira] [Commented] (FLINK-22085) KafkaSourceLegacyITCase hangs/fails on azure

2021-07-01 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17373128#comment-17373128 ] Dong Lin commented on FLINK-22085: -- Thanks you [~gaoyunhaii] for the explanation! Do you plan to

[jira] [Comment Edited] (FLINK-22085) KafkaSourceLegacyITCase hangs/fails on azure

2021-04-26 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17332957#comment-17332957 ] Dong Lin edited comment on FLINK-22085 at 4/27/21, 5:53 AM: Thank you

[jira] [Commented] (FLINK-22488) KafkaSourceLegacyITCase.testOneToOneSources failed due to "OperatorEvent from an OperatorCoordinator to a task was lost"

2021-04-27 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17333032#comment-17333032 ] Dong Lin commented on FLINK-22488: -- [~dwysakowicz] Right, FLINK-21996 tries to address the issue where

[jira] [Commented] (FLINK-22085) KafkaSourceLegacyITCase hangs/fails on azure

2021-04-26 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17332957#comment-17332957 ] Dong Lin commented on FLINK-22085: -- Thank you [~dwysakowicz] for the information. For the first test

[jira] [Created] (FLINK-22488) KafkaSourceLegacyITCase.testOneToOneSources failed due to "OperatorEvent from an OperatorCoordinator to a task was lost"

2021-04-26 Thread Dong Lin (Jira)
Dong Lin created FLINK-22488: Summary: KafkaSourceLegacyITCase.testOneToOneSources failed due to "OperatorEvent from an OperatorCoordinator to a task was lost" Key: FLINK-22488 URL:

[jira] [Commented] (FLINK-22085) KafkaSourceLegacyITCase hangs/fails on azure

2021-04-27 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17333085#comment-17333085 ] Dong Lin commented on FLINK-22085: -- [~dwysakowicz] I see. Previously the test would be fail with

[jira] [Commented] (FLINK-22085) KafkaSourceLegacyITCase hangs/fails on azure

2021-04-27 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17333172#comment-17333172 ] Dong Lin commented on FLINK-22085: -- [~dwysakowicz] Hmm... why would the test hang in a random spot if

[jira] [Comment Edited] (FLINK-22085) KafkaSourceLegacyITCase hangs/fails on azure

2021-04-23 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17330815#comment-17330815 ] Dong Lin edited comment on FLINK-22085 at 4/23/21, 2:29 PM: [~dwysakowicz]

[jira] [Commented] (FLINK-22085) KafkaSourceLegacyITCase hangs/fails on azure

2021-04-23 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17330815#comment-17330815 ] Dong Lin commented on FLINK-22085: -- [~dwysakowicz] After applying

[jira] [Created] (FLINK-21335) READEME should use "mvn install" instead of "mvn package" to compile Flink

2021-02-09 Thread Dong Lin (Jira)
Dong Lin created FLINK-21335: Summary: READEME should use "mvn install" instead of "mvn package" to compile Flink Key: FLINK-21335 URL: https://issues.apache.org/jira/browse/FLINK-21335 Project: Flink

[jira] [Updated] (FLINK-21335) README should use "mvn install" instead of "mvn package" to compile Flink

2021-02-09 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated FLINK-21335: - Summary: README should use "mvn install" instead of "mvn package" to compile Flink (was: READEME

[jira] [Commented] (FLINK-21335) README should use "mvn install" instead of "mvn package" to compile Flink

2021-02-09 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17281770#comment-17281770 ] Dong Lin commented on FLINK-21335: -- I agree it is better to use "mvn package" if the goal is just to

[jira] [Commented] (FLINK-21335) README should use "mvn install" instead of "mvn package" to compile Flink

2021-02-09 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17281788#comment-17281788 ] Dong Lin commented on FLINK-21335: -- Thank you [~chesnay] for the reference link. It seems that the wiki

[jira] [Created] (FLINK-21976) Move Flink ML pipeline API and library code to a separate repository named flink-ml

2021-03-25 Thread Dong Lin (Jira)
Dong Lin created FLINK-21976: Summary: Move Flink ML pipeline API and library code to a separate repository named flink-ml Key: FLINK-21976 URL: https://issues.apache.org/jira/browse/FLINK-21976 Project:

[jira] [Commented] (FLINK-21976) Move Flink ML pipeline API and library code to a separate repository named flink-ml

2021-03-25 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17308777#comment-17308777 ] Dong Lin commented on FLINK-21976: -- +[~becket_qin] FYI > Move Flink ML pipeline API and library code

[jira] [Commented] (FLINK-20114) Test Kafka Source based on the new Source API 

2021-03-30 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17311175#comment-17311175 ] Dong Lin commented on FLINK-20114: -- Hi [~rmetzger], thank you for doing the test! Here is the status

[jira] [Comment Edited] (FLINK-21214) FlinkKafkaProducerITCase.testScaleDownBeforeFirstCheckpoint Failed

2021-03-30 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17311261#comment-17311261 ] Dong Lin edited comment on FLINK-21214 at 3/30/21, 8:18 AM: [~dwysakowicz] 

[jira] [Commented] (FLINK-21214) FlinkKafkaProducerITCase.testScaleDownBeforeFirstCheckpoint Failed

2021-03-30 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17311261#comment-17311261 ] Dong Lin commented on FLINK-21214: -- [~dwysakowicz] we have investigated this bug previously and the

[jira] [Commented] (FLINK-21214) FlinkKafkaProducerITCase.testScaleDownBeforeFirstCheckpoint Failed

2021-03-30 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17311269#comment-17311269 ] Dong Lin commented on FLINK-21214: -- Thank you Dawid for keeping track of these bugs! >

[jira] [Updated] (FLINK-22012) Add nightly-build pipeline to test flink-ml repo with the latest flink repo snapshot

2021-03-29 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated FLINK-22012: - Priority: Major (was: Blocker) > Add nightly-build pipeline to test flink-ml repo with the latest

[jira] [Created] (FLINK-22012) Add nightly-build pipeline to test flink-ml repo with the latest flink repo snapshot

2021-03-29 Thread Dong Lin (Jira)
Dong Lin created FLINK-22012: Summary: Add nightly-build pipeline to test flink-ml repo with the latest flink repo snapshot Key: FLINK-22012 URL: https://issues.apache.org/jira/browse/FLINK-22012

[jira] [Created] (FLINK-22013) Add CI to run tests in Azure DevOps pipeline for every flink-ml pull request

2021-03-29 Thread Dong Lin (Jira)
Dong Lin created FLINK-22013: Summary: Add CI to run tests in Azure DevOps pipeline for every flink-ml pull request Key: FLINK-22013 URL: https://issues.apache.org/jira/browse/FLINK-22013 Project: Flink

[jira] [Updated] (FLINK-22013) Add Github Actions to flink-ml for every push and pull request

2021-03-30 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated FLINK-22013: - Summary: Add Github Actions to flink-ml for every push and pull request (was: Add CI to run tests in

[jira] [Closed] (FLINK-21691) KafkaSource fails with NPE when setting it up

2021-03-10 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin closed FLINK-21691. Resolution: Duplicate Close this JIRA since it duplicates

[jira] [Updated] (FLINK-21160) ValueDeserializerWrapper throws NullPointerException when getProducedType is invoked

2021-03-10 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated FLINK-21160: - Description: The variable {{deserializer}} in class {{ValueDeserializerWrapper}} won't be instantiated

[jira] [Updated] (FLINK-21160) ValueDeserializerWrapper throws NullPointerException when getProducedType is invoked

2021-03-10 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated FLINK-21160: - Description: The variable {{deserializer}} in class {{ValueDeserializerWrapper}} won't be instantiated

[jira] [Updated] (FLINK-21160) ValueDeserializerWrapper throws NullPointerException when getProducedType is invoked

2021-03-10 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated FLINK-21160: - Description: The variable {{deserializer}} in class {{ValueDeserializerWrapper}} won't be instantiated

[jira] [Commented] (FLINK-21706) FlinkKafkaProducerITCase.testMigrateFromAtExactlyOnceToAtLeastOnce fails with "SchemaException: Error reading field 'api_keys': Error reading field 'api_key': java.nio

2021-03-11 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17300066#comment-17300066 ] Dong Lin commented on FLINK-21706: -- I have investigated this bug. The bug is not currently reproducible

[jira] [Comment Edited] (FLINK-21706) FlinkKafkaProducerITCase.testMigrateFromAtExactlyOnceToAtLeastOnce fails with "SchemaException: Error reading field 'api_keys': Error reading field 'api_key': jav

2021-03-11 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17300066#comment-17300066 ] Dong Lin edited comment on FLINK-21706 at 3/12/21, 6:11 AM: I have

[jira] [Updated] (FLINK-20379) Update KafkaRecordDeserializationSchema to enable reuse of DeserializationSchema and KafkaDeserializationSchema

2021-03-01 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated FLINK-20379: - Summary: Update KafkaRecordDeserializationSchema to enable reuse of DeserializationSchema and

[jira] [Commented] (FLINK-21214) FlinkKafkaProducerITCase.testScaleDownBeforeFirstCheckpoint Failed

2021-02-24 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17289928#comment-17289928 ] Dong Lin commented on FLINK-21214: -- Given that this test has the same error message as

[jira] [Commented] (FLINK-20431) KafkaSourceReaderTest.testCommitOffsetsWithoutAliveFetchers:133->lambda$testCommitOffsetsWithoutAliveFetchers$3:134 expected:<10> but was:<1>

2021-02-25 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291364#comment-17291364 ] Dong Lin commented on FLINK-20431: -- According to the test history of the

[jira] [Commented] (FLINK-20928) KafkaSourceReaderTest.testOffsetCommitOnCheckpointComplete:189->pollUntil:270 » Timeout

2021-02-25 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291362#comment-17291362 ] Dong Lin commented on FLINK-20928: -- According to the test history of the

[jira] [Comment Edited] (FLINK-20928) KafkaSourceReaderTest.testOffsetCommitOnCheckpointComplete:189->pollUntil:270 » Timeout

2021-02-25 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291362#comment-17291362 ] Dong Lin edited comment on FLINK-20928 at 2/26/21, 3:16 AM: According to the

[jira] [Commented] (FLINK-16686) [State TTL] Make user class loader available in native RocksDB compaction thread

2021-02-22 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17288794#comment-17288794 ] Dong Lin commented on FLINK-16686: -- Discussed with [~yunta] about this bug. This bug is hard to fix

[jira] [Commented] (FLINK-16908) FlinkKafkaProducerITCase testScaleUpAfterScalingDown Timeout expired while initializing transactional state in 60000ms.

2021-04-07 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17316819#comment-17316819 ] Dong Lin commented on FLINK-16908: -- I think this is due to the same issue as described in

[jira] [Commented] (FLINK-18634) FlinkKafkaProducerITCase.testRecoverCommittedTransaction failed with "Timeout expired after 60000milliseconds while awaiting InitProducerId"

2021-04-07 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17316817#comment-17316817 ] Dong Lin commented on FLINK-18634: -- [~trohrmann] It appears that flink-tests/src/test's root logger

[jira] [Commented] (FLINK-18634) FlinkKafkaProducerITCase.testRecoverCommittedTransaction failed with "Timeout expired after 60000milliseconds while awaiting InitProducerId"

2021-04-08 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17316991#comment-17316991 ] Dong Lin commented on FLINK-18634: -- Sounds good. Thank you [~trohrmann] for fixing it. >

[jira] [Commented] (FLINK-22085) KafkaSourceLegacyITCase hangs/fails on azure

2021-04-15 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1738#comment-1738 ] Dong Lin commented on FLINK-22085: -- [~dwysakowicz] I have updated this JIRA with the root cause

[jira] [Updated] (FLINK-22085) KafkaSourceLegacyITCase hangs/fails on azure

2021-04-15 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated FLINK-22085: - Description: *Observations* 1) The Azure pipeline would occasionally hang without printing any test

[jira] [Updated] (FLINK-22085) KafkaSourceLegacyITCase hangs/fails on azure

2021-04-15 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated FLINK-22085: - Description: 1) Observations a) The Azure pipeline would occasionally hang without printing any test

[jira] [Commented] (FLINK-22085) KafkaSourceLegacyITCase hangs/fails on azure

2021-04-11 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17318958#comment-17318958 ] Dong Lin commented on FLINK-22085: -- [~dwysakowicz] Sure, I will take a look. > KafkaSourceLegacyITCase

[jira] [Commented] (FLINK-22085) KafkaSourceLegacyITCase hangs/fails on azure

2021-04-14 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17321044#comment-17321044 ] Dong Lin commented on FLINK-22085: -- [~dwysakowicz] Sorry, I was busy with other work and didn't realize

[jira] [Commented] (FLINK-22085) KafkaSourceLegacyITCase hangs/fails on azure

2021-04-14 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17321105#comment-17321105 ] Dong Lin commented on FLINK-22085: -- Sounds good. I will use my personal azure account. I am able to

[jira] [Commented] (FLINK-22085) KafkaSourceLegacyITCase hangs/fails on azure

2021-04-20 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17325643#comment-17325643 ] Dong Lin commented on FLINK-22085: -- Thanks for the information [~mapohl]. Previously I have verified

[jira] [Commented] (FLINK-18634) FlinkKafkaProducerITCase.testRecoverCommittedTransaction failed with "Timeout expired after 60000milliseconds while awaiting InitProducerId"

2021-02-18 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17286534#comment-17286534 ] Dong Lin commented on FLINK-18634: -- Sounds good. I will try to upgrade Kafka dependency to 2.5.1. >

[jira] [Commented] (FLINK-18634) FlinkKafkaProducerITCase.testRecoverCommittedTransaction failed with "Timeout expired after 60000milliseconds while awaiting InitProducerId"

2021-02-14 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17284445#comment-17284445 ] Dong Lin commented on FLINK-18634: -- - According to the log [1] from Till, testScaleUpAfterScalingDown

[jira] [Commented] (FLINK-18634) FlinkKafkaProducerITCase.testRecoverCommittedTransaction failed with "Timeout expired after 60000milliseconds while awaiting InitProducerId"

2021-02-14 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17284542#comment-17284542 ] Dong Lin commented on FLINK-18634: -- There is no Kafka 2.4.2 release. And we can not simply bump up the

[jira] [Commented] (FLINK-18634) FlinkKafkaProducerITCase.testRecoverCommittedTransaction failed with "Timeout expired after 60000milliseconds while awaiting InitProducerId"

2021-02-19 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17287086#comment-17287086 ] Dong Lin commented on FLINK-18634: -- Kafka 2.5.1 has dropped support for Scala 2.11. Flink will also

[jira] [Commented] (FLINK-22085) KafkaSourceLegacyITCase hangs/fails on azure

2021-04-21 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1732#comment-1732 ] Dong Lin commented on FLINK-22085: -- [~dwysakowicz] Yeah I am able to reproduce the test hang once. I

[jira] [Commented] (FLINK-22198) KafkaTableITCase hang.

2021-08-18 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17400893#comment-17400893 ] Dong Lin commented on FLINK-22198: -- I have taken a look at the test code and related logs (not

[jira] [Created] (FLINK-23959) FLIP-175: Add GraphBuilder to compose Estimator/Transformer/AlgoOperator from a DAG of stages

2021-08-24 Thread Dong Lin (Jira)
Dong Lin created FLINK-23959: Summary: FLIP-175: Add GraphBuilder to compose Estimator/Transformer/AlgoOperator from a DAG of stages Key: FLINK-23959 URL: https://issues.apache.org/jira/browse/FLINK-23959

[jira] [Updated] (FLINK-22915) FLIP-173: Support DAG of algorithms

2021-08-24 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated FLINK-22915: - Description: The FLIP design doc can be found at

[jira] [Commented] (FLINK-22198) KafkaTableITCase hang.

2021-08-20 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17402527#comment-17402527 ] Dong Lin commented on FLINK-22198: -- Hey [~fsk119], do you think it would be simpler to just change the

[jira] [Commented] (FLINK-22198) KafkaTableITCase hang.

2021-08-19 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17401669#comment-17401669 ] Dong Lin commented on FLINK-22198: -- Here are my findings regarding why the timestamp of the produced

[jira] [Commented] (FLINK-20928) KafkaSourceReaderTest.testOffsetCommitOnCheckpointComplete:189->pollUntil:270 » Timeout

2021-09-23 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17419263#comment-17419263 ] Dong Lin commented on FLINK-20928: -- [~dwysakowicz] I found a possible explanation for the flaky test

[jira] [Created] (FLINK-24398) KafkaSourceFetcherManager should re-use an existing SplitFetcher to commit offset if possible

2021-09-28 Thread Dong Lin (Jira)
Dong Lin created FLINK-24398: Summary: KafkaSourceFetcherManager should re-use an existing SplitFetcher to commit offset if possible Key: FLINK-24398 URL: https://issues.apache.org/jira/browse/FLINK-24398

[jira] [Created] (FLINK-24354) FLIP-174: Improve the WithParam interface

2021-09-22 Thread Dong Lin (Jira)
Dong Lin created FLINK-24354: Summary: FLIP-174: Improve the WithParam interface Key: FLINK-24354 URL: https://issues.apache.org/jira/browse/FLINK-24354 Project: Flink Issue Type: Improvement

[jira] [Updated] (FLINK-23959) FLIP-175: Add GraphBuilder to compose Estimator/Transformer/AlgoOperator from a DAG of stages

2021-09-22 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated FLINK-23959: - Description: The FLIP design doc can be found at

[jira] [Updated] (FLINK-24354) FLIP-174: Improve the WithParam interface

2021-12-28 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated FLINK-24354: - Issue Type: New Feature (was: Improvement) > FLIP-174: Improve the WithParam interface >

[jira] [Updated] (FLINK-24557) Support Knn in FlinkML

2021-12-28 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated FLINK-24557: - Fix Version/s: ml-2.0.0 > Support Knn in FlinkML > -- > > Key:

[jira] [Updated] (FLINK-24557) Support Knn in FlinkML

2021-12-28 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated FLINK-24557: - Issue Type: New Feature (was: Bug) > Support Knn in FlinkML > -- > >

[jira] [Updated] (FLINK-25121) Support ML Python API

2021-12-28 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated FLINK-25121: - Fix Version/s: ml-2.0.0 > Support ML Python API > - > > Key:

[jira] [Updated] (FLINK-23959) FLIP-175: Compose Estimator/Model/AlgoOperator from DAG of Estimator/Model/AlgoOperator

2021-12-28 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated FLINK-23959: - Issue Type: New Feature (was: Improvement) > FLIP-175: Compose Estimator/Model/AlgoOperator from DAG

[jira] [Updated] (FLINK-22915) FLIP-173: Support DAG of algorithms

2021-12-28 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated FLINK-22915: - Issue Type: New Feature (was: Improvement) > FLIP-173: Support DAG of algorithms >

[jira] [Updated] (FLINK-24810) Add Estimator and Model for the k-means clustering algorithm

2021-12-28 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated FLINK-24810: - Issue Type: New Feature (was: Improvement) > Add Estimator and Model for the k-means clustering

[jira] [Created] (FLINK-25509) FLIP-208: Update KafkaSource to detect EOF based on de-serialized records

2022-01-03 Thread Dong Lin (Jira)
Dong Lin created FLINK-25509: Summary: FLIP-208: Update KafkaSource to detect EOF based on de-serialized records Key: FLINK-25509 URL: https://issues.apache.org/jira/browse/FLINK-25509 Project: Flink

[jira] [Updated] (FLINK-25509) FLIP-208: Update KafkaSource to detect EOF based on de-serialized records

2022-01-03 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated FLINK-25509: - Issue Type: Improvement (was: Bug) > FLIP-208: Update KafkaSource to detect EOF based on de-serialized

[jira] [Updated] (FLINK-25509) FLIP-208: Update KafkaSource to detect EOF based on de-serialized records

2022-01-03 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated FLINK-25509: - Description: Please checkout

[jira] [Commented] (FLINK-25368) Use AdminClient to get offsets rather than KafkaConsumer

2021-12-26 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17465544#comment-17465544 ] Dong Lin commented on FLINK-25368: -- Thanks for the creating the ticket to improve Flink! I think the

[jira] [Updated] (FLINK-23959) FLIP-175: Compose Estimator/Model/AlgoOperator from DAG of Estimator/Model/AlgoOperator

2021-11-19 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated FLINK-23959: - Summary: FLIP-175: Compose Estimator/Model/AlgoOperator from DAG of Estimator/Model/AlgoOperator (was:

[jira] [Updated] (FLINK-24810) Add Estimator and Model for the k-means clustering algorithm

2021-11-06 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated FLINK-24810: - Component/s: Library / Machine Learning > Add Estimator and Model for the k-means clustering algorithm

[jira] [Updated] (FLINK-24354) FLIP-174: Improve the WithParam interface

2021-11-06 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated FLINK-24354: - Component/s: Library / Machine Learning > FLIP-174: Improve the WithParam interface >

[jira] [Updated] (FLINK-23959) FLIP-175: Add GraphBuilder to compose Estimator/Transformer/AlgoOperator from a DAG of stages

2021-11-06 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated FLINK-23959: - Component/s: Library / Machine Learning > FLIP-175: Add GraphBuilder to compose

[jira] [Updated] (FLINK-24810) Add Estimator and Model for the k-means clustering algorithm

2021-11-06 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated FLINK-24810: - Description: See [https://en.wikipedia.org/wiki/K-means_clustering] for the algorithm description.  

[jira] [Updated] (FLINK-24810) Add Estimator and Model for the k-means clustering algorithm

2021-11-06 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated FLINK-24810: - Description: See https://e n.wikipedia.org/wiki/K-means_clustering for the algorithm description.    

[jira] [Created] (FLINK-24810) Add Estimator and Model for the k-means clustering algorithm

2021-11-06 Thread Dong Lin (Jira)
Dong Lin created FLINK-24810: Summary: Add Estimator and Model for the k-means clustering algorithm Key: FLINK-24810 URL: https://issues.apache.org/jira/browse/FLINK-24810 Project: Flink Issue

[jira] [Updated] (FLINK-25148) PipelinedSubpartition.resumeConsumption throws IllegalStateException

2021-12-02 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated FLINK-25148: - Description: We observed the following stacktrace when running the unit test

[jira] [Updated] (FLINK-25148) PipelinedSubpartition.resumeConsumption throws IllegalStateException

2021-12-02 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated FLINK-25148: - Description: We observed the following stacktrace when running the unit test

[jira] [Updated] (FLINK-25148) PipelinedSubpartition.resumeConsumption throws IllegalStateException

2021-12-02 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated FLINK-25148: - Description: We observed the following stacktrace when running the unit test

[jira] [Updated] (FLINK-25148) PipelinedSubpartition.resumeConsumption throws IllegalStateException

2021-12-02 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated FLINK-25148: - Description: We observed the following stacktrace when running the unit test

[jira] [Created] (FLINK-25148) PipelinedSubpartition.resumeConsumption throws IllegalStateException

2021-12-02 Thread Dong Lin (Jira)
Dong Lin created FLINK-25148: Summary: PipelinedSubpartition.resumeConsumption throws IllegalStateException Key: FLINK-25148 URL: https://issues.apache.org/jira/browse/FLINK-25148 Project: Flink

[jira] [Assigned] (FLINK-26171) pyFlink -py options has issue with path that starts with //

2022-02-15 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin reassigned FLINK-26171: Assignee: Huang Xingbo > pyFlink -py options has issue with path that starts with // >

[jira] [Assigned] (FLINK-26313) Support Streaming KMeans in Flink ML

2022-03-03 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin reassigned FLINK-26313: Assignee: Yunfeng Zhou > Support Streaming KMeans in Flink ML >

[jira] [Updated] (FLINK-26313) Support Streaming KMeans in Flink ML

2022-03-03 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated FLINK-26313: - Component/s: Library / Machine Learning > Support Streaming KMeans in Flink ML >

[jira] [Updated] (FLINK-26100) Set up Flink ML Document Website

2022-02-14 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated FLINK-26100: - Issue Type: Improvement (was: New Feature) > Set up Flink ML Document Website >

[jira] [Updated] (FLINK-26100) Set up Flink ML Document Website

2022-02-14 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated FLINK-26100: - Component/s: Documentation > Set up Flink ML Document Website > > >

[jira] [Updated] (FLINK-26100) Set up Flink ML Document Website

2022-02-14 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated FLINK-26100: - Component/s: (was: Documentation) > Set up Flink ML Document Website >

[jira] [Assigned] (FLINK-26100) Set up Flink ML Document Website

2022-02-14 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin reassigned FLINK-26100: Assignee: Yunfeng Zhou > Set up Flink ML Document Website > > >

[jira] [Updated] (FLINK-25552) Add Estimator and Transformer for MinMaxScaler

2022-03-22 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated FLINK-25552: - Summary: Add Estimator and Transformer for MinMaxScaler (was: Support MinMaxScaler in FlinkML) > Add

[jira] [Updated] (FLINK-25527) Add Transformer and Estimator for StringIndexer

2022-03-22 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated FLINK-25527: - Summary: Add Transformer and Estimator for StringIndexer (was: Add StringIndexer in FlinkML) > Add

  1   2   3   4   5   6   7   8   >