[jira] [Updated] (FLINK-27193) Kyro Serialisation and Deserialisation returns a different object

2022-04-11 Thread Akshay Hazari (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akshay Hazari updated FLINK-27193: -- Description: We have a unit test to check if Kyro serialisation and deserialisation results

[jira] [Updated] (FLINK-27193) Kyro Serialisation and Deserialisation returns a different object

2022-04-11 Thread Akshay Hazari (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akshay Hazari updated FLINK-27193: -- Priority: Minor (was: Not a Priority) > Kyro Serialisation and Deserialisation returns a

[jira] [Updated] (FLINK-27193) Kyro Serialisation and Deserialisation returns a different object

2022-04-11 Thread Akshay Hazari (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akshay Hazari updated FLINK-27193: -- Description: We have a unit test to check if Kyro serialisation and deserialisation results

[jira] [Created] (FLINK-27193) Kyro Serialisation and Deserialisation returns a different object

2022-04-11 Thread Akshay Hazari (Jira)
Akshay Hazari created FLINK-27193: - Summary: Kyro Serialisation and Deserialisation returns a different object Key: FLINK-27193 URL: https://issues.apache.org/jira/browse/FLINK-27193 Project: Flink

[jira] [Commented] (FLINK-27190) Revisit error handling in main reconcile() loop

2022-04-11 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520915#comment-17520915 ] Gyula Fora commented on FLINK-27190: What improvements do you suggest? > Revisit error handling in

[GitHub] [flink] liuzhuang2017 commented on a diff in pull request #19413: [FLINK-16078] [docs-zh] Translate "Tuning Checkpoints and Large State…

2022-04-11 Thread GitBox
liuzhuang2017 commented on code in PR #19413: URL: https://github.com/apache/flink/pull/19413#discussion_r847981768 ## docs/content.zh/docs/ops/state/large_state_tuning.md: ## @@ -166,149 +125,101 @@ public class MyOptionsFactory implements ConfigurableRocksDBOptionsFactory {

[jira] [Commented] (FLINK-27165) Benchmark test SerializationFrameworkMiniBenchmarks#serializerHeavyString became unstable

2022-04-11 Thread Anton Kalashnikov (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520914#comment-17520914 ] Anton Kalashnikov commented on FLINK-27165: --- I can try to take a look. But I don't see that it

[GitHub] [flink] masteryhx commented on a diff in pull request #19142: [FLINK-23252][changelog] Support recovery from checkpoint after disab…

2022-04-11 Thread GitBox
masteryhx commented on code in PR #19142: URL: https://github.com/apache/flink/pull/19142#discussion_r847968836 ## flink-runtime/src/main/java/org/apache/flink/runtime/checkpoint/metadata/MetadataV2V3SerializerBase.java: ## @@ -391,7 +394,7 @@ static void

[jira] [Updated] (FLINK-27192) Parquet File Read From Local

2022-04-11 Thread Karthik (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik updated FLINK-27192: Issue Type: Technical Debt (was: Bug) > Parquet File Read From Local > > >

[GitHub] [flink-table-store] JingsongLi commented on a diff in pull request #87: [FLINK-27123] Introduce filter predicate for 'LIKE'

2022-04-11 Thread GitBox
JingsongLi commented on code in PR #87: URL: https://github.com/apache/flink-table-store/pull/87#discussion_r847944688 ## flink-table-store-core/src/main/java/org/apache/flink/table/store/file/predicate/StartsWith.java: ## @@ -0,0 +1,62 @@ +/* + * Licensed to the Apache

[GitHub] [flink-table-store] JingsongLi commented on a diff in pull request #87: [FLINK-27123] Introduce filter predicate for 'LIKE'

2022-04-11 Thread GitBox
JingsongLi commented on code in PR #87: URL: https://github.com/apache/flink-table-store/pull/87#discussion_r847942602 ## flink-table-store-core/src/test/java/org/apache/flink/table/store/file/predicate/PredicateTest.java: ## @@ -325,11 +345,29 @@ public void

[jira] [Updated] (FLINK-26761) Fix the cast exception thrown by PreValidateReWriter when insert into/overwrite a partitioned table.

2022-04-11 Thread godfrey he (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] godfrey he updated FLINK-26761: --- Fix Version/s: 1.16.0 > Fix the cast exception thrown by PreValidateReWriter when insert >

[jira] [Commented] (FLINK-26761) Fix the cast exception thrown by PreValidateReWriter when insert into/overwrite a partitioned table.

2022-04-11 Thread godfrey he (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520902#comment-17520902 ] godfrey he commented on FLINK-26761: [~zoucao] you are right, it's a bug. would you like to fix it ?

[jira] [Updated] (FLINK-27192) Parquet File Read From Local

2022-04-11 Thread Karthik (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik updated FLINK-27192: Component/s: Table SQL / API Table SQL / Client Fix Version/s: 1.13.6

[jira] [Updated] (FLINK-27189) Support to always add quotes for string data in CSV format

2022-04-11 Thread Dian Fu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dian Fu updated FLINK-27189: Summary: Support to always add quotes for string data in CSV format (was: Ability for table api to

[jira] [Updated] (FLINK-27189) Ability for table api to always add quotes to generated csv

2022-04-11 Thread Dian Fu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dian Fu updated FLINK-27189: Component/s: Formats (JSON, Avro, Parquet, ORC, SequenceFile) (was: API / Python) >

[jira] [Created] (FLINK-27192) Hi,

2022-04-11 Thread Karthik (Jira)
Karthik created FLINK-27192: --- Summary: Hi, Key: FLINK-27192 URL: https://issues.apache.org/jira/browse/FLINK-27192 Project: Flink Issue Type: Bug Reporter: Karthik -- This

[jira] [Commented] (FLINK-27138) flink1.14.0-sql-job submit failed:Flink doesn't support individual window table-valued function TUMBLE

2022-04-11 Thread yanbiao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520899#comment-17520899 ] yanbiao commented on FLINK-27138: - [~martijnvisser] got it,thanks for your help:) > flink1.14.0-sql-job

[jira] [Assigned] (FLINK-26829) ClassCastException will be thrown when the second operand of divide is a function call

2022-04-11 Thread godfrey he (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] godfrey he reassigned FLINK-26829: -- Assignee: luoyuxia > ClassCastException will be thrown when the second operand of divide is

[jira] [Commented] (FLINK-25242) UDF with primitive int argument does not accept int values even after a not null filter

2022-04-11 Thread godfrey he (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520898#comment-17520898 ] godfrey he commented on FLINK-25242: good catch~ > UDF with primitive int argument does not accept

[GitHub] [flink-ml] weibozhao commented on a diff in pull request #83: [FLINK-27170] Add Transformer and Estimator of Ftrl

2022-04-11 Thread GitBox
weibozhao commented on code in PR #83: URL: https://github.com/apache/flink-ml/pull/83#discussion_r847916030 ## flink-ml-lib/src/main/java/org/apache/flink/ml/classification/logisticregression/LinearModelData.java: ## @@ -37,60 +38,68 @@ import java.io.OutputStream; /** - *

[GitHub] [flink-ml] weibozhao commented on a diff in pull request #83: [FLINK-27170] Add Transformer and Estimator of Ftrl

2022-04-11 Thread GitBox
weibozhao commented on code in PR #83: URL: https://github.com/apache/flink-ml/pull/83#discussion_r847915850 ## flink-ml-lib/src/main/java/org/apache/flink/ml/classification/logisticregression/LinearModelData.java: ## @@ -37,60 +38,68 @@ import java.io.OutputStream; /** - *

[jira] [Resolved] (FLINK-26757) change the default value of state.backend.rocksdb.restore-overlap-fraction-threshold

2022-04-11 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang resolved FLINK-26757. -- Resolution: Fixed merged in master: 4034d3cd6d13e88e2e5ca101510bf333e94a53fa > change the default

[GitHub] [flink] Myasuka merged pull request #19324: [FLINK-26757][state] Change the default value of state.backend.rocksdb.restore-overlap-fraction-threshold to 0

2022-04-11 Thread GitBox
Myasuka merged PR #19324: URL: https://github.com/apache/flink/pull/19324 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [flink] Myasuka commented on a diff in pull request #19413: [FLINK-16078] [docs-zh] Translate "Tuning Checkpoints and Large State…

2022-04-11 Thread GitBox
Myasuka commented on code in PR #19413: URL: https://github.com/apache/flink/pull/19413#discussion_r847908442 ## docs/content.zh/docs/ops/state/large_state_tuning.md: ## @@ -166,149 +125,101 @@ public class MyOptionsFactory implements ConfigurableRocksDBOptionsFactory { }

[GitHub] [flink] zoltar9264 commented on a diff in pull request #19252: [FLINK-25867][docs] translate ChangelogBackend documentation to chinese

2022-04-11 Thread GitBox
zoltar9264 commented on code in PR #19252: URL: https://github.com/apache/flink/pull/19252#discussion_r847906550 ## docs/content.zh/docs/ops/state/state_backends.md: ## @@ -38,6 +38,8 @@ under the License. 在启动 CheckPoint 机制时,状态会随着 CheckPoint 而持久化,以防止数据丢失、保障恢复时的一致性。

[GitHub] [flink] zoltar9264 commented on pull request #19252: [FLINK-25867][docs] translate ChangelogBackend documentation to chinese

2022-04-11 Thread GitBox
zoltar9264 commented on PR #19252: URL: https://github.com/apache/flink/pull/19252#issuecomment-1095911460 Thank for your review again @masteryhx , I hive fixed problems you mentioned. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [flink] zoltar9264 commented on a diff in pull request #19252: [FLINK-25867][docs] translate ChangelogBackend documentation to chinese

2022-04-11 Thread GitBox
zoltar9264 commented on code in PR #19252: URL: https://github.com/apache/flink/pull/19252#discussion_r847905580 ## docs/content.zh/docs/ops/state/state_backends.md: ## @@ -306,77 +329,75 @@ public class MyOptionsFactory implements ConfigurableRocksDBOptionsFactory { {{<

[GitHub] [flink] luoyuxia commented on pull request #19400: [FLINK-25142][Connectors / Hive]Fix user-defined hive udtf initialize exception in hive dialect

2022-04-11 Thread GitBox
luoyuxia commented on PR #19400: URL: https://github.com/apache/flink/pull/19400#issuecomment-1095903340 Thanks @Tartarus0zm for contribution. It's a continue work of #17990. LGTM. @beyond1920 @wuchong Could you please help review & merge? -- This is an automated message from the

[jira] [Updated] (FLINK-27191) Support multi kerberos-enabled Hive clusters

2022-04-11 Thread luoyuxia (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] luoyuxia updated FLINK-27191: - Component/s: Connectors / Hive > Support multi kerberos-enabled Hive clusters >

[jira] [Created] (FLINK-27191) Support multi kerberos-enabled Hive clusters

2022-04-11 Thread luoyuxia (Jira)
luoyuxia created FLINK-27191: Summary: Support multi kerberos-enabled Hive clusters Key: FLINK-27191 URL: https://issues.apache.org/jira/browse/FLINK-27191 Project: Flink Issue Type:

[GitHub] [flink] luoyuxia commented on pull request #19423: [FLINK-27175][hive] Support to call Hive UDAF when the UDAF accepts one parameter with array type

2022-04-11 Thread GitBox
luoyuxia commented on PR #19423: URL: https://github.com/apache/flink/pull/19423#issuecomment-1095873524 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [flink] flinkbot commented on pull request #19429: [hotfix][docs] Fix the "capacity-planning" page of "Tuning Checkpoint…

2022-04-11 Thread GitBox
flinkbot commented on PR #19429: URL: https://github.com/apache/flink/pull/19429#issuecomment-1095867338 ## CI report: * 9e092e3dfca1ea6effdf2edd26acdf9c590d5ac6 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[GitHub] [flink] wenlong88 commented on pull request #19179: [FLINK-26756][table-planner] Fix the deserialization error for match recognize

2022-04-11 Thread GitBox
wenlong88 commented on PR #19179: URL: https://github.com/apache/flink/pull/19179#issuecomment-1095863004 LGTM -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [flink] liuzhuang2017 opened a new pull request, #19429: [hotfix][docs] Fix the "capacity-planning" page of "Tuning Checkpoint…

2022-04-11 Thread GitBox
liuzhuang2017 opened a new pull request, #19429: URL: https://github.com/apache/flink/pull/19429 Fix the "capacity-planning" page of "Tuning Checkpoints and Large State" ## What is the purpose of the change Fix the "capacity-planning" page of "Tuning Checkpoints and

[GitHub] [flink-table-store] LadyForest commented on a diff in pull request #87: [FLINK-27123] Introduce filter predicate for 'LIKE'

2022-04-11 Thread GitBox
LadyForest commented on code in PR #87: URL: https://github.com/apache/flink-table-store/pull/87#discussion_r847890543 ## flink-table-store-core/src/main/java/org/apache/flink/table/store/file/predicate/PredicateConverter.java: ## @@ -95,9 +102,46 @@ public Predicate

[GitHub] [flink] zoltar9264 commented on a diff in pull request #19252: [FLINK-25867][docs] translate ChangelogBackend documentation to chinese

2022-04-11 Thread GitBox
zoltar9264 commented on code in PR #19252: URL: https://github.com/apache/flink/pull/19252#discussion_r847887144 ## docs/content.zh/docs/ops/state/state_backends.md: ## @@ -306,77 +329,75 @@ public class MyOptionsFactory implements ConfigurableRocksDBOptionsFactory { {{<

[GitHub] [flink] zoltar9264 commented on a diff in pull request #19252: [FLINK-25867][docs] translate ChangelogBackend documentation to chinese

2022-04-11 Thread GitBox
zoltar9264 commented on code in PR #19252: URL: https://github.com/apache/flink/pull/19252#discussion_r847885936 ## docs/content.zh/docs/ops/state/state_backends.md: ## @@ -38,6 +38,8 @@ under the License. 在启动 CheckPoint 机制时,状态会随着 CheckPoint 而持久化,以防止数据丢失、保障恢复时的一致性。

[GitHub] [flink] masteryhx commented on a diff in pull request #19252: [FLINK-25867][docs] translate ChangelogBackend documentation to chinese

2022-04-11 Thread GitBox
masteryhx commented on code in PR #19252: URL: https://github.com/apache/flink/pull/19252#discussion_r847882156 ## docs/content.zh/docs/ops/state/state_backends.md: ## @@ -306,77 +329,75 @@ public class MyOptionsFactory implements ConfigurableRocksDBOptionsFactory { {{< top

[GitHub] [flink] masteryhx commented on a diff in pull request #19252: [FLINK-25867][docs] translate ChangelogBackend documentation to chinese

2022-04-11 Thread GitBox
masteryhx commented on code in PR #19252: URL: https://github.com/apache/flink/pull/19252#discussion_r847877301 ## docs/content.zh/docs/ops/state/state_backends.md: ## @@ -38,6 +38,8 @@ under the License. 在启动 CheckPoint 机制时,状态会随着 CheckPoint 而持久化,以防止数据丢失、保障恢复时的一致性。

[jira] [Commented] (FLINK-27018) timestamp missing end zero when outputing to kafka

2022-04-11 Thread Yao Zhang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520882#comment-17520882 ] Yao Zhang commented on FLINK-27018: --- Hi [~fpaul] and [~jeff-zou] , I reproduced this issue with Flink

[GitHub] [flink-table-store] JingsongLi commented on a diff in pull request #87: [FLINK-27123] Introduce filter predicate for 'LIKE'

2022-04-11 Thread GitBox
JingsongLi commented on code in PR #87: URL: https://github.com/apache/flink-table-store/pull/87#discussion_r847865264 ## flink-table-store-core/src/main/java/org/apache/flink/table/store/file/predicate/PredicateConverter.java: ## @@ -95,9 +102,46 @@ public Predicate

[GitHub] [flink] beyond1920 closed pull request #19109: [FLINK-26681][hive] Support sql statement end with ";" for Hive dialect query

2022-04-11 Thread GitBox
beyond1920 closed pull request #19109: [FLINK-26681][hive] Support sql statement end with ";" for Hive dialect query URL: https://github.com/apache/flink/pull/19109 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [flink-ml] yunfengzhou-hub commented on a diff in pull request #83: [FLINK-27170] Add Transformer and Estimator of Ftrl

2022-04-11 Thread GitBox
yunfengzhou-hub commented on code in PR #83: URL: https://github.com/apache/flink-ml/pull/83#discussion_r847844186 ## flink-ml-lib/src/main/java/org/apache/flink/ml/classification/ftrl/Ftrl.java: ## @@ -0,0 +1,395 @@ +/* Review Comment: Jira tickets for algorithms that are

[jira] [Commented] (FLINK-27187) The attemptsPerUpload metric may be lower than it actually is

2022-04-11 Thread Feifan Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520859#comment-17520859 ] Feifan Wang commented on FLINK-27187: - I think it's ok. Should I open a new ticket do this work ? Or

[jira] [Commented] (FLINK-27187) The attemptsPerUpload metric may be lower than it actually is

2022-04-11 Thread Roman Khachatryan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520845#comment-17520845 ] Roman Khachatryan commented on FLINK-27187: --- How about "totalAttemptsPerUpload"? > The

[jira] [Commented] (FLINK-27187) The attemptsPerUpload metric may be lower than it actually is

2022-04-11 Thread Feifan Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520836#comment-17520836 ] Feifan Wang commented on FLINK-27187: - [~roman] , how would you like to name the metric of "the

[jira] [Commented] (FLINK-27187) The attemptsPerUpload metric may be lower than it actually is

2022-04-11 Thread Roman Khachatryan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520833#comment-17520833 ] Roman Khachatryan commented on FLINK-27187: --- The number of the successfull attempt is actually

[jira] [Commented] (FLINK-27132) CheckpointResourcesCleanupRunner might discard shared state of the initial checkpoint

2022-04-11 Thread Roman Khachatryan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520830#comment-17520830 ] Roman Khachatryan commented on FLINK-27132: --- Sorry, I mean the 5th item. And yes, I mean ZK

[jira] [Updated] (FLINK-26070) Update dependency numpy to >=1.21.0,<1.22

2022-04-11 Thread Flink Jira Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Flink Jira Bot updated FLINK-26070: --- Labels: pull-request-available stale-major (was: pull-request-available) I am the [Flink

[jira] [Updated] (FLINK-25962) Flink generated Avro schemas can't be parsed using Python

2022-04-11 Thread Flink Jira Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Flink Jira Bot updated FLINK-25962: --- Labels: pull-request-available stale-major (was: pull-request-available) I am the [Flink

[jira] [Updated] (FLINK-21383) Docker image does not play well together with ConfigMap based flink-conf.yamls

2022-04-11 Thread Flink Jira Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Flink Jira Bot updated FLINK-21383: --- Labels: auto-deprioritized-major usability (was: stale-major usability) Priority:

[jira] [Updated] (FLINK-27132) CheckpointResourcesCleanupRunner might discard shared state of the initial checkpoint

2022-04-11 Thread Roman Khachatryan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roman Khachatryan updated FLINK-27132: -- Description: When considering the following case: # A job starts from a checkpoint in

[jira] [Updated] (FLINK-27132) CheckpointResourcesCleanupRunner might discard shared state of the initial checkpoint

2022-04-11 Thread Roman Khachatryan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roman Khachatryan updated FLINK-27132: -- Description: When considering the following case: # A job starts from a checkpoint in

[jira] [Updated] (FLINK-27132) CheckpointResourcesCleanupRunner might discard shared state of the initial checkpoint

2022-04-11 Thread Roman Khachatryan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roman Khachatryan updated FLINK-27132: -- Description: When considering the following case: # A job starts from a checkpoint in

[jira] [Commented] (FLINK-26811) Document CRD upgrade process

2022-04-11 Thread Ted Chang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520813#comment-17520813 ] Ted Chang commented on FLINK-26811: --- [~wangyang0918] good reference. I will add that. > Document CRD

[jira] [Commented] (FLINK-27101) Periodically break the chain of incremental checkpoint

2022-04-11 Thread Steven Zhen Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520811#comment-17520811 ] Steven Zhen Wu commented on FLINK-27101: [~yunta] a pluggable checkpoint trigger policy might

[jira] [Created] (FLINK-27190) Revisit error handling in main reconcile() loop

2022-04-11 Thread Matyas Orhidi (Jira)
Matyas Orhidi created FLINK-27190: - Summary: Revisit error handling in main reconcile() loop Key: FLINK-27190 URL: https://issues.apache.org/jira/browse/FLINK-27190 Project: Flink Issue

[GitHub] [flink] flinkbot commented on pull request #19428: [FLINK-25694] [file-system] Ugrade Presto

2022-04-11 Thread GitBox
flinkbot commented on PR #19428: URL: https://github.com/apache/flink/pull/19428#issuecomment-1095522423 ## CI report: * 8cb988ee3e60ba740733ece9b96bde1c86d5bef4 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Commented] (FLINK-25694) GSON/Alluxio Vulnerability

2022-04-11 Thread David Perkins (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520798#comment-17520798 ] David Perkins commented on FLINK-25694: --- A new version was finally released. Created a PR with the

[jira] [Updated] (FLINK-25694) GSON/Alluxio Vulnerability

2022-04-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-25694: --- Labels: pull-request-available (was: ) > GSON/Alluxio Vulnerability >

[GitHub] [flink] David-N-Perkins opened a new pull request, #19428: [FLINK-25694] [file-system] Ugrade Presto

2022-04-11 Thread GitBox
David-N-Perkins opened a new pull request, #19428: URL: https://github.com/apache/flink/pull/19428 ## What is the purpose of the change * Updated presto to the latest version due to GSON bug ## Brief change log - Updated prosto library to `.272` ## Verifying this change

[GitHub] [flink] flinkbot commented on pull request #19427: [FLINK-27140][coordination] Write job result in ioExecutor

2022-04-11 Thread GitBox
flinkbot commented on PR #19427: URL: https://github.com/apache/flink/pull/19427#issuecomment-1095484285 ## CI report: * 05707cf8955f190d65021d61c5afd8164e831315 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-27140) Move JobResultStore dirty entry creation into ioExecutor

2022-04-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-27140: --- Labels: pull-request-available (was: ) > Move JobResultStore dirty entry creation into

[GitHub] [flink] zentol opened a new pull request, #19427: [FLINK-27140][coordination] Write job result in ioExecutor

2022-04-11 Thread GitBox
zentol opened a new pull request, #19427: URL: https://github.com/apache/flink/pull/19427 Prevents the main thread from doing a potentially long running operation, moving it instead to the io executor. Needed to adjust some tests to rely on the runner termination future instead of

[jira] [Updated] (FLINK-26140) Add basic handling mechanism to deal with job upgrade errors

2022-04-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-26140: --- Labels: pull-request-available (was: ) > Add basic handling mechanism to deal with job

[GitHub] [flink-kubernetes-operator] gyfora commented on pull request #165: [FLINK-26140] Support rollback strategies

2022-04-11 Thread GitBox
gyfora commented on PR #165: URL: https://github.com/apache/flink-kubernetes-operator/pull/165#issuecomment-1095479699 Opening this for review/discussion, I will work on adding tests for the core logic. cc @wangyang0918 @tweise @Aitozi -- This is an automated message from the

[jira] [Created] (FLINK-27189) Ability for table api to always add quotes to generated csv

2022-04-11 Thread shameet (Jira)
shameet created FLINK-27189: --- Summary: Ability for table api to always add quotes to generated csv Key: FLINK-27189 URL: https://issues.apache.org/jira/browse/FLINK-27189 Project: Flink Issue

[jira] [Created] (FLINK-27188) Deprecate StreamingFileSink

2022-04-11 Thread Daisy Tsang (Jira)
Daisy Tsang created FLINK-27188: --- Summary: Deprecate StreamingFileSink Key: FLINK-27188 URL: https://issues.apache.org/jira/browse/FLINK-27188 Project: Flink Issue Type: Improvement

[GitHub] [flink] blake-wilson commented on pull request #19417: [FLINK-20060][Connectors / Kinesis] Add a Collector to KinsesisDeserializationSchema

2022-04-11 Thread GitBox
blake-wilson commented on PR #19417: URL: https://github.com/apache/flink/pull/19417#issuecomment-1095295771 Test failure is from a Kafka integration test and appears to be unrelated ``` 2022-04-11T07:53:52.3560140Z Apr 11 07:53:52 Caused by: java.lang.IllegalStateException: Cannot

[jira] [Created] (FLINK-27187) The attemptsPerUpload metric may be lower than it actually is

2022-04-11 Thread Feifan Wang (Jira)
Feifan Wang created FLINK-27187: --- Summary: The attemptsPerUpload metric may be lower than it actually is Key: FLINK-27187 URL: https://issues.apache.org/jira/browse/FLINK-27187 Project: Flink

[GitHub] [flink-kubernetes-operator] Aitozi commented on pull request #164: [FLINK-26871] Handle session job spec change

2022-04-11 Thread GitBox
Aitozi commented on PR #164: URL: https://github.com/apache/flink-kubernetes-operator/pull/164#issuecomment-1095272470 @gyfora I introduced the `SavepointObserver` and `JobStatusObserver` to solve the code duplication. Please take a look again -- This is an automated message from the

[GitHub] [flink] gaborgsomogyi commented on a diff in pull request #19372: [FLINK-26043][runtime][security] Add periodic kerberos relogin to KerberosDelegationTokenManager

2022-04-11 Thread GitBox
gaborgsomogyi commented on code in PR #19372: URL: https://github.com/apache/flink/pull/19372#discussion_r847507611 ## flink-runtime/src/main/java/org/apache/flink/runtime/security/token/KerberosDelegationTokenManager.java: ## @@ -110,13 +126,84 @@ public void

[GitHub] [flink] gaborgsomogyi commented on a diff in pull request #19372: [FLINK-26043][runtime][security] Add periodic kerberos relogin to KerberosDelegationTokenManager

2022-04-11 Thread GitBox
gaborgsomogyi commented on code in PR #19372: URL: https://github.com/apache/flink/pull/19372#discussion_r847504606 ## flink-runtime/src/test/java/org/apache/flink/runtime/security/token/KerberosDelegationTokenManagerTest.java: ## @@ -20,13 +20,27 @@ import

[GitHub] [flink] whitecloud6688 commented on pull request #19416: FlinkSQL中创建的表结构信息在SparkSQL中不可见

2022-04-11 Thread GitBox
whitecloud6688 commented on PR #19416: URL: https://github.com/apache/flink/pull/19416#issuecomment-1095242154 感谢回复,可能是我理解错了,FlinkSQL中创建的表,在SparkSQL中是不可读取数据的,如果要读,需要创建外部表关联到FlinkSQL表的路径。所以用desc Flink表是看不到字段的,但是能看到 Table Properties 中的 flink.schema 描述。 @luoyuxia @MartijnVisser -- This

[jira] [Commented] (FLINK-27155) Reduce multiple reads to the same Changelog file in the same taskmanager during restore

2022-04-11 Thread Feifan Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520657#comment-17520657 ] Feifan Wang commented on FLINK-27155: - Thanks for your reply [~roman] , I’m glad to implement this

[jira] [Commented] (FLINK-24700) Clarify semantics of filter, projection, partition, and metadata pushdown

2022-04-11 Thread Francesco Guardiani (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520654#comment-17520654 ] Francesco Guardiani commented on FLINK-24700: - Has this one already been solved [~twalthr]

[jira] [Closed] (FLINK-26905) Re-add FlinkDeploymentList and FlinkSessionJobList classes

2022-04-11 Thread Jira
[ https://issues.apache.org/jira/browse/FLINK-26905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Márton Balassi closed FLINK-26905. -- Resolution: Fixed Implemented via

[GitHub] [flink-kubernetes-operator] asfgit closed pull request #129: [FLINK-26905] Re-add FlinkDeploymentList and FlinkSessionJobList classes

2022-04-11 Thread GitBox
asfgit closed pull request #129: [FLINK-26905] Re-add FlinkDeploymentList and FlinkSessionJobList classes URL: https://github.com/apache/flink-kubernetes-operator/pull/129 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [flink] infoverload commented on a diff in pull request #19414: [FLINK 26389][tests] update deprecated operators in e2e tests

2022-04-11 Thread GitBox
infoverload commented on code in PR #19414: URL: https://github.com/apache/flink/pull/19414#discussion_r847454084 ## flink-end-to-end-tests/flink-stream-stateful-job-upgrade-test/src/main/java/org/apache/flink/streaming/tests/StatefulStreamJobUpgradeTestProgram.java: ## @@

[GitHub] [flink] slinkydeveloper commented on a diff in pull request #19426: [FLINK-25928] Throw validation error early for CAST

2022-04-11 Thread GitBox
slinkydeveloper commented on code in PR #19426: URL: https://github.com/apache/flink/pull/19426#discussion_r847453122 ## flink-table/flink-table-common/src/main/java/org/apache/flink/table/types/logical/utils/LogicalTypeCasts.java: ## @@ -589,6 +591,37 @@ protected Boolean

[GitHub] [flink] slinkydeveloper commented on a diff in pull request #19349: [FLINK-27043][table] Removing old csv format references

2022-04-11 Thread GitBox
slinkydeveloper commented on code in PR #19349: URL: https://github.com/apache/flink/pull/19349#discussion_r847448720 ## flink-table/flink-table-planner/src/test/java/org/apache/flink/table/test/WithTableEnvironment.java: ## @@ -0,0 +1,63 @@ +/* + * Licensed to the Apache

[GitHub] [flink-web] zentol commented on pull request #526: Announcement blogpost for the 1.15 release

2022-04-11 Thread GitBox
zentol commented on PR #526: URL: https://github.com/apache/flink-web/pull/526#issuecomment-1095162237 I would really like to see the experimental OpenAPI specification being part of the announcement. That's not something that existing users would stumble upon in the docs I'm afraid. --

[GitHub] [flink] twalthr commented on a diff in pull request #19349: [FLINK-27043][table] Removing old csv format references

2022-04-11 Thread GitBox
twalthr commented on code in PR #19349: URL: https://github.com/apache/flink/pull/19349#discussion_r847357250 ## flink-table/flink-table-planner/src/test/java/org/apache/flink/table/test/WithTableEnvironment.java: ## @@ -0,0 +1,51 @@ +/* + * Licensed to the Apache Software

[GitHub] [flink] flinkbot commented on pull request #19426: [FLINK-25928] Throw validation error early for CAST

2022-04-11 Thread GitBox
flinkbot commented on PR #19426: URL: https://github.com/apache/flink/pull/19426#issuecomment-1095157121 ## CI report: * 1dd50a02ec38485aa442a46ca439df7861565ed0 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[GitHub] [flink] matriv commented on pull request #19426: [FLINK-25928] Throw validation error early for CAST

2022-04-11 Thread GitBox
matriv commented on PR #19426: URL: https://github.com/apache/flink/pull/19426#issuecomment-1095153446 Added the validation only in the `supportsExplicitCasting` as there are cases where we do implicit casting between TIMESTAMP and numeric, i.e. In `TemporalTypesTest`: ```

[jira] [Updated] (FLINK-25928) Refactor timestamp<->number validation messages

2022-04-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-25928: --- Labels: pull-request-available (was: ) > Refactor timestamp<->number validation messages >

[GitHub] [flink] matriv opened a new pull request, #19426: [FLINK-25928] Throw validation error early for CAST

2022-04-11 Thread GitBox
matriv opened a new pull request, #19426: URL: https://github.com/apache/flink/pull/19426 ## What is the purpose of the change Throw early a validation error with workaround suggestion for casting between numeric types and `TIMESTAMP`/`TIMESTAMP_LTZ` before reaching the

[GitHub] [flink] gaborgsomogyi commented on a diff in pull request #19372: [FLINK-26043][runtime][security] Add periodic kerberos relogin to KerberosDelegationTokenManager

2022-04-11 Thread GitBox
gaborgsomogyi commented on code in PR #19372: URL: https://github.com/apache/flink/pull/19372#discussion_r847414464 ## flink-runtime/src/main/java/org/apache/flink/runtime/security/token/KerberosDelegationTokenManager.java: ## @@ -110,13 +126,84 @@ public void

[GitHub] [flink] gaborgsomogyi commented on a diff in pull request #19372: [FLINK-26043][runtime][security] Add periodic kerberos relogin to KerberosDelegationTokenManager

2022-04-11 Thread GitBox
gaborgsomogyi commented on code in PR #19372: URL: https://github.com/apache/flink/pull/19372#discussion_r847413385 ## flink-runtime/src/main/java/org/apache/flink/runtime/security/token/KerberosDelegationTokenManager.java: ## @@ -110,13 +126,84 @@ public void

[GitHub] [flink] zoltar9264 commented on pull request #19403: [FLINK-27120][docs-zh] Translate "Gradle" tab of development > conf > overview

2022-04-11 Thread GitBox
zoltar9264 commented on PR #19403: URL: https://github.com/apache/flink/pull/19403#issuecomment-1095130896 Thanks @RocMarshal , Is there any thing need I to do ? Such as squash commits ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [flink] zoltar9264 commented on a diff in pull request #19252: [FLINK-25867][docs] translate ChangelogBackend documentation to chinese

2022-04-11 Thread GitBox
zoltar9264 commented on code in PR #19252: URL: https://github.com/apache/flink/pull/19252#discussion_r847395187 ## docs/content.zh/docs/ops/state/state_backends.md: ## @@ -306,77 +329,75 @@ public class MyOptionsFactory implements ConfigurableRocksDBOptionsFactory { {{<

[GitHub] [flink] zoltar9264 commented on a diff in pull request #19252: [FLINK-25867][docs] translate ChangelogBackend documentation to chinese

2022-04-11 Thread GitBox
zoltar9264 commented on code in PR #19252: URL: https://github.com/apache/flink/pull/19252#discussion_r847393806 ## docs/content.zh/docs/ops/state/state_backends.md: ## @@ -306,77 +329,75 @@ public class MyOptionsFactory implements ConfigurableRocksDBOptionsFactory { {{<

[GitHub] [flink] zoltar9264 commented on a diff in pull request #19252: [FLINK-25867][docs] translate ChangelogBackend documentation to chinese

2022-04-11 Thread GitBox
zoltar9264 commented on code in PR #19252: URL: https://github.com/apache/flink/pull/19252#discussion_r847386103 ## docs/content.zh/docs/ops/state/state_backends.md: ## @@ -38,6 +38,8 @@ under the License. 在启动 CheckPoint 机制时,状态会随着 CheckPoint 而持久化,以防止数据丢失、保障恢复时的一致性。

[GitHub] [flink] gaborgsomogyi commented on a diff in pull request #19372: [FLINK-26043][runtime][security] Add periodic kerberos relogin to KerberosDelegationTokenManager

2022-04-11 Thread GitBox
gaborgsomogyi commented on code in PR #19372: URL: https://github.com/apache/flink/pull/19372#discussion_r847376435 ## flink-runtime/src/test/java/org/apache/flink/runtime/security/token/KerberosDelegationTokenManagerTest.java: ## @@ -79,4 +93,48 @@ public void

[GitHub] [flink] zoltar9264 commented on a diff in pull request #19252: [FLINK-25867][docs] translate ChangelogBackend documentation to chinese

2022-04-11 Thread GitBox
zoltar9264 commented on code in PR #19252: URL: https://github.com/apache/flink/pull/19252#discussion_r847374465 ## docs/content.zh/docs/ops/state/state_backends.md: ## @@ -306,77 +329,75 @@ public class MyOptionsFactory implements ConfigurableRocksDBOptionsFactory { {{<

[GitHub] [flink] slinkydeveloper commented on a diff in pull request #19414: [FLINK 26389][tests] update deprecated operators in e2e tests

2022-04-11 Thread GitBox
slinkydeveloper commented on code in PR #19414: URL: https://github.com/apache/flink/pull/19414#discussion_r847359774 ## flink-end-to-end-tests/flink-stream-stateful-job-upgrade-test/src/main/java/org/apache/flink/streaming/tests/StatefulStreamJobUpgradeTestProgram.java: ## @@

[GitHub] [flink] infoverload commented on a diff in pull request #19414: [FLINK 26389][tests] update deprecated operators in e2e tests

2022-04-11 Thread GitBox
infoverload commented on code in PR #19414: URL: https://github.com/apache/flink/pull/19414#discussion_r847355828 ## flink-end-to-end-tests/flink-stream-stateful-job-upgrade-test/src/main/java/org/apache/flink/streaming/tests/StatefulStreamJobUpgradeTestProgram.java: ## @@

[GitHub] [flink] infoverload commented on a diff in pull request #19414: [FLINK 26389][tests] update deprecated operators in e2e tests

2022-04-11 Thread GitBox
infoverload commented on code in PR #19414: URL: https://github.com/apache/flink/pull/19414#discussion_r847354659 ## flink-end-to-end-tests/flink-distributed-cache-via-blob-test/src/main/java/org/apache/flink/streaming/tests/DistributedCacheViaBlobTestProgram.java: ## @@ -65,7

[GitHub] [flink] gaborgsomogyi commented on pull request #19372: [FLINK-26043][runtime][security] Add periodic kerberos relogin to KerberosDelegationTokenManager

2022-04-11 Thread GitBox
gaborgsomogyi commented on PR #19372: URL: https://github.com/apache/flink/pull/19372#issuecomment-1095077528 > Should the obtainDelegationTokens(Credentials credentials) be implemented? Maybe it could be a shared code path for the renewal (the one time renewal that is scheduled)?

  1   2   3   4   >