[Discuss] FLIP-355: Add parent dir of files to classpath using yarn.provided.lib.dirs

2023-08-17 Thread Archit Goyal
Hi All, I am opening this thread to discuss the proposal to add parent directories of files to classpath when using yarn.provided.lib.dirs. This is documented in FLIP-355

[jira] [Created] (FLINK-32893) Make client.id configurable from KafkaSource

2023-08-17 Thread Mason Chen (Jira)
Mason Chen created FLINK-32893: -- Summary: Make client.id configurable from KafkaSource Key: FLINK-32893 URL: https://issues.apache.org/jira/browse/FLINK-32893 Project: Flink Issue Type:

[jira] [Created] (FLINK-32892) Upgrade kafka-clients dependency to 3.4.x

2023-08-17 Thread Mason Chen (Jira)
Mason Chen created FLINK-32892: -- Summary: Upgrade kafka-clients dependency to 3.4.x Key: FLINK-32892 URL: https://issues.apache.org/jira/browse/FLINK-32892 Project: Flink Issue Type:

Re: Plans for Schema Evolution in Table API

2023-08-17 Thread Jing Ge
Hi Ashish, Table API has many restrictions. Even if the source schema has been changed in a compatible manner from the database's perspective, the added column should not be used in the downstream operators, e.g. join. In case schema evolution is required in your business, you might want to

Re: [DISCUSS] [FLINK-32873] Add a config to allow disabling Query hints

2023-08-17 Thread liu ron
Hi, Bonnie > Options hints could be a security concern since users can override settings. I think this still doesn't answer my question Best, Ron Jark Wu 于2023年8月17日周四 19:51写道: > Sorry, I still don't understand why we need to disable the query hint. > It doesn't have the security problems as

[jira] [Created] (FLINK-32891) Opensearch SQL connector crash job on upsert from multiple sources (409 version conflict)

2023-08-17 Thread Kobe Fitussi (Jira)
Kobe Fitussi created FLINK-32891: Summary: Opensearch SQL connector crash job on upsert from multiple sources (409 version conflict) Key: FLINK-32891 URL: https://issues.apache.org/jira/browse/FLINK-32891

Re: request for jira

2023-08-17 Thread Matthias Pohl
Your request was approved. Sorry for the delay and welcome to the community. :) On Tue, Aug 15, 2023 at 3:58 AM lambda ch wrote: > Sorry I may have misunderstood. I need a jira account. And I have already > submitted a jira account request. How long will it take to get approved? My > Jira Id is

[jira] [Created] (FLINK-32890) Flink app rolled back with old savepoints (3 hours back in time) while some checkpoints have been taken in between

2023-08-17 Thread Nicolas Fraison (Jira)
Nicolas Fraison created FLINK-32890: --- Summary: Flink app rolled back with old savepoints (3 hours back in time) while some checkpoints have been taken in between Key: FLINK-32890 URL:

Re: [DISCUSS] FLIP-348: Support System Columns in SQL and Table API

2023-08-17 Thread Jark Wu
Hi Timo, I'm fine with your latest suggestion that introducing a flag to control expanding behavior of metadata virtual columns, but not introducing any concept of system/pseudo columns for now. Best, Jark On Tue, 15 Aug 2023 at 23:25, Timo Walther wrote: > Hi everyone, > > I would like to

Re: [DISCUSS] [FLINK-32873] Add a config to allow disabling Query hints

2023-08-17 Thread Jark Wu
Sorry, I still don't understand why we need to disable the query hint. It doesn't have the security problems as options hint. Bonnie said it could affect performance, but that depends on users using it explicitly. If there is any performance problem, users can remove the hint. If we want to

[DISCUSS][2.0] Evaluation of imperative API related TBD work items

2023-08-17 Thread Xintong Song
Hi devs, We have been evaluating the 3 TBD items from the Imperative API section of the release 2.0 work items [1]. 1. Refactor the API modules 2. Refactor context-like APIs 3. Convert user-facing concrete classes into interfaces. *We propose to remove 1 & 3 from the list *(3 seems subsumed by

[jira] [Created] (FLINK-32889) BinaryClassificationEvaluator gives wrong weighted AUC value

2023-08-17 Thread Fan Hong (Jira)
Fan Hong created FLINK-32889: Summary: BinaryClassificationEvaluator gives wrong weighted AUC value Key: FLINK-32889 URL: https://issues.apache.org/jira/browse/FLINK-32889 Project: Flink Issue

[jira] [Created] (FLINK-32888) File upload runs into EndOfDataDecoderException

2023-08-17 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-32888: Summary: File upload runs into EndOfDataDecoderException Key: FLINK-32888 URL: https://issues.apache.org/jira/browse/FLINK-32888 Project: Flink

Mailing list threading improvements

2023-08-17 Thread Christofer Dutz
TL;DR: We’re updating how auto-generated email from Github will be threaded on your mailing lists. If you want to keep the old defaults, details are below. We’re pleased to let you know that we’re tweaking the way that auto- generated email from Github will appear on your mailing lists. This will

Re: [DISCUSS] [FLINK-32873] Add a config to allow disabling Query hints

2023-08-17 Thread Timo Walther
+1 for this proposal. Not every data team would like to enable hints. Also because they are an extension to the SQL standard. It might also be the case that custom rules would be overwritten otherwise. Setting hints could also be the exclusive task of a DevOp team. Regards, Timo On

Re: [DISCUSS] [FLINK-32873] Add a config to allow disabling Query hints

2023-08-17 Thread Konstantin Knauf
Hi Bonnie, this makes sense to me, in particular, given that we already have this toggle for a different type of hints. Best, Konstantin Am Mi., 16. Aug. 2023 um 19:38 Uhr schrieb Bonnie Arogyam Varghese : > Hi Liu, > Options hints could be a security concern since users can override >

[jira] [Created] (FLINK-32887) SourceCoordinatorContext#workerExecutor may cause task initializing slowly

2023-08-17 Thread liang jie (Jira)
liang jie created FLINK-32887: - Summary: SourceCoordinatorContext#workerExecutor may cause task initializing slowly Key: FLINK-32887 URL: https://issues.apache.org/jira/browse/FLINK-32887 Project: Flink