Re: [DISCUSS] FLIP-323: Support Attached Execution on Flink Application Completion for Batch Jobs

2023-08-16 Thread liu ron
Hi, Jiangjie Thanks for your detailed explanation, I got your point. If the execution.attached is only used for client currently, removing it also make sense to me. Best, Ron Becket Qin 于2023年8月17日周四 07:37写道: > Hi Ron, > > Isn't the cluster (session or per job) only using the

Re: [DISCUSS] FLIP-323: Support Attached Execution on Flink Application Completion for Batch Jobs

2023-08-16 Thread Becket Qin
Hi Ron, Isn't the cluster (session or per job) only using the execution.attached to determine whether the client is attached? If so, the client can always include the information of whether it's an attached client or not in the JobSubmissoinRequestBody, right? For a shared session cluster, there

[jira] [Created] (FLINK-32886) Issue with volumeMounts when creating OLM for Flink Operator 1.6.0

2023-08-16 Thread James Busche (Jira)
James Busche created FLINK-32886: Summary: Issue with volumeMounts when creating OLM for Flink Operator 1.6.0 Key: FLINK-32886 URL: https://issues.apache.org/jira/browse/FLINK-32886 Project: Flink

[jira] [Created] (FLINK-32885) Refactoring: Moving UrlPrefixDecorator into flink-clients so it can be used by RestClusterClient for PyFlink remote execution

2023-08-16 Thread Elkhan Dadashov (Jira)
Elkhan Dadashov created FLINK-32885: --- Summary: Refactoring: Moving UrlPrefixDecorator into flink-clients so it can be used by RestClusterClient for PyFlink remote execution Key: FLINK-32885 URL:

[jira] [Created] (FLINK-32884) PyFlink remote execution should support URLs with paths and https scheme

2023-08-16 Thread Elkhan Dadashov (Jira)
Elkhan Dadashov created FLINK-32884: --- Summary: PyFlink remote execution should support URLs with paths and https scheme Key: FLINK-32884 URL: https://issues.apache.org/jira/browse/FLINK-32884

Re: FLINK-20767 - Support for nested fields filter push down

2023-08-16 Thread Venkatakrishnan Sowrirajan
Forgot to share the link - https://lists.apache.org/thread/686bhgwrrb4xmbfzlk60szwxos4z64t7 in the last email. Regards Venkata krishnan On Wed, Aug 16, 2023 at 11:55 AM Venkatakrishnan Sowrirajan < vsowr...@asu.edu> wrote: > Btw, this is the FLIP proposal discussion thread. Please share your >

Re: FLINK-20767 - Support for nested fields filter push down

2023-08-16 Thread Venkatakrishnan Sowrirajan
Btw, this is the FLIP proposal discussion thread. Please share your thoughts. Thanks. Regards Venkata krishnan On Sun, Aug 13, 2023 at 6:35 AM liu ron wrote: > Hi, Venkata krishnan > > Thanks for driving this work, look forward to your FLIP. > > Best, > Ron > > Venkatakrishnan Sowrirajan

Re: [DISCUSS] [FLINK-32873] Add a config to allow disabling Query hints

2023-08-16 Thread Bonnie Arogyam Varghese
Hi Liu, Options hints could be a security concern since users can override settings. However, query hints specifically could affect performance. Since we have a config to disable Options hint, I'm suggesting we also have a config to disable Query hints. On Wed, Aug 16, 2023 at 9:41 AM liu ron

Re: [DISCUSS] [FLINK-32873] Add a config to allow disabling Query hints

2023-08-16 Thread liu ron
Hi, Thanks for driving this proposal. Can you explain why you would need to disable query hints because of security issues? I don't really understand why query hints affects security. Best, Ron Bonnie Arogyam Varghese 于2023年8月16日周三 23:59写道: > Platform providers may want to disable hints

Re: [DISCUSS] FLIP-323: Support Attached Execution on Flink Application Completion for Batch Jobs

2023-08-16 Thread liu ron
Hi, Jiangjie Sorry for late reply. Thank you for such a detailed response. As you say, there are three behaviours here for users and I agree with you. The goal of this FLIP is to clarify the behaviour of the client side, which I also agree with. However, as weihua said, the config

[jira] [Created] (FLINK-32883) Support for standby task managers

2023-08-16 Thread Tomoyuki NAKAMURA (Jira)
Tomoyuki NAKAMURA created FLINK-32883: - Summary: Support for standby task managers Key: FLINK-32883 URL: https://issues.apache.org/jira/browse/FLINK-32883 Project: Flink Issue Type:

[DISCUSS] [FLINK-32873] Add a config to allow disabling Query hints

2023-08-16 Thread Bonnie Arogyam Varghese
Platform providers may want to disable hints completely for security reasons. Currently, there is a configuration to disable OPTIONS hint - https://nightlies.apache.org/flink/flink-docs-master/docs/dev/table/config/#table-dynamic-table-options-enabled However, there is no configuration available

Re: [DISCUSS] FLIP-327: Support stream-batch unified operator to improve job throughput when processing backlog data

2023-08-16 Thread Piotr Nowojski
Hi Dong, Operators API is unfortunately also our public facing API and I mean the APIs that we will add there should also be marked `@Experimental` IMO. The config options should also be marked as experimental (both annotated @Experimental and noted the same thing in the docs, if @Experimental

[jira] [Created] (FLINK-32882) FineGrainedSlotManager cause NPE when clear pending taskmanager twice

2023-08-16 Thread Weihua Hu (Jira)
Weihua Hu created FLINK-32882: - Summary: FineGrainedSlotManager cause NPE when clear pending taskmanager twice Key: FLINK-32882 URL: https://issues.apache.org/jira/browse/FLINK-32882 Project: Flink

Re: [ANNOUNCE] Updates to Flink's external connector CI workflows

2023-08-16 Thread Etienne Chauchot
This is great! Thanks for working on this. Best Etienne Le 15/06/2023 à 13:19, Martijn Visser a écrit : Hi all, I would like to inform you of two changes that have been made to the shared CI workflow that's used for Flink's externalized connectors. 1. Up until now, weekly builds were

[jira] [Created] (FLINK-32881) Client supports making savepoints in detach mode

2023-08-16 Thread Renxiang Zhou (Jira)
Renxiang Zhou created FLINK-32881: - Summary: Client supports making savepoints in detach mode Key: FLINK-32881 URL: https://issues.apache.org/jira/browse/FLINK-32881 Project: Flink Issue

[jira] [Created] (FLINK-32880) Redundant taskManager should be replenished in FineGrainedSlotManager

2023-08-16 Thread xiangyu feng (Jira)
xiangyu feng created FLINK-32880: Summary: Redundant taskManager should be replenished in FineGrainedSlotManager Key: FLINK-32880 URL: https://issues.apache.org/jira/browse/FLINK-32880 Project: Flink