Re: 关于使用SQL Client提交执行目标为yarn-per-job的作业时无日志文件(jobmanager.log)的求助

2022-04-26 Thread Qishang
Hi. 确认下 conf 下,是否有 log4j.properties 应该是在这个地放生成的, https://github.com/apache/flink/blob/release-1.13/flink-yarn/src/main/java/org/apache/flink/yarn/YarnClusterDescriptor.java#L1699 ruiyun wan 于2022年4月26日周二 14:41写道: > Flink版本:1.13 > 问题描述:使用sql-client.sh启动yarn-per-job(execution.target = > >

Flink Kubernetes Operator helm????????

2022-04-26 Thread ??????
?? ?? helm install flink-kubernetes-operator flink-operator-repo/flink-kubernetes-operator Error: INSTALLATION FAILED: unable to build kubernetes objects from release manifest: [unable to recognize "": no matches for kind "Certificate" in version

Unsubscribe

2022-04-26 Thread Amit Bhatia
Unsubscribe Regards, Amit Bhatia

Re: How to debug Metaspace exception?

2022-04-26 Thread John Smith
Hi Chesnay as per the docs... https://nightlies.apache.org/flink/flink-docs-master/docs/ops/debugging/debugging_classloading/ You can either put the jars in task manager lib folder or use classloader.parent-first-patterns-additional

Re: How to debug Metaspace exception?

2022-04-26 Thread John Smith
Ok so I should put the Apache ignite and my Microsoft drivers in the lib folders of my task managers? And then in my job jar only include them as compile time dependencies? On Tue, Apr 26, 2022 at 10:42 AM Chesnay Schepler wrote: > JDBC drivers are well-known for leaking classloaders

Re: Task manager shutting down.

2022-04-26 Thread John Smith
Yeah based off the flink JDBC output format... On Tue, Apr 26, 2022 at 10:05 AM Martijn Visser wrote: > Hi John, > > Have you built your own JDBC MSSQL source or sink or perhaps a CDC driver? > Because I'm not aware of a Flink Microsoft SQL Server JDBC driver. > > Best regards, > > Martijn

Re: How to debug Metaspace exception?

2022-04-26 Thread Chesnay Schepler
JDBC drivers are well-known for leaking classloaders unfortunately. You have correctly identified your alternatives. You must put the jdbc driver into /lib instead. Setting only the parent-first pattern shouldn't affect anything. That is only relevant if something is in both in /lib and the

Re: Task manager shutting down.

2022-04-26 Thread Martijn Visser
Hi John, Have you built your own JDBC MSSQL source or sink or perhaps a CDC driver? Because I'm not aware of a Flink Microsoft SQL Server JDBC driver. Best regards, Martijn Visser https://twitter.com/MartijnVisser82 https://github.com/MartijnVisser On Tue, 26 Apr 2022 at 16:01, John Smith

Task manager shutting down.

2022-04-26 Thread John Smith
Hi running 1.14.4 Logs included: https://www.dropbox.com/s/8zjndt5rzd9o80f/flink-flink-taskexecutor-138-task-0002.log?dl=0 1- My task managers shut down with: Terminating TaskManagerRunner with exit code 1. 2- It seems to happen at the same time every day. Which leads me to believe it's our

Re: How to debug Metaspace exception?

2022-04-26 Thread John Smith
So I put classloader.parent-first-patterns.additional: "org.apache.ignite." in the task config and so far I don't think I'm getting "java.lang.OutOfMemoryError: Metaspace" any more. Or it's too early to tell. Though now, the task managers are shutting down due to some other failures. So maybe

?????? job????????????job??

2022-04-26 Thread ????????
! ---- ??: "user-zh"

NO jobmanager.log for yarn-per-job submitted with sql-client.sh

2022-04-26 Thread ruiyun wan
Flink Version (1.13) There is not jobmanager.log file when submit yarn-per-job with sql-client.sh。(set execution.target = yarn-per-job;) There are not -Dlog.file and -Dlog4j.configuration properties argument in the auto-generated launch_container.sh on YARN cluster。e.g. the last line of

Re: OOM errors cause by the new KafkaSink API

2022-04-26 Thread Martijn Visser
Hi, What's the Flink version that you're using? Could you also separate the two steps (switching from the old Kafka interfaces to the new ones + modifying serializers) to determine which of the two steps cause the problem? Best regards, Martijn Visser https://twitter.com/MartijnVisser82

Re: UUID on TableAPI

2022-04-26 Thread Martijn Visser
Hi Ian, What is the problem that you're trying to solve? Best regards, Martijn Visser https://twitter.com/MartijnVisser82 https://github.com/MartijnVisser On Tue, 26 Apr 2022 at 02:41, lan tran wrote: > Ok, thanks for the clarification. > > > > Sent from Mail

Re: job运行如何指定job名

2022-04-26 Thread ruiyun wan
-Dpipeline.name= 天道酬勤 <1262420...@qq.com.invalid> 于2022年4月26日周二 16:25写道: > 通过flink run 命令启动任务,如何指定job运行的名称 > 希望大家能给我一些建议!

job????????????job??

2022-04-26 Thread ????????
flink run ??job?? ??!

Re: Jobmanager trying to be registered for Zombie Job

2022-04-26 Thread Matthias Pohl
Hi Peter, based on our analysis the issue already existed before 1.15, yes. We couldn't come up with any other reasoning. It was just never reported... or noticing an older ticket. Matthias On Mon, Apr 25, 2022 at 6:21 PM Peter Schrott wrote: > Hi Matthias, > > You are welcome & thanks a lot

关于使用SQL Client提交执行目标为yarn-per-job的作业时无日志文件(jobmanager.log)的求助

2022-04-26 Thread ruiyun wan
Flink版本:1.13 问题描述:使用sql-client.sh启动yarn-per-job(execution.target = yarn-per-job)时,在YARN集群侧生成的launch_container.sh中,启动org.apache.flink.yarn.entrypoint.YarnJobClusterEntrypoint的参数中无-Dlog.file和-Dlog4j.configuration属性参数,导致没有jobmanager.log日志文件,如何设置才能影响Yarn生成的launch_container.sh包含上述参数。