toolongframeexception

大家好： 我搭建了一个单机standealone 的flink用来测试mysql CDC，我发现每天晚上4点和4.30，我的taskmanager和jobmanager日志都有akka的TooLongFrameException，是BlobServerConnection报出来的，那个时候可能有定时任务在操作大量操作mysql数据库，我想问： 1. TooLongFrameException可能是mysql操作比较大造成的吗？如果是，有解决方法吗？ 2. BlobServer是干嘛的？我一直认为blobserver是用来放job jar之类的，应该和cdc

安装operator

请问没有helm的情况下能否安装flink-k8s-operator？安装operator是否可以不要clusterrole

flink on k8s的taskmanager为啥不是Replica Sets

请问大伙： Flink on k8s里面，为什么taskmanager是单独的pod，而不是做成Replica Sets 利用副本数来控制taskmanager的数量 从 Windows 版邮件发送

??????Re:Re: flink-1.10 checkpoint ?????? NullPointerException

hi ---- ??: "chenkaibit"https://github.com/apache/flink/blob/release-1.10.0/flink-streaming-java/src/main/java/org/apache/flink/streaming/runtime/tasks/StreamTask.java#L1421

?????? flink on yarn ????

hi Xintong: directgc??maxDirectMemorysystem.gc()??maxDirectMemorykill?? ---- ??:

flink on yarn ????

??flink on yarnflink??1.7.2??on yarntaskmanager.heap.sizecontainer??container??kill??taskmanager.heap.size = xmx+maxDirectMemorySizexmx = taskmanager.heap.size - cutoff -

????????????????????????

????????????????????????

liststate

??RocksDBListState#get??list??next??

??????flink??????????????????

checkpoint ---- ??: "??"

??????RichMapFunction??????

flink 1.10??slot??tmcluster.evenly-spread-out-slots: true ---- ??: "xue...@outlook.com"https://go.microsoft.com/fwlink/?LinkId=550986gt;

??????flink on yarn????????kerberos??kafka

krb5.conf??FLINK_ENV_JAVA_OPTS=-Djava.security.krb5.conf=x/krb5.conf ---- ??: "zjfpla...@hotmail.com"

??????webui??????job

hi all flink web ui??jobweb ui??job??savepointweb??job??

?????? flink 1.10????????

direct??nativeunsafe.allocateMemoryDirectByteBuffer??newdirectMaxDirectMemorySize,jvm??DirectByteBuffer ---- ??:

??????flink on kubernetes ????????????????

Map??es ---- ??: "a511955993"

?????? flink 1.10????????

hi Xintong??flink??managed memoryflink??native memory ---- ??: "Xintong Song"http://apache-flink.147419.n8.nabble.com/Flink-tt1869.html

?????? flink 1.10????????

hi Xintong??java??native memoryapi ---- ??: "Xintong Song"http://apache-flink.147419.n8.nabble.com/Flink-tt1869.html

execution.checkpointing.tolerable-failed-checkpoints ????

hi flink-conf.yaml??execution.checkpointing.tolerable-failed-checkpoints?? 1000checkpoint??job?? best jungglge

??????flink????????hdfs parquest,hdfs????ha??????????

??fs.defaultFS?? ---- ??: "196371551"<196371...@qq.com; : 2020??4??30??(??) 8:50 ??: "user"

?????? ????????

java.lang.OutOfMemoryError: unable to create newnative thread??XmxMaxDirectMemorySize?? ---- ??:"LakeShen"http://apache-flink.147419.n8.nabble.com/flink-kafka-td2386.html [2]

?????? flink 1.10????????

ThankyouXintong.?? -XX:MaxDirectMemorySizeFramework + Task Off-Heap + Network Memory MaxDirectMemorySize=FrameworkOff-Heap+ Task Off-Heap + Network

flink 1.10????????

hi ??standalone flinkjob??tm??8gflink1.10??taskmanager.memory.flink.size??10g??job??jobjava.lang.OutOfMemoryError: Direct buffer memory??1??job??Direct

?????? flink1.10????win10????Standlone????

Causedby:org.apache.flink.configuration.IllegalConfigurationException: Thenetworkmemorymin(64mb)andmax(1gb)mismatch,thenetworkmemory hastoberesolvedandsettoafixedvaluebeforetaskexecutorstarts ??1.10?? ----

??????flink1.10????win10????Standlone????

?? ---- ??: ""

??????1.10????????????--??????????????

??MailboxProcessorstreamtask??processInputMailboxDefaultAction??MailboxProcessorInputStatus status = inputProcessor.processInput();inputProcessor??StreamOneInputProcessor??InputStatus status =

??????Flink?????? ?????? Keyed Watermarks

?? ---- ??:"Utopia"https://bigdata.cs.ut.ee/keyed-watermarks-partition-aware-watermark-generation-apache-flink Best regards Utopia