Re: Flink1.14 需求超大内存

2023-06-19 Thread Yanfei Lei
Hi, 从 ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}, numberOfRequiredSlots=1}] 来看,sink节点想申请 1T的 heap memory 和 1T的 off heap

Re: Flink1.14 需求超大内存

2023-06-19 Thread Shammon FY
Hi, 这个doris的sink是你自己实现的还是flink或者doris官方提供的?从错误来看,像是sink节点申请了超大的内存资源,你可以确认一下是否有问题,或者是否有配置项可以配置 Best, Shammon FY On Mon, Jun 19, 2023 at 4:19 PM 郭欣瑞 wrote: > 我在ide里测试一个任务的时候,任务一直处于created状态,过了很久之后报了以下的错 > > DeclarativeSlotPoolBridge.java:351 - Could not acquire the minimum > required

Re: Flink migration 1.15 to 1.17 - Os version change

2023-06-19 Thread Chesnay Schepler
The openjdk images are deprecated, which prevented us from releasing our docker images via some distribution channels. https://issues.apache.org/jira/browse/FLINK-29137 When we switched to the Temurin images we didn't have to change a whole lot, so you might be able to reconstruct a

Flink migration 1.15 to 1.17 - Os version change

2023-06-19 Thread Arek Dankiewicz
Hello All, We recently wanted to migrate flink docker image version from 1.15.1 to 1.17.1 and encountered a problem with our infrastructure not being able to correctly handle an app built on Ubuntu 22+ due to an older version of the docker. Unfortunately, this is out of our control, and we would

Flink1.14 需求超大内存

2023-06-19 Thread 郭欣瑞
我在ide里测试一个任务的时候,任务一直处于created状态,过了很久之后报了以下的错 DeclarativeSlotPoolBridge.java:351 - Could not acquire the minimum required resources, failing slot requests. Acquired: [ResourceRequirement{resourceProfile=ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes),