??preCommit
TwoPhaseCommitSinkFunction??checkpoint
interval??state??
From: 1900 <575209...@qq.com>
Sent:
flink??flinkTwoPhaseCommitSinkFunction??,
?C beginTransaction
?C preCommit
?C commit
?C abort
sink??MYSQL
flink on yarn?? flink??1.7.2??hadoop??2.8.5??kafka??1.0.0
kafkaflinkkafka??offset
??
Properties props = new Properties();
props.put("auto.offset.reset", "latest");
Schema(), props));DataStream data = env.addSource(new
ink/?LinkId=550986> for Windows 10
From: 1900 <57...@qq.com> Sent: Tuesday, April
23, 2019 11:27:47 AM To: user-zh Subject: ??RE: flink??
-- --
??: "Shi Quan";
: 2019??4??
flink1.7.2??hadoop??2.8.5,flink on yarn
ha?? run a job on yarn
??kafka??window??5??list??db
1.??
flink on yarn ha
??flink1.7.2??hadoop2.8.5
??5??flinkCPU48G
flink??
jobmanager.heap.size: 2048m
taskmanager.heap.size: 2048m
taskmanager.numberOfTaskSlots: 4
run a job on flink
ink-docs-release-1.7/monitoring/logging.html??Flink
????
1900 <575209...@qq.com> ??2019??4??4?? 10:45??
> env.enableCheckpointing(5000);
> ??yarn
> ??job?
env.enableCheckpointing(5000);
??yarn
??job
1.??
2.hdfs??
??? MapState
MapState entry
MapState??
Best,
Paul Lam
> ?? 2019??4??213:46??1900 <575209...@qq.com> ??
>
> k
kafka1-25??
??
??keyby
10 matches
Mail list logo