Hi All??
?????????? Flink 1.13.1 ?? application mode ??????????HDP 3.1.5,
Hadoop 3.1.1??,???? ????
/usr/local/flink/flink-1.13.1/bin/flink run-application \
-t yarn-application \
-m yarn-cluster \
-Djobmanager.memory.process.size=4G \
-Dtaskmanager.memory.process.size=2G \
-Dtaskmanager.numberOfTaskSlots=2 \
-Dyarn.provided.lib.dirs="hdfs://namenode1/user/luke/flink/dist" \
hdfs://namenode1/user/luke/project/netflow/NetFlowKafkaToKafkaThoughtWorks.jar \
--properties
hdfs://namenode1/user/luke/project/netflow/thoughtWorksV5.properties
???????????????? ???? ParameterTool ??????????????????????????????????????
// ????????????????????????
ParameterTool cmdLineParameters = ParameterTool.fromArgs(args);
// ????????????
ParameterTool conf =
ParameterTool.fromPropertiesFile(cmdLineParameters.get("properties"));
??????????????????????????????
Caused by: org.apache.flink.client.program.ProgramInvocationException: The main
method caused an error: Properties file
/data1/hadoop/yarn/local/usercache/luke/appcache/application_1625629232536_0988/container_e24_1625629232536_0988_01_000001/hdfs:/namenode1/user/luke/project/netflow/thoughtWorksV5.properties
does not exist at
org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:372)
~[flink-dist_2.11-1.13.1.jar:1.13.1] at
org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:222)
~[flink-dist_2.11-1.13.1.jar:1.13.1] at
org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:114)
~[flink-dist_2.11-1.13.1.jar:1.13.1] at
org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:242)
~[flink-dist_2.11-1.13.1.jar:1.13.1] ... 10 more
?????????????????? ???? ???????????????? ???????????????????????????? HDFS
?????? ????????????????
/data1/hadoop/yarn/local/usercache/luke/appcache/application_1625629232536_0988/container_e24_1625629232536_0988_01_000001/hdfs:/namenode1/user/luke/project/netflow/thoughtWorksV5.properties??????????????HDFS
?????????????????????? container ??????????????????????????????????????????????
????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????
????????
Luke yan
