TyrantLucifer commented on PR #7762:
URL: https://github.com/apache/seatunnel/pull/7762#issuecomment-2404283323
> root@hadoop-master1:/mnt/apache-seatunnel-2.3.8-SNAPSHOT#
./bin/start-seatunnel-flink-15-connector-v2.sh --config
./config/mysql/mysql2hive2_partitioned.conf --target yarn-application -e
run-application --name st-test Execute SeaTunnel Flink Job:
${FLINK_HOME}/bin/flink run-application --target yarn-application
-Dyarn.ship-files="./config/mysql/mysql2hive2_partitioned.conf"
-Dyarn.ship-archives=runtime.tar.gz -Dyarn.application.name=st-test -c
org.apache.seatunnel.core.starter.flink.SeaTunnelFlink
/mnt/apache-seatunnel-2.3.8-SNAPSHOT/starter/seatunnel-flink-15-starter.jar
--config ./config/mysql/mysql2hive2_partitioned.conf --name st-test
--deploy-mode run-application 2024-10-09 10:58:12,913 INFO
org.apache.flink.yarn.cli.FlinkYarnSessionCli [] - Found Yarn properties file
under /tmp/.yarn-properties-root. 2024-10-09 10:58:12,913 INFO
org.apache.flink.yarn.cli.FlinkYarnSessionCli [] - Found Yarn properties file
under /tmp/.yarn-properties-root. 2024-10-09 10:58:13,067 INFO org.a
pache.hadoop.yarn.client.DefaultNoHARMFailoverProxyProvider [] - Connecting to
ResourceManager at hadoop-master1.orb.local/172.31.0.5:8032 2024-10-09
10:58:13,170 INFO org.apache.flink.yarn.YarnClusterDescriptor [] - No path for
the flink jar passed. Using the location of class
org.apache.flink.yarn.YarnClusterDescriptor to locate the jar
>
> The program finished with the following exception:
>
> java.lang.IllegalArgumentException: Directories or non-archive files are
included. at
org.apache.flink.util.Preconditions.checkArgument(Preconditions.java:138) at
org.apache.flink.yarn.YarnClusterDescriptor.addShipArchives(YarnClusterDescriptor.java:306)
at java.util.Optional.ifPresent(Optional.java:159) at
org.apache.flink.yarn.YarnClusterDescriptor.(YarnClusterDescriptor.java:197) at
org.apache.flink.yarn.YarnClusterClientFactory.getClusterDescriptor(YarnClusterClientFactory.java:88)
at
org.apache.flink.yarn.YarnClusterClientFactory.createClusterDescriptor(YarnClusterClientFactory.java:60)
at
org.apache.flink.yarn.YarnClusterClientFactory.createClusterDescriptor(YarnClusterClientFactory.java:42)
at
org.apache.flink.client.deployment.application.cli.ApplicationClusterDeployer.run(ApplicationClusterDeployer.java:63)
at
org.apache.flink.client.cli.CliFrontend.runApplication(CliFrontend.java:212) at
org.apache.flink.client.cli.CliFrontend.parseAndRun(CliFrontend.java:1098) at
org.
apache.flink.client.cli.CliFrontend.lambda$mainInternal$9(CliFrontend.java:1189)
at java.security.AccessController.doPrivileged(Native Method) at
javax.security.auth.Subject.doAs(Subject.java:422) at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1899)
at
org.apache.flink.runtime.security.contexts.HadoopSecurityContext.runSecured(HadoopSecurityContext.java:41)
at org.apache.flink.client.cli.CliFrontend.mainInternal(CliFrontend.java:1189)
at org.apache.flink.client.cli.CliFrontend.main(CliFrontend.java:1157)
```bash
if [ ! -f "${APP_DIR}/runtime.tar.gz" ];then
directories=("connectors" "lib" "plugins")
existing_dirs=()
for dir in "${directories[@]}"; do
if [ -d "$dir" ]; then
existing_dirs+=("$dir")
fi
done
if [ ${#existing_dirs[@]} -eq 0 ]; then
echo "[connectors,lib,plugins] not existed, skip generate
runtime.tar.gz"
else
tar -zcvf runtime.tar.gz "${existing_dirs[@]}"
fi
fi
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
