Aireed opened a new issue, #3527:
URL: https://github.com/apache/amoro/issues/3527
### What happened?
-Djobmanager.memory.process.size=2 gb
-Dtaskmanager.memory.process.size=4 gb
```
2025-04-21 11:30:15,851 INFO [JettyServerThreadPool-90]
[org.apache.amoro.server.manager.FlinkOptimizerContainer] [] - Starting flink
optimizer using command : export HADOOP_USER_NAME=hive && export
HADOOP_CONF_DIR=/home/arctic/yarn_coo
nf/conf_amoro_dev && export
FLINK_CONF_DIR=/home/arctic/flink_conf/118_conf_amoro_dev && export
JVM_ARGS=-Djava.security.krb5.conf=/home/arctic/yarn_conf/conf_amoro_dev/krb5.conf
&& /home/arctic/flink/ne-flink-1.18.0/bin/flink run --ta
rget=yarn-per-job -Dyarn.per-job-cluster.include-user-jar=FIRST
-Dtaskmanager.memory.process.size=4 gb
-Dyarn.application.name=Amoro-flink-optimizer-118_conatiner-28rmmd58ve89kobnqt2miccjbj
-Djobmanager.memory.process.size=2 gb -c org..
apache.amoro.optimizer.flink.FlinkOptimizer
/home/arctic/opensource_arctic_ittest/github/amoro-0.8-SNAPSHOT/plugin/optimizer/flink/optimizer-job.jar
-a thrift://10.45.132.189:18181 -p 1 -g 118_conatiner -id
28rmmd58ve89kobnqt2miccjbj
```
we got exception
```
- org.apache.flink.client.cli.CliArgsException: Could not get job jar and
dependencies from JAR file: JAR file does noo
t exist: gb
```
### Affects Versions
master
### What table formats are you seeing the problem on?
Mixed-Hive
### What engines are you seeing the problem on?
Optimizer
### How to reproduce
create a optimizer with flinkContainer
### Relevant log output
```shell
2025-04-21 11:30:17,729 INFO [JettyServerThreadPool-90]
[org.apache.amoro.server.manager.FlinkOptimizerContainer] [] - 2025-04-21
11:30:17,729 INFO org.apache.hadoop.security.UserGroupInformation
[] - Login successful forr
user hive/[email protected] using keytab file
/home/arctic/flink_conf/conf_amoro_dev/hive.keytab
2025-04-21 11:30:17,729 INFO [JettyServerThreadPool-90]
[org.apache.amoro.server.manager.FlinkOptimizerContainer] [] - 2025-04-21
11:30:17,729 INFO
org.apache.flink.runtime.security.token.hadoop.KerberosLoginProvider [] -
Successfullyy
logged into KDC
2025-04-21 11:30:17,732 INFO [JettyServerThreadPool-90]
[org.apache.amoro.server.manager.FlinkOptimizerContainer] [] - 2025-04-21
11:30:17,732 INFO org.apache.flink.runtime.security.modules.HadoopModule
[] - Starting TGT renewall
task
2025-04-21 11:30:17,733 INFO [JettyServerThreadPool-90]
[org.apache.amoro.server.manager.FlinkOptimizerContainer] [] - 2025-04-21
11:30:17,733 INFO org.apache.flink.runtime.security.modules.HadoopModule
[] - TGT renewal task staa
rted and reoccur in 60000 ms
2025-04-21 11:30:17,733 INFO [JettyServerThreadPool-90]
[org.apache.amoro.server.manager.FlinkOptimizerContainer] [] - 2025-04-21
11:30:17,733 INFO org.apache.flink.runtime.security.modules.HadoopModule
[] - Hadoop user set to hh
ive/[email protected] (auth:KERBEROS)
2025-04-21 11:30:17,734 INFO [JettyServerThreadPool-90]
[org.apache.amoro.server.manager.FlinkOptimizerContainer] [] - 2025-04-21
11:30:17,733 INFO org.apache.flink.runtime.security.modules.HadoopModule
[] - Kerberos security iss
enabled.
2025-04-21 11:30:17,734 INFO [JettyServerThreadPool-90]
[org.apache.amoro.server.manager.FlinkOptimizerContainer] [] - 2025-04-21
11:30:17,734 INFO org.apache.flink.runtime.security.modules.HadoopModule
[] - Kerberos credentialss
are valid.
2025-04-21 11:30:17,741 INFO [JettyServerThreadPool-90]
[org.apache.amoro.server.manager.FlinkOptimizerContainer] [] - 2025-04-21
11:30:17,741 INFO org.apache.flink.runtime.security.modules.JaasModule
[] - Jaas file will be crr
eated as /tmp/jaas-3157571870123386642.conf.
2025-04-21 11:30:17,748 INFO [JettyServerThreadPool-90]
[org.apache.amoro.server.manager.FlinkOptimizerContainer] [] - 2025-04-21
11:30:17,747 INFO org.apache.flink.client.cli.CliFrontend
[] - Running 'run' commann
d.
2025-04-21 11:30:17,793 INFO [JettyServerThreadPool-90]
[org.apache.amoro.server.manager.FlinkOptimizerContainer] [] - 2025-04-21
11:30:17,751 ERROR org.apache.flink.client.cli.CliFrontend
[] - Invalid command linee
arguments.
2025-04-21 11:30:17,793 INFO [JettyServerThreadPool-90]
[org.apache.amoro.server.manager.FlinkOptimizerContainer] [] -
org.apache.flink.client.cli.CliArgsException: Could not get job jar and
dependencies from JAR file: JAR file does noo
t exist: gb
2025-04-21 11:30:17,793 INFO [JettyServerThreadPool-90]
[org.apache.amoro.server.manager.FlinkOptimizerContainer] [] - at
org.apache.flink.client.cli.CliFrontend.getJobJarAndDependencies(CliFrontend.java:260)
~[flink-dist-ne-flink-1.11
8.0-1.1.1.jar:ne-flink-1.18.0-1.1.1]
2025-04-21 11:30:17,793 INFO [JettyServerThreadPool-90]
[org.apache.amoro.server.manager.FlinkOptimizerContainer] [] - at
org.apache.flink.client.cli.CliFrontend.run(CliFrontend.java:237)
~[flink-dist-ne-flink-1.18.0-1.1.1.jar:ne-flinn
k-1.18.0-1.1.1]
2025-04-21 11:30:17,793 INFO [JettyServerThreadPool-90]
[org.apache.amoro.server.manager.FlinkOptimizerContainer] [] - at
org.apache.flink.client.cli.CliFrontend.parseAndRun(CliFrontend.java:1095)
~[flink-dist-ne-flink-1.18.0-1.1.1.jaa
r:ne-flink-1.18.0-1.1.1]
2025-04-21 11:30:17,793 INFO [JettyServerThreadPool-90]
[org.apache.amoro.server.manager.FlinkOptimizerContainer] [] - at
org.apache.flink.client.cli.CliFrontend.lambda$mainInternal$9(CliFrontend.java:1189)
~[flink-dist-ne-flink-1.18..
0-1.1.1.jar:ne-flink-1.18.0-1.1.1]
2025-04-21 11:30:17,793 INFO [JettyServerThreadPool-90]
[org.apache.amoro.server.manager.FlinkOptimizerContainer] [] - at
java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_152]
2025-04-21 11:30:17,793 INFO [JettyServerThreadPool-90]
[org.apache.amoro.server.manager.FlinkOptimizerContainer] [] - at
javax.security.auth.Subject.doAs(Subject.java:422) ~[?:1.8.0_152]
2025-04-21 11:30:17,793 INFO [JettyServerThreadPool-90]
[org.apache.amoro.server.manager.FlinkOptimizerContainer] [] - at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1938)
~[flink-shaded-hadoop-2-ubee
r-2.10.2-10.0.jar:2.10.2-10.0]
2025-04-21 11:30:17,794 INFO [JettyServerThreadPool-90]
[org.apache.amoro.server.manager.FlinkOptimizerContainer] [] - at
org.apache.flink.runtime.security.contexts.HadoopSecurityContext.runSecured(HadoopSecurityContext.java:41)
~[flii
nk-dist-ne-flink-1.18.0-1.1.1.jar:ne-flink-1.18.0-1.1.1]
2025-04-21 11:30:17,794 INFO [JettyServerThreadPool-90]
[org.apache.amoro.server.manager.FlinkOptimizerContainer] [] - at
org.apache.flink.client.cli.CliFrontend.mainInternal(CliFrontend.java:1189)
~[flink-dist-ne-flink-1.18.0-1.1.1.jj
ar:ne-flink-1.18.0-1.1.1]
2025-04-21 11:30:17,794 INFO [JettyServerThreadPool-90]
[org.apache.amoro.server.manager.FlinkOptimizerContainer] [] - at
org.apache.flink.client.cli.CliFrontend.main(CliFrontend.java:1157)
~[flink-dist-ne-flink-1.18.0-1.1.1.jar:ne-fll
ink-1.18.0-1.1.1]
2025-04-21 11:30:17,794 INFO [JettyServerThreadPool-90]
[org.apache.amoro.server.manager.FlinkOptimizerContainer] [] - Caused by:
java.io.FileNotFoundException: JAR file does not exist: gb
2025-04-21 11:30:17,794 INFO [JettyServerThreadPool-90]
[org.apache.amoro.server.manager.FlinkOptimizerContainer] [] - at
org.apache.flink.client.cli.CliFrontend.getJarFile(CliFrontend.java:904)
~[flink-dist-ne-flink-1.18.0-1.1.1.jar::
ne-flink-1.18.0-1.1.1]
2025-04-21 11:30:17,794 INFO [JettyServerThreadPool-90]
[org.apache.amoro.server.manager.FlinkOptimizerContainer] [] - at
org.apache.flink.client.cli.CliFrontend.getJobJarAndDependencies(CliFrontend.java:256)
~[flink-dist-ne-flink-1.11
8.0-1.1.1.jar:ne-flink-1.18.0-1.1.1]
2025-04-21 11:30:17,794 INFO [JettyServerThreadPool-90]
[org.apache.amoro.server.manager.FlinkOptimizerContainer] [] - ... 9 more
2025-04-21 11:30:17,804 INFO [JettyServerThreadPool-90]
[org.apache.amoro.server.manager.FlinkOptimizerContainer] [] - Could not get
job jar and dependencies from JAR file: JAR file does not exist: gb
2025-04-21 11:30:17,804 INFO [JettyServerThreadPool-90]
[org.apache.amoro.server.manager.FlinkOptimizerContainer] [] -
2025-04-21 11:30:17,804 INFO [JettyServerThreadPool-90]
[org.apache.amoro.server.manager.FlinkOptimizerContainer] [] - Use the help
option (-h or --help) to get help on the command.
2025-04-21 11:30:23,849 ERROR [thrift-server-optimize-manager-2]
[org.apache.amoro.server.TableManagementService] [] - Thrift
service:DefaultOptimizingService.pollTask execute failed
47806,1
```
### Anything else
_No response_
### Are you willing to submit a PR?
- [x] Yes I am willing to submit a PR!
### Code of Conduct
- [x] I agree to follow this project's Code of Conduct
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
