ngk2009 edited a comment on issue #4297:
URL: https://github.com/apache/hudi/issues/4297#issuecomment-993071565
> I have some tips
>
> 1. put `flink-s3-fs-hadoop` into `/opt/flink/lib`
>
> 2. add `hadoop-hdfs-client`, `hadoop-aws`,
`hadoop-mapreduce-client-core` into `/opt/flink/lib` as well
>
> 3. if there is aws credential issue, try to set up core-site.xml (I
had this issue when using hudi 0.9.0 and flink 1.12.2)
Unfortunately, I tried your method but did not succeed。Copy those jar
packages to the /opt/flink/lib and $FLINK_HOME/lib directories at the same
time, and then restart the yarn session :
ERROR org.apache.flink.yarn.cli.FlinkYarnSessionCli [] -
Error while running the Flink session.
java.lang.NoSuchFieldError: IGNORE_CLIENT_LOCALITY
-----
This may be caused by the hadoop version that flink depends on. I try to
recompile flink-fs-hadoop. If hudi does not rely on hadoop's filesystem, just
use s3's sdk, the dependence is too heavy
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
