Hi Vino,
Because I build the project with Maven, maybe I can not use the jars
directly download from the web.
If built with Maven, how can I adjust the Hadoop version with the
Hadoop version really used?
Thanks a lot!!
Best
Henry
> 在 2018年10月26日，上午10:02，vino yang <yanghua1...@gmail.com> 写道：
>
> Hi Henry,
>
> When running flink on YARN, from ClusterEntrypoint the system environment
> info is print out.
> One of the info is "Hadoop version: 2.4.1”, I think it is from the
> flink-shaded-hadoop2 jar. But actually the system Hadoop version is 2.7.2.
>
> I want to know is it OK if the version is different?
>
> > I don't think it is OK, because you will use a lower version of the client
> > to access the higher version of the server.
>
> Is it a best practice to adjust flink Hadoop version to the Hadoop version
> actually used?
>
> > I personally recommend that you keep the two versions consistent to
> > eliminate the possibility of causing various potential problems.
> In fact, Flink provides a bundle of Hadoop 2.7.x bundles for you to
> download.[1]
>
> [1]:
> https://www.apache.org/dyn/closer.lua/flink/flink-1.6.1/flink-1.6.1-bin-hadoop27-scala_2.11.tgz
>
> <https://www.apache.org/dyn/closer.lua/flink/flink-1.6.1/flink-1.6.1-bin-hadoop27-scala_2.11.tgz>
>
> Thanks, vino.
>
> 徐涛 <happydexu...@gmail.com <mailto:happydexu...@gmail.com>> 于2018年10月26日周五
> 上午9:13写道：
> Hi Experts
> When running flink on YARN, from ClusterEntrypoint the system
> environment info is print out.
> One of the info is "Hadoop version: 2.4.1”, I think it is from the
> flink-shaded-hadoop2 jar. But actually the system Hadoop version is 2.7.2.
> I want to know is it OK if the version is different? Is it a best
> practice to adjust flink Hadoop version to the Hadoop version actually used?
>
> Thanks a lot.
>
> Best
> Henry
