[
https://issues.apache.org/jira/browse/FLINK-9540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Razvan updated FLINK-9540:
--
Description:
Download Apache Flink 1.4.2 for Hadoop 2.7 or earlier. Go to opt/ inside
flink-s3-fs-hadoop-1.4.2.jar, open common version info .properties inside you
get:
#
# Licensed to the Apache Software Foundation (ASF) under one
# or more contributor license agreements. See the NOTICE file
# distributed with this work for additional information
# regarding copyright ownership. The ASF licenses this file
# to you under the Apache License, Version 2.0 (the
# "License"); you may not use this file except in compliance
# with the License. You may obtain a copy of the License at
#
# [http://www.apache.org/licenses/LICENSE-2.0]
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
*version=2.8.1*
revision=1e6296df38f9cd3d9581c8af58a2a03a6e4312be
*branch=branch-2.8.1-private*
user=vinodkv
date=2017-06-07T21:22Z
*url=[https://git-wip-us.apache.org/repos/asf/hadoop.git*]
srcChecksum=60125541c2b3e266cbf3becc5bda666
protocVersion=2.5.0
This will fail to work with dependencies described in
([https://ci.apache.org/projects/flink/flink-docs-release-1.5/ops/deployment/aws.html)]
"Depending on which file system you use, please add the following dependencies.
You can find these as part of the Hadoop binaries in
{{hadoop-2.7/share/hadoop/tools/lib}}:
* {{S3AFileSystem}}:
** {{hadoop-aws-2.7.3.jar}}
** {{aws-java-sdk-s3-1.11.183.jar}} and its dependencies:
*** {{aws-java-sdk-core-1.11.183.jar}}
*** {{aws-java-sdk-kms-1.11.183.jar}}
*** {{jackson-annotations-2.6.7.jar}}
*** {{jackson-core-2.6.7.jar}}
*** {{jackson-databind-2.6.7.jar}}
*** {{joda-time-2.8.1.jar}}
*** {{httpcore-4.4.4.jar}}
*** {{httpclient-4.5.3.jar}}
* {{NativeS3FileSystem}}:
** {{hadoop-aws-2.7.3.jar}}
** {{guava-11.0.2.jar"}}{{}}
{{ I presume the build task is flawed, it should be built for Apache Hadoop
2.7 can someone please check it?}}
was:
Download Apache Flink 1.4.2 for Hadoop 2.7 or earlier. Go to opt/ inside
flink-s3-fs-hadoop-1.4.2.jar, open common version info .properties inside you
get:
#
# Licensed to the Apache Software Foundation (ASF) under one
# or more contributor license agreements. See the NOTICE file
# distributed with this work for additional information
# regarding copyright ownership. The ASF licenses this file
# to you under the Apache License, Version 2.0 (the
# "License"); you may not use this file except in compliance
# with the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
*version=2.8.1*
revision=1e6296df38f9cd3d9581c8af58a2a03a6e4312be
*branch=branch-2.8.1-private*
user=vinodkv
date=2017-06-07T21:22Z
*url=https://git-wip-us.apache.org/repos/asf/hadoop.git*
srcChecksum=60125541c2b3e266cbf3becc5bda666
protocVersion=2.5.0
This will fail to work with dependencies described in
([https://ci.apache.org/projects/flink/flink-docs-release-1.5/ops/deployment/aws.html)]
"Depending on which file system you use, please add the following dependencies.
You can find these as part of the Hadoop binaries in
{{hadoop-2.7/share/hadoop/tools/lib}}:
* {{S3AFileSystem}}:
** {{hadoop-aws-2.7.3.jar}}
** {{aws-java-sdk-s3-1.11.183.jar}} and its dependencies:
*** {{aws-java-sdk-core-1.11.183.jar}}
*** {{aws-java-sdk-kms-1.11.183.jar}}
*** {{jackson-annotations-2.6.7.jar}}
*** {{jackson-core-2.6.7.jar}}
*** {{jackson-databind-2.6.7.jar}}
*** {{joda-time-2.8.1.jar}}
*** {{httpcore-4.4.4.jar}}
*** {{httpclient-4.5.3.jar}}
* {{NativeS3FileSystem}}:
** {{hadoop-aws-2.7.3.jar}}
** {{guava-11.0.2.jar"}}{{}}
{{ I presume the build task is flawed, it should be built for Apache Hadoop
2.7}}
> Apache Flink 1.4.2 S3 Hadoop library for Hadoop 2.7 is built for Hadoop 2.8
> and fails
> -
>
> Key: FLINK-9540
> URL: https://issues.apache.org/jira/browse/FLINK-9540
> Project: Flink
> Issue Type: Bug
>Reporter: Razvan
>Priority: Blocker
>
> Download Apache Flink 1.4.2 for Hadoop 2.7 or earlier. Go to opt/ inside
> flink-s3-fs-hadoop-1.4.2.jar, open common version info .properties inside you
> get:
>
