[
https://issues.apache.org/jira/browse/HADOOP-16055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16747193#comment-16747193
]
Steve Loughran commented on HADOOP-16055:
-----------------------------------------
aah, that's the JSON problem isn't it?
# As with all object store patches: which AWS endpoint have you tested against?
# This is the current [AWS SDK update
workflow|https://github.com/apache/hadoop/blob/trunk/hadoop-tools/hadoop-aws/src/site/markdown/tools/hadoop-aws/testing.md#-qualifying-an-aws-sdk-update]
It's easier with a backport, but we still need to: Rerun all the tests, look at
the output to make sure that some new random warning isn't appearing. It's
pretty rare that a regression *hasn't* surfaced.
regarding the 2.7.x line, it's more trouble. HADOOP-12269 covers what it took
to move up there, and it wasn't seamless. And it depended on/forced in jackson
updates too. (having the aws sdk trying to force jackson versions is why we've
switched to the shaded one)
Given that the 2.7.x line is still in active use, especially bundled in things
(spark), we do have to deal with this. Which is one of
* the incompatible change, + whatever jackson updates come with. That gets
people off a very outdated AWS SDK, which has particular problems working with
the v4 endpoints.
* exclude the aws-sdk from the patch and say "you need this on your CP"
Either way, probably most relevant talking to people on the spark team like
[~sowen] about how they'd like their builds broken.
> Upgrade AWS SDK to 1.11.45 to fix license issue
> -----------------------------------------------
>
> Key: HADOOP-16055
> URL: https://issues.apache.org/jira/browse/HADOOP-16055
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs/s3
> Reporter: Akira Ajisaka
> Assignee: Akira Ajisaka
> Priority: Blocker
> Attachments: HADOOP-16055-branch-2.8-01.patch,
> HADOOP-16055-branch-2.8-02.patch
>
>
> Per HADOOP-13794, we must exclude the JSON license.
> The upgrade will contain incompatible changes, however, the license issue is
> much more important.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
