[
https://issues.apache.org/jira/browse/SPARK-44124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17749264#comment-17749264
]
Steve Loughran commented on SPARK-44124:
----------------------------------------
we are soon to move hadoop trunk up to SDK v2, stabilise it with a goal to
backport ASAP: HADOOP-18818 any help with testing this would be wonderful.
for spark
* usual classpath issues (bundle.jar + aws-crt.jar)
* spark-kinesis will need to move to the sdk or spark continues to ship v1 with
that module (i.e. they can coexist)
* any testing people can do
apart from classpath pain, unless people are actually extending bits of the s3a
client by plugging in classes (credentials, signing, delegation,...) the move
seems painless
> Upgrade AWS SDK to v2
> ---------------------
>
> Key: SPARK-44124
> URL: https://issues.apache.org/jira/browse/SPARK-44124
> Project: Spark
> Issue Type: Sub-task
> Components: Build
> Affects Versions: 4.0.0
> Reporter: Dongjoon Hyun
> Priority: Major
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
