[jira] [Commented] (SPARK-45404) Support AWS_ENDPOINT_URL env variable

2024-01-23 Thread Dongjoon Hyun (Jira)


[ 
https://issues.apache.org/jira/browse/SPARK-45404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17810058#comment-17810058
 ] 

Dongjoon Hyun commented on SPARK-45404:
---

Thank you, [~ste...@apache.org].

> Support AWS_ENDPOINT_URL env variable
> -
>
> Key: SPARK-45404
> URL: https://issues.apache.org/jira/browse/SPARK-45404
> Project: Spark
>  Issue Type: Sub-task
>  Components: Spark Core
>Affects Versions: 4.0.0
>Reporter: Dongjoon Hyun
>Assignee: Dongjoon Hyun
>Priority: Major
>  Labels: pull-request-available
> Fix For: 4.0.0
>
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Commented] (SPARK-45404) Support AWS_ENDPOINT_URL env variable

2024-01-22 Thread Steve Loughran (Jira)


[ 
https://issues.apache.org/jira/browse/SPARK-45404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17809536#comment-17809536
 ] 

Steve Loughran commented on SPARK-45404:


Just saw this while working on SPARK-35878. 

If you are copying endpoints then you may also want to think about picking up 
the region from AWS_REGION too.

The full list of env vars which I have collected by looking in the AWS SDKs is 
up at 
https://github.com/steveloughran/cloudstore/blob/main/src/main/java/org/apache/hadoop/fs/store/diag/S3ADiagnosticsInfo.java#L379
I do not know what they all mean or do, only that if I get a support call I 
want to know if anyone has been setting them.



> Support AWS_ENDPOINT_URL env variable
> -
>
> Key: SPARK-45404
> URL: https://issues.apache.org/jira/browse/SPARK-45404
> Project: Spark
>  Issue Type: Sub-task
>  Components: Spark Core
>Affects Versions: 4.0.0
>Reporter: Dongjoon Hyun
>Assignee: Dongjoon Hyun
>Priority: Major
>  Labels: pull-request-available
> Fix For: 4.0.0
>
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org