[
https://issues.apache.org/jira/browse/SPARK-26043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16704864#comment-16704864
]
Ian O Connell commented on SPARK-26043:
---------------------------------------
[~srowen] i just edited the comment right this sec to add that context sry,
race condition, but:
(context is via the command line/in spark i had been setting hadoop
configuration options – but i need to pick those up in some libraries on the
executors to see what was set (if s3guard is enabled in my case). I need some
means to hook into what the submitter though the hadoop conf should be to turn
on/off reporting to dynamodb for s3guard info)
> Make SparkHadoopUtil private to Spark
> -------------------------------------
>
> Key: SPARK-26043
> URL: https://issues.apache.org/jira/browse/SPARK-26043
> Project: Spark
> Issue Type: Improvement
> Components: Spark Core
> Affects Versions: 3.0.0
> Reporter: Marcelo Vanzin
> Assignee: Sean Owen
> Priority: Minor
> Labels: release-notes
> Fix For: 3.0.0
>
>
> This API contains a few small helper methods used internally by Spark, mostly
> related to Hadoop configs and kerberos.
> It's been historically marked as "DeveloperApi". But in reality it's not very
> useful for others, and changes a lot to be considered a stable API. Better to
> just make it private to Spark.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
