Sagar Sumit created HUDI-4473:
---------------------------------
Summary: Deprecate EmrFs related configs from DefaultSource
Key: HUDI-4473
URL: https://issues.apache.org/jira/browse/HUDI-4473
Project: Apache Hudi
Issue Type: Task
Reporter: Sagar Sumit
For context, see here
[https://github.com/apache/hudi/pull/6154#discussion_r927021771]
This Jira is to track the removal of certain EmrFS configs once the issue is
properly fixed.
{code:java}
// Revisit EMR Spark and EMRFS incompatibilities, for now disable
spark.conf.set("spark.sql.dataPrefetch.enabled", "false")
spark.sparkContext.hadoopConfiguration.set("fs.s3.metadata.cache.expiration.seconds",
"0") {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
