goutamadwant opened a new pull request, #11902: URL: https://github.com/apache/seatunnel/pull/11902
### Purpose of this pull request Fixes #10104. This adds Hadoop-style `abfs://` and `abfss://` support to the existing HdfsFile connector. The change: - supports ABFS for the existing source, sink, and catalog paths - keeps authentication in standard Hadoop Azure configuration loaded through `hdfs_site_path` - packages only the ABFS implementation from `hadoop-azure` - excludes the legacy WASB implementation and Azure Storage SDK - preserves the current Hadoop 3.1.4 runtime - documents the configuration in the English and Chinese source and sink pages ### Does this PR introduce _any_ user-facing change? Yes. HdfsFile can now read from and write to Azure Data Lake Storage Gen2 using `abfs://` or `abfss://` paths. Existing HDFS and other filesystem behavior is unchanged. ### How was this patch tested? Added coverage for: - ABFS source configuration - ABFSS sink configuration - initialization of both filesystem implementations using the shaded Hadoop runtime - propagation of Azure authentication properties - protection of SeaTunnel-managed filesystem properties from user overrides Verified with: `./mvnw -pl seatunnel-connectors-v2/connector-file/connector-file-hadoop package -DskipITs -Dtest=HdfsFileFactoryTest -DfailIfNoTests=false -DenableSourceJarCreation=false` All 6 focused tests pass. The final Hadoop uber Jar was also checked for ABFS classes, delegation-token services, dependency isolation, and Java 8 class compatibility. A live ADLS Gen2 read/write test was not run because Azure account credentials were not available. ### Check list * [x] License notices were added for the packaged Hadoop Azure dependencies. * [x] English and Chinese connector documentation was updated. * [x] This change is backward compatible and does not require an `incompatible-changes.md` entry. * [x] This extends the existing HdfsFile connector, so no plugin mapping, distribution registration, connector label, E2E registration, or plugin configuration change is required. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
