SML0127 opened a new issue, #226:
URL: https://github.com/apache/paimon-rust/issues/226

   ### Search before asking
   
   - [x] I searched in the 
[issues](https://github.com/apache/paimon-rust/issues) and found nothing 
similar.
   
   
   ### Motivation
   
   paimon-rust currently supports file://, s3://, s3a://, and oss:// storage 
schemes via OpenDAL, but does not support hdfs://.  Many production Paimon 
deployments use HDFS as the primary warehouse storage, making this a blocker 
for adoption.
   
   ### Solution
   
   The storage layer already has a clean pattern for adding new backends — 
Storage enum variant + config parser + feature flag (see storage-s3, 
storage-oss). OpenDAL provides two HDFS-compatible services that could be 
leveraged:
     - `opendal::services::Webhdfs` — WebHDFS REST API. No native library or 
JVM required.
     - `opendal::services::HdfsNative` — Pure Rust HDFS client via hdfs-native. 
No JVM/libhdfs dependency. Built-in HA NameNode support.
   
   Adding a storage-hdfs feature flag (similar to storage-s3 / storage-oss) 
with either backend would unblock HDFS users.
   
   ### Anything else?
   
   _No response_
   
   ### Willingness to contribute
   
   - [x] I'm willing to submit a PR!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to