Charles created HUDI-4189:
-----------------------------

             Summary: Support custom filesystem schema
                 Key: HUDI-4189
                 URL: https://issues.apache.org/jira/browse/HUDI-4189
             Project: Apache Hudi
          Issue Type: New Feature
            Reporter: Charles


Add options:
 # 
--user-defined-schemes='[\{"name":"ufs","supportsAppend":true},\{"name":"somefs","supportsAppend":false}]'
 # --override-predefined-schemes=false

to let user specified filesystem schemes.

 

This feature is useful in the following two cases:
 # Some vendors provide hdfs-compatible filesystems and change the protocol 
name from hdfs:// to [x]fs://.
 # Some vendors provide totally new filesystems, and they already integrate 
these filesystems with spark.



--
This message was sent by Atlassian Jira
(v8.20.7#820007)

Reply via email to