Charles created HUDI-4189:
-----------------------------
Summary: Support custom filesystem schema
Key: HUDI-4189
URL: https://issues.apache.org/jira/browse/HUDI-4189
Project: Apache Hudi
Issue Type: New Feature
Reporter: Charles
Add options:
#
--user-defined-schemes='[\{"name":"ufs","supportsAppend":true},\{"name":"somefs","supportsAppend":false}]'
# --override-predefined-schemes=false
to let user specified filesystem schemes.
This feature is useful in the following two cases:
# Some vendors provide hdfs-compatible filesystems and change the protocol
name from hdfs:// to [x]fs://.
# Some vendors provide totally new filesystems, and they already integrate
these filesystems with spark.
--
This message was sent by Atlassian Jira
(v8.20.7#820007)