CenluChen opened a new pull request, #46257:
URL: https://github.com/apache/arrow/pull/46257

   
   ### Rationale for this change
   Baidu advanced file system (AFS) is HDFS-compatible file system and 
implements all HDFS interfaces which is used by Baidu, Inc. The only deferent 
is AFS start with afs://, so we need to follow the HDFS processing when 
encountering a file system starting with afs:// in arrow.
   
   ### What changes are included in this PR?
   This PR add conditional check on uri. When an uri start with afs://, Arrow 
will determine  it is HDFS and use the HDFS api to deal data .
   
   
   ### Are these changes tested?
   Yes,and we've used in our AFS based data processing.
   
   
   ### Are there any user-facing changes?
   No, hdfs:// and viewfs:// processing was not changed.
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

Reply via email to