frankliee opened a new pull request, #8524:
URL: https://github.com/apache/iceberg/pull/8524
I have tested pyiceberg on our hdfs cluster, and this pr fixed some bugs.
Changed.
1. Using optional parameters to create hdfs client, similar to gcs's style.
2. Fix `PyArrowFileIO.parse_location` for hdfs style, which cannot be
resolved by HadoopFileSystem.
Previous behavior： parse_location("hdfs://127.0.0.1:9000/root/abc") ->
"hdfs", "127.0.0.1:9000/root/abc"
New behavior: parse_location("hdfs://127.0.0.1:9000/root/abc") ->
"hdfs", "hdfs://127.0.0.1:9000/root/abc"
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
