haseebmalik18 opened a new pull request, #37290: URL: https://github.com/apache/beam/pull/37290
Closes #20719
Adds Kerberos authentication support to Python HadoopFileSystem via new
`--hdfs_client` flag.
**Changes:**
- Added `--hdfs_client` option (default: `INSECURE`, new: `KERBEROS`)
- Uses `hdfs.ext.kerberos.KerberosClient` for Kerberos mode
- Added `requests-kerberos` dependency to hadoop extra
- 6 new unit tests covering both authentication modes
**Usage:**
```python
options = PipelineOptions([
'--hdfs_client=KERBEROS',
'--hdfs_host=namenode.com',
'--hdfs_port=9871',
'--hdfs_user=user',
])
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
