potiuk commented on issue #10705: URL: https://github.com/apache/airflow/issues/10705#issuecomment-686438848
I think the problem is only because of snakebite which used python-krbv (which was python2 only). Apparently recently the PyPI package was removed (it was maintained by RedHat: https://bugzilla.redhat.com/show_bug.cgi?id=1024834 RedHat replaced the usage of other Python-kerberos packages with GSSAPI (https://access.redhat.com/documentation/en-us/red_hat_enterprise_linux/8/pdf/considerations_in_adopting_rhel_8/Red_Hat_Enterprise_Linux-8-Considerations_in_adopting_RHEL_8-en-US.pdf) - see chapter "17.4.2. Selected Python Kerberos packages have been replaced". We also had a lot of other issues with Snakebite and we HAVE to replace it before 2.0 I believe: @elukey tried hard to implement encryption support for hdfs using snakebite-py3, but it turned out to be very difficult https://github.com/apache/airflow/pull/5659#issuecomment-651770583 and the idea was to replace snakebite with pyarrow. I think we should get rid of snakebite completely and replace it with pyarrow. CC: @mik-laj @jaketf @debek - since I know this might impact us - it will only impact us seriously if we plan to use "hdfs" operator with Kerberos support, because it relies on snakebite currently. If we do, then maybe it's an opportunity to finally get it fixed. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
