[
https://issues.apache.org/jira/browse/AIRFLOW-3894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16769256#comment-16769256
]
ASF GitHub Bot commented on AIRFLOW-3894:
-----------------------------------------
GuzikJakub commented on pull request #4714: [AIRFLOW-3894] unstructured
connection to webhdfs
URL: https://github.com/apache/airflow/pull/4714
Make sure you have checked _all_ steps below.
### Jira
https://issues.apache.org/jira/browse/AIRFLOW-3894
### Description
Therefore in the BaseHook class we introduced a new function that divides
each of the namenodes after a semicolon, and then adds a prefix and port to
each host.
This function is called from webhdfs_hook.py using the following parameters:
prefix (https://), host and port.
It is also possible to expand this function, i.e. to receive a separator.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
> unstructured connection to webhdfs
> ----------------------------------
>
> Key: AIRFLOW-3894
> URL: https://issues.apache.org/jira/browse/AIRFLOW-3894
> Project: Apache Airflow
> Issue Type: Improvement
> Components: hooks
> Affects Versions: 1.10.1
> Reporter: Jakub Guzik
> Priority: Minor
> Labels: connection, patch, usability, webhdfs
> Fix For: 1.10.1
>
> Original Estimate: 4h
> Remaining Estimate: 4h
>
> We want to connect to two active namenodes. While creating a connection to
> webhdfs we were wondering the error that in each namenode should be added the
> prefix 'https://' (except the first), while in each except the first one a
> port should be added (despite the existing field). This is not a mistake, but
> it is worth unifying.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
