[
https://issues.apache.org/jira/browse/AIRFLOW-3888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16837168#comment-16837168
]
ASF subversion and git services commented on AIRFLOW-3888:
----------------------------------------------------------
Commit 355bd56282e6a684c5c060953e9948ba2260aa37 in airflow's branch
refs/heads/master from Jacob
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=355bd56 ]
[AIRFLOW-3888] HA for metastore connection (#4708)
* HA for Metastore
* [AIRFLOW-3888] HA for metastore connection
Creating a connection to a metasotor with two hosts for high avitablity (eg
connection 1, connection 2) is not possible because the entire value entered is
taken. For our needs, it is necessary to go through subsequent hosts and
connect to the first working.
This change allows you to check and then connect to a working metastor.
* add function to base_hook
* update webhdfs_hook
* back to original version
* back to original version
* Update hive_hooks.py
Thank you. I made a few changes because during the tests I detected several
errors.
I have a question, when I do marge to my pull it will be still possible to
land it in the airflow main branch?
* [AIRFLOW-3888] HA for metastore connection
flake8 code repair
* [AIRFLOW-3888] HA for metastore connection
Flake8 repair
* [AIRFLOW-3888] HA for metastore connection
Code behavior improvements
* [AIRFLOW-3888] HA for metastore connection
Add test
* [AIRFLOW-3888] HA for metastore connection
test improvement
* [AIRFLOW-3888] HA for metastore connection
Add test
[AIRFLOW-3888] HA for metastore connection
test improvement
* [AIRFLOW-3888] HA for metastore connection
Add test
[AIRFLOW-3888] HA for metastore connection
test improvement
[AIRFLOW-3888] HA for metastore connection
test improvement
* [AIRFLOW-3888] HA for metastore connection
Improving the typo in the variable name
* [AIRFLOW-3888] HA for metastore connection
Mock return_value edit
* [AIRFLOW-3888] HA for metastore connection
Flake8 repair
* [AIRFLOW-3888] HA for metastore connection
Test repair
* [AIRFLOW-3888] HA for metastore connection
Flake8 repair
[AIRFLOW-3888] HA for metastore connection
Test repair
> HA for metastore connection
> ---------------------------
>
> Key: AIRFLOW-3888
> URL: https://issues.apache.org/jira/browse/AIRFLOW-3888
> Project: Apache Airflow
> Issue Type: Improvement
> Components: hive_hooks
> Affects Versions: 1.10.3
> Environment: Linux Centos 7
> Reporter: Jakub Guzik
> Priority: Major
> Labels: high-availability, hive, metastore, patch
> Fix For: 2.0.0
>
> Attachments: hive_hook.py
>
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> Creating a connection to a metasotor with two hosts for high avitablity (eg
> connection 1, connection 2) is not possible because the entire value entered
> is taken. For our needs, it is necessary to go through subsequent hosts and
> connect to the first working.
> This change allows you to check and then connect to a working metastor.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
