This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/airflow.git
The following commit(s) were added to refs/heads/main by this push:
new 761c0da723 Upper-bind elasticearch integration (#31255)
761c0da723 is described below
commit 761c0da723799c3c37d9eb2cadaa9c4fa256d13a
Author: Jarek Potiuk <[email protected]>
AuthorDate: Fri May 12 21:24:57 2023 +0200
Upper-bind elasticearch integration (#31255)
* Upper-bind elasticearch integration
During bumping the dependencies of Google Provider we found out
that elasticsearch >= 7.15.0 (which we never tested before because
of other constraints) breaks our tests. Since there is an 8 version
of eleastic search available as of 2021, we should - rather than
solve the tests in 7, likely migrate to version 8, which should
likely involve getting rid of elastisearch-dsl, because it has
limitations of elasticsearch <8.
* Update airflow/providers/elasticsearch/provider.yaml
Co-authored-by: Jed Cunningham
<[email protected]>
---------
Co-authored-by: Jed Cunningham
<[email protected]>
---
airflow/providers/elasticsearch/provider.yaml | 7 ++++++-
generated/provider_dependencies.json | 2 +-
2 files changed, 7 insertions(+), 2 deletions(-)
diff --git a/airflow/providers/elasticsearch/provider.yaml
b/airflow/providers/elasticsearch/provider.yaml
index 9493ae7000..05a9acda56 100644
--- a/airflow/providers/elasticsearch/provider.yaml
+++ b/airflow/providers/elasticsearch/provider.yaml
@@ -50,7 +50,12 @@ versions:
dependencies:
- apache-airflow>=2.4.0
- apache-airflow-providers-common-sql>=1.3.1
- - elasticsearch>7
+ # We cannot use elasticsearch 8 yet. The elasticsearch-dsl is not compatible
with it.
+ # elasticsearch>=7.15.0 breaks our tests.The eleasticsearch 7 is an old
version that is not
+ # supported anymore. We should move to elasticsearch 8 as
+ # likely requires getting rid of elasticsearch-dsl or waiting until there is
a compatible version
+ # We can also try to replace the <7.15.0 with <8.0.0 but we need to solve
the test failures first
+ - elasticsearch>7,<7.15.0
- elasticsearch-dbapi
- elasticsearch-dsl>=5.0.0
diff --git a/generated/provider_dependencies.json
b/generated/provider_dependencies.json
index d576dc9078..9777e3bfa1 100644
--- a/generated/provider_dependencies.json
+++ b/generated/provider_dependencies.json
@@ -296,7 +296,7 @@
"apache-airflow>=2.4.0",
"elasticsearch-dbapi",
"elasticsearch-dsl>=5.0.0",
- "elasticsearch>7"
+ "elasticsearch>7,<7.15.0"
],
"cross-providers-deps": [
"common.sql"
