Hello Airflow community,

We would like to contribute with the Cloudera provider to allow out of the
box interactions with Cloudera services, currently starting with Cloudera
Data Engineering <https://www.cloudera.com/products/data-engineering.html>
(CDE) and Cloudera Data Warehouse
<https://www.cloudera.com/products/data-warehouse.html> (CDW).

Our first two Operators are CdeRunJobOperator, to run a CDE job (Spark or
Airflow) and CdwExecuteQueryOperator, to execute a query on a managed CDW
cluster (Hive / Impala). It also comes with a Sensor for CDW, in order to
wait on a Hive partition.

We already initiated a Pull Request, however we need to fix a few bits and
add System tests as described in AIP-47, so not yet ready for a full review.

Please let us know if you accept this provider so that we can move on with
the PR.

Thank you,
Philippe

Reply via email to