+1. Good integration to have.
It should be exciting for on-prem Hadoop users, including teams moving from Oozie to Airflow who need hbase steps in their Dags. Thanks & Regards, Amogh Desai On Tue, Nov 17, 2026 at 2:12 PM Dmitriy Bezlootskiy via dev < [email protected]> wrote: > Subject: [DISCUSS] New Community Provider: Apache HBase > > Hi Airflow community, > > I'd like to propose adding a new community provider for Apache HBase. > The provider would enter at the incubation stage with state not-ready > in provider.yaml until the first release. It targets Airflow 2.11+ > and Python 3.11+ > > Integration overview > -------------------- > Apache HBase (https://hbase.apache.org/) is an ASF top-level project, > a distributed, scalable, big data store for random, realtime read/write > access. I work at Arenadata, where HBase is part of our data platform > and we have been running this integration in our Airflow fork > > There is currently no HBase provider in the Apache Airflow ecosystem. > This provider communicates with HBase via the Thrift2 API and the HBase > CLI. It introduces an HBase connection type, HBaseThriftHook, > HBaseCLIHook, operators, and sensors for typical HBase workflows. > The only additional Python dependency is thrift. The Thrift2 bindings > are vendored as hbase_thrift2_generated/ cause there is no standalone PyPI > package for them and the HBase Thrift2 API is stable > > System tests > ------------ > Unit tests mock both the Thrift2 and CLI interfaces and run without a > live cluster. The Apache Airflow CI environment does not include an > HBase service. We run integration tests against the apache/hbase Docker > image in our fork but they require a dedicated Breeze integration which > is out of scope for this PR. We plan to submit that as a follow-up. > We are not publishing a public system-test dashboard at this stage > > Proposed stewards > ----------------- > - Vyacheslav Chaplygin, @slavachy, [email protected] > - Mikhail Zaplatin, @ZMichael3012, [email protected] > - Aleksey Gladkih, @gaxeliy, [email protected] > - Dmitry Bezlutskiy, @Dimitrionian, [email protected] > > Sponsoring committer(s) > ----------------------- > - Amogh Desai, @amoghrajesh > > Working implementation > ---------------------- > https://github.com/apache/airflow/pull/77029 > > Incubation commitment > --------------------- > We commit to maintaining the provider and responding to issues in a > timely manner, meeting the incubation health metrics within 6 months, > and participating in quarterly governance updates > > Best regards, > Dmitry Bezlutskiy > > --------------------------------------------------------------------- > To unsubscribe, e-mail: [email protected] > For additional commands, e-mail: [email protected] > >
