pateash opened a new pull request, #25714:
URL: https://github.com/apache/airflow/pull/25714

   closes: #10893 
   
   ---
   ## Description
   
   Adding ClickHouse provider based on its Python SDK 
https://clickhouse-driver.readthedocs.io/en/latest/
   
   Users can create their own custom operators leveraging the 
**ClickHouseHook**  directly 
   or building their operator on **ClickHouseOperator** by providing 
**result_processor**  method,
   
   ```
   operator = ClickHouseOperator(
       task_id='clickhouse_operator',
       sql="SELECT * FROM gettingstarted.clickstream",
       dag=dag,
       result_processor=lambda cursor: print(cursor)
   )
   ```
   
   The sensor can be implemented by SQL
   
   ```
   sensor = ClickHouseSensor(
       task_id="clickhouse_sensor",
       sql="SELECT * FROM gettingstarted.clickstream where 
customer_id='customer1'",
       timeout=60,
       poke_interval=10,
       dag=dag,
   )
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to