spbail commented on a change in pull request #11113:
URL: https://github.com/apache/airflow/pull/11113#discussion_r504034965



##########
File path: 
airflow/providers/greatexpectations/operators/greatexpectations_base.py
##########
@@ -0,0 +1,30 @@
+from airflow.models import BaseOperator
+
+
+class GreatExpectationsBaseOperator(BaseOperator):

Review comment:
       Just to chime in, one challenge we're looking at is that GE can 
basically work with any kind of backend, and we have a lot of folks who've 
built their own Airflow operators already. Even if the base operator isn't 
super helpful as part of this PR, I can see us extending it to work with other 
backends very quickly.
   
   I think this would be my biggest question for @ryw and @mrrobby. I'm 
thinking the base operator could implement a generic load data context + load 
batch + validation flow similar to a draft PR we received: 
https://github.com/apache/airflow/pull/11113/files




----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[email protected]


Reply via email to