We can present our internal tool for doing data quality checks for ETL's in Qubole. Iris is an Airflow Operator that currently has built-in functions for count validation, data-profile validation and duplicate data validation.
On Wed, Jan 31, 2018 at 3:36 AM, George Leslie-Waksman < [email protected]> wrote: > I can't because I have a kid due right in the middle of QCon but I'm sure > that I could recruit one of my co-workers, if you'd like. > > --George > > On Sun, Jan 28, 2018 at 10:34 AM Sid Anand <[email protected]> wrote: > > > Anyone interested in giving a 10-minute intro to Apache Airflow at > > https://qcon.ai/ > > > > I have a micro-talk slot open in my data eng track. > > -s > > >
