Re: S3keysonsor

ic in above location are >> >> s3a://mybucket/ >> >> data1/_SUCCESS >> >> Now I want to configure tolerance for _SUCCESS file as latest or 1 day >> older based on this configuration it should pick the right time stamp >> folder which has _SUCCESS file >

Re: S3keysonsor

Purna, with regards to "this path is not completely static," can you clarify what you mean? Do you mean that you don't know the actual key name beforehand? E.g. pertaining to "111447", "111241", and "111035" in your example? On Mon, May 21, 2018 at 2:23 PM, Brian Greene <

Re: Airflow Docker Container

You may consider this base image we put together at Blue Apron. My fork fixes a build issue by pinning to pip < 10. https://github.com/joenap/airflow-base Joe Nap On Mon, May 14, 2018 at 4:37 PM, Daniel Imberman wrote: > @Fokko > > I definitely agree with that. I