Hi Jørn, Great that you are test driving it. It does not have an affect if inlets and outlets are not used thus although experimental it will end up in 1.10. It does need more iterations as some very valuable points have been made and I am working to see how those can get integrated properly. If possible I would like to move to the open meta data structure that will be in atlas 1.0 and allows easier interoperability with other systems.
If you have suggestions please let me now! I will do a presentation at PyData Amsterdam together with Fokko that will feature some of the new things we are thinking of (and shamelessly copying some of Max ideas, hope you don’t mind Max!). Bolke Verstuurd vanaf mijn iPad > Op 14 mei 2018 om 18:19 heeft Jørn A Hansen <[email protected]> het > volgende geschreven: > >> On Sat, 5 May 2018 at 23.49, Bolke de Bruin <[email protected]> wrote: >> >> Hi All, >> I have made a first implementation that allows tracking of lineage in >> Airflow and integration with Apache Atlas. > > > Snip > >> >> >> I’m looking forward to your comments! >> >> https://github.com/apache/incubator-airflow/pull/3321 > > > I see this just got merged - looking forward to be able to kick the tires > more on this. When I tried getting started setting this up I stumbled over > Bolke’s nice Atlas Dockerfile (on his GitHub account. Bolke, thanks for > sharing) it quickly helped me getting to a running Atlas instance which I > was able to explore a bit ... and then I ran out of time. > > Just one quick question: Will this go into 1.10 or is the general feeling > that it has to get a bit more mileage on master first? > > Cheers, > JornH
