Hi all, Nice overwhelming response! :)
I'd like to host a meeting on zoom to discuss. I'm on the free plan there, so we are limited to 40 minutes! :) (msg me priv if you have better hosting options). Here's a way to let me know your availability without polluting the mailing list: https://docs.google.com/forms/d/e/1FAIpQLSfsvfM6mUVwD_qV9EXdUB1aLcdKt55toYKRp3JDanonoFRSLQ/viewform?usp=sf_link I'll record the meeting and share the video for those who cannot attend. Agenda: - What specifically is so useful about the data portal? - ( If anyone from airbnb attends, they get the floor to give us more context and info ) - Is there sufficient interest and value creation through a collaboration? - How would a data portal complement airflow and vice versa? - How do we progress this further and which actions can I take here? You can prepare for the meeting by reading the blog post or watching the video (which has even more detail): https://medium.com/airbnb-engineering/democratizing- data-at-airbnb-852d76c51770 https://www.youtube.com/watch?v=gayXC2FDSiA&t=4s Looking forward to your availability responses. Best Regards, Gerard On Wed, Nov 29, 2017 at 7:31 PM, Nathan McIntyre <[email protected]> wrote: > +1 > > > On Nov 29, 2017, at 09:48, Alek Storm <[email protected]> wrote: > > > > +1 > > > > On Wed, Nov 29, 2017 at 9:50 AM, Igors Vaitkus < > [email protected]> > > wrote: > > > >> +1 > >> > >> On 11/29/17, 3:48 PM, "Kate-Laurel Agnew" <[email protected]> wrote: > >> > >> +1 > >> > >> On Wed, Nov 29, 2017 at 12:09 AM, Koen Mevissen < > [email protected]> > >> wrote: > >> > >>> +1 > >>> > >>> I'm interested as well! > >>> > >>> > >>> > >>> Op di 28 nov. 2017 om 14:04 schreef Marc Bollinger < > >> [email protected]> > >>> > >>>> +1 > >>>> > >>>> On Mon, Nov 27, 2017 at 6:18 PM, Ruslan Dautkhanov < > >> [email protected] > >>>> > >>>> wrote: > >>>> > >>>>> ‘’’ > >>>>> I'm > >>>>> now working on sql scanners, extractors and other tools that > >> allow me > >>> to > >>>>> populate the database > >>>>> ‘’’ > >>>>> > >>>>> Very cool. Cloudera Navigator ( not an open source product) does > >> this > >>> too > >>>>> to some extent - collect metadata and create data lineage > >>> automatically ( > >>>>> stored as a Solr collection) by parsing sql queries. > >>>>> > >>>>> https://www.cloudera.com/documentation/enterprise/5-12- > >>>>> x/topics/datamgmt_extraction_indexing.html > >>>>> > >>>>> > >>>>> > >>>>> On Mon, Nov 27, 2017 at 12:38 PM Gerard Toonstra < > >> [email protected]> > >>>>> wrote: > >>>>> > >>>>>> Hi all, > >>>>>> > >>>>>> So something that really drew my attention recently is a "data > >>> portal" > >>>>> as > >>>>>> described by a team from airbnb somewhere in May. The idea is > >>>> basically a > >>>>>> "facebook of data": > >>>>>> > >>>>>> > >>>>>> > >>>>>> https://medium.com/airbnb-engineering/democratizing- > >>>>> data-at-airbnb-852d76c51770 > >>>>>> > >>>>>> > >>>>>> Unfortunately it looks like it's not going to be opensourced > >> due to > >>> how > >>>>>> heavily integrated it is with their specific infrastructure; > >> but the > >>>> idea > >>>>>> itself to me sounds like it's something every organization of a > >>> certain > >>>>>> size should have to keep track of data and stay informed as an > >>>>>> organization. > >>>>>> > >>>>>> Based on the descriptions, I prototyped some things away and > >> am happy > >>>>> with > >>>>>> the results and the speed that something like this can be > >>> constructed. > >>>>> I'm > >>>>>> now working on sql scanners, extractors and other tools that > >> allow me > >>>> to > >>>>>> populate the database and put a poc together on some real data. > >>>>>> > >>>>>> If other people have similar concerns in their organization > >> and think > >>>>> this > >>>>>> would be a great thing to have, reply to me or the list; with > >>>> sufficient > >>>>>> interest I may set up a web chat/meet session so this can be > >>> discussed > >>>> in > >>>>>> more detail and find ways to progress this. > >>>>>> > >>>>>> > >>>>>> Best regards, > >>>>>> > >>>>>> Gerard > >>>>>> > >>>>> > >>>> > >>> -- > >>> Kind regards, > >>> Met vriendelijke groet, > >>> > >>> *Koen Mevissen* > >>> Principal BI Developer > >>> > >>> > >>> *Travix Nederland B.V.* > >>> Piet Heinkade 55 > >>> 1019 GM Amsterdam > >>> The Netherlands > >>> > >>> T. +31 (0)20 203 3241 > >>> E: [email protected] > >>> www.travix.com > >>> > >>> *Brands: * CheapTickets | Vliegwinkel | Vayama | BudgetAir | > >>> Flugladen > >>> > >> > >> > >> > >> -- > >> > >> > >> > >> > >> *Kate-Laurel AgnewData Engineerm: 503-741-9207 > >> <503%20741%209207>e: [email protected] > >> <https://mail.google.com/mail/?view=cm&fs=1&tf=1&[email protected] > > > >> signal.co > >> <http://www.google.com/url?q=http%3A%2F%2Fsignal.co%2F&sa= > >> D&sntz=1&usg=AFQjCNGG8nAqplB1u72dXPbYfPYRcf > opNQ>________________________ > >> Cut > >> Through the NoiseThis e-mail and any files transmitted with it are > for > >> the > >> sole use of the intended recipient(s) and may contain confidential > and > >> privileged information. Any unauthorized use of this email is > strictly > >> prohibited. ©2015 Signal. All rights reserved.* > >> > >> > >> > >> > >> >
