+1 On Wed, Nov 29, 2017 at 12:09 AM, Koen Mevissen <[email protected]> wrote:
> +1 > > I'm interested as well! > > > > Op di 28 nov. 2017 om 14:04 schreef Marc Bollinger <[email protected]> > > > +1 > > > > On Mon, Nov 27, 2017 at 6:18 PM, Ruslan Dautkhanov <[email protected] > > > > wrote: > > > > > ‘’’ > > > I'm > > > now working on sql scanners, extractors and other tools that allow me > to > > > populate the database > > > ‘’’ > > > > > > Very cool. Cloudera Navigator ( not an open source product) does this > too > > > to some extent - collect metadata and create data lineage > automatically ( > > > stored as a Solr collection) by parsing sql queries. > > > > > > https://www.cloudera.com/documentation/enterprise/5-12- > > > x/topics/datamgmt_extraction_indexing.html > > > > > > > > > > > > On Mon, Nov 27, 2017 at 12:38 PM Gerard Toonstra <[email protected]> > > > wrote: > > > > > > > Hi all, > > > > > > > > So something that really drew my attention recently is a "data > portal" > > > as > > > > described by a team from airbnb somewhere in May. The idea is > > basically a > > > > "facebook of data": > > > > > > > > > > > > > > > > https://medium.com/airbnb-engineering/democratizing- > > > data-at-airbnb-852d76c51770 > > > > > > > > > > > > Unfortunately it looks like it's not going to be opensourced due to > how > > > > heavily integrated it is with their specific infrastructure; but the > > idea > > > > itself to me sounds like it's something every organization of a > certain > > > > size should have to keep track of data and stay informed as an > > > > organization. > > > > > > > > Based on the descriptions, I prototyped some things away and am happy > > > with > > > > the results and the speed that something like this can be > constructed. > > > I'm > > > > now working on sql scanners, extractors and other tools that allow me > > to > > > > populate the database and put a poc together on some real data. > > > > > > > > If other people have similar concerns in their organization and think > > > this > > > > would be a great thing to have, reply to me or the list; with > > sufficient > > > > interest I may set up a web chat/meet session so this can be > discussed > > in > > > > more detail and find ways to progress this. > > > > > > > > > > > > Best regards, > > > > > > > > Gerard > > > > > > > > > > -- > Kind regards, > Met vriendelijke groet, > > *Koen Mevissen* > Principal BI Developer > > > *Travix Nederland B.V.* > Piet Heinkade 55 > 1019 GM Amsterdam > The Netherlands > > T. +31 (0)20 203 3241 > E: [email protected] > www.travix.com > > *Brands: * CheapTickets | Vliegwinkel | Vayama | BudgetAir | > Flugladen > -- *Kate-Laurel AgnewData Engineerm: 503-741-9207 <503%20741%209207>e: [email protected] <https://mail.google.com/mail/?view=cm&fs=1&tf=1&[email protected]>signal.co <http://www.google.com/url?q=http%3A%2F%2Fsignal.co%2F&sa=D&sntz=1&usg=AFQjCNGG8nAqplB1u72dXPbYfPYRcfopNQ>________________________Cut Through the NoiseThis e-mail and any files transmitted with it are for the sole use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized use of this email is strictly prohibited. ©2015 Signal. All rights reserved.*
