Hello, I’d like to call a vote in regards to the following:
Creation of an Ingest redesign branch (name to be determined) and linkage of this branch to a Jira epic. These are the proposed requirements: 1. Extendible to any source. 2. NRT latency between ingestion and output to the HDFS/persistent store. 3. Maintain the integrity of the ODM module in order to facilitate seamless integration with applications. Please see the design spec for more details prior to voting: https://docs.google.com/document/d/1yYaD50gp2HN9RHYaUG8ASDfh3f__ GyB1Msu2LUofIU4/edit# I will leave the vote open for 3 days, - Nathanael On Nov 17, 2017, at 2:28 PM, Mubashir Kazia <[email protected]> wrote: +1 for breaking down into tasks. Let's resolve the comments in the doc and put it up for vote. Looks good to me otherwise. Thanks Vartika for working on this. On Wed, Nov 8, 2017 at 10:36 PM, Michael Ridley <[email protected]> wrote: I just realized that in my re-writing and editing of the last email I took out the part where I said that I thought it looks good. But I do think it looks good :-) Michael On Wed, Nov 8, 2017 at 10:35 PM, Michael Ridley <[email protected]> wrote: Hi Vartika- Thanks for the reminder about the ingestion design document. Suggest we open a JIRA (unless one has already been opened and I missed it) with the specific tasks broken down (create an Epic if necessary) and attach a PDF version of the architecture document. Would also be great to get this document into the Spot repo. Do we need a separate upstream branch? I don't think there has been much development process discussion here but I would expect the work to be in the main dev branch after the patches/PRs are accepted and the JIRAs are resolved. Michael On Tue, Oct 31, 2017 at 11:31 PM, Vartika Singh <[email protected]> wrote: Hello all, The following document has been out for discussion for a while: https://docs.google.com/document/d/1yYaD50gp2HN9RHYaUG8ASDfh3f__ GyB1Msu2LUofIU4/edit#heading=h.ptz51qlqt0t I would like to start a new branch for ingestion component. A Again, the idea of ingestion component is the following: 1. Extendible to any source. 2. NRT latency between ingestion and output to the HDFS/persistent store. 3. Maintain the integrity of the ODM module in order to facilitate seamless integration with applications. Thoughts? Vartika Singh -- Michael Ridley <[email protected]> office: (650) 352-1337 mobile: (571) 438-2420 Senior Solutions Architect Cloudera -- Michael Ridley <[email protected]> office: (650) 352-1337 mobile: (571) 438-2420 Senior Solutions Architect Cloudera
