Oh, if I made you uncomfortable, you know I didn't mean that :) I just want to know more about the design because I'm always interested in the architecture things, especially when I see something different. Even Spark just added HA in their master in recent release last year. So it's totally fine.
And the following is just for the discussion: Just a side node: as you know literally _all_ components in Hadoop-based stack have SPOF. I think it's more related to the maturity of a component, but somehow it will get there to eliminate the SPOF just like what HDFS, YARN, Oozie, Spark did. For operations, two SPOFs is good enough for them to have a good sleep at night ;) 2016-01-26 12:08 GMT+08:00 Jay Vyas <[email protected]>: > Awesome! It's great to hear about another HDFS alternative :) > > , We tried pretty hard to make bigtop more "HCFS" compliant, by adding the > init hcfs tooling and so on, but never completed making the puppet recipes > add support for other file systems. > > > Would be very interesting to see if the quant cast team can take over on > the HCFS integration so that bigtop is a home for more Than just one under > filesystem . > > Let us know what your planning on working on, looking forward to it...! > > > > > > On Jan 25, 2016, at 9:06 PM, Faraaz Sareshwala < > [email protected]> wrote: > > > > Hello everyone in the Bigtop community! > > > > My name is Faraaz Sareshwala and I am an engineer working at Quantcast > to integrate QFS (https://quantcast.github.io/qfs) into the Bigtop > project. I just wanted to send a small note out to introduce myself to the > community and announce that we are working on an integration. Feel free to > reach out to me if you have any questions about QFS, our integration, or > Quantcast itself. > > > > At this point, I am nearly complete integrating QFS. I plan to submit a > patch through github and JIRA later in the week or early next week once I > get a chance to test everything is working correctly. I’ve read the wiki on > contribution to the project, but if you guys have any other tips or > guidance for me, I’d really appreciate that. > > > > Patch coming soon! > > > > Take care, > > Faraaz > > >
