Thanks Jon! I agree and think you have articulated the complexities of the problem very well. For the record here is the exact phrase:
*"This installation guide assumes that a cluster with HDFS is running CDH."* I think that we could probably tweak this slightly and get where we need to be. If I can get some +1's I will make a change and submit a PR to the asf-site branch that modifies this to read: *"This version of the installation guide has been validated for clusters with HDFS running CDH."* A On Thu, Apr 27, 2017 at 6:05 PM Jon Zeolla <[email protected]> wrote: > Just for clarity, because it took a minute or two of clicking around, I > think this <http://spot.incubator.apache.org/doc/#cdh> is what is being > discussed here. > > As a member of the both the Spot and Metron communities, I can say that > simplifying or automating deployment and configuration of either of these > two projects is an extremely heavy lift. At the same time, doing so is > essential to reducing the barrier to entry for new users and increasing > adoption. > > Minimizing the variability of the platform that either of these projects > run on top of is critical to actually getting them off the ground, which is > why it appears they have both chosen a single platform to leverage and > haven't yet grown from there. I could very easily see a point in the > future where either project has expanded beyond a single platform, and I > have in fact discussed this idea numerous times in the past. > > That said, I think the concern here is more focused on the perception of > commercial endorsements, not specifically using a branded but open > distribution of Apache software. On that topic, I know very little about > the right way to approach documenting the fact that a certain platform is > assumed without appearing to be an endorsement. I would be interested to > receive any guidance that the ASF can provide. > > Jon > > > On Thu, Apr 27, 2017 at 8:20 PM Jonathan Natkins <[email protected]> > wrote: > > > It might be worth noting that the Apache Metron page is somewhat guilty > of > > this, as well. In their quickstart guide, they advertise a VirtualBox VM > > loaded with HDP: http://metron.apache.org/documentation/ > > > > Their installation documentation also seems to indicate that they only > work > > with HDP 2.4: > > > > > https://cwiki.apache.org/confluence/display/METRON/Metron+Installation+on+an+Ambari-Managed+Cluster > > > > If there's action to be taken with the Spot website, it may be worthwhile > > to point the same thing out to the Metron community. > > > > Jonathan "Natty" Natkins > > StreamSets | Field Engineering Director > > mobile: 609.577.1600 <(609)%20577-1600> <(609)%20577-1600> | linkedin < > > http://www.linkedin.com/in/nattyice> > > > > > > On Thu, Apr 27, 2017 at 4:59 PM, Austin Leahy <[email protected]> > > wrote: > > > > > I think your point is fair. > > > > > > But I think that its also important to understand that as a community > > > driven project installation on CDH is currently the only install path > > that > > > has been validated. > > > > > > Until community members begin to test and install parts of the platform > > > elsewhere it is important that they understand that the docs are > > explained > > > from a particular context. As someone who has installed several > different > > > versions of hadoop including CDH I would say that there are often > > > surprising side effects based on who's "best practice install" you have > > > followed for your cluster. > > > > > > My meta question would be; is there a foundation requirement that would > > > lead us to prioritize basic setup and configuration specifically on the > > > apache sources? This would probably derail several of the current > > "install > > > & config" initiatives. > > > > > > On Thu, Apr 27, 2017 at 4:47 PM Ted Dunning <[email protected]> > wrote: > > > > > > > (To avoid confusion, please note that I am speaking as just me here, > > not > > > a > > > > director, nor as VP Incubator) > > > > > > > > On the Spot incubating web site, there is a nav element on the left > > > labeled > > > > "CDH Requirements". That doesn't seem to me to be appropriate because > > is > > > > looks like a commercial endorsement. > > > > > > > > Anybody have any thoughts on this? > > > > > > > > > > -- > > Jon >
