Hi, I agree - as folks develop and test Trafodion, we should note the versions of all Hadoop ecosystem components that we test with (whether from a vendor Hadoop distro or as part of setting up an Apache Hadoop cluster to test on).
Steve, as release manager... As part of the release notes, can we collect/include this information? Some of it was in the R1.3 release notes, but with Apache Hadoop support we really need to document more, as Gunnar notes. I can volunteer to organize it into a table, or Gunnar might want to since he's done an incredible job pulling together the web site and other documentation. -Carol P. --------------------------------------------------------------- Email: [email protected] Twitter: @CarolP222 --------------------------------------------------------------- On Thu, Feb 4, 2016 at 11:09 PM, Gunnar Tapper <[email protected]> wrote: > Hi, > > Apache Hadoop covers HDFS, MapReduce, and YARN only. Therefore, I think we > need to also document what version of HBase, Hive, Sqoop, etc. we've tested > for a vanilla Hadoop environments. Or not tested as the case may be; for > example, "Sqoop version X tested with CDH and HDP but not explicitly tested > with vanilla Hadoop." > > Gunnar > > On Thu, Feb 4, 2016 at 5:52 PM, Carol Pearson <[email protected]> > wrote: > >> Hi Trafodion Fans, >> >> I'm trying to make sure I'm clear on the targeted runtime environments >> for our next release, which I think we're calling Trafodion 2.0. I've seen >> that it needs to support working with Apache Hadoop, since the 1.3 release >> supported only the Cloudera and Hadoop distros. >> >> *Trafodion 2.0* >> >> From what's been discussed on the Dev list and here, I think the target >> is: >> >> - Linux Versions CentOS 6.5-6.7 (RHEL 6.5-6.7 - untested? but should >> support) >> - SUSE? >> >> Hadoop/Version HBase Version >> ========================================= >> Cloudera CDH 5.4.x 1.1 >> Hortonworks HDP 2.3 1.1 >> Apache Hadoop 2.7.1 1.1 >> >> >> Are these the targets that folks are working on Trafodion 2.0 to >> support? Are they the right ones? (For example, should we be looking at >> Apache Hadoop 2.6.3?) >> >> Are there other versions of software in the Hadoop ecosystem whose >> versions should be specified as targets, especially for distro-less vanilla >> Apache Hadoop? >> >> I think that once we release, we should identify the specific versions >> that folks have tested with (which might not be all versions and all >> distros). I think we should also list versions for software that we >> believe should work but have not been tested. As I was trying to understand >> which releases worked with what, I came across a great chart in the the >> HBase reference book in section 4.1: >> https://hbase.apache.org/book.html#basic.prerequisites then scroll down >> to see the Hadoop versions. It would be great to develop that chart for >> Trafodion as 2.0 goes forward. >> >> Thanks for any light people can shed on this! >> -Carol P. >> >> PS: For reference, here's my understanding of what Trafodion 1.3 >> supported: >> I've put together the following chart based on the notes from the >> Trafodion website for release 1.3 and my understanding of Trafodion 2.0: >> >> *Trafodion 1.3: (Current release)* >> >> - Linux Versions: CentOS 6.5-6.7, (RHEL 6.5-6.7 - untested? but should >> support) >> >> Hadoop/Version HBase Version >> ========================================= >> Cloudera CDH 5.3.x 0.98 >> Hortonworks HDP 2.2 0.98 >> >> >> >> --------------------------------------------------------------- >> Email: [email protected] >> Twitter: @CarolP222 >> --------------------------------------------------------------- >> > > > > -- > Thanks, > > Gunnar > *If you think you can you can, if you think you can't you're right.* >
