Sure, we can collect this info in the release notes. I think, however, that we need to differentiate the direct dependencies, particularly the components that Trafodion is tightly integrated with (i.e., HBase, and to lesser degree HDFS, Hive) versus things that are generally can interoperate with (e.g., Sqoop) and the version is less likely to be an issue.
--Steve *From:* Carol Pearson [mailto:[email protected]] *Sent:* Friday, February 5, 2016 9:00 AM *To:* [email protected] *Subject:* Re: Trafodion Release 2.0 Hadoop/HBase Versions? Hi, I agree - as folks develop and test Trafodion, we should note the versions of all Hadoop ecosystem components that we test with (whether from a vendor Hadoop distro or as part of setting up an Apache Hadoop cluster to test on). Steve, as release manager... As part of the release notes, can we collect/include this information? Some of it was in the R1.3 release notes, but with Apache Hadoop support we really need to document more, as Gunnar notes. I can volunteer to organize it into a table, or Gunnar might want to since he's done an incredible job pulling together the web site and other documentation. -Carol P. --------------------------------------------------------------- Email: [email protected] Twitter: @CarolP222 --------------------------------------------------------------- On Thu, Feb 4, 2016 at 11:09 PM, Gunnar Tapper <[email protected]> wrote: Hi, Apache Hadoop covers HDFS, MapReduce, and YARN only. Therefore, I think we need to also document what version of HBase, Hive, Sqoop, etc. we've tested for a vanilla Hadoop environments. Or not tested as the case may be; for example, "Sqoop version X tested with CDH and HDP but not explicitly tested with vanilla Hadoop." Gunnar On Thu, Feb 4, 2016 at 5:52 PM, Carol Pearson <[email protected]> wrote: Hi Trafodion Fans, I'm trying to make sure I'm clear on the targeted runtime environments for our next release, which I think we're calling Trafodion 2.0. I've seen that it needs to support working with Apache Hadoop, since the 1.3 release supported only the Cloudera and Hadoop distros. *Trafodion 2.0* >From what's been discussed on the Dev list and here, I think the target is: - Linux Versions CentOS 6.5-6.7 (RHEL 6.5-6.7 - untested? but should support) - SUSE? Hadoop/Version HBase Version ========================================= Cloudera CDH 5.4.x 1.1 Hortonworks HDP 2.3 1.1 Apache Hadoop 2.7.1 1.1 Are these the targets that folks are working on Trafodion 2.0 to support? Are they the right ones? (For example, should we be looking at Apache Hadoop 2.6.3?) Are there other versions of software in the Hadoop ecosystem whose versions should be specified as targets, especially for distro-less vanilla Apache Hadoop? I think that once we release, we should identify the specific versions that folks have tested with (which might not be all versions and all distros). I think we should also list versions for software that we believe should work but have not been tested. As I was trying to understand which releases worked with what, I came across a great chart in the the HBase reference book in section 4.1: https://hbase.apache.org/book.html#basic.prerequisites then scroll down to see the Hadoop versions. It would be great to develop that chart for Trafodion as 2.0 goes forward. Thanks for any light people can shed on this! -Carol P. PS: For reference, here's my understanding of what Trafodion 1.3 supported: I've put together the following chart based on the notes from the Trafodion website for release 1.3 and my understanding of Trafodion 2.0: *Trafodion 1.3: (Current release)* - Linux Versions: CentOS 6.5-6.7, (RHEL 6.5-6.7 - untested? but should support) Hadoop/Version HBase Version ========================================= Cloudera CDH 5.3.x 0.98 Hortonworks HDP 2.2 0.98 --------------------------------------------------------------- Email: [email protected] Twitter: @CarolP222 --------------------------------------------------------------- -- Thanks, Gunnar *If you think you can you can, if you think you can't you're right.*
