Spectrum Scale next generation hadoop connector is available for public download
from YONG ZHENG, Spectrum Scale HDFS transparency (or HDFS protocol), the next generation Hadoop connector, is available for public download from IBM developerWorks: https://www.ibm.com/developerworks/community/wikis/home?lang=en#!/wiki/General%20Parallel%20File%20System%20%28GPFS%29/page/Hadoop%20Connector%20Download%20%26%20Info The 1st release 2.7.0-0 supports FPO storage model (internal disk model). For shared storage model (e.g. ESS, SAN-based storage), it's in progress and will be available around Jan, 2016. The key advantage for HDFS transparency includes: 1.GPFS client free(it doesn't need every Hadoop node to install GPFS client) 2.Full kerberos support for enterprise security requirement 3.make some hdfs hard-coded components working(e.g. Impala which will call HDFS client directly instead calling Hadoop FileSystem interface) 4.make some popular features working: discp, webhdfs, multiple hadoop cluster over the same Spectrum Scale file systems etc refer the above link for more details. -frank- Frank Kraemer IBM Consulting IT Specialist / Client Technical Architect Hechtsheimer Str. 2, 55131 Mainz mailto:[email protected] voice: +49171-3043699 IBM Germany
_______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss
