Hello Sandy, The post was useful and gave an insight of the migration.
I am doing a test migration from Apache Hadoop-1.2.0 to Apache Hadoop-2.0.6-alpha on a single node environment. I am having the Apache Hadoop-1.2.0 up and running. Can you please let me know the steps that one should follow for the migration? I am thinking of doing something like: * Install Apache Hadoop-2.0.6-alpha alongside the existing Apache Hadoop-1.2.0 * Use the same HDFS locations * Change the various required configuration files * Stop Apache Hadoop-1.2.0 and start Apache Hadoop-2.0.6-alpha * Verify all the services are running * Test via mapreduce (test MRv1 and MRv2 examples) * Check Web UI Console and verify the MRv1 and MRv2 jobs These above steps needs to be performed on all the nodes in a cluster environment. The translation table mapping old configuration to new would be definitely *very* useful. Also the existing Hadoop ecosystem components needs to be considered: * Hive Scripts * Pig Scripts * Oozie Workflows Their compatibility and version support would need to be checked. Also thinking of any risks like Data Loss, others that one should keep in mind. Also I found: http://strataconf.com/strata2014/public/schedule/detail/32247 Thanks, -Nirmal From: Robert Dyer [mailto:[email protected]] Sent: Friday, November 22, 2013 9:08 PM To: [email protected] Subject: Re: Any reference for upgrade hadoop from 1.x to 2.2 Thanks Sandy! These seem helpful! "MapReduce cluster configuration options have been split into YARN configuration options, which go in yarn-site.xml; and MapReduce configuration options, which go in mapred-site.xml. Many have been given new names to reflect the shift. ... We'll follow up with a full translation table in a future post." This type of translation table mapping old configuration to new would be *very* useful! - Robert On Fri, Nov 22, 2013 at 2:15 AM, Sandy Ryza <[email protected]<mailto:[email protected]>> wrote: For MapReduce and YARN, we recently published a couple blog posts on migrating: http://blog.cloudera.com/blog/2013/11/migrating-to-mapreduce-2-on-yarn-for-users/ http://blog.cloudera.com/blog/2013/11/migrating-to-mapreduce-2-on-yarn-for-operators/ hope that helps, Sandy On Fri, Nov 22, 2013 at 3:03 AM, Nirmal Kumar <[email protected]<mailto:[email protected]>> wrote: Hi All, I am also looking into migrating\upgrading from Apache Hadoop 1.x to Apache Hadoop 2.x. I didn't find any doc\guide\blogs for the same. Although there are guides\docs for the CDH and HDP migration\upgradation from Hadoop 1.x to Hadoop 2.x Would referring those be of some use? I am looking for similar guides\docs for Apache Hadoop 1.x to Apache Hadoop 2.x. I found something on slideshare though. Not sure how much useful that is going to be. I still need to verify that. http://www.slideshare.net/mikejf12/an-example-apache-hadoop-yarn-upgrade Any suggestions\comments will be of great help. Thanks, -Nirmal From: Jilal Oussama [mailto:[email protected]<mailto:[email protected]>] Sent: Friday, November 08, 2013 9:13 PM To: [email protected]<mailto:[email protected]> Subject: Re: Any reference for upgrade hadoop from 1.x to 2.2 I am looking for the same thing if anyone can point us to a good direction please. Thank you. (Currently running Hadoop 1.2.1) 2013/11/1 YouPeng Yang <[email protected]<mailto:[email protected]>> Hi users Are there any reference docs to introduce how to upgrade hadoop from 1.x to 2.2. Regards ________________________________ NOTE: This message may contain information that is confidential, proprietary, privileged or otherwise protected by law. The message is intended solely for the named addressee. If received in error, please destroy and notify the sender. Any use of this email is prohibited when received in error. Impetus does not represent, warrant and/or guarantee, that the integrity of this communication has been maintained nor that the communication is free of errors, virus, interception or interference. ________________________________ NOTE: This message may contain information that is confidential, proprietary, privileged or otherwise protected by law. The message is intended solely for the named addressee. If received in error, please destroy and notify the sender. Any use of this email is prohibited when received in error. Impetus does not represent, warrant and/or guarantee, that the integrity of this communication has been maintained nor that the communication is free of errors, virus, interception or interference.
