Try to go to http://mc00000.mcloud.bah.com:50075/streamFile?filename=/user/cluster/annotated/2009/07/05/_logs/history/mc00002_1291306280950_job_201012021111_0518_cluster_com.bah.mapred.CombineFilesDriver%253A+netflow-smallfi&ugi=hdfs and check if browser show you the stacktrace. If could give a lot of information.
And what's wrong with distcp (any stacktraces, error messages?) On Tue, Feb 8, 2011 at 8:06 PM, Korb, Michael [USA] <[email protected]> wrote: > I have two Hadoop instances running on one cluster of machines for the > purpose of upgrading. I'm trying to copy all the files from the old instance > to the new one but have been having trouble with both distcp and fs -cp. > > Most recently, I've been trying, "sudo -u hdfs ./hadoop fs -cp > hftp://mc00001:50070/* hdfs://mc00000:55310/" where mc00001 is the namenode > of old hadoop and mc00000 is the namenode of new hadoop. > > I've had some success with this command (some files have actually been > copied), but part of the way through the copy, I get this error: > > cp: Server returned HTTP response code: 500 for URL: > http://mc00000.mcloud.bah.com:50075/streamFile?filename=/user/cluster/annotated/2009/07/05/_logs/history/mc00002_1291306280950_job_201012021111_0518_cluster_com.bah.mapred.CombineFilesDriver%253A+netflow-smallfi&ugi=hdfs > > Is it possible that there could be permissions issues? It also doesn't seem > quite right to be copying * since there are directories, but I don't think > there's a way to call fs -cp recursively. Could this be causing problems? > > Thanks, > Mike -- Vladimir Klimontovich Cell: +7-926-890-2349, skype: klimontovich
