[
https://issues.apache.org/jira/browse/SOLR-10360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16031632#comment-16031632
]
ASF subversion and git services commented on SOLR-10360:
--------------------------------------------------------
Commit 872b0dba2d383255ffc020a2b429e395d9817175 in lucene-solr's branch
refs/heads/master from [[email protected]]
[ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=872b0db ]
SOLR-10360: Solr HDFS snapshot export fails due to FileNotFoundException error
when using MR1 instead of yarn.
This closes #173
> Solr HDFS snapshot export fails due to FileNotFoundException error
> ------------------------------------------------------------------
>
> Key: SOLR-10360
> URL: https://issues.apache.org/jira/browse/SOLR-10360
> Project: Solr
> Issue Type: Bug
> Security Level: Public(Default Security Level. Issues are Public)
> Affects Versions: 6.3
> Environment: SOLR deployed along with a HADOOP cluster (HDFS +M/R 1).
> Reporter: Hrishikesh Gadre
> Priority: Minor
>
> The Solr snapshot export command (implemented in the snapshotscli.sh) uses
> Hadoop distcp tool to copy the Solr index files to the desired location. When
> the cluster is configured with MR1 framework (instead of YARN), this command
> fails with following error,
> {noformat}
> Err:With failures, global counters are inaccurate; consider running with -i
> Copy failed: java.io.FileNotFoundException: File does not exist:
> /user/systest/ /backups/mysnap/copylistings/shard1
> at
> org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:66)
> at
> org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:56)
> at
> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocationsInt(FSNamesystem.java:2007)
> at
> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:1977)
> at
> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:1890)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getBlockLocations(NameNodeRpcServer.java:572)
> {noformat}
> During investigation I found that an extra space in the distcp command was
> causing this failure. For example,
> This command fails with the error mentioned above,
> {noformat}
> hadoop distcp -f ' /backups/mysnap/copylistings/shard1'
> /backups/mysnap/snapshot.shard1
> {noformat}
> Removing the space from the copylisting directory path fixes this issue.
> {noformat}
> hadoop distcp -f '/backups/mysnap/copylistings/shard1'
> /backups/mysnap/snapshot.shard1
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
