[
https://issues.apache.org/jira/browse/SOLR-10360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mark Miller resolved SOLR-10360.
--------------------------------
Resolution: Fixed
Assignee: Mark Miller
Fix Version/s: 6.7
master (7.0)
Thanks Hrishikesh!
> Solr HDFS snapshot export fails due to FileNotFoundException error
> ------------------------------------------------------------------
>
> Key: SOLR-10360
> URL: https://issues.apache.org/jira/browse/SOLR-10360
> Project: Solr
> Issue Type: Bug
> Security Level: Public(Default Security Level. Issues are Public)
> Affects Versions: 6.3
> Environment: SOLR deployed along with a HADOOP cluster (HDFS +M/R 1).
> Reporter: Hrishikesh Gadre
> Assignee: Mark Miller
> Priority: Minor
> Fix For: master (7.0), 6.7
>
>
> The Solr snapshot export command (implemented in the snapshotscli.sh) uses
> Hadoop distcp tool to copy the Solr index files to the desired location. When
> the cluster is configured with MR1 framework (instead of YARN), this command
> fails with following error,
> {noformat}
> Err:With failures, global counters are inaccurate; consider running with -i
> Copy failed: java.io.FileNotFoundException: File does not exist:
> /user/systest/ /backups/mysnap/copylistings/shard1
> at
> org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:66)
> at
> org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:56)
> at
> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocationsInt(FSNamesystem.java:2007)
> at
> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:1977)
> at
> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:1890)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getBlockLocations(NameNodeRpcServer.java:572)
> {noformat}
> During investigation I found that an extra space in the distcp command was
> causing this failure. For example,
> This command fails with the error mentioned above,
> {noformat}
> hadoop distcp -f ' /backups/mysnap/copylistings/shard1'
> /backups/mysnap/snapshot.shard1
> {noformat}
> Removing the space from the copylisting directory path fixes this issue.
> {noformat}
> hadoop distcp -f '/backups/mysnap/copylistings/shard1'
> /backups/mysnap/snapshot.shard1
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
