[jira] [Commented] (HDFS-9676) “hdfs dfs -put”,the return value is 0, but the size of $hdfsPath is 0.
[ https://issues.apache.org/jira/browse/HDFS-9676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15112229#comment-15112229 ] DuRuiling commented on HDFS-9676: - Ok, the previous namenode logs has been flushed and I will check it at the next backup, I would like to be able to find the relevant error log information. thanks > “hdfs dfs -put”,the return value is 0, but the size of $hdfsPath is 0. > -- > > Key: HDFS-9676 > URL: https://issues.apache.org/jira/browse/HDFS-9676 > Project: Hadoop HDFS > Issue Type: Bug > Components: auto-failover, datanode, hdfs-client >Affects Versions: 2.5.0 > Environment: Linux version 3.0.101 > 2 namenode, 54 datanode >Reporter: DuRuiling >Assignee: DuRuiling > Original Estimate: 168h > Remaining Estimate: 168h > > I find the bug when I backup about 240T data from local file system to HDFS, > I use command “hdfs dfs -D dfs.replication=3 -put $localPath $hdfsPath” to > backup each file one by one, the return value of this command is 0, then > illustrate the command execute right, I find file path is right, but the size > of $hdfsPath is 0 and the size of $loaclPath is non-zero. I reproduce the bug > when I backup data again. > I write a bash shell to backup all data, according to the $? of the command > to judge the file is backup success and record a detailed log. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HDFS-9676) “hdfs dfs -put”,the return value is 0, but the size of $hdfsPath is 0.
DuRuiling created HDFS-9676: --- Summary: “hdfs dfs -put”,the return value is 0, but the size of $hdfsPath is 0. Key: HDFS-9676 URL: https://issues.apache.org/jira/browse/HDFS-9676 Project: Hadoop HDFS Issue Type: Bug Components: auto-failover, datanode, hdfs-client Affects Versions: 2.5.0 Environment: Linux version 3.0.101 2 namenode, 54 datanode Reporter: DuRuiling I find the bug when I backup about 240T data from local file system to HDFS, I use command “hdfs dfs -D dfs.replication=3 -put $localPath $hdfsPath”,the return value of this command is 0, then illustrate the command execute right, I find file path is right, but the size of $hdfsPath is 0 and the size of $loaclPath is non-zero. I reproduce the bug when I backup data again. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HDFS-9676) “hdfs dfs -put”,the return value is 0, but the size of $hdfsPath is 0.
[ https://issues.apache.org/jira/browse/HDFS-9676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DuRuiling updated HDFS-9676: Description: I find the bug when I backup about 240T data from local file system to HDFS, I use command “hdfs dfs -D dfs.replication=3 -put $localPath $hdfsPath” to backup each file one by one, the return value of this command is 0, then illustrate the command execute right, I find file path is right, but the size of $hdfsPath is 0 and the size of $loaclPath is non-zero. I reproduce the bug when I backup data again. I write a bash shell to backup all data, according to the $? of the command to judge the file is backup success and record a detailed log. was:I find the bug when I backup about 240T data from local file system to HDFS, I use command “hdfs dfs -D dfs.replication=3 -put $localPath $hdfsPath”,the return value of this command is 0, then illustrate the command execute right, I find file path is right, but the size of $hdfsPath is 0 and the size of $loaclPath is non-zero. I reproduce the bug when I backup data again. > “hdfs dfs -put”,the return value is 0, but the size of $hdfsPath is 0. > -- > > Key: HDFS-9676 > URL: https://issues.apache.org/jira/browse/HDFS-9676 > Project: Hadoop HDFS > Issue Type: Bug > Components: auto-failover, datanode, hdfs-client >Affects Versions: 2.5.0 > Environment: Linux version 3.0.101 > 2 namenode, 54 datanode >Reporter: DuRuiling > Original Estimate: 168h > Remaining Estimate: 168h > > I find the bug when I backup about 240T data from local file system to HDFS, > I use command “hdfs dfs -D dfs.replication=3 -put $localPath $hdfsPath” to > backup each file one by one, the return value of this command is 0, then > illustrate the command execute right, I find file path is right, but the size > of $hdfsPath is 0 and the size of $loaclPath is non-zero. I reproduce the bug > when I backup data again. > I write a bash shell to backup all data, according to the $? of the command > to judge the file is backup success and record a detailed log. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Assigned] (HDFS-9676) “hdfs dfs -put”,the return value is 0, but the size of $hdfsPath is 0.
[ https://issues.apache.org/jira/browse/HDFS-9676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DuRuiling reassigned HDFS-9676: --- Assignee: DuRuiling > “hdfs dfs -put”,the return value is 0, but the size of $hdfsPath is 0. > -- > > Key: HDFS-9676 > URL: https://issues.apache.org/jira/browse/HDFS-9676 > Project: Hadoop HDFS > Issue Type: Bug > Components: auto-failover, datanode, hdfs-client >Affects Versions: 2.5.0 > Environment: Linux version 3.0.101 > 2 namenode, 54 datanode >Reporter: DuRuiling >Assignee: DuRuiling > Original Estimate: 168h > Remaining Estimate: 168h > > I find the bug when I backup about 240T data from local file system to HDFS, > I use command “hdfs dfs -D dfs.replication=3 -put $localPath $hdfsPath” to > backup each file one by one, the return value of this command is 0, then > illustrate the command execute right, I find file path is right, but the size > of $hdfsPath is 0 and the size of $loaclPath is non-zero. I reproduce the bug > when I backup data again. > I write a bash shell to backup all data, according to the $? of the command > to judge the file is backup success and record a detailed log. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-9676) “hdfs dfs -put”,the return value is 0, but the size of $hdfsPath is 0.
[ https://issues.apache.org/jira/browse/HDFS-9676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111820#comment-15111820 ] DuRuiling commented on HDFS-9676: - Ok, I execute command “hdfs dfs -D dfs.replication=3 -put $localPath $hdfsPath >> $logfile 2>&1”to catch possible error. I checked $logfile when I found $hdfsPath is empty, but I found nothing. I think the return value of the command has already shown that the command is executed successfully, actually it's failed. > “hdfs dfs -put”,the return value is 0, but the size of $hdfsPath is 0. > -- > > Key: HDFS-9676 > URL: https://issues.apache.org/jira/browse/HDFS-9676 > Project: Hadoop HDFS > Issue Type: Bug > Components: auto-failover, datanode, hdfs-client >Affects Versions: 2.5.0 > Environment: Linux version 3.0.101 > 2 namenode, 54 datanode >Reporter: DuRuiling >Assignee: DuRuiling > Original Estimate: 168h > Remaining Estimate: 168h > > I find the bug when I backup about 240T data from local file system to HDFS, > I use command “hdfs dfs -D dfs.replication=3 -put $localPath $hdfsPath” to > backup each file one by one, the return value of this command is 0, then > illustrate the command execute right, I find file path is right, but the size > of $hdfsPath is 0 and the size of $loaclPath is non-zero. I reproduce the bug > when I backup data again. > I write a bash shell to backup all data, according to the $? of the command > to judge the file is backup success and record a detailed log. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
