[
https://issues.apache.org/jira/browse/HDFS-14735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16908812#comment-16908812
]
Tatyana Alexeyev commented on HDFS-14735:
-----------------------------------------
There are some error in datanode log file:
2019-08-16 03:52:05,696 INFO org.apache.hadoop.hdfs.server.datanode.DataNode
(BP-56322450-10.6.14.101-1565836229790 heartbeating to
ip-10-6-14-101.us-east-2.compute.internal/10.6.14.101:8020):
DatanodeRegistration(10.6.13.226:50010,
datanodeUuid=4a8a4e5b-604d-4a8d-96b7-246ccf4d9baf, infoPort=50075,
infoSecurePort=0, ipcPort=50020,
storageInfo=lv=-57;cid=CID-39f69814-6f95-4195-8272-37b6d2166de4;nsid=950102054;c=1565836229790)
Starting thread to transfer
BP-56322450-10.6.14.101-1565836229790:blk_1073973783_232959 to 10.6.14.73:50010
10.6.13.248:50010
2019-08-16 03:52:05,696 INFO org.apache.hadoop.hdfs.server.datanode.DataNode
(BP-56322450-10.6.14.101-1565836229790 heartbeating to
ip-10-6-14-101.us-east-2.compute.internal/10.6.14.101:8020):
DatanodeRegistration(10.6.13.226:50010,
datanodeUuid=4a8a4e5b-604d-4a8d-96b7-246ccf4d9baf, infoPort=50075,
infoSecurePort=0, ipcPort=50020,
storageInfo=lv=-57;cid=CID-39f69814-6f95-4195-8272-37b6d2166de4;nsid=950102054;c=1565836229790)
Starting thread to transfer
BP-56322450-10.6.14.101-1565836229790:blk_1073973798_232974 to
10.6.13.248:50010 10.6.14.73:50010
2019-08-16 03:52:05,696 INFO org.apache.hadoop.hdfs.server.datanode.DataNode
([org.apache.hadoop.hdfs.server.datanode.DataNode$DataTransfer@32ac48b6|mailto:org.apache.hadoop.hdfs.server.datanode.DataNode$DataTransfer@32ac48b6]):
DataTransfer, at ip-10-6-13-226.us-east-2.compute.internal:50010: Transmitted
BP-56322450-10.6.14.101-1565836229790:blk_1073973727_232903 (numBytes=60530) to
/10.6.13.248:50010
2019-08-16 03:52:05,696 INFO org.apache.hadoop.hdfs.server.datanode.DataNode
([org.apache.hadoop.hdfs.server.datanode.DataNode$DataTransfer@57370a18|mailto:org.apache.hadoop.hdfs.server.datanode.DataNode$DataTransfer@57370a18]):
DataTransfer, at ip-10-6-13-226.us-east-2.compute.internal:50010: Transmitted
BP-56322450-10.6.14.101-1565836229790:blk_1073973701_232877 (numBytes=36427) to
/10.6.14.73:50010
2019-08-16 03:52:05,696 INFO org.apache.hadoop.hdfs.server.datanode.DataNode
([org.apache.hadoop.hdfs.server.datanode.DataNode$DataTransfer@766e0d79|mailto:org.apache.hadoop.hdfs.server.datanode.DataNode$DataTransfer@766e0d79]):
DataTransfer, at ip-10-6-13-226.us-east-2.compute.internal:50010: Transmitted
BP-56322450-10.6.14.101-1565836229790:blk_1073973741_232917 (numBytes=36427) to
/10.6.14.73:50010
2019-08-16 03:52:05,697 WARN org.apache.hadoop.hdfs.server.datanode.DataNode
(BP-56322450-10.6.14.101-1565836229790 heartbeating to
ip-10-6-14-101.us-east-2.compute.internal/10.6.14.101:8020): *Can't replicate
block BP-56322450-10.6.14.101-1565836229790:blk_1073973750_232926 because
on-disk length 402868 is shorter than NameNode recorded length
9223372036854775807*
**
There are some messages related to the replication in the Namenode log:
2019-08-16 04:00:00,141 INFO org.apache.hadoop.hdfs.StateChange (IPC Server
handler 30 on 8020): DIR* completeFile:
/tmp/hadoop-yarn/staging/sphdadm/.staging/job_1565836275738_5267/job.xml is
closed by DFSClient_NONMAPREDUCE_-1718547537_1
2019-08-16 04:00:00,152 INFO org.apache.hadoop.hdfs.server.namenode.FSDirectory
(IPC Server handler 1 on 8020): *Increasing replication from 1 to 4 for
/tmp/hadoop-yarn/staging/sphdadm/.staging/job_1565836275738_5268/libjars/parquet-encoding-1.6.0.jar*
**
> File could only be replicated to 0 nodes instead of minReplication (=1)
> -----------------------------------------------------------------------
>
> Key: HDFS-14735
> URL: https://issues.apache.org/jira/browse/HDFS-14735
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: datanode
> Reporter: Tatyana Alexeyev
> Priority: Major
>
> Hello I have intermitent error when running my EMR Hadoop Cluster:
> "Error: org.apache.hadoop.ipc.RemoteException(java.io.IOException): File
> /user/sphdadm/_sqoop/00501bd7b05e4182b5006b9d51
> bafb7f_f405b2f3/_temporary/1/_temporary/attempt_1565136887564_20057_m_000000_0/part-m-00000.snappy
> could only be replicated to 0 nodes instead of minReplication (=1). There
> are 5 datanode(s) running and no node(s) are excluded in this operation."
> I am running Hadoop version
> sphdadm@ip-10-6-15-108 hadoop]$ hadoop version
> Hadoop 2.8.5-amzn-4
>
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
