[
https://issues.apache.org/jira/browse/HDFS-13835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16742896#comment-16742896
]
venkata ramkumar edited comment on HDFS-13835 at 1/15/19 9:30 AM:
------------------------------------------------------------------
Thanks [~ayushtkn] for the comment.
{quote}This statement seems to be the culprit to me.
Firstly before update the scenerio was somewhat like:
/apps pointed to ns1->/tmp1 and ns2->/tmp2 (for which the actual destinations
exists)
After the update
/apps pointed to ns1->/tmp1,/tmp2 and ns2->/tmp1,/tmp2 (these destination
doesn't exist)
{quote}
Here the actual scenario is :
I am unable to change only the order from HASH to RANDOM if a mount entry is
pointing to multiple destinations using Update command due to which file is not
getting added after update command.
commands :
{noformat}
/hadoop/router/bin> ./hdfs dfsrouteradmin -add /apps hacluster1 /tmp1
19/01/15 14:28:27 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
Successfully added mount point /apps
/hadoop/router/bin> ./hdfs dfs -mkdir hdfs://hacluster1/tmp1
19/01/15 14:28:44 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
/hadoop/router/bin> ./hdfs dfsrouteradmin -add /apps hacluster2 /tmp2
19/01/15 14:28:53 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
Successfully added mount point /apps
/hadoop/router/bin> ./hdfs dfs -mkdir hdfs://hacluster2/tmp2
19/01/15 14:29:05 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
/hadoop/router/bin> ./hdfs dfsrouteradmin -ls /
19/01/15 14:29:18 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
Mount Table Entries:
Source Destinations Owner
Group Mode Quota/Usage
/apps hacluster1->/tmp1,hacluster2->/tmp2 securedn
users rwxr-xr-x [NsQuota: -/-,
SsQuota: -/-]
/hadoop/router/bin> ./hdfs dfs -put mapred.cmd /apps/.
19/01/15 14:29:50 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
/hadoop/router/bin> ./hdfs dfsrouteradmin -update /apps hacluster1,hacluster2
/tmp1,/tmp2 -order RANDOM
19/01/15 14:30:20 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
Successfully updated mount point /apps
/hadoop/router/bin> ./hdfs dfsrouteradmin -ls /
19/01/15 14:30:43 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
Mount Table Entries:
Source Destinations Owner
Group Mode Quota/Usage
/apps hacluster1->/tmp1,/tmp2,hacluster2->/tmp1,/tmp2
securedn users rwxr-xr-x
[NsQuota: -/-, SsQuota: -/-]
{noformat}
When i used the update command for changing the order HASH --> RANDOM
the destination of /apps for hacluster1 changed from /tmp1 to /tmp1,/tmp2.
Because of which i am unable to add files after changing the order.
was (Author: ramkumar):
Thanks [~ayushtkn] for the comment.
{quote}This statement seems to be the culprit to me.
Firstly before update the scenerio was somewhat like:
/apps pointed to ns1->/tmp1 and ns2->/tmp2 (for which the actual destinations
exists)
After the update
/apps pointed to ns1->/tmp1,/tmp2 and ns2->/tmp1,/tmp2 (these destination
doesn't exist)
{quote}
Here the actual scenario is :
I am unable to change only the order from HASH to RANDOM if a mount entry is
pointing to multiple destinations using Update command due to which file is not
getting added after update command.
commands :
{noformat}
/hadoop/router/bin> ./hdfs dfsrouteradmin -add /apps hacluster1 /tmp1
19/01/15 14:28:27 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
Successfully added mount point /apps
/hadoop/router/bin> ./hdfs dfs -mkdir hdfs://hacluster1/tmp1
19/01/15 14:28:44 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
/hadoop/router/bin> ./hdfs dfsrouteradmin -add /apps hacluster2 /tmp2
19/01/15 14:28:53 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
Successfully added mount point /apps
/hadoop/router/bin> ./hdfs dfs -mkdir hdfs://hacluster2/tmp2
19/01/15 14:29:05 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
/hadoop/router/bin> ./hdfs dfsrouteradmin -ls /
19/01/15 14:29:18 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
Mount Table Entries:
Source Destinations Owner
Group Mode Quota/Usage
/apps {color:#205081}hacluster1->/tmp1,hacluster2->/tmp2
{color}securedn users rwxr-xr-x
[NsQuota: -/-, SsQuota: -/-]
/hadoop/router/bin> ./hdfs dfs -put mapred.cmd /apps/.
19/01/15 14:29:50 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
/hadoop/router/bin> ./hdfs dfsrouteradmin -update /apps hacluster1,hacluster2
/tmp1,/tmp2 -order RANDOM
19/01/15 14:30:20 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
Successfully updated mount point /apps
/hadoop/router/bin> ./hdfs dfsrouteradmin -ls /
19/01/15 14:30:43 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
Mount Table Entries:
Source Destinations Owner
Group Mode Quota/Usage
/apps
{color:red}hacluster1->/tmp1,/tmp2,hacluster2->/tmp1,/tmp2{color} { securedn
users rwxr-xr-x [NsQuota:
-/-, SsQuota: -/-]
{noformat}
When i used the update command for changing the order HASH --> RANDOM
the destination of /apps for hacluster1 changed from /tmp1 to /tmp1,/tmp2.
Because of which i am unable to add files after changing the order.
> RBF: Unable to add files after changing the order
> -------------------------------------------------
>
> Key: HDFS-13835
> URL: https://issues.apache.org/jira/browse/HDFS-13835
> Project: Hadoop HDFS
> Issue Type: Bug
> Reporter: venkata ramkumar
> Assignee: venkata ramkumar
> Priority: Critical
>
> When a mount point it pointing to multiple sub cluster by default the order
> is HASH.
> But After changing the order from HASH to RANDOM i am unable to add files to
> that mount point.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
