[jira] [Commented] (HDFS-14889) Ability to check if a block has a replica on provided storage
[
https://issues.apache.org/jira/browse/HDFS-14889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16944211#comment-16944211
]
Virajith Jalaparti commented on HDFS-14889:
---
Thanks for working on this [~ashvin] and the review [~elgoiri]!
> Ability to check if a block has a replica on provided storage
> -
>
> Key: HDFS-14889
> URL: https://issues.apache.org/jira/browse/HDFS-14889
> Project: Hadoop HDFS
> Issue Type: Sub-task
>Reporter: Ashvin Agrawal
>Assignee: Ashvin Agrawal
>Priority: Major
>
> Provided storage (HDFS-9806) allows data on external storage systems to
> seamlessly appear as files on HDFS. However, in the implementation today,
> there is no easy way to distinguish a {{Block}} belonging to an external
> provided storage volume from a block belonging to the local cluster. This
> task simplifies this.
> {{isProvided}} block will be useful in hybrid scenarios when the local
> cluster will host both kinds of blocks. For e.g. policy for management of
> replica/cached-blocks will be different from that of regular blocks. As of
> this task {{isProvided}} is not invoked anywhere.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-14889) Ability to check if a block has a replica on provided storage
[
https://issues.apache.org/jira/browse/HDFS-14889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16944209#comment-16944209
]
Hudson commented on HDFS-14889:
---
SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #17463 (See
[https://builds.apache.org/job/Hadoop-trunk-Commit/17463/])
HDFS-14889. Ability to check if a block has a replica on provided (virajith:
rev 844b766da535894b792892b38de6bc2500eca57f)
* (edit)
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockInfoContiguous.java
* (edit)
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockInfoStriped.java
* (edit)
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestBlockInfo.java
* (edit)
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockInfo.java
> Ability to check if a block has a replica on provided storage
> -
>
> Key: HDFS-14889
> URL: https://issues.apache.org/jira/browse/HDFS-14889
> Project: Hadoop HDFS
> Issue Type: Sub-task
>Reporter: Ashvin Agrawal
>Assignee: Ashvin Agrawal
>Priority: Major
>
> Provided storage (HDFS-9806) allows data on external storage systems to
> seamlessly appear as files on HDFS. However, in the implementation today,
> there is no easy way to distinguish a {{Block}} belonging to an external
> provided storage volume from a block belonging to the local cluster. This
> task simplifies this.
> {{isProvided}} block will be useful in hybrid scenarios when the local
> cluster will host both kinds of blocks. For e.g. policy for management of
> replica/cached-blocks will be different from that of regular blocks. As of
> this task {{isProvided}} is not invoked anywhere.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-14889) Ability to check if a block has a replica on provided storage
[
https://issues.apache.org/jira/browse/HDFS-14889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16944045#comment-16944045
]
Ashvin Agrawal commented on HDFS-14889:
---
Thanks for the review [~virajith]
> Ability to check if a block has a replica on provided storage
> -
>
> Key: HDFS-14889
> URL: https://issues.apache.org/jira/browse/HDFS-14889
> Project: Hadoop HDFS
> Issue Type: Sub-task
>Reporter: Ashvin Agrawal
>Assignee: Ashvin Agrawal
>Priority: Major
>
> Provided storage (HDFS-9806) allows data on external storage systems to
> seamlessly appear as files on HDFS. However, in the implementation today,
> there is no easy way to distinguish a {{Block}} belonging to an external
> provided storage volume from a block belonging to the local cluster. This
> task simplifies this.
> {{isProvided}} block will be useful in hybrid scenarios when the local
> cluster will host both kinds of blocks. For e.g. policy for management of
> replica/cached-blocks will be different from that of regular blocks. As of
> this task {{isProvided}} is not invoked anywhere.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-14889) Ability to check if a block has a replica on provided storage
[
https://issues.apache.org/jira/browse/HDFS-14889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16943807#comment-16943807
]
Virajith Jalaparti commented on HDFS-14889:
---
[~ashvin] - can you add some context as to why this is needed? from the PR, it
looks like no one is calling the {{isProvided}} method.
> Ability to check if a block has a replica on provided storage
> -
>
> Key: HDFS-14889
> URL: https://issues.apache.org/jira/browse/HDFS-14889
> Project: Hadoop HDFS
> Issue Type: Sub-task
>Reporter: Ashvin Agrawal
>Assignee: Ashvin Agrawal
>Priority: Major
>
> Provided storage (HDFS-9806) allows data on external storage systems to
> seamlessly appear as files on HDFS. However, in the implementation today,
> there is no easy way to distinguish a {{Block}} belonging to an external
> provided storage volume from a block belonging to the local cluster. This
> task simplifies this. This feature will be useful in hybrid scenarios when
> the local cluster will host both kinds of blocks.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-14889) Ability to check if a block has a replica on provided storage
[
https://issues.apache.org/jira/browse/HDFS-14889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16943166#comment-16943166
]
Ashvin Agrawal commented on HDFS-14889:
---
Thanks for the review [~elgoiri]. I have updated the PR.
> Ability to check if a block has a replica on provided storage
> -
>
> Key: HDFS-14889
> URL: https://issues.apache.org/jira/browse/HDFS-14889
> Project: Hadoop HDFS
> Issue Type: Sub-task
>Reporter: Ashvin Agrawal
>Assignee: Ashvin Agrawal
>Priority: Major
>
> Provided storage (HDFS-9806) allows data on external storage systems to
> seamlessly appear as files on HDFS. However, in the implementation today,
> there is no easy way to distinguish a {{Block}} belonging to an external
> provided storage volume from a block belonging to the local cluster. This
> task simplifies this. This feature will be useful in hybrid scenarios when
> the local cluster will host both kinds of blocks.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-14889) Ability to check if a block has a replica on provided storage
[
https://issues.apache.org/jira/browse/HDFS-14889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16943000#comment-16943000
]
Íñigo Goiri commented on HDFS-14889:
Can we make the JIRA and the PR have the same title?
> Ability to check if a block has a replica on provided storage
> -
>
> Key: HDFS-14889
> URL: https://issues.apache.org/jira/browse/HDFS-14889
> Project: Hadoop HDFS
> Issue Type: Sub-task
>Reporter: Ashvin Agrawal
>Assignee: Ashvin Agrawal
>Priority: Major
>
> Provided storage (HDFS-9806) allows data on external storage systems to
> seamlessly appear as files on HDFS. However, in the implementation today,
> there is no easy way to distinguish a {{Block}} belonging to an external
> provided storage volume from a block belonging to the local cluster. This
> task simplifies this. This feature will be useful in hybrid scenarios when
> the local cluster will host both kinds of blocks.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-14889) Ability to check if a block has a replica on provided storage
[
https://issues.apache.org/jira/browse/HDFS-14889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16942507#comment-16942507
]
Ashvin Agrawal commented on HDFS-14889:
---
CC: [~virajith] [~elgoiri]
> Ability to check if a block has a replica on provided storage
> -
>
> Key: HDFS-14889
> URL: https://issues.apache.org/jira/browse/HDFS-14889
> Project: Hadoop HDFS
> Issue Type: Sub-task
>Reporter: Ashvin Agrawal
>Assignee: Ashvin Agrawal
>Priority: Major
>
> Provided storage (HDFS-9806) allows data on external storage systems to
> seamlessly appear as files on HDFS. However, in the implementation today,
> there is no easy way to distinguish a {{Block}} belonging to an external
> provided storage volume from a block belonging to the local cluster. This
> task simplifies this. This feature will be useful in hybrid scenarios when
> the local cluster will host both kinds of blocks.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
