[jira] [Commented] (HDFS-1905) Improve the usability of namenode -format

2011-05-12 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13032760#comment-13032760 ] Sanjay Radia commented on HDFS-1905: I think we are mixing the nice name with the

[jira] [Commented] (HDFS-1905) Improve the usability of namenode -format

2011-05-12 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13032772#comment-13032772 ] Sanjay Radia commented on HDFS-1905: Fixing the data files so that they are not plain

[jira] [Created] (HDFS-1911) HDFS tests for viewfs

2011-05-10 Thread Sanjay Radia (JIRA)
HDFS tests for viewfs - Key: HDFS-1911 URL: https://issues.apache.org/jira/browse/HDFS-1911 Project: Hadoop HDFS Issue Type: Test Reporter: Sanjay Radia Assignee: Sanjay Radia Fix

[jira] [Updated] (HDFS-1911) HDFS tests for viewfs

2011-05-10 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Radia updated HDFS-1911: --- Status: Patch Available (was: Open) HDFS tests for viewfs -

[jira] [Updated] (HDFS-1911) HDFS tests for viewfs

2011-05-10 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Radia updated HDFS-1911: --- Attachment: viewFs-hdfs1.patch HDFS tests for viewfs - Key:

[jira] [Updated] (HDFS-1911) HDFS tests for viewfs

2011-05-10 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Radia updated HDFS-1911: --- Attachment: viewFs-hdfs2.patch HDFS tests for viewfs - Key:

[jira] [Updated] (HDFS-1911) HDFS tests for viewfs

2011-05-10 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Radia updated HDFS-1911: --- Attachment: (was: viewFs-hdfs2.patch) HDFS tests for viewfs -

[jira] [Updated] (HDFS-1911) HDFS tests for viewfs

2011-05-10 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Radia updated HDFS-1911: --- Attachment: viewFs-hdfs2.patch HDFS tests for viewfs - Key:

[jira] [Updated] (HDFS-1911) HDFS tests for viewfs

2011-05-10 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Radia updated HDFS-1911: --- Status: Patch Available (was: Open) HDFS tests for viewfs -

[jira] [Updated] (HDFS-1911) HDFS tests for viewfs

2011-05-10 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Radia updated HDFS-1911: --- Status: Patch Available (was: Open) HDFS tests for viewfs -

[jira] [Updated] (HDFS-1911) HDFS tests for viewfs

2011-05-10 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Radia updated HDFS-1911: --- Status: Open (was: Patch Available) HDFS tests for viewfs -

[jira] [Commented] (HDFS-1911) HDFS tests for viewfs

2011-05-10 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13031532#comment-13031532 ] Sanjay Radia commented on HDFS-1911: The failed tests are not related to the patch. The

[jira] [Updated] (HDFS-1053) A client side mount table to give per-application/per-job file system view

2011-05-02 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Radia updated HDFS-1053: --- Attachment: viewFs3.patch Attach patch addresses the Assert error message issue that cos raised. Also

[jira] [Updated] (HDFS-1053) A client side mount table to give per-application/per-job file system view

2011-05-02 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Radia updated HDFS-1053: --- Affects Version/s: (was: 0.22.0) 0.23.0 Status: Patch

[jira] [Updated] (HDFS-1053) A client side mount table to give per-application/per-job file system view

2011-04-29 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Radia updated HDFS-1053: --- Attachment: viewFs1.patch A client side mount table to give per-application/per-job file system view

[jira] [Updated] (HDFS-1053) A client side mount table to give per-application/per-job file system view

2011-04-29 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Radia updated HDFS-1053: --- Attachment: viewFs2.patch A client side mount table to give per-application/per-job file system view

[jira] [Updated] (HDFS-1053) A client side mount table to give per-application/per-job file system view

2011-04-29 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Radia updated HDFS-1053: --- Attachment: ViewFs - javdoc2.pdf A client side mount table to give per-application/per-job file

[jira] [Commented] (HDFS-1053) A client side mount table to give per-application/per-job file system view

2011-04-29 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13027248#comment-13027248 ] Sanjay Radia commented on HDFS-1053: The patch provides an implementation for viewfs

[jira] [Updated] (HDFS-1053) A client side mount table to give per-application/per-job file system view

2011-04-29 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Radia updated HDFS-1053: --- Attachment: ViewFs - javdoc2.pdf A client side mount table to give per-application/per-job file

[jira] [Updated] (HDFS-1053) A client side mount table to give per-application/per-job file system view

2011-04-29 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Radia updated HDFS-1053: --- Attachment: (was: ViewFs - javdoc2.pdf) A client side mount table to give

[jira] [Commented] (HDFS-1658) A less expensive way to figure out directory size

2011-04-14 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13019970#comment-13019970 ] Sanjay Radia commented on HDFS-1658: Having the length be number of directory entries

[jira] [Commented] (HDFS-1831) FileContext createFlag combinations during create are not clearly defined

2011-04-12 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13018909#comment-13018909 ] Sanjay Radia commented on HDFS-1831: Looks good. BTW I wish we had used the Posix TRUNC

[jira] [Commented] (HDFS-1070) Speedup NameNode image loading and saving by storing local file names

2011-04-01 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13014772#comment-13014772 ] Sanjay Radia commented on HDFS-1070: With the old full names format, an arbitrary

[jira] [Commented] (HDFS-1362) Provide volume management functionality for DataNode

2011-03-21 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13009456#comment-13009456 ] Sanjay Radia commented on HDFS-1362: Steps 1 and 2 are done by the operator and step 3

[jira] Commented: (HDFS-1073) Simpler model for Namenode's fs Image and edit Logs

2011-03-18 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13008682#comment-13008682 ] Sanjay Radia commented on HDFS-1073: Noticed the progress on HDFS-1521. Todd, are you

[jira] Commented: (HDFS-1362) Provide volume management functionality for DataNode

2011-03-15 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13007016#comment-13007016 ] Sanjay Radia commented on HDFS-1362: @Todd Having the ability to add/remove volumes via

[jira] Commented: (HDFS-1362) Provide volume management functionality for DataNode

2011-03-15 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13007053#comment-13007053 ] Sanjay Radia commented on HDFS-1362: I would like to better understand the use case for

[jira] Commented: (HDFS-1312) Re-balance disks within a Datanode

2011-03-15 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13007204#comment-13007204 ] Sanjay Radia commented on HDFS-1312: From my point, there are mainly two cases of

[jira] Created: (HDFS-1623) High Availability Framework for HDFS NN

2011-02-10 Thread Sanjay Radia (JIRA)
High Availability Framework for HDFS NN --- Key: HDFS-1623 URL: https://issues.apache.org/jira/browse/HDFS-1623 Project: Hadoop HDFS Issue Type: New Feature Reporter: Sanjay Radia

[jira] Commented: (HDFS-1623) High Availability Framework for HDFS NN

2011-02-10 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12993315#comment-12993315 ] Sanjay Radia commented on HDFS-1623: There are various steps one can take to improve

[jira] Updated: (HDFS-1623) High Availability Framework for HDFS NN

2011-02-10 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Radia updated HDFS-1623: --- Attachment: Namenode HA Framework.pdf Draft of Proposal High Availability Framework for HDFS NN

[jira] Commented: (HDFS-347) DFS read performance suboptimal when client co-located on nodes with data

2011-02-03 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12990410#comment-12990410 ] Sanjay Radia commented on HDFS-347: --- Dhruba, you had mentioned that you have a prototype

[jira] Created: (HDFS-1599) Umbrella Jira for Improving HBASE support in HDFS

2011-01-26 Thread Sanjay Radia (JIRA)
Umbrella Jira for Improving HBASE support in HDFS - Key: HDFS-1599 URL: https://issues.apache.org/jira/browse/HDFS-1599 Project: Hadoop HDFS Issue Type: Improvement Reporter:

[jira] Commented: (HDFS-1593) Allow a datanode to copy a block to a datanode on a foreign HDFS cluster.

2011-01-25 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12986852#action_12986852 ] Sanjay Radia commented on HDFS-1593: In the case of the NN issuing a copy operation,

[jira] Commented: (HDFS-1547) Improve decommission mechanism

2011-01-08 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12979147#action_12979147 ] Sanjay Radia commented on HDFS-1547: +1 Good analysis, good summary. Thanks suresh.

[jira] Commented: (HDFS-1547) Improve decommission mechanism

2011-01-05 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12978047#action_12978047 ] Sanjay Radia commented on HDFS-1547: 4. I really like the fact that you are proposing

[jira] Commented: (HDFS-1547) Improve decommission mechanism

2011-01-05 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12978051#action_12978051 ] Sanjay Radia commented on HDFS-1547: when a node is being-decommissioned state, why do

[jira] Commented: (HDFS-1547) Improve decommission mechanism

2010-12-20 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12973441#action_12973441 ] Sanjay Radia commented on HDFS-1547: Have you considered adding RPCs (and CLI wrappers

[jira] Commented: (HDFS-1064) NN Availability - umbrella Jira

2010-12-16 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12972195#action_12972195 ] Sanjay Radia commented on HDFS-1064: Would users find the the use of HA NFS in a

[jira] Commented: (HDFS-1521) Persist transaction ID on disk between NN restarts

2010-12-12 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12970655#action_12970655 ] Sanjay Radia commented on HDFS-1521: Adding the txid to each record has thae advantage

[jira] Commented: (HDFS-1508) Ability to do savenamespace without being in safemode

2010-12-10 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12970223#action_12970223 ] Sanjay Radia commented on HDFS-1508: I don't see a problem with the entering the

[jira] Commented: (HDFS-1521) Persist transaction ID on disk between NN restarts

2010-12-09 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12969662#action_12969662 ] Sanjay Radia commented on HDFS-1521: Todd, from what I can see you are planning to write

[jira] Commented: (HDFS-1508) Ability to do savenamespace without being in safemode

2010-12-09 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12969975#action_12969975 ] Sanjay Radia commented on HDFS-1508: Does the following table representative the design?

[jira] Commented: (HDFS-1521) Persist transaction ID on disk between NN restarts

2010-12-08 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12969635#action_12969635 ] Sanjay Radia commented on HDFS-1521: @Dhruba can we instead use the generationStamp

[jira] Commented: (HDFS-1508) Ability to do savenamespace without being in safemode

2010-12-07 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12969202#action_12969202 ] Sanjay Radia commented on HDFS-1508: Konstantine, I think there is a use case where one

[jira] Commented: (HDFS-1508) Ability to do savenamespace without being in safemode

2010-12-06 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12968405#action_12968405 ] Sanjay Radia commented on HDFS-1508: There is a whole chess game going on underneath

[jira] Commented: (HDFS-1508) Ability to do savenamespace without being in safemode

2010-12-01 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12965785#action_12965785 ] Sanjay Radia commented on HDFS-1508: Dhruab, I understand your use case and do support

[jira] Commented: (HDFS-1508) Ability to do savenamespace without being in safemode

2010-11-30 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12965424#action_12965424 ] Sanjay Radia commented on HDFS-1508: The main difference between doing it in safemode

[jira] Commented: (HDFS-1508) Ability to do savenamespace without being in safemode

2010-11-30 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12965556#action_12965556 ] Sanjay Radia commented on HDFS-1508: saveNamespace with -f to indicate that NN should

[jira] Commented: (HDFS-1073) Simpler model for Namenode's fs Image and edit Logs

2010-11-17 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12933198#action_12933198 ] Sanjay Radia commented on HDFS-1073: On the roll transaction and the quit transaction we

[jira] Commented: (HDFS-1070) Speedup NameNode image loading and saving by storing local file names

2010-11-17 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12933217#action_12933217 ] Sanjay Radia commented on HDFS-1070: You have probably done some break down of where the

[jira] Resolved: (HDFS-1491) Update Hdfs to match the change of methods from protected to public in AbstractFileSystem (Hadoop-6903)

2010-11-15 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Radia resolved HDFS-1491. Resolution: Fixed Committed on Nov 10. Update Hdfs to match the change of methods from protected

[jira] Commented: (HDFS-1491) Update Hdfs to match the change of methods from protected to public in AbstractFileSystem (Hadoop-6903)

2010-11-12 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12931419#action_12931419 ] Sanjay Radia commented on HDFS-1491: The patch depends on HADOOP-6903 patch in command

[jira] Commented: (HDFS-1073) Simpler model for Namenode's fs Image and edit Logs

2010-11-09 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12930238#action_12930238 ] Sanjay Radia commented on HDFS-1073: if anyone may ask for a roll - ie CN, BN, or NN.

[jira] Updated: (HDFS-1491) Update Hdfs to match the change of methods from protected to public in AbstractFileSystem (Hadoop-6903)

2010-11-09 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Radia updated HDFS-1491: --- Attachment: Hdfs-1491.patch Update Hdfs to match the change of methods from protected to public in

[jira] Created: (HDFS-1491) Update Hdfs to match the change of methods from protected to public in AbstractFileSystem (Hadoop-6903)

2010-11-08 Thread Sanjay Radia (JIRA)
Update Hdfs to match the change of methods from protected to public in AbstractFileSystem (Hadoop-6903) - Key: HDFS-1491 URL:

[jira] Commented: (HDFS-1491) Update Hdfs to match the change of methods from protected to public in AbstractFileSystem (Hadoop-6903)

2010-11-08 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12929680#action_12929680 ] Sanjay Radia commented on HDFS-1491: I ran the tests and the following tests fail

[jira] Commented: (HDFS-1073) Simpler model for Namenode's fs Image and edit Logs

2010-11-05 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12928672#action_12928672 ] Sanjay Radia commented on HDFS-1073: ... but then you get the problem of synchronizing

[jira] Commented: (HDFS-1073) Simpler model for Namenode's fs Image and edit Logs

2010-11-05 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12928682#action_12928682 ] Sanjay Radia commented on HDFS-1073: .. not understand the rational for I'm quitting!

[jira] Commented: (HDFS-1073) Simpler model for Namenode's fs Image and edit Logs

2010-11-04 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12928283#action_12928283 ] Sanjay Radia commented on HDFS-1073: 4) No more edits, but a new BN starts up, and thus

[jira] Commented: (HDFS-1462) Refactor edit log loading to a separate class from edit log writing

2010-10-26 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12925208#action_12925208 ] Sanjay Radia commented on HDFS-1462: Had not realized that there is already a log

[jira] Commented: (HDFS-1462) Refactor edit log loading to a separate class from edit log writing

2010-10-25 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12924448#action_12924448 ] Sanjay Radia commented on HDFS-1462: +1 Looks good. Not worth changing the Log category

[jira] Commented: (HDFS-1073) Simpler model for Namenode's fs Image and edit Logs

2010-10-05 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12918088#action_12918088 ] Sanjay Radia commented on HDFS-1073: In order to do an offline fsck one can needs to

[jira] Commented: (HDFS-1073) Simpler model for Namenode's fs Image and edit Logs

2010-10-05 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12918102#action_12918102 ] Sanjay Radia commented on HDFS-1073: So are you suggesting that each edit will include

[jira] Commented: (HDFS-1073) Simpler model for Namenode's fs Image and edit Logs

2010-08-18 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12900162#action_12900162 ] Sanjay Radia commented on HDFS-1073: Here is what I remember from our meeting in April.

[jira] Updated: (HDFS-1053) A client side mount table to give per-application/per-job file system view

2010-07-19 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Radia updated HDFS-1053: --- Attachment: (was: ViewFs (Hadoop-common 0.22.0-SNAPSHOT API).pdf) A client side mount table to

[jira] Updated: (HDFS-1053) A client side mount table to give per-application/per-job file system view

2010-07-19 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Radia updated HDFS-1053: --- Attachment: ViewFsJavaDoc.pdf A client side mount table to give per-application/per-job file system

[jira] Updated: (HDFS-1053) A client side mount table to give per-application/per-job file system view

2010-07-19 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Radia updated HDFS-1053: --- Attachment: ViewFs (Hadoop-common 0.22.0-SNAPSHOT API).pdf A client side mount table to give

[jira] Updated: (HDFS-1053) A client side mount table to give per-application/per-job file system view

2010-07-13 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Radia updated HDFS-1053: --- Attachment: viewfs1.patch ViewFsJavaDoc.pdf BTW this jira should be in hadoop common,

[jira] Commented: (HDFS-1111) getCorruptFiles() should give some hint that the list is not complete

2010-06-29 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12883602#action_12883602 ] Sanjay Radia commented on HDFS-: I really think the correct design choice is to

[jira] Commented: (HDFS-599) Improve Namenode robustness by prioritizing datanode heartbeats over client requests

2010-05-18 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12868745#action_12868745 ] Sanjay Radia commented on HDFS-599: --- Having all protocols serve on all ports is strange

[jira] Commented: (HDFS-1079) HDFS implementation should throw exceptions defined in AbstractFileSystem

2010-04-29 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12862237#action_12862237 ] Sanjay Radia commented on HDFS-1079: * dfsclient: The methods should declare only

[jira] Updated: (HDFS-1052) HDFS scalability with multiple namenodes

2010-04-20 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Radia updated HDFS-1052: --- Attachment: Mulitple Namespaces5.pdf Minor updates to the doc (plus name change). HDFS scalability

[jira] Commented: (HDFS-1073) Simpler model for Namenode's fs Image and edit Logs

2010-04-13 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12856636#action_12856636 ] Sanjay Radia commented on HDFS-1073: Todd, thanks for the design. Before you move

[jira] Commented: (HDFS-1073) Simpler model for Namenode's fs Image and edit Logs

2010-04-13 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12856646#action_12856646 ] Sanjay Radia commented on HDFS-1073: # Checkpointing node issues beginCheckpoint to NN

[jira] Commented: (HDFS-1073) Simpler model for Namenode's fs Image and edit Logs

2010-04-13 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12856649#action_12856649 ] Sanjay Radia commented on HDFS-1073: Please add the following items to your design doc:

[jira] Commented: (HDFS-1073) Simpler model for Namenode's fs Image and edit Logs

2010-04-05 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12853485#action_12853485 ] Sanjay Radia commented on HDFS-1073: I forgot to mention other advantages. * The image

[jira] Commented: (HDFS-1073) Simpler model for Namenode's fs Image and edit Logs

2010-04-05 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12853490#action_12853490 ] Sanjay Radia commented on HDFS-1073: Sanjay mentioned it decouples the split (ie roll)

[jira] Commented: (HDFS-1077) namenode RPC protocol method names are overloaded

2010-04-05 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12853564#action_12853564 ] Sanjay Radia commented on HDFS-1077: We can rename them as they are not public. So short

[jira] Commented: (HDFS-892) optionally use Avro for namenode RPC

2010-04-05 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12853593#action_12853593 ] Sanjay Radia commented on HDFS-892: --- Just noticed that this added an Avro @Nullable. This

[jira] Commented: (HDFS-892) optionally use Avro for namenode RPC

2010-04-05 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12853621#action_12853621 ] Sanjay Radia commented on HDFS-892: --- Actually I am okay with Hadoop completely depending on

[jira] Commented: (HDFS-892) optionally use Avro for namenode RPC

2010-04-05 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12853623#action_12853623 ] Sanjay Radia commented on HDFS-892: --- Doug, you defined: +public interface NamenodeProtocols

[jira] Created: (HDFS-1073) Simpler model for Namenode's fs Image and edit Logs

2010-04-01 Thread Sanjay Radia (JIRA)
Simpler model for Namenode's fs Image and edit Logs Key: HDFS-1073 URL: https://issues.apache.org/jira/browse/HDFS-1073 Project: Hadoop HDFS Issue Type: Improvement Reporter:

[jira] Commented: (HDFS-1073) Simpler model for Namenode's fs Image and edit Logs

2010-04-01 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12852652#action_12852652 ] Sanjay Radia commented on HDFS-1073: This Jira proposes a simpler design for for

[jira] Commented: (HDFS-1073) Simpler model for Namenode's fs Image and edit Logs

2010-04-01 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12852661#action_12852661 ] Sanjay Radia commented on HDFS-1073: Todd, Just looked at your idea. Great minds think

[jira] Commented: (HDFS-1052) HDFS scalability with multiple namenodes

2010-03-30 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12851650#action_12851650 ] Sanjay Radia commented on HDFS-1052: Do you mean initial implementation or first patch?

[jira] Created: (HDFS-1069) Write HDFS wire protocols in AVRO IDL

2010-03-26 Thread Sanjay Radia (JIRA)
Write HDFS wire protocols in AVRO IDL - Key: HDFS-1069 URL: https://issues.apache.org/jira/browse/HDFS-1069 Project: Hadoop HDFS Issue Type: Improvement Reporter: Sanjay Radia

[jira] Commented: (HDFS-1069) Write HDFS wire protocols in AVRO IDL

2010-03-26 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12850281#action_12850281 ] Sanjay Radia commented on HDFS-1069: There are two main parts here # The HDFS RPC

[jira] Commented: (HDFS-1052) HDFS scalability with multiple namenodes

2010-03-23 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12848964#action_12848964 ] Sanjay Radia commented on HDFS-1052: There are no failover notions amongst the multiple

[jira] Created: (HDFS-1064) NN Availability - umbrella Jira

2010-03-23 Thread Sanjay Radia (JIRA)
NN Availability - umbrella Jira --- Key: HDFS-1064 URL: https://issues.apache.org/jira/browse/HDFS-1064 Project: Hadoop HDFS Issue Type: New Feature Reporter: Sanjay Radia This is an umbrella jira

[jira] Commented: (HDFS-1064) NN Availability - umbrella Jira

2010-03-23 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12848988#action_12848988 ] Sanjay Radia commented on HDFS-1064: Some of the comments in the other Jiras have

[jira] Commented: (HDFS-1051) Umbrella Jira for Scaling the HDFS Name Service

2010-03-22 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12848235#action_12848235 ] Sanjay Radia commented on HDFS-1051: * Filing of this Jira does not exclude work on HA.

[jira] Commented: (HDFS-1051) Umbrella Jira for Scaling the HDFS Name Service

2010-03-22 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12848334#action_12848334 ] Sanjay Radia commented on HDFS-1051: NN memory ... machines with 144 GB memory or more

[jira] Commented: (HDFS-1051) Umbrella Jira for Scaling the HDFS Name Service

2010-03-19 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12847649#action_12847649 ] Sanjay Radia commented on HDFS-1051: The HDFS Name service currently uses a single

[jira] Updated: (HDFS-1051) Umbrella Jira for Scaling the HDFS Name Service

2010-03-19 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Radia updated HDFS-1051: --- Fix Version/s: (was: 0.22.0) Umbrella Jira for Scaling the HDFS Name Service

[jira] Updated: (HDFS-1051) Umbrella Jira for Scaling the HDFS Name Service

2010-03-19 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Radia updated HDFS-1051: --- Oops. Didn't intend to say release 22 - this master jira will remain open for a very long time.

[jira] Created: (HDFS-1053) A client side mount table to give per-application/per-job file system view

2010-03-19 Thread Sanjay Radia (JIRA)
A client side mount table to give per-application/per-job file system view -- Key: HDFS-1053 URL: https://issues.apache.org/jira/browse/HDFS-1053 Project: Hadoop HDFS

[jira] Commented: (HDFS-1053) A client side mount table to give per-application/per-job file system view

2010-03-19 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12847660#action_12847660 ] Sanjay Radia commented on HDFS-1053: A client side mount table allows application

[jira] Updated: (HDFS-245) Create symbolic links in HDFS

2010-02-24 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Radia updated HDFS-245: -- Resolution: Fixed Fix Version/s: 0.22.0 Release Note: HDFS-245. Adds a symlink

[jira] Commented: (HDFS-245) Create symbolic links in HDFS

2010-02-24 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12838136#action_12838136 ] Sanjay Radia commented on HDFS-245: --- +1 Committed the patch. Thanks Eli Create symbolic

<    1   2   3   4   5   >