[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

2016-03-15 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15195908#comment-15195908 ] Colin Patrick McCabe commented on HDFS-7648: Hi [~rakesh_r], can you rebase the patch on trunk?

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

2016-03-04 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15180541#comment-15180541 ] Colin Patrick McCabe commented on HDFS-7648: Hi [~dwatzke], this question sounds like it should

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

2016-03-04 Thread David Watzke (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15179806#comment-15179806 ] David Watzke commented on HDFS-7648: Hi guys. I ran into trouble because I used

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

2015-02-23 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14334273#comment-14334273 ] Colin Patrick McCabe commented on HDFS-7648: bq. Mmm ... We are not fixing the

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

2015-02-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14334506#comment-14334506 ] Tsz Wo Nicholas Sze commented on HDFS-7648: --- If you don't fix the bug, isn't

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

2015-02-22 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14332305#comment-14332305 ] Rakesh R commented on HDFS-7648: There is a long discussion thread about automatically

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

2015-02-21 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14330239#comment-14330239 ] Tsz Wo Nicholas Sze commented on HDFS-7648: --- We can help the users by pointing

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

2015-02-20 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14329289#comment-14329289 ] Colin Patrick McCabe commented on HDFS-7648: Latest patch looks better. Can we

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

2015-02-18 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14325681#comment-14325681 ] Rakesh R commented on HDFS-7648: Attached new patch where it checks the block-ID layout

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

2015-02-18 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14327066#comment-14327066 ] Tsz Wo Nicholas Sze commented on HDFS-7648: --- ... Has this ever actually

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

2015-02-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14325831#comment-14325831 ] Hadoop QA commented on HDFS-7648: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

2015-02-17 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14325196#comment-14325196 ] Colin Patrick McCabe commented on HDFS-7648: bq. I see Colin that point that

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

2015-02-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14322530#comment-14322530 ] Hadoop QA commented on HDFS-7648: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

2015-02-16 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14322540#comment-14322540 ] Rakesh R commented on HDFS-7648: [~cmccabe] kindly review the patch. Thanks! I could see

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

2015-02-12 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14319028#comment-14319028 ] Tsz Wo Nicholas Sze commented on HDFS-7648: --- [~cmccabe], I means these questions:

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

2015-02-12 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14319033#comment-14319033 ] Colin Patrick McCabe commented on HDFS-7648: bq. should the block report

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

2015-02-12 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14318996#comment-14318996 ] Colin Patrick McCabe commented on HDFS-7648: If there are a bunch of files in

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

2015-02-12 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14319015#comment-14319015 ] Colin Patrick McCabe commented on HDFS-7648: Hi [~szetszwo], since you

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

2015-02-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14319541#comment-14319541 ] Rakesh R commented on HDFS-7648: bq. If there are a bunch of files in the wrong location,

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

2015-02-12 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14319000#comment-14319000 ] Tsz Wo Nicholas Sze commented on HDFS-7648: --- [~cmccabe], in case that you missed

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

2015-02-12 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14319067#comment-14319067 ] Tsz Wo Nicholas Sze commented on HDFS-7648: --- I see Colin that point that before

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

2015-02-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14319716#comment-14319716 ] Hadoop QA commented on HDFS-7648: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

2015-02-11 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317523#comment-14317523 ] Colin Patrick McCabe commented on HDFS-7648: Thank you for sticking with this.

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

2015-02-11 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317551#comment-14317551 ] Rakesh R commented on HDFS-7648: bq. Why don't you just log them as you go? I really see no

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

2015-02-10 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14315505#comment-14315505 ] Rakesh R commented on HDFS-7648: [~szetszwo]Nicholas bq.I am fine even if we do it in two

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

2015-02-10 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14314176#comment-14314176 ] Rakesh R commented on HDFS-7648: Hi [~szetszwo], [~cmccabe], Thanks for the comments. It

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

2015-02-10 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14315675#comment-14315675 ] Rakesh R commented on HDFS-7648: Attach new patch where it will print the log message and

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

2015-02-10 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14315296#comment-14315296 ] Colin Patrick McCabe commented on HDFS-7648: I think the current patch is fine,

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

2015-02-10 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14315307#comment-14315307 ] Tsz Wo Nicholas Sze commented on HDFS-7648: --- None of those cases seems like

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

2015-01-30 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299128#comment-14299128 ] Tsz Wo Nicholas Sze commented on HDFS-7648: --- It's not the goal of

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

2015-01-30 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299387#comment-14299387 ] Colin Patrick McCabe commented on HDFS-7648: bq. The original design of

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

2015-01-30 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14298373#comment-14298373 ] Rakesh R commented on HDFS-7648: [~cmccabe] bq. It's not the goal of DirectoryScanner to

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

2015-01-29 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14296925#comment-14296925 ] Rakesh R commented on HDFS-7648: Thanks [~cmccabe] for comments. bq.Probably what we want

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

2015-01-29 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14297894#comment-14297894 ] Colin Patrick McCabe commented on HDFS-7648: bq. Do you meant, DirectoryScanner

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

2015-01-26 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292443#comment-14292443 ] Colin Patrick McCabe commented on HDFS-7648: I agree with Nicholas that we

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

2015-01-23 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289778#comment-14289778 ] Rakesh R commented on HDFS-7648: bq.If a mismatch is found, it should also fix it Should I

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

2015-01-23 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289698#comment-14289698 ] Rakesh R commented on HDFS-7648: [~szetszwo] I'm going through the block ID-based block

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

2015-01-23 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289822#comment-14289822 ] Rakesh R commented on HDFS-7648: Ah, this is upgrade path. {{DataStorage.java:}} {code}

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

2015-01-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289855#comment-14289855 ] Tsz Wo Nicholas Sze commented on HDFS-7648: --- Yes. It won't be a problem then.

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

2015-01-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289727#comment-14289727 ] Tsz Wo Nicholas Sze commented on HDFS-7648: --- During block report generation or

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

2015-01-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289787#comment-14289787 ] Tsz Wo Nicholas Sze commented on HDFS-7648: --- Should I need to worry about the