[jira] [Commented] (HDFS-3702) Add an option for NOT writing the blocks locally if there is a datanode on the same box as the client

[ https://issues.apache.org/jira/browse/HDFS-3702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15205380#comment-15205380 ] Nicolas Liochon commented on HDFS-3702: --- bq. The issue was opened in July 2012 so we not holding our

[jira] [Commented] (HDFS-3702) Add an option for NOT writing the blocks locally if there is a datanode on the same box as the client

[ https://issues.apache.org/jira/browse/HDFS-3702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15186889#comment-15186889 ] Nicolas Liochon commented on HDFS-3702: --- It's really really great to see this progressing. For a

[jira] [Updated] (HDFS-9213) Minicluster with Kerberos generates some stacks when checking the ports

[ https://issues.apache.org/jira/browse/HDFS-9213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicolas Liochon updated HDFS-9213: -- Attachment: hdfs-9213.v1.patch > Minicluster with Kerberos generates some stacks when checking

[jira] [Updated] (HDFS-9213) Minicluster with Kerberos generates some stacks when checking the ports

[ https://issues.apache.org/jira/browse/HDFS-9213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicolas Liochon updated HDFS-9213: -- Status: Patch Available (was: Open) retriggering a hadoopqa run... > Minicluster with Kerberos

[jira] [Updated] (HDFS-9213) Minicluster with Kerberos generates some stacks when checking the ports

[ https://issues.apache.org/jira/browse/HDFS-9213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicolas Liochon updated HDFS-9213: -- Status: Open (was: Patch Available) > Minicluster with Kerberos generates some stacks when

[jira] [Updated] (HDFS-9213) Minicluster with Kerberos generates some stacks when checking the ports

[ https://issues.apache.org/jira/browse/HDFS-9213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicolas Liochon updated HDFS-9213: -- Status: Patch Available (was: Open) > Minicluster with Kerberos generates some stacks when

[jira] [Updated] (HDFS-9213) Minicluster with Kerberos generates some stacks when checking the ports

[ https://issues.apache.org/jira/browse/HDFS-9213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicolas Liochon updated HDFS-9213: -- Attachment: hdfs-9213.v1.patch > Minicluster with Kerberos generates some stacks when checking

[jira] [Created] (HDFS-9213) Minicluster with Kerberos generates some stacks when checking the ports

Nicolas Liochon created HDFS-9213: - Summary: Minicluster with Kerberos generates some stacks when checking the ports Key: HDFS-9213 URL: https://issues.apache.org/jira/browse/HDFS-9213 Project:

[jira] [Commented] (HDFS-3702) Add an option for NOT writing the blocks locally if there is a datanode on the same box as the client

[ https://issues.apache.org/jira/browse/HDFS-3702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14220771#comment-14220771 ] Nicolas Liochon commented on HDFS-3702: --- It's great. Thanks, Lei. That should be a

[jira] [Commented] (HDFS-5916) provide API to bulk delete directories/files

[ https://issues.apache.org/jira/browse/HDFS-5916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13911658#comment-13911658 ] Nicolas Liochon commented on HDFS-5916: --- This would be great. I was actually very

[jira] [Updated] (HDFS-3705) Add the possibility to mark a node as 'low priority' for read in the DFSClient

[ https://issues.apache.org/jira/browse/HDFS-3705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicolas Liochon updated HDFS-3705: -- Resolution: Won't Fix Status: Resolved (was: Patch Available) HBASE-6453 short term

[jira] [Updated] (HDFS-347) DFS read performance suboptimal when client co-located on nodes with data

[ https://issues.apache.org/jira/browse/HDFS-347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicolas Liochon updated HDFS-347: - Description: One of the major strategies Hadoop uses to get scalable data processing is to move

[jira] [Commented] (HDFS-4754) Add an API in the namenode to mark a datanode as stale

[ https://issues.apache.org/jira/browse/HDFS-4754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13735026#comment-13735026 ] Nicolas Liochon commented on HDFS-4754: --- Nick: I agree. I will provide a version with

[jira] [Updated] (HDFS-4754) Add an API in the namenode to mark a datanode as stale

[ https://issues.apache.org/jira/browse/HDFS-4754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicolas Liochon updated HDFS-4754: -- Status: Open (was: Patch Available) Add an API in the namenode to mark a datanode as

[jira] [Commented] (HDFS-4754) Add an API in the namenode to mark a datanode as stale

[ https://issues.apache.org/jira/browse/HDFS-4754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13731767#comment-13731767 ] Nicolas Liochon commented on HDFS-4754: --- I don't reproduce the issue locally. And

[jira] [Updated] (HDFS-4754) Add an API in the namenode to mark a datanode as stale

[ https://issues.apache.org/jira/browse/HDFS-4754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicolas Liochon updated HDFS-4754: -- Fix Version/s: 2.1.1-beta 3.0.0 Status: Patch Available (was:

[jira] [Updated] (HDFS-4754) Add an API in the namenode to mark a datanode as stale

[ https://issues.apache.org/jira/browse/HDFS-4754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicolas Liochon updated HDFS-4754: -- Attachment: 4754.v4.patch Add an API in the namenode to mark a datanode as stale

[jira] [Commented] (HDFS-4754) Add an API in the namenode to mark a datanode as stale

[ https://issues.apache.org/jira/browse/HDFS-4754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13731859#comment-13731859 ] Nicolas Liochon commented on HDFS-4754: --- Reviews welcome, I would like to have this

[jira] [Commented] (HDFS-4754) Add an API in the namenode to mark a datanode as stale

[ https://issues.apache.org/jira/browse/HDFS-4754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13730853#comment-13730853 ] Nicolas Liochon commented on HDFS-4754: --- [~qwertymaniac] Thanks for the feedback. I'm

[jira] [Updated] (HDFS-4754) Add an API in the namenode to mark a datanode as stale

[ https://issues.apache.org/jira/browse/HDFS-4754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicolas Liochon updated HDFS-4754: -- Status: Open (was: Patch Available) Add an API in the namenode to mark a datanode as

[jira] [Updated] (HDFS-4754) Add an API in the namenode to mark a datanode as stale

[ https://issues.apache.org/jira/browse/HDFS-4754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicolas Liochon updated HDFS-4754: -- Attachment: 4754.v4.patch Add an API in the namenode to mark a datanode as stale

[jira] [Commented] (HDFS-4754) Add an API in the namenode to mark a datanode as stale

[ https://issues.apache.org/jira/browse/HDFS-4754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13731080#comment-13731080 ] Nicolas Liochon commented on HDFS-4754: --- v4: - the api is in HdfsAdmin, so it can be

[jira] [Updated] (HDFS-4754) Add an API in the namenode to mark a datanode as stale

[ https://issues.apache.org/jira/browse/HDFS-4754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicolas Liochon updated HDFS-4754: -- Status: Patch Available (was: Open) Add an API in the namenode to mark a datanode as

[jira] [Commented] (HDFS-4754) Add an API in the namenode to mark a datanode as stale

[ https://issues.apache.org/jira/browse/HDFS-4754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13731091#comment-13731091 ] Nicolas Liochon commented on HDFS-4754: --- The patch is for trunk but applies to

[jira] [Commented] (HDFS-5016) Heartbeating thread blocks under some failure conditions leading to loss of datanodes

[ https://issues.apache.org/jira/browse/HDFS-5016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13719356#comment-13719356 ] Nicolas Liochon commented on HDFS-5016: --- nice analysis. as Devaraj, I think the

[jira] [Commented] (HDFS-4754) Add an API in the namenode to mark a datanode as stale

[ https://issues.apache.org/jira/browse/HDFS-4754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13669845#comment-13669845 ] Nicolas Liochon commented on HDFS-4754: --- Whatever you say. We depend on HFileSystem /

[jira] [Updated] (HDFS-4754) Add an API in the namenode to mark a datanode as stale

[ https://issues.apache.org/jira/browse/HDFS-4754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicolas Liochon updated HDFS-4754: -- Status: Open (was: Patch Available) Add an API in the namenode to mark a datanode as

[jira] [Updated] (HDFS-4754) Add an API in the namenode to mark a datanode as stale

[ https://issues.apache.org/jira/browse/HDFS-4754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicolas Liochon updated HDFS-4754: -- Status: Patch Available (was: Open) Add an API in the namenode to mark a datanode as

[jira] [Updated] (HDFS-4754) Add an API in the namenode to mark a datanode as stale

[ https://issues.apache.org/jira/browse/HDFS-4754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicolas Liochon updated HDFS-4754: -- Attachment: 4754.v2.patch Add an API in the namenode to mark a datanode as stale

[jira] [Commented] (HDFS-4754) Add an API in the namenode to mark a datanode as stale

[ https://issues.apache.org/jira/browse/HDFS-4754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13668338#comment-13668338 ] Nicolas Liochon commented on HDFS-4754: --- v2 takes the comments above into account. If

[jira] [Commented] (HDFS-4754) Add an API in the namenode to mark a datanode as stale

[ https://issues.apache.org/jira/browse/HDFS-4754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13667257#comment-13667257 ] Nicolas Liochon commented on HDFS-4754: --- bq. Should the markStale return a int

[jira] [Commented] (HDFS-4754) Add an API in the namenode to mark a datanode as stale

[ https://issues.apache.org/jira/browse/HDFS-4754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13665669#comment-13665669 ] Nicolas Liochon commented on HDFS-4754: --- I forgot the apache license on the file I

[jira] [Updated] (HDFS-4754) Add an API in the namenode to mark a datanode as stale

[ https://issues.apache.org/jira/browse/HDFS-4754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicolas Liochon updated HDFS-4754: -- Attachment: 4754.v1.patch Add an API in the namenode to mark a datanode as stale

[jira] [Updated] (HDFS-4754) Add an API in the namenode to mark a datanode as stale

[ https://issues.apache.org/jira/browse/HDFS-4754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicolas Liochon updated HDFS-4754: -- Status: Patch Available (was: Open) There is a setting to disable it if needed, by configuring

[jira] [Updated] (HDFS-4754) Add an API in the namenode to mark a datanode as stale

[ https://issues.apache.org/jira/browse/HDFS-4754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicolas Liochon updated HDFS-4754: -- Assignee: Nicolas Liochon Add an API in the namenode to mark a datanode as stale

[jira] [Created] (HDFS-4754) Add an API in the namenode to mark a datanode as stale

Nicolas Liochon created HDFS-4754: - Summary: Add an API in the namenode to mark a datanode as stale Key: HDFS-4754 URL: https://issues.apache.org/jira/browse/HDFS-4754 Project: Hadoop HDFS

[jira] [Commented] (HDFS-4721) Speed up lease/block recovery when DN fails and a block goes into recovery

[ https://issues.apache.org/jira/browse/HDFS-4721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13639235#comment-13639235 ] Nicolas Liochon commented on HDFS-4721: --- Would it make sense, in

[jira] [Commented] (HDFS-4721) Speed up lease/block recovery when DN fails and a block goes into recovery

[ https://issues.apache.org/jira/browse/HDFS-4721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13639323#comment-13639323 ] Nicolas Liochon commented on HDFS-4721: --- May be there is something I haven't

[jira] [Commented] (HDFS-4721) Speed up lease/block recovery when DN fails and a block goes into recovery

[ https://issues.apache.org/jira/browse/HDFS-4721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13639337#comment-13639337 ] Nicolas Liochon commented on HDFS-4721: --- You can use a specific configuration for

[jira] [Commented] (HDFS-4721) Speed up lease/block recovery when DN fails and a block goes into recovery

[ https://issues.apache.org/jira/browse/HDFS-4721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13639360#comment-13639360 ] Nicolas Liochon commented on HDFS-4721: --- bq. Btw, do you know why the build failed ?

[jira] [Commented] (HDFS-3705) Add the possibility to mark a node as 'low priority' for read in the DFSClient

[ https://issues.apache.org/jira/browse/HDFS-3705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13637922#comment-13637922 ] Nicolas Liochon commented on HDFS-3705: --- This JIRA is actually more critical than I

[jira] [Commented] (HDFS-4721) Speed up lease/block recovery when DN fails and a block goes into recovery

[ https://issues.apache.org/jira/browse/HDFS-4721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638295#comment-13638295 ] Nicolas Liochon commented on HDFS-4721: --- The algo as I understand it is: namenode

[jira] [Commented] (HDFS-4689) freeze/seal a hdfs file

[ https://issues.apache.org/jira/browse/HDFS-4689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13631679#comment-13631679 ] Nicolas Liochon commented on HDFS-4689: --- It was an idea (a good one :-) ) from

[jira] [Commented] (HDFS-4689) freeze/seal a hdfs file

[ https://issues.apache.org/jira/browse/HDFS-4689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13629915#comment-13629915 ] Nicolas Liochon commented on HDFS-4689: --- You're sure it's not HBASE-7878 / HBASE-8204