[jira] [Updated] (HDFS-4101) ZKFC should implement zookeeper.recovery.retry like HBase to connect to ZooKeeper

2015-09-03 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi Ozawa updated HDFS-4101: - Status: Open (was: Patch Available) Cancelling this patch for the comments. It would be great if

[jira] [Commented] (HDFS-8941) DistributedFileSystem listCorruptFileBlocks API should resolve relative path

2015-09-03 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14729158#comment-14729158 ] Rakesh R commented on HDFS-8941: Please ignore the {{checkstyle}} warnings and {{hdfs tests}} failures,

[jira] [Commented] (HDFS-8698) Add "-direct" flag option for fs copy so that user can choose not to create "._COPYING_" file

2015-09-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14729060#comment-14729060 ] Hadoop QA commented on HDFS-8698: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Created] (HDFS-9015) Refactor TestReplicationPolicy to test different block placement policies

2015-09-03 Thread Ming Ma (JIRA)
Ming Ma created HDFS-9015: - Summary: Refactor TestReplicationPolicy to test different block placement policies Key: HDFS-9015 URL: https://issues.apache.org/jira/browse/HDFS-9015 Project: Hadoop HDFS

[jira] [Commented] (HDFS-8967) Create a BlockManagerLock class to represent the lock used in the BlockManager

2015-09-03 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14729181#comment-14729181 ] Daryn Sharp commented on HDFS-8967: --- Are you sure there isn't a race in the tests, perhaps with the

[jira] [Commented] (HDFS-8581) count cmd calculate wrong when huge files exist in one folder

2015-09-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14729203#comment-14729203 ] Hadoop QA commented on HDFS-8581: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-8885) ByteRangeInputStream used in webhdfs does not override available()

2015-09-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14729205#comment-14729205 ] Hudson commented on HDFS-8885: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2267 (See

[jira] [Created] (HDFS-9014) Block placement policy with respect to DN free space

2015-09-03 Thread Max Lapan (JIRA)
Max Lapan created HDFS-9014: --- Summary: Block placement policy with respect to DN free space Key: HDFS-9014 URL: https://issues.apache.org/jira/browse/HDFS-9014 Project: Hadoop HDFS Issue Type:

[jira] [Created] (HDFS-9016) Display upgrade domain information in fsck

2015-09-03 Thread Ming Ma (JIRA)
Ming Ma created HDFS-9016: - Summary: Display upgrade domain information in fsck Key: HDFS-9016 URL: https://issues.apache.org/jira/browse/HDFS-9016 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Updated] (HDFS-5165) FSNameSystem TotalFiles and FilesTotal metrics are the same

2015-09-03 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi Ozawa updated HDFS-5165: - Status: Open (was: Patch Available) Cancelling the patch since it's obsoleted and cannot be

[jira] [Commented] (HDFS-9014) Block placement policy with respect to DN free space

2015-09-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14729222#comment-14729222 ] Hadoop QA commented on HDFS-9014: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-8885) ByteRangeInputStream used in webhdfs does not override available()

2015-09-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14729170#comment-14729170 ] Hudson commented on HDFS-8885: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #329 (See

[jira] [Commented] (HDFS-7116) Add a command to get the balancer bandwidth

2015-09-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14729191#comment-14729191 ] Hadoop QA commented on HDFS-7116: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-8984) Move replication queues related methods in FSNamesystem to BlockManager

2015-09-03 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14729201#comment-14729201 ] Daryn Sharp commented on HDFS-8984: --- Generally paralleling an old patch I was working on, looks to be on

[jira] [Commented] (HDFS-9013) Deprecate NameNodeMXBean#getNNStarted in branch2 and remove from trunk

2015-09-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14729223#comment-14729223 ] Hadoop QA commented on HDFS-9013: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-9014) Block placement policy with respect to DN free space

2015-09-03 Thread Max Lapan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Lapan updated HDFS-9014: Status: Patch Available (was: Open) > Block placement policy with respect to DN free space >

[jira] [Updated] (HDFS-9014) Block placement policy with respect to DN free space

2015-09-03 Thread Max Lapan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Lapan updated HDFS-9014: Attachment: ReplicationPolicyFreeSpace.patch > Block placement policy with respect to DN free space >

[jira] [Commented] (HDFS-8885) ByteRangeInputStream used in webhdfs does not override available()

2015-09-03 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14729254#comment-14729254 ] Chris Nauroth commented on HDFS-8885: - [~srevanka], thank you for the patch. [~ajisakaa], thank you

[jira] [Updated] (HDFS-5361) Change the unit of StartupProgress 'PercentComplete' to percentage

2015-09-03 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi Ozawa updated HDFS-5361: - Status: Open (was: Patch Available) Cancelling the patch since it cannot be applied. > Change

[jira] [Commented] (HDFS-7929) inotify unable fetch pre-upgrade edit log segments once upgrade starts

2015-09-03 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14729320#comment-14729320 ] Sangjin Lee commented on HDFS-7929: --- HDFS-8480 is included in the list, and will be backported. As for

[jira] [Commented] (HDFS-8999) Namenode need not wait for {{blockReceived}} for the last block before completing a file.

2015-09-03 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14729407#comment-14729407 ] Daryn Sharp commented on HDFS-8999: --- My rhetorical question to provoke thought was misunderstood. I was

[jira] [Updated] (HDFS-9010) Replace NameNode.DEFAULT_PORT with HdfsClientConfigKeys.DFS_NAMENODE_RPC_PORT_DEFAULT config key

2015-09-03 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9010: Attachment: HDFS-9010.002.patch The failing tests may not be related. The v2 patch rebases from

[jira] [Updated] (HDFS-8384) Allow NN to startup if there are files having a lease but are not under construction

2015-09-03 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8384: Attachment: HDFS-8384.000.patch Post a simple patch: # Log a warning msg instead of throwing exception in

[jira] [Updated] (HDFS-8979) Clean up checkstyle warnings in hadoop-hdfs-client module

2015-09-03 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-8979: Summary: Clean up checkstyle warnings in hadoop-hdfs-client module (was: Clean up checkstyle

[jira] [Commented] (HDFS-8984) Move replication queues related methods in FSNamesystem to BlockManager

2015-09-03 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14729488#comment-14729488 ] Haohui Mai commented on HDFS-8984: -- Thanks for the reviews. Speaking of the race conditions, this patch

[jira] [Updated] (HDFS-9012) Move o.a.h.hdfs.protocol.datatransfer.PipelineAck class to hadoop-hdfs-client module

2015-09-03 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9012: Description: The {{package org.apache.hadoop.hdfs.protocol.datatransfer.PipelineAck}} class is used

[jira] [Updated] (HDFS-8979) Clean up checkstyle warnings in hadoop-hdfs-client module

2015-09-03 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-8979: Description: This jira tracks the effort of cleaning up checkstyle warnings in

[jira] [Updated] (HDFS-8964) INotify should not read at or beyond the file offset that is being written in FileJournalManager

2015-09-03 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8964: --- Summary: INotify should not read at or beyond the file offset that is being written in

[jira] [Commented] (HDFS-8964) When validating the edit log, do not read at or beyond the file offset that is being written

2015-09-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14729536#comment-14729536 ] Hudson commented on HDFS-8964: -- FAILURE: Integrated in Hadoop-trunk-Commit #8399 (See

[jira] [Updated] (HDFS-9018) Update the pom to add junit dependency and move TestXAttr to client project

2015-09-03 Thread kanaka kumar avvaru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kanaka kumar avvaru updated HDFS-9018: -- Status: Patch Available (was: Open) Attaching initial patch. [~wheat9], please review.

[jira] [Commented] (HDFS-8966) Separate the lock used in namespace and block management layer

2015-09-03 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14729491#comment-14729491 ] Haohui Mai commented on HDFS-8966: -- The final goal is to allow the namespace and the blockmanager run

[jira] [Commented] (HDFS-8964) Provide max TxId when validating in-progress edit log files

2015-09-03 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14729506#comment-14729506 ] Colin Patrick McCabe commented on HDFS-8964: +1. Thanks, [~zhz]. > Provide max TxId when

[jira] [Updated] (HDFS-9014) Block placement policy with respect to DN free space

2015-09-03 Thread Max Lapan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Lapan updated HDFS-9014: Status: Open (was: Patch Available) > Block placement policy with respect to DN free space >

[jira] [Created] (HDFS-9018) Update the pom to add junit dependency and move TestXAttr to client project

2015-09-03 Thread kanaka kumar avvaru (JIRA)
kanaka kumar avvaru created HDFS-9018: - Summary: Update the pom to add junit dependency and move TestXAttr to client project Key: HDFS-9018 URL: https://issues.apache.org/jira/browse/HDFS-9018

[jira] [Commented] (HDFS-8966) Separate the lock used in namespace and block management layer

2015-09-03 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14729637#comment-14729637 ] Daryn Sharp commented on HDFS-8966: --- I understand the goal, and fully support it, but it's not a trivial

[jira] [Updated] (HDFS-9002) Move o.a.h.hdfs.net/*Peer classes to client module

2015-09-03 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9002: Attachment: HDFS-9002.003.patch The failing tests have the class not found exception as following:

[jira] [Updated] (HDFS-8964) When validating the edit log, do not read at or beyond the file offset that is being written

2015-09-03 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8964: --- Description: NN/JN validates in-progress edit log files in multiple scenarios, via

[jira] [Commented] (HDFS-9009) Send metrics logs to NullAppender by default

2015-09-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14729524#comment-14729524 ] Hudson commented on HDFS-9009: -- FAILURE: Integrated in Hadoop-trunk-Commit #8398 (See

[jira] [Commented] (HDFS-8998) Small files storage supported inside HDFS

2015-09-03 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14729574#comment-14729574 ] Andrew Wang commented on HDFS-8998: --- Hi Yong, thanks for posting this doc. It's an interesting read. Have

[jira] [Updated] (HDFS-9018) Update the pom to add junit dependency and move TestXAttr to client project

2015-09-03 Thread kanaka kumar avvaru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kanaka kumar avvaru updated HDFS-9018: -- Attachment: HDFS-9018.patch > Update the pom to add junit dependency and move TestXAttr

[jira] [Updated] (HDFS-8981) Adding revision to data node jmx getVersion() method

2015-09-03 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated HDFS-8981: -- Attachment: HDFS-8981.v4.patch > Adding revision to data node jmx getVersion() method >

[jira] [Updated] (HDFS-9009) Send metrics logs to NullAppender by default

2015-09-03 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9009: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Target

[jira] [Updated] (HDFS-8964) When validating the edit log, do not read at or beyond the file offset that is being written

2015-09-03 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8964: --- Summary: When validating the edit log, do not read at or beyond the file offset that

[jira] [Updated] (HDFS-8998) Small files storage supported inside HDFS

2015-09-03 Thread Yong Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yong Zhang updated HDFS-8998: - Attachment: HDFS-8998.design.001.pdf Please review > Small files storage supported inside HDFS >

[jira] [Commented] (HDFS-7639) Remove the limitation imposed by dfs.balancer.moverThreads

2015-09-03 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14729594#comment-14729594 ] Chen He commented on HDFS-7639: --- Assign to [~kanaka], thanks. > Remove the limitation imposed by

[jira] [Updated] (HDFS-7639) Remove the limitation imposed by dfs.balancer.moverThreads

2015-09-03 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated HDFS-7639: -- Assignee: kanaka kumar avvaru (was: Chen He) > Remove the limitation imposed by dfs.balancer.moverThreads >

[jira] [Updated] (HDFS-7278) Add a command that allows sysadmins to manually trigger full block reports from a DN

2015-09-03 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-7278: -- Fix Version/s: 2.6.1 [~sjlee0] backported this to 2.6.1. I just pushed the

[jira] [Updated] (HDFS-8384) Allow NN to startup if there are files having a lease but are not under construction

2015-09-03 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8384: Assignee: Jing Zhao (was: Tsz Wo Nicholas Sze) Target Version/s: 2.8.0 Status:

[jira] [Updated] (HDFS-9011) Support splitting BlockReport of a storage into multiple RPC

2015-09-03 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-9011: Status: Patch Available (was: Open) > Support splitting BlockReport of a storage into multiple RPC >

[jira] [Updated] (HDFS-8964) When validating the edit log, do not read at or beyond the file offset that is being written

2015-09-03 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8964: --- Resolution: Fixed Fix Version/s: 2.8 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-8964) When validating the edit log, do not read at or beyond the file offset that is being written

2015-09-03 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14729567#comment-14729567 ] Zhe Zhang commented on HDFS-8964: - Thanks Colin for reviewing! > When validating the edit log, do not read

[jira] [Updated] (HDFS-7894) Rolling upgrade readiness is not updated in jmx until query command is issued.

2015-09-03 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-7894: -- Fix Version/s: 2.6.1 [~sjlee0] backported this to 2.6.1, the patch applied

[jira] [Updated] (HDFS-8431) hdfs crypto class not found in Windows

2015-09-03 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-8431: -- Labels: 2.6.1-candidate 2.7.2-candidate encryption scripts windows (was:

[jira] [Updated] (HDFS-8984) Move replication queues related methods in FSNamesystem to BlockManager

2015-09-03 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8984: - Attachment: HDFS-8984.004.patch > Move replication queues related methods in FSNamesystem to BlockManager

[jira] [Updated] (HDFS-9012) Move o.a.h.hdfs.protocol.datatransfer.PipelineAck class to hadoop-hdfs-client module

2015-09-03 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9012: Attachment: HDFS-9012.001.patch The v1 patch rebases from {{trunk}} branch so it will trigger

[jira] [Commented] (HDFS-8763) After file closed, a race condition between IBR of 3rd replica of lastBlock and ReplicationMonitor

2015-09-03 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14729430#comment-14729430 ] Daryn Sharp commented on HDFS-8763: --- I don't think the timing is the root cause, if correct, an

[jira] [Commented] (HDFS-8966) Separate the lock used in namespace and block management layer

2015-09-03 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14729433#comment-14729433 ] Daryn Sharp commented on HDFS-8966: --- Would you please elaborate on the design vision for doing the final

[jira] [Created] (HDFS-9017) UI shows wrong last contact for dead nodes

2015-09-03 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-9017: - Summary: UI shows wrong last contact for dead nodes Key: HDFS-9017 URL: https://issues.apache.org/jira/browse/HDFS-9017 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-8698) Add "-direct" flag option for fs copy so that user can choose not to create "._COPYING_" file

2015-09-03 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14729434#comment-14729434 ] Chen He commented on HDFS-8698: --- Hi [~andreina], can you update the patch? > Add "-direct" flag option for

[jira] [Commented] (HDFS-8964) When validating the edit log, do not read at or beyond the file offset that is being written

2015-09-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14729673#comment-14729673 ] Hudson commented on HDFS-8964: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #348 (See

[jira] [Commented] (HDFS-9019) sticky bit permission denied error not informative enough

2015-09-03 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14729700#comment-14729700 ] Thejas M Nair commented on HDFS-9019: - Above exception should include 3 more things for ease of

[jira] [Commented] (HDFS-9009) Send metrics logs to NullAppender by default

2015-09-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14729731#comment-14729731 ] Hudson commented on HDFS-9009: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1079 (See

[jira] [Updated] (HDFS-8404) Pending block replication can get stuck using older genstamp

2015-09-03 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-8404: -- Fix Version/s: 2.6.1 [~sjlee0] backported this to 2.6.1 after fixing minor

[jira] [Updated] (HDFS-9020) Support hflush/hsync in WebHDFS

2015-09-03 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-9020: Attachment: HDFS-9020-alt.txt > Support hflush/hsync in WebHDFS > --- >

[jira] [Commented] (HDFS-9020) Support hflush/hsync in WebHDFS

2015-09-03 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14729751#comment-14729751 ] Chris Douglas commented on HDFS-9020: - Talking with [~jghoman] and [~daryn], the following seems like

[jira] [Updated] (HDFS-7609) Avoid retry cache collision when Standby NameNode loading edits

2015-09-03 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-7609: -- Fix Version/s: 2.6.1 [~sjlee0] backported this to 2.6.1 after fixing non-trivial

[jira] [Commented] (HDFS-9012) Move o.a.h.hdfs.protocol.datatransfer.PipelineAck class to hadoop-hdfs-client module

2015-09-03 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14729813#comment-14729813 ] Haohui Mai commented on HDFS-9012: -- The patch looks good to me. {code} + + /** + * Get the timeout to

[jira] [Commented] (HDFS-8966) Separate the lock used in namespace and block management layer

2015-09-03 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14729826#comment-14729826 ] Jing Zhao commented on HDFS-8966: - Yeah, I agree more design details are necessary. In the meanwhile, I

[jira] [Commented] (HDFS-8967) Create a BlockManagerLock class to represent the lock used in the BlockManager

2015-09-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14729847#comment-14729847 ] Hadoop QA commented on HDFS-8967: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-8984) Move replication queues related methods in FSNamesystem to BlockManager

2015-09-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14729844#comment-14729844 ] Hadoop QA commented on HDFS-8984: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9018) Update the pom to add junit dependency and move TestXAttr to client project

2015-09-03 Thread Kanaka Kumar Avvaru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14729846#comment-14729846 ] Kanaka Kumar Avvaru commented on HDFS-9018: --- {{org.apache.hadoop.fs.XAttr}} is already present in

[jira] [Assigned] (HDFS-9019) sticky bit permission denied error not informative enough

2015-09-03 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao reassigned HDFS-9019: Assignee: Xiaoyu Yao > sticky bit permission denied error not informative enough >

[jira] [Commented] (HDFS-8964) When validating the edit log, do not read at or beyond the file offset that is being written

2015-09-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14729854#comment-14729854 ] Hudson commented on HDFS-8964: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #331 (See

[jira] [Commented] (HDFS-9012) Move o.a.h.hdfs.protocol.datatransfer.PipelineAck class to hadoop-hdfs-client module

2015-09-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14729855#comment-14729855 ] Hadoop QA commented on HDFS-9012: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9011) Support splitting BlockReport of a storage into multiple RPC

2015-09-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14729883#comment-14729883 ] Hadoop QA commented on HDFS-9011: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-8964) When validating the edit log, do not read at or beyond the file offset that is being written

2015-09-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14729882#comment-14729882 ] Hudson commented on HDFS-8964: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #2269 (See

[jira] [Commented] (HDFS-9009) Send metrics logs to NullAppender by default

2015-09-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14729881#comment-14729881 ] Hudson commented on HDFS-9009: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #2269 (See

[jira] [Commented] (HDFS-8964) When validating the edit log, do not read at or beyond the file offset that is being written

2015-09-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14729732#comment-14729732 ] Hudson commented on HDFS-8964: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1079 (See

[jira] [Commented] (HDFS-8939) Test(S)WebHdfsFileContextMainOperations failing on branch-2

2015-09-03 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14729736#comment-14729736 ] Chris Nauroth commented on HDFS-8939: - [~jghoman], thanks for the review and commit. >

[jira] [Updated] (HDFS-9020) Support hflush/hsync in WebHDFS

2015-09-03 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-9020: Attachment: (was: HDFS-9020-alt.txt) > Support hflush/hsync in WebHDFS >

[jira] [Updated] (HDFS-9020) Support hflush/hsync in WebHDFS

2015-09-03 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-9020: Attachment: HDFS-9020-alt.txt > Support hflush/hsync in WebHDFS > --- >

[jira] [Updated] (HDFS-9021) Use a yellow elephant rather than a blue one in diagram

2015-09-03 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-9021: -- Status: Patch Available (was: Open) > Use a yellow elephant rather than a blue one in diagram >

[jira] [Updated] (HDFS-9019) sticky bit permission denied error not informative enough

2015-09-03 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-9019: - Attachment: HDFS-9019.000.patch Thanks [~thejas] for reporting the issue. Attach a patch adding additional

[jira] [Commented] (HDFS-9020) Support hflush/hsync in WebHDFS

2015-09-03 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14729874#comment-14729874 ] Daryn Sharp commented on HDFS-9020: --- In fairness, I didn't advocate for the above. :) I agreed that

[jira] [Updated] (HDFS-8939) Test(S)WebHdfsFileContextMainOperations failing on branch-2

2015-09-03 Thread Jakob Homan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan updated HDFS-8939: -- Resolution: Fixed Assignee: Chris Nauroth (was: Jakob Homan) Hadoop Flags: Reviewed

[jira] [Created] (HDFS-9020) Support hflush/hsync in WebHDFS

2015-09-03 Thread Chris Douglas (JIRA)
Chris Douglas created HDFS-9020: --- Summary: Support hflush/hsync in WebHDFS Key: HDFS-9020 URL: https://issues.apache.org/jira/browse/HDFS-9020 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Commented] (HDFS-8964) When validating the edit log, do not read at or beyond the file offset that is being written

2015-09-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14729791#comment-14729791 ] Hudson commented on HDFS-8964: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2290 (See

[jira] [Commented] (HDFS-9009) Send metrics logs to NullAppender by default

2015-09-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14729790#comment-14729790 ] Hudson commented on HDFS-9009: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2290 (See

[jira] [Commented] (HDFS-9018) Update the pom to add junit dependency and move TestXAttr to client project

2015-09-03 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14729817#comment-14729817 ] Haohui Mai commented on HDFS-9018: -- Maybe it makes more sense to combine this patch with actual code

[jira] [Updated] (HDFS-9021) Use a yellow elephant rather than a blue one in diagram

2015-09-03 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-9021: -- Attachment: HDFS-9021.001.patch Patch attached, just modifying a png. [~cmccabe] mind an easy review? >

[jira] [Updated] (HDFS-9019) sticky bit permission denied error not informative enough

2015-09-03 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-9019: - Status: Patch Available (was: Open) > sticky bit permission denied error not informative enough >

[jira] [Commented] (HDFS-9002) Move o.a.h.hdfs.net/*Peer classes to client module

2015-09-03 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14729880#comment-14729880 ] Haohui Mai commented on HDFS-9002: -- Thanks. It looks good overall. {code} +++

[jira] [Commented] (HDFS-9009) Send metrics logs to NullAppender by default

2015-09-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14729672#comment-14729672 ] Hudson commented on HDFS-9009: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #348 (See

[jira] [Commented] (HDFS-8245) Standby namenode doesn't process DELETED_BLOCK if the add block request is in edit log.

2015-09-03 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14729716#comment-14729716 ] Vinod Kumar Vavilapalli commented on HDFS-8245: --- [~sjlee0] backported this to 2.6.1, after

[jira] [Created] (HDFS-9021) Use a yellow elephant rather than a blue one in diagram

2015-09-03 Thread Andrew Wang (JIRA)
Andrew Wang created HDFS-9021: - Summary: Use a yellow elephant rather than a blue one in diagram Key: HDFS-9021 URL: https://issues.apache.org/jira/browse/HDFS-9021 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-8850) VolumeScanner thread exits with exception if there is no block pool to be scanned but there are suspicious blocks

2015-09-03 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-8850: -- Labels: 2.6.1-candidate (was: ) Adding back 2.6.1-candidate label for tracking.

[jira] [Commented] (HDFS-8981) Adding revision to data node jmx getVersion() method

2015-09-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14729870#comment-14729870 ] Hadoop QA commented on HDFS-8981: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9019) sticky bit permission denied error not informative enough

2015-09-03 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14729695#comment-14729695 ] Thejas M Nair commented on HDFS-9019: - The relavent function - {code} private void

[jira] [Updated] (HDFS-9019) sticky bit permission denied error not informative enough

2015-09-03 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thejas M Nair updated HDFS-9019: Labels: easyfix newbie (was: ) > sticky bit permission denied error not informative enough >

[jira] [Created] (HDFS-9019) sticky bit permission denied error not informative enough

2015-09-03 Thread Thejas M Nair (JIRA)
Thejas M Nair created HDFS-9019: --- Summary: sticky bit permission denied error not informative enough Key: HDFS-9019 URL: https://issues.apache.org/jira/browse/HDFS-9019 Project: Hadoop HDFS

  1   2   3   >