[jira] [Commented] (HDFS-5411) Update Bookkeeper dependency to 4.2.1

2014-06-30 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14047418#comment-14047418 ] Rakesh R commented on HDFS-5411: +Note:+ Since BookKeeper has done the necessary changes,

[jira] [Updated] (HDFS-6573) TestDeadDatanode#testDeadDatanode fails if debug flag is turned on for the unit test

2014-06-30 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated HDFS-6573: Fix Version/s: (was: 2.4.1) 2.5.0 TestDeadDatanode#testDeadDatanode fails

[jira] [Commented] (HDFS-6596) Improve InputStream when read spans two blocks

2014-06-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14047472#comment-14047472 ] Hadoop QA commented on HDFS-6596: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-4120) Add a new -skipSharedEditsCheck option for BootstrapStandby

2014-06-30 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-4120: --- Status: Open (was: Patch Available) Add a new -skipSharedEditsCheck option for BootstrapStandby

[jira] [Updated] (HDFS-4120) Add a new -skipSharedEditsCheck option for BootstrapStandby

2014-06-30 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-4120: --- Attachment: HDFS-4120.patch Add a new -skipSharedEditsCheck option for BootstrapStandby

[jira] [Updated] (HDFS-4120) Add a new -skipSharedEditsCheck option for BootstrapStandby

2014-06-30 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-4120: --- Status: Patch Available (was: Open) Add a new -skipSharedEditsCheck option for BootstrapStandby

[jira] [Created] (HDFS-6607) DFSInputStream Seek performance improvement

2014-06-30 Thread Abdullah Alamoudi (JIRA)
Abdullah Alamoudi created HDFS-6607: --- Summary: DFSInputStream Seek performance improvement Key: HDFS-6607 URL: https://issues.apache.org/jira/browse/HDFS-6607 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-6455) NFS: Exception should be added in NFS log for invalid separator in allowed.hosts

2014-06-30 Thread Abhiraj Butala (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14047486#comment-14047486 ] Abhiraj Butala commented on HDFS-6455: -- Hey Brandon, I compared this with the NN's

[jira] [Updated] (HDFS-6596) Improve InputStream when read spans two blocks

2014-06-30 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zesheng Wu updated HDFS-6596: - Attachment: HDFS-6596.3.patch Fixed javadoc warnings. Improve InputStream when read spans two blocks

[jira] [Updated] (HDFS-5411) Update Bookkeeper dependency to 4.2.3

2014-06-30 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-5411: --- Description: Update the bookkeeper dependency to 4.2.3. This eases compilation on Fedora platforms (was:

[jira] [Updated] (HDFS-5411) Update Bookkeeper dependency to 4.2.3

2014-06-30 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-5411: --- Summary: Update Bookkeeper dependency to 4.2.3 (was: Update Bookkeeper dependency to 4.2.1) Update

[jira] [Created] (HDFS-6608) FsDatasetCache: hard-coded 4096 value in test is not appropriate for all HW

2014-06-30 Thread Tony Reix (JIRA)
Tony Reix created HDFS-6608: --- Summary: FsDatasetCache: hard-coded 4096 value in test is not appropriate for all HW Key: HDFS-6608 URL: https://issues.apache.org/jira/browse/HDFS-6608 Project: Hadoop HDFS

[jira] [Commented] (HDFS-6608) FsDatasetCache: hard-coded 4096 value in test is not appropriate for all HW

2014-06-30 Thread Tony Reix (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14047504#comment-14047504 ] Tony Reix commented on HDFS-6608: - See defect

[jira] [Commented] (HDFS-4265) BKJM doesn't take advantage of speculative reads

2014-06-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14047522#comment-14047522 ] Hadoop QA commented on HDFS-4265: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-4221) Remove the format limitation point from BKJM documentation as HDFS-3810 closed

2014-06-30 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-4221: --- Attachment: HDFS-4221.patch Remove the format limitation point from BKJM documentation as HDFS-3810 closed

[jira] [Commented] (HDFS-6608) FsDatasetCache: hard-coded 4096 value in test is not appropriate for all HW

2014-06-30 Thread Tony Reix (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14047527#comment-14047527 ] Tony Reix commented on HDFS-6608: - Looking at non-test HDFS code, there are several places

[jira] [Updated] (HDFS-4221) Remove the format limitation point from BKJM documentation as HDFS-3810 closed

2014-06-30 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-4221: --- Assignee: Rakesh R (was: Uma Maheswara Rao G) Target Version/s: 2.0.3-alpha, 3.0.0 (was: 3.0.0,

[jira] [Commented] (HDFS-4221) Remove the format limitation point from BKJM documentation as HDFS-3810 closed

2014-06-30 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14047529#comment-14047529 ] Rakesh R commented on HDFS-4221: [~umamaheswararao] Attached latest patch, I've removed the

[jira] [Updated] (HDFS-6591) while loop is executed tens of thousands of times in Hedged Read

2014-06-30 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6591: Attachment: HDFS-6591-v4.txt while loop is executed tens of thousands of times in Hedged Read

[jira] [Updated] (HDFS-6607) DFSInputStream Seek performance improvement

2014-06-30 Thread Abdullah Alamoudi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abdullah Alamoudi updated HDFS-6607: Priority: Major (was: Minor) DFSInputStream Seek performance improvement

[jira] [Commented] (HDFS-6591) while loop is executed tens of thousands of times in Hedged Read

2014-06-30 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14047549#comment-14047549 ] Liang Xie commented on HDFS-6591: - Attached v4 should address [~andrew.purt...@gmail.com]'s

[jira] [Updated] (HDFS-6591) while loop is executed tens of thousands of times in Hedged Read

2014-06-30 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6591: Attachment: HDFS-6591-v4.txt while loop is executed tens of thousands of times in Hedged Read

[jira] [Updated] (HDFS-6591) while loop is executed tens of thousands of times in Hedged Read

2014-06-30 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6591: Attachment: (was: HDFS-6591-v4.txt) while loop is executed tens of thousands of times in Hedged Read

[jira] [Updated] (HDFS-6607) DFSInputStream Seek performance improvement

2014-06-30 Thread Abdullah Alamoudi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abdullah Alamoudi updated HDFS-6607: Description: When having a DFSInputStream open and seeking to a position that resides in

[jira] [Commented] (HDFS-6591) while loop is executed tens of thousands of times in Hedged Read

2014-06-30 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14047552#comment-14047552 ] Liang Xie commented on HDFS-6591: - To me, it should not a showstopper for current jira so

[jira] [Commented] (HDFS-6607) DFSInputStream Seek performance improvement

2014-06-30 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14047564#comment-14047564 ] Steve Loughran commented on HDFS-6607: -- Some of the object store streams (e.g. for

[jira] [Commented] (HDFS-6418) Regression: DFS_NAMENODE_USER_NAME_KEY missing in trunk

2014-06-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14047562#comment-14047562 ] Hudson commented on HDFS-6418: -- FAILURE: Integrated in Hadoop-Yarn-trunk #599 (See

[jira] [Updated] (HDFS-6607) Improve DFSInputStream forward seek performance by discarding bytes

2014-06-30 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HDFS-6607: - Summary: Improve DFSInputStream forward seek performance by discarding bytes (was:

[jira] [Updated] (HDFS-6607) Improve DFSInputStream forward seek performance

2014-06-30 Thread Abdullah Alamoudi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abdullah Alamoudi updated HDFS-6607: Summary: Improve DFSInputStream forward seek performance (was: Improve DFSInputStream

[jira] [Commented] (HDFS-4120) Add a new -skipSharedEditsCheck option for BootstrapStandby

2014-06-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14047577#comment-14047577 ] Hadoop QA commented on HDFS-4120: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-4120) Add a new -skipSharedEditsCheck option for BootstrapStandby

2014-06-30 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14047608#comment-14047608 ] Vinayakumar B commented on HDFS-4120: - Hi rakesh, Thanks for adding a test. Following

[jira] [Updated] (HDFS-4286) Changes from BOOKKEEPER-203 broken capability of including bookkeeper-server jar in hidden package of BKJM

2014-06-30 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-4286: --- Attachment: HDFS-4286.patch Changes from BOOKKEEPER-203 broken capability of including bookkeeper-server

[jira] [Updated] (HDFS-4286) Changes from BOOKKEEPER-203 broken capability of including bookkeeper-server jar in hidden package of BKJM

2014-06-30 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-4286: --- Status: Patch Available (was: Open) Changes from BOOKKEEPER-203 broken capability of including

[jira] [Commented] (HDFS-4286) Changes from BOOKKEEPER-203 broken capability of including bookkeeper-server jar in hidden package of BKJM

2014-06-30 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14047616#comment-14047616 ] Rakesh R commented on HDFS-4286: Hi, Removed the shading option and now users has to

[jira] [Commented] (HDFS-6596) Improve InputStream when read spans two blocks

2014-06-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14047617#comment-14047617 ] Hadoop QA commented on HDFS-6596: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-6596) Improve InputStream when read spans two blocks

2014-06-30 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zesheng Wu updated HDFS-6596: - Attachment: HDFS-6596.3.patch Improve InputStream when read spans two blocks

[jira] [Updated] (HDFS-6597) Add a new option to NN upgrade to terminate the process after upgrade on NN is completed

2014-06-30 Thread Danilo Vunjak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danilo Vunjak updated HDFS-6597: Attachment: JIRA-HDFS-6597.patch Add a new option to NN upgrade to terminate the process after

[jira] [Commented] (HDFS-6597) Add a new option to NN upgrade to terminate the process after upgrade on NN is completed

2014-06-30 Thread Danilo Vunjak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14047623#comment-14047623 ] Danilo Vunjak commented on HDFS-6597: - Hi, I've attached patch proposal. Please take a

[jira] [Commented] (HDFS-4221) Remove the format limitation point from BKJM documentation as HDFS-3810 closed

2014-06-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14047639#comment-14047639 ] Hadoop QA commented on HDFS-4221: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6418) Regression: DFS_NAMENODE_USER_NAME_KEY missing in trunk

2014-06-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14047664#comment-14047664 ] Hudson commented on HDFS-6418: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1817 (See

[jira] [Commented] (HDFS-6418) Regression: DFS_NAMENODE_USER_NAME_KEY missing in trunk

2014-06-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14047685#comment-14047685 ] Hudson commented on HDFS-6418: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1790 (See

[jira] [Commented] (HDFS-6591) while loop is executed tens of thousands of times in Hedged Read

2014-06-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14047682#comment-14047682 ] Hadoop QA commented on HDFS-6591: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-4286) Changes from BOOKKEEPER-203 broken capability of including bookkeeper-server jar in hidden package of BKJM

2014-06-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14047753#comment-14047753 ] Hadoop QA commented on HDFS-4286: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6596) Improve InputStream when read spans two blocks

2014-06-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14047779#comment-14047779 ] Hadoop QA commented on HDFS-6596: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6527) Edit log corruption due to defered INode removal

2014-06-30 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14047893#comment-14047893 ] Jing Zhao commented on HDFS-6527: - Copied from release vote mailing thread: {code} That's

[jira] [Commented] (HDFS-6527) Edit log corruption due to defered INode removal

2014-06-30 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14047895#comment-14047895 ] Aaron T. Myers commented on HDFS-6527: -- I'd say we should still probably do it, but

[jira] [Commented] (HDFS-6527) Edit log corruption due to defered INode removal

2014-06-30 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14047907#comment-14047907 ] Jing Zhao commented on HDFS-6527: - Thanks for the quick reply, [~atm]. I will merge it to

[jira] [Commented] (HDFS-6558) Missing '\n' in the description of dfsadmin -rollingUpgrade

2014-06-30 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14047929#comment-14047929 ] Kihwal Lee commented on HDFS-6558: -- +1 lgtm Missing '\n' in the description of dfsadmin

[jira] [Commented] (HDFS-6558) Missing '\n' in the description of dfsadmin -rollingUpgrade

2014-06-30 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14047932#comment-14047932 ] Kihwal Lee commented on HDFS-6558: -- I've committed this to trunk and branch-2. Thanks for

[jira] [Updated] (HDFS-6558) Missing '\n' in the description of dfsadmin -rollingUpgrade

2014-06-30 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-6558: - Resolution: Fixed Fix Version/s: 2.5.0 3.0.0 Hadoop Flags: Reviewed

[jira] [Created] (HDFS-6609) Use DirectorySnapshottableFeature to represent a snapshottable directory

2014-06-30 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-6609: --- Summary: Use DirectorySnapshottableFeature to represent a snapshottable directory Key: HDFS-6609 URL: https://issues.apache.org/jira/browse/HDFS-6609 Project: Hadoop HDFS

[jira] [Updated] (HDFS-6415) Missing null check in FSImageSerialization#writePermissionStatus()

2014-06-30 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-6415: - Resolution: Won't Fix Status: Resolved (was: Patch Available) Missing null check in

[jira] [Commented] (HDFS-6558) Missing '\n' in the description of dfsadmin -rollingUpgrade

2014-06-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14047941#comment-14047941 ] Hudson commented on HDFS-6558: -- SUCCESS: Integrated in Hadoop-trunk-Commit #5801 (See

[jira] [Commented] (HDFS-6415) Missing null check in FSImageSerialization#writePermissionStatus()

2014-06-30 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14047944#comment-14047944 ] Kihwal Lee commented on HDFS-6415: -- I don't think we want to do anything special here. If

[jira] [Updated] (HDFS-6591) while loop is executed tens of thousands of times in Hedged Read

2014-06-30 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-6591: Hadoop Flags: Reviewed +1 for the patch. Thank you for making the change on the test counter. The

[jira] [Updated] (HDFS-6604) Disk space leak with shortcircuit

2014-06-30 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-6604: --- Attachment: HDFS-6604.002.patch Thanks, Chris. There is an existing unit test for

[jira] [Updated] (HDFS-6604) The short-circuit cache doesn't correctly time out replicas that haven't been used in a while

2014-06-30 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-6604: --- Summary: The short-circuit cache doesn't correctly time out replicas that haven't

[jira] [Updated] (HDFS-6591) while loop is executed tens of thousands of times in Hedged Read

2014-06-30 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-6591: Resolution: Fixed Fix Version/s: 2.5.0 3.0.0 Status: Resolved

[jira] [Commented] (HDFS-6591) while loop is executed tens of thousands of times in Hedged Read

2014-06-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14048157#comment-14048157 ] Hudson commented on HDFS-6591: -- SUCCESS: Integrated in Hadoop-trunk-Commit #5802 (See

[jira] [Commented] (HDFS-6606) Optimize encryption support in DataTransfer Protocol with High performance

2014-06-30 Thread Mike Yoder (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14048162#comment-14048162 ] Mike Yoder commented on HDFS-6606: -- Agreed this is a great thing to have - the existing

[jira] [Updated] (HDFS-6604) The short-circuit cache doesn't correctly time out replicas that haven't been used in a while

2014-06-30 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-6604: Status: Patch Available (was: In Progress) The short-circuit cache doesn't correctly time out

[jira] [Updated] (HDFS-6604) The short-circuit cache doesn't correctly time out replicas that haven't been used in a while

2014-06-30 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-6604: Assignee: Colin Patrick McCabe (was: Chris Nauroth) The short-circuit cache doesn't correctly

[jira] [Assigned] (HDFS-6604) The short-circuit cache doesn't correctly time out replicas that haven't been used in a while

2014-06-30 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth reassigned HDFS-6604: --- Assignee: Chris Nauroth (was: Colin Patrick McCabe) The short-circuit cache doesn't

[jira] [Updated] (HDFS-6604) The short-circuit cache doesn't correctly time out replicas that haven't been used in a while

2014-06-30 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-6604: Hadoop Flags: Reviewed +1 for the patch, pending Jenkins run. I just clicked Submit Patch. Thank

[jira] [Commented] (HDFS-6604) The short-circuit cache doesn't correctly time out replicas that haven't been used in a while

2014-06-30 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14048186#comment-14048186 ] stack commented on HDFS-6604: - lgtm The short-circuit cache doesn't correctly time out

[jira] [Created] (HDFS-6610) TestShortCircuitLocalRead tests sometimes timeout on slow machines

2014-06-30 Thread Charles Lamb (JIRA)
Charles Lamb created HDFS-6610: -- Summary: TestShortCircuitLocalRead tests sometimes timeout on slow machines Key: HDFS-6610 URL: https://issues.apache.org/jira/browse/HDFS-6610 Project: Hadoop HDFS

[jira] [Updated] (HDFS-6609) Use DirectorySnapshottableFeature to represent a snapshottable directory

2014-06-30 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6609: Attachment: HDFS-6609.000.patch Initial patch. The patch adds a new DirectorySnapshottableFeature which

[jira] [Updated] (HDFS-6609) Use DirectorySnapshottableFeature to represent a snapshottable directory

2014-06-30 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6609: Status: Patch Available (was: Open) Use DirectorySnapshottableFeature to represent a snapshottable

[jira] [Work started] (HDFS-6610) TestShortCircuitLocalRead tests sometimes timeout on slow machines

2014-06-30 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-6610 started by Charles Lamb. TestShortCircuitLocalRead tests sometimes timeout on slow machines

[jira] [Updated] (HDFS-6610) TestShortCircuitLocalRead tests sometimes timeout on slow machines

2014-06-30 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-6610: --- Attachment: HDFS-6610.001.patch The attached patch bumps the timeouts to 1min for any test that

[jira] [Updated] (HDFS-6610) TestShortCircuitLocalRead tests sometimes timeout on slow machines

2014-06-30 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-6610: --- Status: Patch Available (was: In Progress) TestShortCircuitLocalRead tests sometimes timeout on

[jira] [Commented] (HDFS-6527) Edit log corruption due to defered INode removal

2014-06-30 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14048258#comment-14048258 ] Jing Zhao commented on HDFS-6527: - Actually the patch has already been merged into 2.4. I

[jira] [Commented] (HDFS-6606) Optimize encryption support in DataTransfer Protocol with High performance

2014-06-30 Thread Andrew Purtell (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14048266#comment-14048266 ] Andrew Purtell commented on HDFS-6606: -- bq. For now I have a question, any reason not

Re: HDFS command giving error

2014-06-30 Thread Akira AJISAKA
'hadoop hdfs dfs -ls' is not correct. You should use 'hdfs dfs -ls path' to access HDFS. For more details, see http://hadoop.apache.org/docs/r2.0.6-alpha/hadoop-project-dist/hadoop-common/FileSystemShell.html FYI: It's preferred to use u...@hadoop.apache.org if you have a question.

[jira] [Created] (HDFS-6611) secure components have the wrong pid files

2014-06-30 Thread Allen Wittenauer (JIRA)
Allen Wittenauer created HDFS-6611: -- Summary: secure components have the wrong pid files Key: HDFS-6611 URL: https://issues.apache.org/jira/browse/HDFS-6611 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-6611) secure components have the wrong pid in their files

2014-06-30 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-6611: --- Summary: secure components have the wrong pid in their files (was: secure components have

[jira] [Created] (HDFS-6612) MiniDFSNNTopology#simpleFederatedTopology(int) always hardcode nameservice ID

2014-06-30 Thread Juan Yu (JIRA)
Juan Yu created HDFS-6612: - Summary: MiniDFSNNTopology#simpleFederatedTopology(int) always hardcode nameservice ID Key: HDFS-6612 URL: https://issues.apache.org/jira/browse/HDFS-6612 Project: Hadoop HDFS

[jira] [Commented] (HDFS-6611) secure components have the wrong pid in their files

2014-06-30 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14048294#comment-14048294 ] Allen Wittenauer commented on HDFS-6611: Because of the way we launch with jsvc, I

[jira] [Resolved] (HDFS-6612) MiniDFSNNTopology#simpleFederatedTopology(int) always hardcode nameservice ID

2014-06-30 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Yu resolved HDFS-6612. --- Resolution: Duplicate MiniDFSNNTopology#simpleFederatedTopology(int) always hardcode nameservice ID

[jira] [Reopened] (HDFS-6612) MiniDFSNNTopology#simpleFederatedTopology(int) always hardcode nameservice ID

2014-06-30 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Yu reopened HDFS-6612: --- There are a couple of unit tests who specify nameservice in config still use {{simpleFederatedTopology(int

[jira] [Work started] (HDFS-6612) MiniDFSNNTopology#simpleFederatedTopology(int) always hardcode nameservice ID

2014-06-30 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-6612 started by Juan Yu. MiniDFSNNTopology#simpleFederatedTopology(int) always hardcode nameservice ID

[jira] [Updated] (HDFS-6612) MiniDFSNNTopology#simpleFederatedTopology(int) always hardcode nameservice ID

2014-06-30 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Yu updated HDFS-6612: -- Attachment: HDFS-6612.001.patch MiniDFSNNTopology#simpleFederatedTopology(int) always hardcode nameservice ID

[jira] [Updated] (HDFS-6612) MiniDFSNNTopology#simpleFederatedTopology(int) always hardcode nameservice ID

2014-06-30 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Yu updated HDFS-6612: -- Status: Patch Available (was: In Progress) MiniDFSNNTopology#simpleFederatedTopology(int) always hardcode

[jira] [Commented] (HDFS-6604) The short-circuit cache doesn't correctly time out replicas that haven't been used in a while

2014-06-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14048336#comment-14048336 ] Hadoop QA commented on HDFS-6604: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-6603) Add XAttr with ACL test

2014-06-30 Thread Stephen Chu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen Chu updated HDFS-6603: -- Status: Patch Available (was: Open) Add XAttr with ACL test ---

[jira] [Updated] (HDFS-6603) Add XAttr with ACL test

2014-06-30 Thread Stephen Chu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen Chu updated HDFS-6603: -- Attachment: HDFS-6603.001.patch This patch adds a test to verify that XAttr operations adhere to ACLs.

[jira] [Commented] (HDFS-6378) NFS: when portmap/rpcbind is not available, NFS registration should timeout instead of hanging

2014-06-30 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14048360#comment-14048360 ] Brandon Li commented on HDFS-6378: -- [~abutala], thanks for the fix. 500ms looks ok to me

[jira] [Commented] (HDFS-6455) NFS: Exception should be added in NFS log for invalid separator in allowed.hosts

2014-06-30 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14048363#comment-14048363 ] Brandon Li commented on HDFS-6455: -- {quote}Should we similarly add a log message here

[jira] [Created] (HDFS-6613) Improve logging in caching classes

2014-06-30 Thread Andrew Wang (JIRA)
Andrew Wang created HDFS-6613: - Summary: Improve logging in caching classes Key: HDFS-6613 URL: https://issues.apache.org/jira/browse/HDFS-6613 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Updated] (HDFS-6613) Improve logging in caching classes

2014-06-30 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6613: -- Attachment: HDFS-6613.001.patch Patch attached, almost purely logging changes. Improve logging in

[jira] [Updated] (HDFS-6378) NFS: when portmap/rpcbind is not available, NFS registration should timeout instead of hanging

2014-06-30 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-6378: - Assignee: Abhiraj Butala NFS: when portmap/rpcbind is not available, NFS registration should timeout

[jira] [Work started] (HDFS-6613) Improve logging in caching classes

2014-06-30 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-6613 started by Andrew Wang. Improve logging in caching classes -- Key: HDFS-6613 URL:

[jira] [Commented] (HDFS-6612) MiniDFSNNTopology#simpleFederatedTopology(int) always hardcode nameservice ID

2014-06-30 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14048372#comment-14048372 ] Andrew Wang commented on HDFS-6612: --- +1 pending jenkins

[jira] [Commented] (HDFS-6134) Transparent data at rest encryption

2014-06-30 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14048380#comment-14048380 ] Tsz Wo Nicholas Sze commented on HDFS-6134: --- ..., at rest. Someone who has root

[jira] [Commented] (HDFS-6610) TestShortCircuitLocalRead tests sometimes timeout on slow machines

2014-06-30 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14048382#comment-14048382 ] Andrew Wang commented on HDFS-6610: --- +1 pending Jenkins TestShortCircuitLocalRead tests

[jira] [Commented] (HDFS-6134) Transparent data at rest encryption

2014-06-30 Thread Andrew Purtell (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14048386#comment-14048386 ] Andrew Purtell commented on HDFS-6134: -- bq. Ideally, the malicious admin should ONLY

[jira] [Resolved] (HDFS-1379) Multihoming brokenness in HDFS

2014-06-30 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-1379. --- Resolution: Not a Problem I believe this is not a problem anymore after other JIRAs

[jira] [Commented] (HDFS-6612) MiniDFSNNTopology#simpleFederatedTopology(int) always hardcode nameservice ID

2014-06-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14048460#comment-14048460 ] Hadoop QA commented on HDFS-6612: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6603) Add XAttr with ACL test

2014-06-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14048466#comment-14048466 ] Hadoop QA commented on HDFS-6603: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6603) Add XAttr with ACL test

2014-06-30 Thread Stephen Chu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14048472#comment-14048472 ] Stephen Chu commented on HDFS-6603: --- The test failure (TestBPOfferService) above is

  1   2   >