[jira] [Created] (HDFS-7427) [ HTTPS Only ] Fetchimage will not work when we enable cluster with HTTPS only

2014-11-23 Thread Brahma Reddy Battula (JIRA)
Brahma Reddy Battula created HDFS-7427: -- Summary: [ HTTPS Only ] Fetchimage will not work when we enable cluster with HTTPS only Key: HDFS-7427 URL: https://issues.apache.org/jira/browse/HDFS-7427

[jira] [Updated] (HDFS-7427) [ HTTPS Only ] Fetchimage will not work when we enable cluster with HTTPS only

2014-11-23 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-7427: --- Description: Scenario: Start cluster in securemode and enable only HTTPS Run

[jira] [Updated] (HDFS-6735) A minor optimization to avoid pread() be blocked by read() inside the same DFSInputStream

2014-11-23 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Hofhansl updated HDFS-6735: Attachment: HDFS-6735-v4.txt New patch: * added synchronized back to tryZeroCopyRead * renamed

[jira] [Updated] (HDFS-6735) A minor optimization to avoid pread() be blocked by read() inside the same DFSInputStream

2014-11-23 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Hofhansl updated HDFS-6735: Attachment: (was: HDFS-6735-v4.txt) A minor optimization to avoid pread() be blocked by read()

[jira] [Updated] (HDFS-6735) A minor optimization to avoid pread() be blocked by read() inside the same DFSInputStream

2014-11-23 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Hofhansl updated HDFS-6735: Attachment: HDFS-6735-v4.txt A minor optimization to avoid pread() be blocked by read() inside the

[jira] [Commented] (HDFS-6735) A minor optimization to avoid pread() be blocked by read() inside the same DFSInputStream

2014-11-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14222544#comment-14222544 ] Hadoop QA commented on HDFS-6735: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-7312) Update DistCp v1 to optionally not use tmp location

2014-11-23 Thread Joseph Prosser (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph Prosser updated HDFS-7312: - Attachment: HDFS-7312.007.patch Made all recommended changes. Update DistCp v1 to optionally not

[jira] [Created] (HDFS-7428) Include path in the XML output of oiv

2014-11-23 Thread Gautam Gopalakrishnan (JIRA)
Gautam Gopalakrishnan created HDFS-7428: --- Summary: Include path in the XML output of oiv Key: HDFS-7428 URL: https://issues.apache.org/jira/browse/HDFS-7428 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-7428) Include path in the XML output of oiv

2014-11-23 Thread Gautam Gopalakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gautam Gopalakrishnan updated HDFS-7428: Description: When generating the XML output using {noformat}hadoop oiv -p

[jira] [Commented] (HDFS-7419) Improve error messages for DataNode hot swap drive feature

2014-11-23 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14222616#comment-14222616 ] Colin Patrick McCabe commented on HDFS-7419: {code} @@ -559,10 +559,11 @@

[jira] [Created] (HDFS-7429) DomainSocketWatcher.doPoll0 stuck

2014-11-23 Thread zhaoyunjiong (JIRA)
zhaoyunjiong created HDFS-7429: -- Summary: DomainSocketWatcher.doPoll0 stuck Key: HDFS-7429 URL: https://issues.apache.org/jira/browse/HDFS-7429 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-4882) Namenode LeaseManager checkLeases() runs into infinite loop

2014-11-23 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14222629#comment-14222629 ] Colin Patrick McCabe commented on HDFS-4882: Hi [~vinayrpet], This change

[jira] [Updated] (HDFS-7419) Improve error messages for DataNode hot swap drive feature

2014-11-23 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-7419: Attachment: HDFS-7419.003.patch [~cmccabe] Thanks for the reviews! I have updated the patch to

[jira] [Created] (HDFS-7430) Refactor the BlockScanner to use O(1) memory and use multiple threads

2014-11-23 Thread Colin Patrick McCabe (JIRA)
Colin Patrick McCabe created HDFS-7430: -- Summary: Refactor the BlockScanner to use O(1) memory and use multiple threads Key: HDFS-7430 URL: https://issues.apache.org/jira/browse/HDFS-7430

[jira] [Updated] (HDFS-7430) Refactor the BlockScanner to use O(1) memory and use multiple threads

2014-11-23 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7430: --- Attachment: memory.png Here is a screenshot of how much DN heap the BlockScanner uses

[jira] [Updated] (HDFS-7430) Refactor the BlockScanner to use O(1) memory and use multiple threads

2014-11-23 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7430: --- Attachment: HDFS-7430.001.patch * added {{dfs.datanode.scan.period.hours}} to

[jira] [Updated] (HDFS-7430) Refactor the BlockScanner to use O(1) memory and use multiple threads

2014-11-23 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7430: --- Attachment: HDFS-7430.002.patch remove debug message Refactor the BlockScanner to

[jira] [Updated] (HDFS-7430) Refactor the BlockScanner to use O(1) memory and use multiple threads

2014-11-23 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7430: --- Assignee: Colin Patrick McCabe Status: Patch Available (was: Open) Refactor

[jira] [Updated] (HDFS-7430) Refactor the BlockScanner to use O(1) memory and use multiple threads

2014-11-23 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7430: --- Attachment: (was: HDFS-7430.001.patch) Refactor the BlockScanner to use O(1)

[jira] [Commented] (HDFS-7430) Refactor the BlockScanner to use O(1) memory and use multiple threads

2014-11-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14222659#comment-14222659 ] Hadoop QA commented on HDFS-7430: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-6735) A minor optimization to avoid pread() be blocked by read() inside the same DFSInputStream

2014-11-23 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Hofhansl updated HDFS-6735: Attachment: HDFS-6735-v5.txt Looked through the findbugs warning for DFSInputStream: * indeed

[jira] [Commented] (HDFS-6735) A minor optimization to avoid pread() be blocked by read() inside the same DFSInputStream

2014-11-23 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14222673#comment-14222673 ] Lars Hofhansl commented on HDFS-6735: - s/since we never get into that if block if we

[jira] [Updated] (HDFS-7429) DomainSocketWatcher.doPoll0 stuck

2014-11-23 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-7429: --- Attachment: 11241025 11241023 11241021 Upload more stack trace files.

[jira] [Commented] (HDFS-4882) Namenode LeaseManager checkLeases() runs into infinite loop

2014-11-23 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14222680#comment-14222680 ] Vinayakumar B commented on HDFS-4882: - bq. This change makes the code more robust

[jira] [Updated] (HDFS-7403) Inaccurate javadoc of BlockUCState#COMPLETE state

2014-11-23 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7403: - Resolution: Fixed Fix Version/s: 2.7.0 Hadoop Flags: Reviewed Status: Resolved (was: Patch

[jira] [Commented] (HDFS-7342) Lease Recovery doesn't happen some times

2014-11-23 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14222707#comment-14222707 ] Vinayakumar B commented on HDFS-7342: - I got the reason, why [~raviprak] is facing the

[jira] [Created] (HDFS-7431) log message for InvalidMagicNumberException may be incorrect

2014-11-23 Thread Yi Liu (JIRA)
Yi Liu created HDFS-7431: Summary: log message for InvalidMagicNumberException may be incorrect Key: HDFS-7431 URL: https://issues.apache.org/jira/browse/HDFS-7431 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-7431) log message for InvalidMagicNumberException may be incorrect

2014-11-23 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7431: - Target Version/s: (was: 2.7.0) log message for InvalidMagicNumberException may be incorrect

[jira] [Updated] (HDFS-7431) log message for InvalidMagicNumberException may be incorrect

2014-11-23 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7431: - Priority: Minor (was: Major) Target Version/s: 2.7.0 log message for InvalidMagicNumberException may

[jira] [Updated] (HDFS-7431) log message for InvalidMagicNumberException may be incorrect

2014-11-23 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7431: - Description: For security mode, HDFS now supports that Datanodes don't require root or jsvc if

[jira] [Updated] (HDFS-7431) log message for InvalidMagicNumberException may be incorrect

2014-11-23 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7431: - Description: For security mode, HDFS now supports that Datanodes don't require root or jsvc if

[jira] [Commented] (HDFS-7431) log message for InvalidMagicNumberException may be incorrect

2014-11-23 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14222731#comment-14222731 ] Yi Liu commented on HDFS-7431: -- So there are two cases for {{InvalidMagicNumberException}}: *.

[jira] [Comment Edited] (HDFS-7431) log message for InvalidMagicNumberException may be incorrect

2014-11-23 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14222731#comment-14222731 ] Yi Liu edited comment on HDFS-7431 at 11/24/14 7:06 AM: So there

[jira] [Commented] (HDFS-7403) Inaccurate javadoc of BlockUCState#COMPLETE state

2014-11-23 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14222735#comment-14222735 ] Yongjun Zhang commented on HDFS-7403: - Thanks a lot Yi! Inaccurate javadoc of

[jira] [Updated] (HDFS-7427) [ HTTPS Only ] Fetchimage will not work when we enable cluster with HTTPS only

2014-11-23 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-7427: --- Description: Scenario: Start cluster in securemode and enable only HTTPS Run

[jira] [Updated] (HDFS-7427) [ HTTPS Only ] Fetchimage will not work when we enable cluster with HTTPS only

2014-11-23 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-7427: --- Description: Scenario: Start cluster in securemode and enable only HTTPS Run

[jira] [Commented] (HDFS-4882) Namenode LeaseManager checkLeases() runs into infinite loop

2014-11-23 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14222737#comment-14222737 ] Yongjun Zhang commented on HDFS-4882: - Hi [~cmccabe] and [~vinayrpet], Thanks for

[jira] [Updated] (HDFS-7431) log message for InvalidMagicNumberException may be incorrect

2014-11-23 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7431: - Status: Patch Available (was: Open) log message for InvalidMagicNumberException may be incorrect

[jira] [Updated] (HDFS-7431) log message for InvalidMagicNumberException may be incorrect

2014-11-23 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7431: - Attachment: HDFS-7431.001.patch log message for InvalidMagicNumberException may be incorrect

[jira] [Assigned] (HDFS-7392) org.apache.hadoop.hdfs.DistributedFileSystem open invalid URI forever

2014-11-23 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu reassigned HDFS-7392: Assignee: Yi Liu org.apache.hadoop.hdfs.DistributedFileSystem open invalid URI forever

[jira] [Updated] (HDFS-7392) org.apache.hadoop.hdfs.DistributedFileSystem open invalid URI forever

2014-11-23 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7392: - Priority: Major (was: Critical) org.apache.hadoop.hdfs.DistributedFileSystem open invalid URI forever

[jira] [Commented] (HDFS-7419) Improve error messages for DataNode hot swap drive feature

2014-11-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14222753#comment-14222753 ] Hadoop QA commented on HDFS-7419: - {color:red}-1 overall{color}. Here are the results of