[jira] [Created] (HDFS-9705) Refine the behaviour of getFileChecksum when length = 0

2016-01-26 Thread Kai Zheng (JIRA)
Kai Zheng created HDFS-9705: --- Summary: Refine the behaviour of getFileChecksum when length = 0 Key: HDFS-9705 URL: https://issues.apache.org/jira/browse/HDFS-9705 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-9701) DN may deadlock when hot-swapping under load

2016-01-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15116999#comment-15116999 ] Hadoop QA commented on HDFS-9701: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9705) Refine the behaviour of getFileChecksum when length = 0

2016-01-26 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-9705: Attachment: (was: HDFS-9705-v1.patch) > Refine the behaviour of getFileChecksum when length = 0 >

[jira] [Updated] (HDFS-9705) Refine the behaviour of getFileChecksum when length = 0

2016-01-26 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-9705: Attachment: HDFS-9705-v1.patch > Refine the behaviour of getFileChecksum when length = 0 >

[jira] [Updated] (HDFS-9705) Refine the behaviour of getFileChecksum when length = 0

2016-01-26 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-9705: Status: Patch Available (was: Open) > Refine the behaviour of getFileChecksum when length = 0 >

[jira] [Updated] (HDFS-9705) Refine the behaviour of getFileChecksum when length = 0

2016-01-26 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-9705: Attachment: HDFS-9705-v2.patch Change safer and add comment for a confusing place. > Refine the behaviour

[jira] [Commented] (HDFS-9694) Make existing DFSClient#getFileChecksum() work for striped blocks

2016-01-26 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15117103#comment-15117103 ] Kai Zheng commented on HDFS-9694: - Oops, the result patch seems too large. Will do the not-so-relevant

[jira] [Commented] (HDFS-9705) Refine the behaviour of getFileChecksum when length = 0

2016-01-26 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118764#comment-15118764 ] Tsz Wo Nicholas Sze commented on HDFS-9705: --- Thanks Kai for working on this. Some comment on the

[jira] [Commented] (HDFS-9239) DataNode Lifeline Protocol: an alternative protocol for reporting DataNode liveness

2016-01-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118590#comment-15118590 ] Hadoop QA commented on HDFS-9239: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9677) Rename generationStampV1/generationStampV2 to legacyGenerationStamp/generationStamp

2016-01-26 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118752#comment-15118752 ] Vinayakumar B commented on HDFS-9677: - I feel current change is fine. {{legacyGenerationStamp}} looks

[jira] [Commented] (HDFS-9654) Code refactoring for HDFS-8578

2016-01-26 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118792#comment-15118792 ] Tsz Wo Nicholas Sze commented on HDFS-9654: --- > 2. Nit: Maybe make doUgrade method name a little

[jira] [Commented] (HDFS-9668) Many long-time BLOCKED threads on FsDatasetImpl in a tiered storage test

2016-01-26 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118758#comment-15118758 ] Vinayakumar B commented on HDFS-9668: - bq. I am +1 on the concept of fixing the locking Yes, this

[jira] [Commented] (HDFS-9701) DN may deadlock when hot-swapping under load

2016-01-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118585#comment-15118585 ] Hadoop QA commented on HDFS-9701: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9677) Rename generationStampV1/generationStampV2 to legacyGenerationStamp/generationStamp

2016-01-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118811#comment-15118811 ] Mingliang Liu commented on HDFS-9677: - This makes perfect sense to me. Thanks for your comment and

[jira] [Commented] (HDFS-9704) terminate progress after namenode recover finished

2016-01-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118725#comment-15118725 ] Hadoop QA commented on HDFS-9704: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9705) Refine the behaviour of getFileChecksum when length = 0

2016-01-26 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118810#comment-15118810 ] Tsz Wo Nicholas Sze commented on HDFS-9705: --- FileChecksum#EMPTY is attractive, however, it is

[jira] [Commented] (HDFS-9705) Refine the behaviour of getFileChecksum when length = 0

2016-01-26 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118783#comment-15118783 ] Kai Zheng commented on HDFS-9705: - Thanks Nicholas for the comment! bq. Let's check if length == 0 in the

[jira] [Commented] (HDFS-9654) Code refactoring for HDFS-8578

2016-01-26 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118795#comment-15118795 ] Tsz Wo Nicholas Sze commented on HDFS-9654: --- Thanks [~ctrezzo] for reviewing the patch! > Code

[jira] [Commented] (HDFS-9503) Replace -namenode option with -fs for NNThroughputBenchmark

2016-01-26 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118820#comment-15118820 ] Vinayakumar B commented on HDFS-9503: - bq. If not specified, the default file system URI will be

[jira] [Commented] (HDFS-9705) Refine the behaviour of getFileChecksum when length = 0

2016-01-26 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118821#comment-15118821 ] Kai Zheng commented on HDFS-9705: - Got it. I'll use the preferred option. Thanks! > Refine the behaviour

[jira] [Commented] (HDFS-9349) Support reconfiguring fs.protected.directories without NN restart

2016-01-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118647#comment-15118647 ] Hadoop QA commented on HDFS-9349: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9654) Code refactoring for HDFS-8578

2016-01-26 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118784#comment-15118784 ] Tsz Wo Nicholas Sze commented on HDFS-9654: --- > 1. Nit: Params in javadoc do not match the params

[jira] [Commented] (HDFS-9503) Replace -namenode option with -fs for NNThroughputBenchmark

2016-01-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15116918#comment-15116918 ] Hadoop QA commented on HDFS-9503: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9684) DataNode stopped sending heartbeat after getting OutOfMemoryError form DataTransfer thread.

2016-01-26 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15116906#comment-15116906 ] Surendra Singh Lilhore commented on HDFS-9684: -- Thanks [~kihwal] for comments. Yes, ulimit is

[jira] [Commented] (HDFS-9705) Refine the behaviour of getFileChecksum when length = 0

2016-01-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15117309#comment-15117309 ] Hadoop QA commented on HDFS-9705: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9705) Refine the behaviour of getFileChecksum when length = 0

2016-01-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15117357#comment-15117357 ] Hadoop QA commented on HDFS-9705: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9525) hadoop utilities need to support provided delegation tokens

2016-01-26 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15117373#comment-15117373 ] Daryn Sharp commented on HDFS-9525: --- Allowing webhdfs to search for tokens with security off is a fine

[jira] [Commented] (HDFS-9684) DataNode stopped sending heartbeat after getting OutOfMemoryError form DataTransfer thread.

2016-01-26 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15117387#comment-15117387 ] Kihwal Lee commented on HDFS-9684: -- If we are to make datanode recoverable from such conditions, we need

[jira] [Updated] (HDFS-9690) ClientProtocol.addBlock is not idempotent after HDFS-8071

2016-01-26 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-9690: Summary: ClientProtocol.addBlock is not idempotent after HDFS-8071 (was: addBlock is not

[jira] [Commented] (HDFS-9690) ClientProtocol.addBlock is not idempotent after HDFS-8071

2016-01-26 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15117469#comment-15117469 ] Vinayakumar B commented on HDFS-9690: - +1 for the patch for branch-2.7 Committed to branch-2.7 >

[jira] [Updated] (HDFS-9690) ClientProtocol.addBlock is not idempotent after HDFS-8071

2016-01-26 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-9690: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.7.3 Status: Resolved

[jira] [Commented] (HDFS-7694) FSDataInputStream should support "unbuffer"

2016-01-26 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15117491#comment-15117491 ] Junping Du commented on HDFS-7694: -- Thanks [~cmccabe] for confirmation. I will cherry-pick this patch to

[jira] [Updated] (HDFS-9701) DN may deadlock when hot-swapping under load

2016-01-26 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9701: Attachment: HDFS-9701.03.patch > DN may deadlock when hot-swapping under load >

[jira] [Commented] (HDFS-9701) DN may deadlock when hot-swapping under load

2016-01-26 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15117686#comment-15117686 ] Xiao Chen commented on HDFS-9701: - The findbugs warning helped me thinking of a cleaner way to fix this.

[jira] [Created] (HDFS-9706) Log more details in debug logs in BlockReceiver's constructor

2016-01-26 Thread Xiao Chen (JIRA)
Xiao Chen created HDFS-9706: --- Summary: Log more details in debug logs in BlockReceiver's constructor Key: HDFS-9706 URL: https://issues.apache.org/jira/browse/HDFS-9706 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-9706) Log more details in debug logs in BlockReceiver's constructor

2016-01-26 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9706: Labels: supportability (was: ) > Log more details in debug logs in BlockReceiver's constructor >

[jira] [Updated] (HDFS-9706) Log more details in debug logs in BlockReceiver's constructor

2016-01-26 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9706: Attachment: HDFS-9706.01.patch Patch 1 adds isTransfer, and some other infos I think might be useful. >

[jira] [Updated] (HDFS-9706) Log more details in debug logs in BlockReceiver's constructor

2016-01-26 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9706: Status: Patch Available (was: Open) > Log more details in debug logs in BlockReceiver's constructor >

[jira] [Updated] (HDFS-9666) Enable hdfs-client to read even remote SSD/RAM prior to local disk replica to improve random read

2016-01-26 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-9666: -- Fix Version/s: (was: 2.7.2) [~aderen], please use Target Version for your

[jira] [Updated] (HDFS-815) FileContext tests fail on Windows

2016-01-26 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-815: - Fix Version/s: (was: 2.7.2) > FileContext tests fail on Windows >

[jira] [Commented] (HDFS-9629) Update the footer of Web UI to show year 2016

2016-01-26 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15117734#comment-15117734 ] Xiao Chen commented on HDFS-9629: - Thanks [~yzhangal] for the input. My intention of this JIRA was just to

[jira] [Commented] (HDFS-9525) hadoop utilities need to support provided delegation tokens

2016-01-26 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15117737#comment-15117737 ] Allen Wittenauer commented on HDFS-9525: bq. it will cause webhdfs to look for a token even if

[jira] [Commented] (HDFS-7764) DirectoryScanner shouldn't abort the scan if one directory had an error

2016-01-26 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15117766#comment-15117766 ] Rakesh R commented on HDFS-7764: Hi [~cmccabe], Could you share your opinion about the latest patch when

[jira] [Updated] (HDFS-9541) Add hdfsStreamBuilder API to libhdfs to support defaultBlockSizes greater than 2 GB

2016-01-26 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9541: --- Status: Patch Available (was: In Progress) > Add hdfsStreamBuilder API to libhdfs to

[jira] [Commented] (HDFS-9629) Update the footer of Web UI to show year 2016

2016-01-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15117782#comment-15117782 ] Yongjun Zhang commented on HDFS-9629: - Thanks Xiao, agree. > Update the footer of Web UI to show year

[jira] [Commented] (HDFS-9541) Add hdfsStreamBuilder API to libhdfs to support defaultBlockSizes greater than 2 GB

2016-01-26 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15117787#comment-15117787 ] Zhe Zhang commented on HDFS-9541: - Thanks Colin for the update. +1 on the v02 patch. > Add

[jira] [Updated] (HDFS-8676) Delayed rolling upgrade finalization can cause heartbeat expiration and write failures

2016-01-26 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-8676: -- Fix Version/s: (was: 3.0.0) > Delayed rolling upgrade finalization can cause

[jira] [Updated] (HDFS-8950) NameNode refresh doesn't remove DataNodes that are no longer in the allowed list

2016-01-26 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-8950: -- Fix Version/s: (was: 3.0.0) > NameNode refresh doesn't remove DataNodes that

[jira] [Updated] (HDFS-9220) Reading small file (< 512 bytes) that is open for append fails due to incorrect checksum

2016-01-26 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-9220: -- Fix Version/s: (was: 3.0.0) > Reading small file (< 512 bytes) that is open

[jira] [Updated] (HDFS-8850) VolumeScanner thread exits with exception if there is no block pool to be scanned but there are suspicious blocks

2016-01-26 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-8850: -- Fix Version/s: (was: 3.0.0) > VolumeScanner thread exits with exception if

[jira] [Updated] (HDFS-8879) Quota by storage type usage incorrectly initialized upon namenode restart

2016-01-26 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-8879: -- Fix Version/s: (was: 3.0.0) > Quota by storage type usage incorrectly

[jira] [Updated] (HDFS-7645) Rolling upgrade is restoring blocks from trash multiple times

2016-01-26 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-7645: -- Fix Version/s: (was: 3.0.0) > Rolling upgrade is restoring blocks from trash

[jira] [Updated] (HDFS-9221) HdfsServerConstants#ReplicaState#getState should avoid calling values() since it creates a temporary array

2016-01-26 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-9221: -- Fix Version/s: (was: 3.0.0) > HdfsServerConstants#ReplicaState#getState

[jira] [Updated] (HDFS-8656) Preserve compatibility of ClientProtocol#rollingUpgrade after finalization

2016-01-26 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-8656: -- Fix Version/s: (was: 3.0.0) > Preserve compatibility of

[jira] [Updated] (HDFS-9178) Slow datanode I/O can cause a wrong node to be marked bad

2016-01-26 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-9178: -- Fix Version/s: (was: 3.0.0) > Slow datanode I/O can cause a wrong node to be

[jira] [Updated] (HDFS-9541) Add hdfsStreamBuilder API to libhdfs to support defaultBlockSizes greater than 2 GB

2016-01-26 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9541: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.9.0 Status: Resolved (was:

[jira] [Updated] (HDFS-9290) DFSClient#callAppend() is not backward compatible for slightly older NameNodes

2016-01-26 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-9290: -- Fix Version/s: (was: 3.0.0) > DFSClient#callAppend() is not backward

[jira] [Updated] (HDFS-9445) Datanode may deadlock while handling a bad volume

2016-01-26 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-9445: -- Fix Version/s: (was: 3.0.0) > Datanode may deadlock while handling a bad

[jira] [Commented] (HDFS-9541) Add hdfsStreamBuilder API to libhdfs to support defaultBlockSizes greater than 2 GB

2016-01-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15117809#comment-15117809 ] Hadoop QA commented on HDFS-9541: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-8384) Allow NN to startup if there are files having a lease but are not under construction

2016-01-26 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-8384: -- Fix Version/s: (was: 2.8.0) > Allow NN to startup if there are files having

[jira] [Updated] (HDFS-7609) Avoid retry cache collision when Standby NameNode loading edits

2016-01-26 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-7609: -- Fix Version/s: (was: 2.8.0) > Avoid retry cache collision when Standby

[jira] [Updated] (HDFS-8846) Add a unit test for INotify functionality across a layout version upgrade

2016-01-26 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-8846: -- Fix Version/s: (was: 2.8.0) > Add a unit test for INotify functionality

[jira] [Updated] (HDFS-9294) DFSClient deadlock when close file and failed to renew lease

2016-01-26 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-9294: -- Fix Version/s: (was: 2.8.0) > DFSClient deadlock when close file and failed

[jira] [Updated] (HDFS-9273) ACLs on root directory may be lost after NN restart

2016-01-26 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-9273: -- Fix Version/s: (was: 2.8.0) > ACLs on root directory may be lost after NN

[jira] [Updated] (HDFS-8219) setStoragePolicy with folder behavior is different after cluster restart

2016-01-26 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-8219: -- Fix Version/s: (was: 2.8.0) > setStoragePolicy with folder behavior is

[jira] [Updated] (HDFS-8431) hdfs crypto class not found in Windows

2016-01-26 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-8431: -- Fix Version/s: (was: 2.8.0) > hdfs crypto class not found in Windows >

[jira] [Updated] (HDFS-7314) When the DFSClient lease cannot be renewed, abort open-for-write files rather than the entire DFSClient

2016-01-26 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-7314: -- Fix Version/s: (was: 2.8.0) > When the DFSClient lease cannot be renewed,

[jira] [Updated] (HDFS-8046) Allow better control of getContentSummary

2016-01-26 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-8046: -- Fix Version/s: (was: 2.8.0) > Allow better control of getContentSummary >

[jira] [Updated] (HDFS-6945) BlockManager should remove a block from excessReplicateMap and decrement ExcessBlocks metric when the block is removed

2016-01-26 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-6945: -- Fix Version/s: (was: 2.8.0) > BlockManager should remove a block from

[jira] [Commented] (HDFS-9579) Provide bytes-read-by-network-distance metrics at FileSystem.Statistics level

2016-01-26 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15117815#comment-15117815 ] Colin Patrick McCabe commented on HDFS-9579: Thanks for this patch, [~mingma]. As [~sjlee0]

[jira] [Commented] (HDFS-9541) Add hdfsStreamBuilder API to libhdfs to support defaultBlockSizes greater than 2 GB

2016-01-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15117817#comment-15117817 ] Hudson commented on HDFS-9541: -- FAILURE: Integrated in Hadoop-trunk-Commit #9187 (See

[jira] [Commented] (HDFS-9494) Parallel optimization of DFSStripedOutputStream#flushAllInternals( )

2016-01-26 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15117849#comment-15117849 ] Jing Zhao commented on HDFS-9494: - Thanks for updating the patch, [~demongaorui]! The latest patch looks

[jira] [Updated] (HDFS-9679) libhdfs++: Fix inconsistencies with libhdfs C API

2016-01-26 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9679: -- Summary: libhdfs++: Fix inconsistencies with libhdfs C API (was: libhdfs++: Implement lseek in

[jira] [Commented] (HDFS-9698) Long running Balancer should renew TGT

2016-01-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15117862#comment-15117862 ] Andrew Wang commented on HDFS-9698: --- Hey Zhe, overall idea seems good, though I wonder if there's a place

[jira] [Updated] (HDFS-9679) libhdfs++: Fix inconsistencies with libhdfs C API

2016-01-26 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9679: -- Description: There is at least 1 minor inconsistency with the libhdfs api. Currently hdfsSeek

[jira] [Commented] (HDFS-9698) Long running Balancer should renew TGT

2016-01-26 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15117894#comment-15117894 ] Zhe Zhang commented on HDFS-9698: - Thanks Andrew for taking a look. Below is one possible stack trace

[jira] [Commented] (HDFS-9598) Use heap buffer in PacketReceiver If hdfs client has no enough free direct buffer.

2016-01-26 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15117906#comment-15117906 ] Colin Patrick McCabe commented on HDFS-9598: Hmm. It looks like the code already has a

[jira] [Commented] (HDFS-9541) Add hdfsStreamBuilder API to libhdfs to support defaultBlockSizes greater than 2 GB

2016-01-26 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15117909#comment-15117909 ] Colin Patrick McCabe commented on HDFS-9541: Thanks, [~zhz]. > Add hdfsStreamBuilder API to

[jira] [Commented] (HDFS-9611) DiskBalancer : Replace htrace json imports with jackson

2016-01-26 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15117921#comment-15117921 ] Colin Patrick McCabe commented on HDFS-9611: Thanks for this, [~anu]. Just one small

[jira] [Commented] (HDFS-9610) cmake tests don't fail when they should?

2016-01-26 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15117935#comment-15117935 ] Colin Patrick McCabe commented on HDFS-9610: This is not a bug.

[jira] [Commented] (HDFS-9611) DiskBalancer : Replace htrace json imports with jackson

2016-01-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15117937#comment-15117937 ] Anu Engineer commented on HDFS-9611: This code is not in trunk yet, it was a mistake that was made in

[jira] [Commented] (HDFS-9701) DN may deadlock when hot-swapping under load

2016-01-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15117943#comment-15117943 ] Hadoop QA commented on HDFS-9701: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9641) IOException in hdfs write process causes file leases not released

2016-01-26 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118023#comment-15118023 ] Colin Patrick McCabe commented on HDFS-9641: This seems like a duplicate of HDFS-4504. >

[jira] [Commented] (HDFS-9629) Update the footer of Web UI to show year 2016

2016-01-26 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118045#comment-15118045 ] Xiao Chen commented on HDFS-9629: - Thanks Yongjun, created HDFS-9707 for the above. > Update the footer of

[jira] [Created] (HDFS-9707) Add more info the the Web UI footer

2016-01-26 Thread Xiao Chen (JIRA)
Xiao Chen created HDFS-9707: --- Summary: Add more info the the Web UI footer Key: HDFS-9707 URL: https://issues.apache.org/jira/browse/HDFS-9707 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Commented] (HDFS-9698) Long running Balancer should renew TGT

2016-01-26 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118072#comment-15118072 ] Jing Zhao commented on HDFS-9698: - Thanks for working on this, Zhe. Looks like we do have the

[jira] [Updated] (HDFS-9610) test_libhdfs_threaded_hdfs_static generates a lot of noise on stderr which looks like a failure even though it isn't

2016-01-26 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9610: --- Summary: test_libhdfs_threaded_hdfs_static generates a lot of noise on stderr which

[jira] [Commented] (HDFS-9610) test_libhdfs_threaded_hdfs_static generates a lot of noise on stderr which looks like a failure even though it isn't

2016-01-26 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118129#comment-15118129 ] Colin Patrick McCabe commented on HDFS-9610: Also, the native unit tests in Hadoop include more

[jira] [Commented] (HDFS-9654) Code refactoring for HDFS-8578

2016-01-26 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118203#comment-15118203 ] Chris Trezzo commented on HDFS-9654: Thanks [~szetszwo] for the updated patch. Overall it is looking

[jira] [Created] (HDFS-9708) FSNamesystem.initAuditLoggers() doesn't trim classnames

2016-01-26 Thread Steve Loughran (JIRA)
Steve Loughran created HDFS-9708: Summary: FSNamesystem.initAuditLoggers() doesn't trim classnames Key: HDFS-9708 URL: https://issues.apache.org/jira/browse/HDFS-9708 Project: Hadoop HDFS

[jira] [Updated] (HDFS-9708) FSNamesystem.initAuditLoggers() doesn't trim classnames

2016-01-26 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HDFS-9708: - Priority: Minor (was: Major) > FSNamesystem.initAuditLoggers() doesn't trim classnames >

[jira] [Commented] (HDFS-9708) FSNamesystem.initAuditLoggers() doesn't trim classnames

2016-01-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118239#comment-15118239 ] Mingliang Liu commented on HDFS-9708: - Will

[jira] [Commented] (HDFS-9701) DN may deadlock when hot-swapping under load

2016-01-26 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118247#comment-15118247 ] Lei (Eddy) Xu commented on HDFS-9701: - Hi, [~xiaochen] Thanks a lot for digging into this bug. The

[jira] [Updated] (HDFS-9708) FSNamesystem.initAuditLoggers() doesn't trim classnames

2016-01-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9708: Attachment: HDFS-9708.000.patch > FSNamesystem.initAuditLoggers() doesn't trim classnames >

[jira] [Assigned] (HDFS-9708) FSNamesystem.initAuditLoggers() doesn't trim classnames

2016-01-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu reassigned HDFS-9708: --- Assignee: Mingliang Liu > FSNamesystem.initAuditLoggers() doesn't trim classnames >

[jira] [Updated] (HDFS-9708) FSNamesystem.initAuditLoggers() doesn't trim classnames

2016-01-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9708: Status: Patch Available (was: Open) > FSNamesystem.initAuditLoggers() doesn't trim classnames >

[jira] [Commented] (HDFS-9610) test_libhdfs_threaded_hdfs_static generates a lot of noise on stderr which looks like a failure even though it isn't

2016-01-26 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118259#comment-15118259 ] James Clampffer commented on HDFS-9610: --- bq. this is not a bug. test_libhdfs_threaded_hdfs_static

[jira] [Commented] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

2016-01-26 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118269#comment-15118269 ] Colin Patrick McCabe commented on HDFS-9260: bq. Should I convert storages field to private?

[jira] [Comment Edited] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

2016-01-26 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118269#comment-15118269 ] Colin Patrick McCabe edited comment on HDFS-9260 at 1/26/16 11:30 PM: --

[jira] [Commented] (HDFS-9579) Provide bytes-read-by-network-distance metrics at FileSystem.Statistics level

2016-01-26 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118276#comment-15118276 ] Ming Ma commented on HDFS-9579: --- Thanks [~cmccabe]. Yes, it is possible to have distance of three or five

  1   2   >