[jira] [Commented] (HDFS-10958) Add instrumentation hooks around Datanode disk IO

2016-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15737278#comment-15737278 ] Hadoop QA commented on HDFS-10958: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9335) Webhdfs hangs when folder is used for Append

2016-12-09 Thread Jagadesh Kiran N (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15737261#comment-15737261 ] Jagadesh Kiran N commented on HDFS-9335: Analyzed this issue, this is not related to Hadoop, issue

[jira] [Commented] (HDFS-11217) Annotate NameNode and DataNode MXBean interfaces as Private/Stable

2016-12-09 Thread Jagadesh Kiran N (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15737171#comment-15737171 ] Jagadesh Kiran N commented on HDFS-11217: - Thanks [~andrew.wang] for commiting the same ,and

[jira] [Updated] (HDFS-10958) Add instrumentation hooks around Datanode disk IO

2016-12-09 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10958: - Status: Patch Available (was: Open) > Add instrumentation hooks around Datanode disk IO >

[jira] [Comment Edited] (HDFS-10958) Add instrumentation hooks around Datanode disk IO

2016-12-09 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15737105#comment-15737105 ] Arpit Agarwal edited comment on HDFS-10958 at 12/10/16 3:21 AM: Attached a

[jira] [Updated] (HDFS-10958) Add instrumentation hooks around Datanode disk IO

2016-12-09 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10958: - Attachment: HDFS-10958.01.patch Attached a patch to factor out most of the DataNode file IO

[jira] [Commented] (HDFS-10684) WebHDFS DataNode calls fail without parameter createparent

2016-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15737050#comment-15737050 ] Hadoop QA commented on HDFS-10684: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-10930) Refactor: Wrap Datanode IO related operations

2016-12-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15737003#comment-15737003 ] Andrew Wang commented on HDFS-10930: Once there's a PR, precommit bot can't process patch files

[jira] [Updated] (HDFS-8870) Lease is leaked on write failure

2016-12-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8870: -- Resolution: Fixed Status: Resolved (was: Patch Available) I'm going to resolve this issue for

[jira] [Updated] (HDFS-7955) Improve naming of classes, methods, and variables related to block replication and recovery

2016-12-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7955: -- Fix Version/s: (was: 3.0.0-alpha2) > Improve naming of classes, methods, and variables related to

[jira] [Updated] (HDFS-11181) Fuse wrapper has a typo

2016-12-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11181: --- Fix Version/s: 3.0.0-alpha2 2.8.0 > Fuse wrapper has a typo >

[jira] [Updated] (HDFS-10206) Datanodes not sorted properly by distance when the reader isn't a datanode

2016-12-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10206: --- Fix Version/s: 3.0.0-alpha2 > Datanodes not sorted properly by distance when the reader isn't a

[jira] [Updated] (HDFS-8678) Bring back the feature to view chunks of files in the HDFS file browser

2016-12-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8678: -- Fix Version/s: 3.0.0-alpha2 > Bring back the feature to view chunks of files in the HDFS file browser >

[jira] [Commented] (HDFS-11229) HDFS-11056 failed to close meta file

2016-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736971#comment-15736971 ] Hadoop QA commented on HDFS-11229: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11228) Remove deprecated FileSystem#getDefault* and getServerDefault methods that don't take a Path argument

2016-12-09 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-11228: - Resolution: Won't Fix Assignee: (was: Akira Ajisaka) Status: Resolved (was:

[jira] [Commented] (HDFS-10684) WebHDFS DataNode calls fail without parameter createparent

2016-12-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736951#comment-15736951 ] Andrew Wang commented on HDFS-10684: Tracked down the issue I think caused this, which added support

[jira] [Commented] (HDFS-8630) WebHDFS : Support get/set/unset StoragePolicy

2016-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736946#comment-15736946 ] Hadoop QA commented on HDFS-8630: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10684) WebHDFS DataNode calls fail without parameter createparent

2016-12-09 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736932#comment-15736932 ] John Zhuge commented on HDFS-10684: --- The branch-2 patch applies to trunk cleanly. > WebHDFS DataNode

[jira] [Updated] (HDFS-10860) Switch HttpFS from Tomcat to Jetty

2016-12-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10860: --- Summary: Switch HttpFS from Tomcat to Jetty (was: Switch HttpFS to from Tomcat to Jetty) > Switch

[jira] [Commented] (HDFS-11156) Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API

2016-12-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736831#comment-15736831 ] Andrew Wang commented on HDFS-11156: Thanks for the rev [~cheersyang], looks good overall, some small

[jira] [Updated] (HDFS-9896) WebHDFS API may return invalid JSON

2016-12-09 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-9896: - Affects Version/s: 2.6.5 > WebHDFS API may return invalid JSON > --- > >

[jira] [Commented] (HDFS-11056) Concurrent append and read operations lead to checksum error

2016-12-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736788#comment-15736788 ] Hudson commented on HDFS-11056: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10979 (See

[jira] [Commented] (HDFS-11229) HDFS-11056 failed to close meta file

2016-12-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736787#comment-15736787 ] Hudson commented on HDFS-11229: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10979 (See

[jira] [Updated] (HDFS-11123) [SPS] Make storage policy satisfier daemon work on/off dynamically

2016-12-09 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11123: --- Attachment: HDFS-11123-HDFS-10285-00.patch Just renamed the patch to pick up in

[jira] [Updated] (HDFS-10684) WebHDFS DataNode calls fail without parameter createparent

2016-12-09 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10684: -- Status: Patch Available (was: In Progress) > WebHDFS DataNode calls fail without parameter

[jira] [Updated] (HDFS-10684) WebHDFS DataNode calls fail without parameter createparent

2016-12-09 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10684: -- Attachment: HDFS-10684.002-branch-2.patch Patch 002: * Add a unit test. Without the fix, it fails with

[jira] [Commented] (HDFS-10684) WebHDFS DataNode calls fail without parameter createparent

2016-12-09 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736676#comment-15736676 ] John Zhuge commented on HDFS-10684: --- Sounds good, [~andrew.wang]. I will get on it right away.

[jira] [Updated] (HDFS-10796) libhdfs++: rationalize ioservice interactions

2016-12-09 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-10796: --- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to HDFS-8707.

[jira] [Updated] (HDFS-11229) HDFS-11056 failed to close meta file

2016-12-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11229: --- Release Note: The fix for HDFS-111056 reads meta file to load last partial chunk checksum

[jira] [Updated] (HDFS-11229) HDFS-11056 failed to close meta file

2016-12-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11229: --- Release Note: The fix for HDFS-111056 reads meta file to load last partial chunk checksum

[jira] [Updated] (HDFS-11229) HDFS-11056 failed to close meta file

2016-12-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11229: --- Release Note: The fix for HDFS-111056 reads meta file to load last partial chunk checksum

[jira] [Updated] (HDFS-8630) WebHDFS : Support get/set/unset StoragePolicy

2016-12-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8630: -- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Available) Thanks

[jira] [Updated] (HDFS-11229) HDFS-11056 failed to close meta file

2016-12-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11229: --- Attachment: HDFS-11229.branch-2.patch Branch 2 patch > HDFS-11056 failed to close meta file

[jira] [Commented] (HDFS-6984) In Hadoop 3, make FileStatus serialize itself via protobuf

2016-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736555#comment-15736555 ] Hadoop QA commented on HDFS-6984: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (HDFS-10958) Add instrumentation hooks around Datanode disk IO

2016-12-09 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reassigned HDFS-10958: Assignee: Arpit Agarwal (was: Xiaoyu Yao) > Add instrumentation hooks around Datanode

[jira] [Resolved] (HDFS-11230) Refactor DataNode file IO operations

2016-12-09 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-11230. -- Resolution: Duplicate Dup of HDFS-10958. > Refactor DataNode file IO operations >

[jira] [Created] (HDFS-11230) Refactor DataNode file IO operations

2016-12-09 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-11230: Summary: Refactor DataNode file IO operations Key: HDFS-11230 URL: https://issues.apache.org/jira/browse/HDFS-11230 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-10684) WebHDFS DataNode calls fail without parameter createparent

2016-12-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736521#comment-15736521 ] Andrew Wang commented on HDFS-10684: A basic unit test should be easy, since it's just calling a REST

[jira] [Commented] (HDFS-10796) libhdfs++: rationalize ioservice interactions

2016-12-09 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736518#comment-15736518 ] Xiaowei Zhu commented on HDFS-10796: +1. > libhdfs++: rationalize ioservice interactions >

[jira] [Commented] (HDFS-11072) Add ability to unset and change directory EC policy

2016-12-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736500#comment-15736500 ] Andrew Wang commented on HDFS-11072: Thanks for the detailed writeup Sammi! bq. Andrew, can you

[jira] [Commented] (HDFS-11229) HDFS-11056 failed to close meta file

2016-12-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736493#comment-15736493 ] Wei-Chiu Chuang commented on HDFS-11229: The failed test looks unrelated and can't be reproduced

[jira] [Updated] (HDFS-8630) WebHDFS : Support get/set/unset StoragePolicy

2016-12-09 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-8630: - Attachment: HDFS-8630-branch-2.8-001.patch Attached branch-2.8 patch.. Please

[jira] [Commented] (HDFS-8630) WebHDFS : Support get/set/unset StoragePolicy

2016-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736479#comment-15736479 ] Hadoop QA commented on HDFS-8630: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10796) libhdfs++: rationalize ioservice interactions

2016-12-09 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736462#comment-15736462 ] James Clampffer commented on HDFS-10796: Thanks for taking a look at this Xiaowei! I ran the

[jira] [Commented] (HDFS-11160) VolumeScanner reports write-in-progress replicas as corrupt incorrectly

2016-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736430#comment-15736430 ] Hadoop QA commented on HDFS-11160: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11229) HDFS-11056 failed to close meta file

2016-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736420#comment-15736420 ] Hadoop QA commented on HDFS-11229: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11229) HDFS-11056 failed to close meta file

2016-12-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11229: --- Affects Version/s: 3.0.0-alpha2 > HDFS-11056 failed to close meta file >

[jira] [Updated] (HDFS-11229) HDFS-11056 failed to close meta file

2016-12-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11229: --- Target Version/s: 2.7.4, 3.0.0-alpha2 > HDFS-11056 failed to close meta file >

[jira] [Commented] (HDFS-11229) HDFS-11056 failed to close meta file

2016-12-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736407#comment-15736407 ] Andrew Wang commented on HDFS-11229: +1 LGTM too. Please also set the targets versions in the future,

[jira] [Updated] (HDFS-7958) dfshealth_nonsecure.html should not be accessble in secure cluster.

2016-12-09 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-7958: - Assignee: (was: Surendra Singh Lilhore) > dfshealth_nonsecure.html should not

[jira] [Updated] (HDFS-7974) DFS admin rollEdits command should do audit log.

2016-12-09 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-7974: - Assignee: (was: Surendra Singh Lilhore) > DFS admin rollEdits command should

[jira] [Commented] (HDFS-10796) libhdfs++: rationalize ioservice interactions

2016-12-09 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736377#comment-15736377 ] Xiaowei Zhu commented on HDFS-10796: Things look good to me. The only concern is the failures with

[jira] [Commented] (HDFS-11229) HDFS-11056 failed to close meta file

2016-12-09 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736288#comment-15736288 ] Yongjun Zhang commented on HDFS-11229: -- Ha, I got you, in java 7, "Any variable declared in the try

[jira] [Commented] (HDFS-11160) VolumeScanner reports write-in-progress replicas as corrupt incorrectly

2016-12-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736283#comment-15736283 ] Wei-Chiu Chuang commented on HDFS-11160: FYI the meta file not close bug is pretty serious, and I

[jira] [Commented] (HDFS-11229) HDFS-11056 failed to close meta file

2016-12-09 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736273#comment-15736273 ] Yongjun Zhang commented on HDFS-11229: -- HI Wei-Chiu, Thanks for the patch, I thought we want to do:

[jira] [Updated] (HDFS-6984) In Hadoop 3, make FileStatus serialize itself via protobuf

2016-12-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6984: -- Attachment: HDFS-6984.nowritable.patch Here's the sample patch I used to remove Writable. > In Hadoop

[jira] [Commented] (HDFS-6984) In Hadoop 3, make FileStatus serialize itself via protobuf

2016-12-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736258#comment-15736258 ] Andrew Wang commented on HDFS-6984: --- Here's also a more radical idea: how about we simply stop

[jira] [Commented] (HDFS-11217) Annotate NameNode and DataNode MXBean interfaces as Private/Stable

2016-12-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736256#comment-15736256 ] Hudson commented on HDFS-11217: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10977 (See

[jira] [Commented] (HDFS-10675) Datanode support to read from external stores.

2016-12-09 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736252#comment-15736252 ] Virajith Jalaparti commented on HDFS-10675: --- Thanks [~ehiggs]. > Datanode support to read from

[jira] [Updated] (HDFS-11229) HDFS-11056 failed to close meta file

2016-12-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11229: --- Description: The following code failed to close the file after it is read.

[jira] [Updated] (HDFS-11229) HDFS-11056 failed to close meta file

2016-12-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11229: --- Attachment: HDFS-11229.001.patch Upload patch v001. Use try-with-resources statement to close

[jira] [Updated] (HDFS-11229) HDFS-11056 failed to close meta file

2016-12-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11229: --- Status: Patch Available (was: Open) > HDFS-11056 failed to close meta file >

[jira] [Updated] (HDFS-11217) Annotate NameNode and DataNode MXBean interfaces as Private/Stable

2016-12-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11217: --- Resolution: Fixed Fix Version/s: 3.0.0-alpha2 2.8.0 Release Note: The

[jira] [Updated] (HDFS-11217) Annotate NameNode and DataNode MXBean interfaces as Private/Stable

2016-12-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11217: --- Summary: Annotate NameNode and DataNode MXBean interfaces as Private/Stable (was: Make some JMX

[jira] [Created] (HDFS-11229) HDFS-11056 failed to close meta file

2016-12-09 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-11229: -- Summary: HDFS-11056 failed to close meta file Key: HDFS-11229 URL: https://issues.apache.org/jira/browse/HDFS-11229 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-11217) Make some JMX interfaces private

2016-12-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736213#comment-15736213 ] Andrew Wang commented on HDFS-11217: +1 LGTM, I'll fix the whitespace on commit. > Make some JMX

[jira] [Updated] (HDFS-11225) NameNode crashed because deleteSnapshot held FSNamesystem lock too long

2016-12-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11225: --- Description: The deleteSnapshot operation is synchronous. In certain situations this

[jira] [Commented] (HDFS-11227) BlockReader read doesn't timeout

2016-12-09 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736130#comment-15736130 ] Mingliang Liu commented on HDFS-11227: -- [~subahugu] I've added you as HDFS contributor on the JIRA

[jira] [Updated] (HDFS-11227) BlockReader read doesn't timeout

2016-12-09 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11227: - Status: Patch Available (was: Open) > BlockReader read doesn't timeout >

[jira] [Updated] (HDFS-11227) BlockReader read doesn't timeout

2016-12-09 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11227: - Assignee: Suresh Bahuguna > BlockReader read doesn't timeout > >

[jira] [Commented] (HDFS-11226) Storagepolicy command is not working with "-fs" option

2016-12-09 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736115#comment-15736115 ] Mingliang Liu commented on HDFS-11226: -- {code} hdfs storagepolicies Usage: bin/hdfs storagepolicies

[jira] [Commented] (HDFS-11225) NameNode crashed because deleteSnapshot held FSNamesystem lock too long

2016-12-09 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736111#comment-15736111 ] Yongjun Zhang commented on HDFS-11225: -- Thanks [~jojochuang] and [~linyiqun]. I have a further idea

[jira] [Updated] (HDFS-8630) WebHDFS : Support get/set/unset StoragePolicy

2016-12-09 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-8630: - Attachment: HDFS-8630-branch-2.001.patch Attached branch-2 patch. Please review..

[jira] [Updated] (HDFS-11160) VolumeScanner reports write-in-progress replicas as corrupt incorrectly

2016-12-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11160: --- Attachment: HDFS-11160.004.patch The timeout in TimeReplication was related to this patch

[jira] [Commented] (HDFS-11094) Send back HAState along with NamespaceInfo during a versionRequest as an optional parameter

2016-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736011#comment-15736011 ] Hadoop QA commented on HDFS-11094: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11094) Send back HAState along with NamespaceInfo during a versionRequest as an optional parameter

2016-12-09 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated HDFS-11094: --- Attachment: HDFS-11094.011.patch The test was racy. Heartbeats were setting the active NN to null

[jira] [Commented] (HDFS-11217) Make some JMX interfaces private

2016-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15735680#comment-15735680 ] Hadoop QA commented on HDFS-11217: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11094) Send back HAState along with NamespaceInfo during a versionRequest as an optional parameter

2016-12-09 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15735593#comment-15735593 ] Eric Badger commented on HDFS-11094: The TestBPOfferService failure is definitely relevant here. Not

[jira] [Commented] (HDFS-11228) Remove deprecated FileSystem#getDefault* and getServerDefault methods that don't take a Path argument

2016-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15735559#comment-15735559 ] Hadoop QA commented on HDFS-11228: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11160) VolumeScanner reports write-in-progress replicas as corrupt incorrectly

2016-12-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15735430#comment-15735430 ] Wei-Chiu Chuang commented on HDFS-11160: The timeout in TestReplication seems related to this

[jira] [Updated] (HDFS-11217) Make some JMX interfaces private

2016-12-09 Thread Jagadesh Kiran N (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jagadesh Kiran N updated HDFS-11217: Status: Patch Available (was: Open) > Make some JMX interfaces private >

[jira] [Updated] (HDFS-11217) Make some JMX interfaces private

2016-12-09 Thread Jagadesh Kiran N (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jagadesh Kiran N updated HDFS-11217: Attachment: HDFS-11217_00.patch Attached the patch, please review > Make some JMX

[jira] [Commented] (HDFS-11163) Mover should move the file blocks to default storage once policy is unset

2016-12-09 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15735307#comment-15735307 ] Surendra Singh Lilhore commented on HDFS-11163: --- [~szetszwo], can you please review the

[jira] [Commented] (HDFS-11228) Remove deprecated FileSystem#getDefault* and getServerDefault methods that don't take a Path argument

2016-12-09 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15735302#comment-15735302 ] Akira Ajisaka commented on HDFS-11228: -- Thanks [~ste...@apache.org] for the review. I agreed that we

[jira] [Commented] (HDFS-10838) Last full block report received time for each DN should be easily discoverable

2016-12-09 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15735299#comment-15735299 ] Surendra Singh Lilhore commented on HDFS-10838: --- [~arpitagarwal], [~vinayrpet] Can you

[jira] [Commented] (HDFS-11225) NameNode crashed because deleteSnapshot held FSNamesystem lock too long

2016-12-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15735270#comment-15735270 ] Wei-Chiu Chuang commented on HDFS-11225: Thanks [~linyiqun] for confirming this issue. Yes I think

[jira] [Updated] (HDFS-11225) NameNode crashed because deleteSnapshot held FSNamesystem lock too long

2016-12-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11225: --- Labels: high-availability (was: ) > NameNode crashed because deleteSnapshot held

[jira] [Updated] (HDFS-11225) NameNode crashed because deleteSnapshot held FSNamesystem lock too long

2016-12-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11225: --- Environment: CDH5.8.2, HA (was: CDH5.8.2) > NameNode crashed because deleteSnapshot held

[jira] [Commented] (HDFS-11228) Remove deprecated FileSystem#getDefault* and getServerDefault methods that don't take a Path argument

2016-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15735254#comment-15735254 ] Hadoop QA commented on HDFS-11228: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-11226) Storagepolicy command is not working with "-fs" option

2016-12-09 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15735247#comment-15735247 ] Brahma Reddy Battula edited comment on HDFS-11226 at 12/9/16 12:59 PM:

[jira] [Commented] (HDFS-11226) Storagepolicy command is not working with "-fs" option

2016-12-09 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15735247#comment-15735247 ] Brahma Reddy Battula commented on HDFS-11226: - bq.I have makes a quick fix in HADOOP-13883.

[jira] [Commented] (HDFS-11228) Remove deprecated FileSystem#getDefault* and getServerDefault methods that don't take a Path argument

2016-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15735234#comment-15735234 ] Hadoop QA commented on HDFS-11228: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-11228) Remove deprecated FileSystem#getDefault* and getServerDefault methods that don't take a Path argument

2016-12-09 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15735218#comment-15735218 ] Steve Loughran edited comment on HDFS-11228 at 12/9/16 12:43 PM: - -1 #

[jira] [Updated] (HDFS-11228) Remove deprecated FileSystem#getDefault* and getServerDefault methods that don't take a Path argument

2016-12-09 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HDFS-11228: -- Target Version/s: 3.0.0-alpha2 Priority: Minor (was: Major) Component/s:

[jira] [Moved] (HDFS-11228) Remove deprecated FileSystem#getDefault* and getServerDefault methods that don't take a Path argument

2016-12-09 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran moved HADOOP-13879 to HDFS-11228: Target Version/s: (was: 3.0.0-alpha2) Key:

[jira] [Commented] (HDFS-11226) Storagepolicy command is not working with "-fs" option

2016-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15735181#comment-15735181 ] Hadoop QA commented on HDFS-11226: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11226) Storagepolicy command is not working with "-fs" option

2016-12-09 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15735097#comment-15735097 ] Yiqun Lin commented on HDFS-11226: -- +1 for the quick fix, [~brahmareddy]. But I am concerning one point:

[jira] [Commented] (HDFS-11227) BlockReader read doesn't timeout

2016-12-09 Thread Suresh Bahuguna (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15735041#comment-15735041 ] Suresh Bahuguna commented on HDFS-11227: Created pull request

[jira] [Commented] (HDFS-11227) BlockReader read doesn't timeout

2016-12-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15735038#comment-15735038 ] ASF GitHub Bot commented on HDFS-11227: --- GitHub user subahugu opened a pull request:

[jira] [Created] (HDFS-11227) BlockReader read doesn't timeout

2016-12-09 Thread Suresh Bahuguna (JIRA)
Suresh Bahuguna created HDFS-11227: -- Summary: BlockReader read doesn't timeout Key: HDFS-11227 URL: https://issues.apache.org/jira/browse/HDFS-11227 Project: Hadoop HDFS Issue Type: Bug

  1   2   >