[jira] [Commented] (HDFS-10434) Fix intermittent test failure of TestDataNodeErasureCodingMetrics

2016-05-24 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299509#comment-15299509 ] Kai Zheng commented on HDFS-10434: -- Thanks Rakesh for tracking this. The fix LGTM and +1. A minor is the

[jira] [Commented] (HDFS-8057) Move BlockReader implementation to the client implementation package

2016-05-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299471#comment-15299471 ] Hadoop QA commented on HDFS-8057: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10433) Make retry also works well for Async DFS

2016-05-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299468#comment-15299468 ] Hadoop QA commented on HDFS-10433: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-10458) getFileEncryptionInfo should return quickly for non-encrypted cluster

2016-05-24 Thread Zhe Zhang (JIRA)
Zhe Zhang created HDFS-10458: Summary: getFileEncryptionInfo should return quickly for non-encrypted cluster Key: HDFS-10458 URL: https://issues.apache.org/jira/browse/HDFS-10458 Project: Hadoop HDFS

[jira] [Updated] (HDFS-10457) DataNode should not auto-format block pool directory if VERSION is missing

2016-05-24 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10457: --- Attachment: HDFS-10457.001.patch v01: a one-liner fix. > DataNode should not auto-format

[jira] [Updated] (HDFS-10457) DataNode should not auto-format block pool directory if VERSION is missing

2016-05-24 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10457: --- Attachment: (was: HDFS-10457.001.patch) > DataNode should not auto-format block pool

[jira] [Updated] (HDFS-10457) DataNode should not auto-format block pool directory if VERSION is missing

2016-05-24 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10457: --- Attachment: HDFS-10457.001.patch > DataNode should not auto-format block pool directory if

[jira] [Created] (HDFS-10457) DataNode should not auto-format block pool directory if VERSION is missing

2016-05-24 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-10457: -- Summary: DataNode should not auto-format block pool directory if VERSION is missing Key: HDFS-10457 URL: https://issues.apache.org/jira/browse/HDFS-10457

[jira] [Commented] (HDFS-10440) Improve DataNode web UI

2016-05-24 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299423#comment-15299423 ] Weiwei Yang commented on HDFS-10440: [~vinayrpet] Sure, thanks. I just attached a new mockup

[jira] [Updated] (HDFS-10440) Improve DataNode web UI

2016-05-24 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-10440: --- Attachment: (was: datanode_UI_mockup.jpg) > Improve DataNode web UI > --- > >

[jira] [Updated] (HDFS-10440) Improve DataNode web UI

2016-05-24 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-10440: --- Attachment: dn_web_ui_mockup.jpg > Improve DataNode web UI > --- > >

[jira] [Commented] (HDFS-10456) Print out the file path when the writes on snapshots are denied

2016-05-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299365#comment-15299365 ] Hadoop QA commented on HDFS-10456: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-7240) Object store in HDFS

2016-05-24 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299336#comment-15299336 ] Kai Zheng commented on HDFS-7240: - Looking forward, things could be better, given the prototype

[jira] [Updated] (HDFS-10433) Make retry also works well for Async DFS

2016-05-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-10433: --- Status: Patch Available (was: Open) > Make retry also works well for Async DFS >

[jira] [Updated] (HDFS-10433) Make retry also works well for Async DFS

2016-05-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-10433: --- Attachment: h10433_20160524.patch h10433_20160524.patch: adds an async call queue to

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-05-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Target Version/s: 2.7.1 Status: Patch Available (was: Open) > ReplicationMonitor

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-05-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Status: Open (was: Patch Available) > ReplicationMonitor thread could stuck for long time due to the

[jira] [Commented] (HDFS-10449) TestRollingFileSystemSinkWithHdfs#testFailedClose() fails on branch-2

2016-05-24 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299322#comment-15299322 ] Takanobu Asanuma commented on HDFS-10449: - Thanks for the comment. Actually, I got the contributor

[jira] [Assigned] (HDFS-10449) TestRollingFileSystemSinkWithHdfs#testFailedClose() fails on branch-2

2016-05-24 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma reassigned HDFS-10449: --- Assignee: Takanobu Asanuma > TestRollingFileSystemSinkWithHdfs#testFailedClose()

[jira] [Commented] (HDFS-7240) Object store in HDFS

2016-05-24 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299319#comment-15299319 ] Arpit Agarwal commented on HDFS-7240: - bq. I actually would be delighted to commit my time and energy

[jira] [Commented] (HDFS-10448) CacheManager#checkLimit always assumes a replication factor of 1

2016-05-24 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299316#comment-15299316 ] Yiqun Lin commented on HDFS-10448: -- Hi, [~cmccabe], I am a little confused of what you said. {quote} I

[jira] [Updated] (HDFS-8057) Move BlockReader implementation to the client implementation package

2016-05-24 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-8057: --- Attachment: HDFS-8057.branch-2.003.patch Oh, I'm sorry to you, too. I updated the patch. >

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-05-24 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299313#comment-15299313 ] Konstantin Shvachko commented on HDFS-10301: Hey Colin, let's decide on the way to move

[jira] [Commented] (HDFS-10341) Add a metric to expose the timeout number of pending replication blocks

2016-05-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299305#comment-15299305 ] Hadoop QA commented on HDFS-10341: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10456) Print out the file path when the writes on snapshots are denied

2016-05-24 Thread Tianyin Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tianyin Xu updated HDFS-10456: -- Status: Patch Available (was: Open) > Print out the file path when the writes on snapshots are denied

[jira] [Updated] (HDFS-10456) Print out the file path when the writes on snapshots are denied

2016-05-24 Thread Tianyin Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tianyin Xu updated HDFS-10456: -- Attachment: HDFS-10456.000.patch Patch against trunk > Print out the file path when the writes on

[jira] [Created] (HDFS-10456) Print out the file path when the writes on snapshots are denied

2016-05-24 Thread Tianyin Xu (JIRA)
Tianyin Xu created HDFS-10456: - Summary: Print out the file path when the writes on snapshots are denied Key: HDFS-10456 URL: https://issues.apache.org/jira/browse/HDFS-10456 Project: Hadoop HDFS

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-05-24 Thread Vinitha Reddy Gankidi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299255#comment-15299255 ] Vinitha Reddy Gankidi commented on HDFS-10301: -- Thanks for your review [~cmccabe]. By legacy

[jira] [Commented] (HDFS-10415) TestDistributedFileSystem#testDFSCloseOrdering() fails on branch-2

2016-05-24 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299248#comment-15299248 ] Andrew Wang commented on HDFS-10415: I think that's just an omission, though it's been 3 years. I'm

[jira] [Commented] (HDFS-10455) Logging the username when deny the setOwner operation

2016-05-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299242#comment-15299242 ] Hadoop QA commented on HDFS-10455: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9924) [umbrella] Asynchronous HDFS Access

2016-05-24 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299220#comment-15299220 ] Andrew Wang commented on HDFS-9924: --- Nicholas, I proposed two solutions above, neither of which you have

[jira] [Commented] (HDFS-7240) Object store in HDFS

2016-05-24 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299197#comment-15299197 ] Andrew Wang commented on HDFS-7240: --- [~arpitagarwal] the impedance mismatch here is illustrated in your

[jira] [Commented] (HDFS-9924) [umbrella] Asynchronous HDFS Access

2016-05-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299174#comment-15299174 ] Tsz Wo Nicholas Sze commented on HDFS-9924: --- > ... . It's not fair to push the burden of

[jira] [Commented] (HDFS-9782) RollingFileSystemSink should have configurable roll interval

2016-05-24 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299165#comment-15299165 ] Karthik Kambatla commented on HDFS-9782: Oh, and thanks [~andrew.wang] and [~rkanter] for your

[jira] [Updated] (HDFS-9782) RollingFileSystemSink should have configurable roll interval

2016-05-24 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated HDFS-9782: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.9.0 Status:

[jira] [Commented] (HDFS-9924) [umbrella] Asynchronous HDFS Access

2016-05-24 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299161#comment-15299161 ] Andrew Wang commented on HDFS-9924: --- I'm still not convinced enough to change my -1 on Future in 2.8.

[jira] [Commented] (HDFS-9782) RollingFileSystemSink should have configurable roll interval

2016-05-24 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299147#comment-15299147 ] Karthik Kambatla commented on HDFS-9782: Okay, will check this into branch-2 then. >

[jira] [Updated] (HDFS-10341) Add a metric to expose the timeout number of pending replication blocks

2016-05-24 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-10341: - Attachment: HDFS-10341.03.patch 03: Expose the total number of timed out pending replication

[jira] [Updated] (HDFS-10341) Add a metric to expose the timeout number of pending replication blocks

2016-05-24 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-10341: - Attachment: HDFS-10341.02.patch Thanks Arpit for the comment. Updated the patch. I wanted to

[jira] [Created] (HDFS-10455) Logging the username when deny the setOwner operation

2016-05-24 Thread Tianyin Xu (JIRA)
Tianyin Xu created HDFS-10455: - Summary: Logging the username when deny the setOwner operation Key: HDFS-10455 URL: https://issues.apache.org/jira/browse/HDFS-10455 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-10455) Logging the username when deny the setOwner operation

2016-05-24 Thread Tianyin Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tianyin Xu updated HDFS-10455: -- Attachment: HDFS-10455.000.patch Patch against trunk > Logging the username when deny the setOwner

[jira] [Updated] (HDFS-10455) Logging the username when deny the setOwner operation

2016-05-24 Thread Tianyin Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tianyin Xu updated HDFS-10455: -- Status: Patch Available (was: Open) > Logging the username when deny the setOwner operation >

[jira] [Commented] (HDFS-10341) Add a metric to expose the timeout number of pending replication blocks

2016-05-24 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299076#comment-15299076 ] Arpit Agarwal commented on HDFS-10341: -- Hi [~ajisakaa], can we just return timedOutItems.size() by

[jira] [Commented] (HDFS-10390) Implement asynchronous setAcl/getAclStatus for DistributedFileSystem

2016-05-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299035#comment-15299035 ] Hudson commented on HDFS-10390: --- SUCCESS: Integrated in Hadoop-trunk-Commit #9850 (See

[jira] [Updated] (HDFS-10390) Implement asynchronous setAcl/getAclStatus for DistributedFileSystem

2016-05-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-10390: --- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-10390) Implement asynchronous setAcl/getAclStatus for DistributedFileSystem

2016-05-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15298998#comment-15298998 ] Tsz Wo Nicholas Sze commented on HDFS-10390: Jenkins seem not picking up the v011. Since the

[jira] [Updated] (HDFS-10390) Implement asynchronous setAcl/getAclStatus for DistributedFileSystem

2016-05-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-10390: --- Hadoop Flags: Reviewed +1 patch looks good. Thanks for all the hard works! >

[jira] [Updated] (HDFS-9365) Balaner does not work with the HDFS-6376 HA setup

2016-05-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9365: -- Resolution: Fixed Fix Version/s: 2.7.3 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-9547) DiskBalancer : Add user documentation

2016-05-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15298877#comment-15298877 ] Hadoop QA commented on HDFS-9547: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9547) DiskBalancer : Add user documentation

2016-05-24 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9547: --- Attachment: HDFS-9547-HDFS-1312.002.patch Addressed all code review comments > DiskBalancer : Add

[jira] [Commented] (HDFS-6376) Distcp data between two HA clusters requires another configuration

2016-05-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15298811#comment-15298811 ] Hudson commented on HDFS-6376: -- SUCCESS: Integrated in Hadoop-trunk-Commit #9849 (See

[jira] [Updated] (HDFS-10370) Allow DataNode to be started with numactl

2016-05-24 Thread Dave Marion (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Marion updated HDFS-10370: --- Attachment: HDFS-10370-branch-2.004.patch HDFS-10370.004.patch Updated patches for

[jira] [Commented] (HDFS-9365) Balaner does not work with the HDFS-6376 HA setup

2016-05-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15298812#comment-15298812 ] Hudson commented on HDFS-9365: -- SUCCESS: Integrated in Hadoop-trunk-Commit #9849 (See

[jira] [Commented] (HDFS-8057) Move BlockReader implementation to the client implementation package

2016-05-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15298804#comment-15298804 ] Tsz Wo Nicholas Sze commented on HDFS-8057: --- There are some also three "RemoteBlockReader"s in

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-05-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15298742#comment-15298742 ] Hadoop QA commented on HDFS-10301: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10415) TestDistributedFileSystem#testDFSCloseOrdering() fails on branch-2

2016-05-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15298714#comment-15298714 ] Mingliang Liu commented on HDFS-10415: -- If no objections about the 1st approach, does the v1 patch

[jira] [Commented] (HDFS-10220) A large number of expired leases can make namenode unresponsive and cause failover

2016-05-24 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15298678#comment-15298678 ] Ravi Prakash commented on HDFS-10220: - I think this probably happens rarely so having dynamic duty

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-05-24 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15298675#comment-15298675 ] Colin Patrick McCabe commented on HDFS-10301: - Oh, sorry! I didn't realize we had added a new

[jira] [Commented] (HDFS-10370) Allow DataNode to be started with numactl

2016-05-24 Thread Dave Marion (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15298674#comment-15298674 ] Dave Marion commented on HDFS-10370: Not yet, we are just starting to test this. I don't expect that

[jira] [Commented] (HDFS-9782) RollingFileSystemSink should have configurable roll interval

2016-05-24 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15298651#comment-15298651 ] Daniel Templeton commented on HDFS-9782: There's already a JIRA for it: HDFS-10449 >

[jira] [Commented] (HDFS-10449) TestRollingFileSystemSinkWithHdfs#testFailedClose() fails on branch-2

2016-05-24 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15298656#comment-15298656 ] Daniel Templeton commented on HDFS-10449: - Go for it. We'll work out the JIRA ownership later. >

[jira] [Commented] (HDFS-10370) Allow DataNode to be started with numactl

2016-05-24 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15298631#comment-15298631 ] John Zhuge commented on HDFS-10370: --- Thanks for the clarifications. I understand the current focus is on

[jira] [Updated] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-05-24 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-10301: Attachment: HDFS-10301.005.patch Rebasing patch 003 on trunk. > BlockReport

[jira] [Commented] (HDFS-9782) RollingFileSystemSink should have configurable roll interval

2016-05-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15298616#comment-15298616 ] Hudson commented on HDFS-9782: -- SUCCESS: Integrated in Hadoop-trunk-Commit #9847 (See

[jira] [Commented] (HDFS-9782) RollingFileSystemSink should have configurable roll interval

2016-05-24 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15298602#comment-15298602 ] Karthik Kambatla commented on HDFS-9782: Committed to trunk, but

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-05-24 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15298604#comment-15298604 ] Zhe Zhang commented on HDFS-10301: -- [~cmccabe] Just a quick note that it's a new JIRA rule that you have

[jira] [Commented] (HDFS-10430) Refactor FileSystem#checkAccessPermissions for better reuse from tests

2016-05-24 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15298596#comment-15298596 ] Chris Nauroth commented on HDFS-10430: -- It's not immediately clear to me why another project's tests

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-05-24 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15298565#comment-15298565 ] Colin Patrick McCabe commented on HDFS-10301: - Hi [~redvine], Thanks for your interest in

[jira] [Assigned] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-05-24 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe reassigned HDFS-10301: --- Assignee: Colin Patrick McCabe (was: Vinitha Reddy Gankidi) > BlockReport

[jira] [Commented] (HDFS-10448) CacheManager#checkLimit always assumes a replication factor of 1

2016-05-24 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15298543#comment-15298543 ] Colin Patrick McCabe commented on HDFS-10448: - I think it should change {{computeNeeded}} to

[jira] [Commented] (HDFS-9782) RollingFileSystemSink should have configurable roll interval

2016-05-24 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15298504#comment-15298504 ] Karthik Kambatla commented on HDFS-9782: Thanks for the updates, [~templedf]. +1, checking this in.

[jira] [Commented] (HDFS-10370) Allow DataNode to be started with numactl

2016-05-24 Thread Dave Marion (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15298453#comment-15298453 ] Dave Marion commented on HDFS-10370: bq. Could you please update the patch? I'll try to get to it

[jira] [Commented] (HDFS-8678) Bring back the feature to view chunks of files in the HDFS file browser

2016-05-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15298396#comment-15298396 ] Hadoop QA commented on HDFS-8678: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-8678) Bring back the feature to view chunks of files in the HDFS file browser

2016-05-24 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated HDFS-8678: --- Attachment: HDFS-8678.02.patch Here's a new patch which simplifies the alignment of the links > Bring

[jira] [Commented] (HDFS-9782) RollingFileSystemSink should have configurable roll interval

2016-05-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15298384#comment-15298384 ] Hadoop QA commented on HDFS-9782: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10434) Fix intermittent test failure of TestDataNodeErasureCodingMetrics

2016-05-24 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15298369#comment-15298369 ] Rakesh R commented on HDFS-10434: - Thanks [~libo-intel]. [~drankye] please a look at this when you get a

[jira] [Commented] (HDFS-9877) HDFS Namenode UI: Fix browsing directories that need to be encoded

2016-05-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15298364#comment-15298364 ] Hadoop QA commented on HDFS-9877: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9877) HDFS Namenode UI: Fix browsing directories that need to be encoded

2016-05-24 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated HDFS-9877: --- Target Version/s: (was: 2.8.0) Status: Patch Available (was: Open) > HDFS Namenode

[jira] [Commented] (HDFS-10217) show "blockScheduled count" in datanodes table.

2016-05-24 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15298335#comment-15298335 ] Ravi Prakash commented on HDFS-10217: - I'm fine with exposing the information as a tooltip. > show

[jira] [Commented] (HDFS-9833) Erasure coding: recomputing block checksum on the fly by reconstructing the missed/corrupt block data

2016-05-24 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15298307#comment-15298307 ] Kai Zheng commented on HDFS-9833: - Thanks Rakesh for the update on this. I will take a careful review

[jira] [Commented] (HDFS-10430) Refactor FileSystem#checkAccessPermissions for better reuse from tests

2016-05-24 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15298287#comment-15298287 ] Andras Bokor commented on HDFS-10430: - cc: [~cnauroth]. He added this method. He may be able to share

[jira] [Commented] (HDFS-10384) MiniDFSCluster doesnt support multiple HTTPS server instances

2016-05-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15298280#comment-15298280 ] Hadoop QA commented on HDFS-10384: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10385) LocalFileSystem rename() function should return false when destination file exists

2016-05-24 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15298267#comment-15298267 ] Andras Bokor commented on HDFS-10385: - Who can/should resolve this? [~cnauroth], I have a similar

[jira] [Updated] (HDFS-9782) RollingFileSystemSink should have configurable roll interval

2016-05-24 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-9782: --- Attachment: (was: HDFS-9782.009.patch) > RollingFileSystemSink should have configurable

[jira] [Updated] (HDFS-9782) RollingFileSystemSink should have configurable roll interval

2016-05-24 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-9782: --- Attachment: HDFS-9782.009.patch > RollingFileSystemSink should have configurable roll interval

[jira] [Commented] (HDFS-9833) Erasure coding: recomputing block checksum on the fly by reconstructing the missed/corrupt block data

2016-05-24 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15298145#comment-15298145 ] Rakesh R commented on HDFS-9833: Hi, [~drankye], [~umamaheswararao] would be great to see feedback on the

[jira] [Commented] (HDFS-10217) show "blockScheduled count" in datanodes table.

2016-05-24 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15298139#comment-15298139 ] Vinayakumar B commented on HDFS-10217: -- Tooltip patch looks good. +1 [~raviprak], Can you also take a

[jira] [Created] (HDFS-10454) libhdfspp: Move NameNodeOp to a separate file

2016-05-24 Thread Anatoli Shein (JIRA)
Anatoli Shein created HDFS-10454: Summary: libhdfspp: Move NameNodeOp to a separate file Key: HDFS-10454 URL: https://issues.apache.org/jira/browse/HDFS-10454 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-9833) Erasure coding: recomputing block checksum on the fly by reconstructing the missed/corrupt block data

2016-05-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15298102#comment-15298102 ] Hadoop QA commented on HDFS-9833: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10256) Use GenericTestUtils.getTestDir method in tests for temporary directories

2016-05-24 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15298090#comment-15298090 ] Vinayakumar B commented on HDFS-10256: -- Pushed below changes to the latest PR along with rebase

[jira] [Commented] (HDFS-9833) Erasure coding: recomputing block checksum on the fly by reconstructing the missed/corrupt block data

2016-05-24 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15298047#comment-15298047 ] Rakesh R commented on HDFS-9833: I'm attaching new patch. Here I corrected the reconstruction of missing

[jira] [Updated] (HDFS-9833) Erasure coding: recomputing block checksum on the fly by reconstructing the missed/corrupt block data

2016-05-24 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-9833: --- Attachment: HDFS-9833-04.patch > Erasure coding: recomputing block checksum on the fly by reconstructing the

[jira] [Updated] (HDFS-10367) TestDFSShell.testMoveWithTargetPortEmpty fails with Address bind exception.

2016-05-24 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-10367: Attachment: HDFS-10367-004.patch Uploaded the patch to fix the checkstyle comment.

[jira] [Commented] (HDFS-10367) TestDFSShell.testMoveWithTargetPortEmpty fails with Address bind exception.

2016-05-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297920#comment-15297920 ] Hadoop QA commented on HDFS-10367: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9833) Erasure coding: recomputing block checksum on the fly by reconstructing the missed/corrupt block data

2016-05-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297903#comment-15297903 ] Hadoop QA commented on HDFS-9833: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9833) Erasure coding: recomputing block checksum on the fly by reconstructing the missed/corrupt block data

2016-05-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297887#comment-15297887 ] Hadoop QA commented on HDFS-9833: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-8057) Move BlockReader implementation to the client implementation package

2016-05-24 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15297867#comment-15297867 ] Takanobu Asanuma commented on HDFS-8057: The failed test,

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-05-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Status: Patch Available (was: Open) > ReplicationMonitor thread could stuck for long time due to the

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-05-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Status: Open (was: Patch Available) > ReplicationMonitor thread could stuck for long time due to the

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-05-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Attachment: (was: HDFS-10453.patch) > ReplicationMonitor thread could stuck for long time due to

  1   2   >