[jira] [Created] (HDFS-10883) `getTrashRoot`'s behavior is not consistent in DFS after enabling EZ.

2016-09-20 Thread Yuanbo Liu (JIRA)
Yuanbo Liu created HDFS-10883: - Summary: `getTrashRoot`'s behavior is not consistent in DFS after enabling EZ. Key: HDFS-10883 URL: https://issues.apache.org/jira/browse/HDFS-10883 Project: Hadoop HDFS

[jira] [Commented] (HDFS-10882) Federation State Store Interface API

2016-09-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508793#comment-15508793 ] Hadoop QA commented on HDFS-10882: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Resolved] (HDFS-9333) Some tests using MiniDFSCluster errored complaining port in use

2016-09-20 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-9333. --- Resolution: Fixed Fix Version/s: 3.0.0-alpha2 2.8.0 Resolving since it looks

[jira] [Commented] (HDFS-10881) Federation State Store Driver API

2016-09-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508686#comment-15508686 ] Hadoop QA commented on HDFS-10881: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10630) Federation State Store

2016-09-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508623#comment-15508623 ] Hadoop QA commented on HDFS-10630: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10882) Federation State Store Interface API

2016-09-20 Thread Jason Kace (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Kace updated HDFS-10882: -- Assignee: Jason Kace Status: Patch Available (was: Open) > Federation State Store Interface API

[jira] [Updated] (HDFS-10882) Federation State Store Interface API

2016-09-20 Thread Jason Kace (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Kace updated HDFS-10882: -- Attachment: HDFS-10882-HDFS-10467-001.patch Attaching the first patch version. This patch contains:

[jira] [Commented] (HDFS-10631) Federation State Store ZooKeeper implementation

2016-09-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508531#comment-15508531 ] Hadoop QA commented on HDFS-10631: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10881) Federation State Store Driver API

2016-09-20 Thread Jason Kace (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Kace updated HDFS-10881: -- Assignee: Jason Kace Status: Patch Available (was: Open) > Federation State Store Driver API >

[jira] [Updated] (HDFS-10881) Federation State Store Driver API

2016-09-20 Thread Jason Kace (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Kace updated HDFS-10881: -- Attachment: HDFS-10881-HDFS-10467-001.patch First version of the state store driver API patch. This

[jira] [Updated] (HDFS-9333) Some tests using MiniDFSCluster errored complaining port in use

2016-09-20 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9333: --- Status: In Progress (was: Patch Available) > Some tests using MiniDFSCluster errored

[jira] [Updated] (HDFS-10630) Federation State Store

2016-09-20 Thread Jason Kace (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Kace updated HDFS-10630: -- Attachment: HDFS-10630-HDFS-10467-003.patch Updating patch: 1) Findbugs errors that are relevant (not

[jira] [Commented] (HDFS-9333) Some tests using MiniDFSCluster errored complaining port in use

2016-09-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508420#comment-15508420 ] Hudson commented on HDFS-9333: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10471 (See

[jira] [Created] (HDFS-10882) Federation State Store Interface API

2016-09-20 Thread Jason Kace (JIRA)
Jason Kace created HDFS-10882: - Summary: Federation State Store Interface API Key: HDFS-10882 URL: https://issues.apache.org/jira/browse/HDFS-10882 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-10881) Federation State Store Driver API

2016-09-20 Thread Jason Kace (JIRA)
Jason Kace created HDFS-10881: - Summary: Federation State Store Driver API Key: HDFS-10881 URL: https://issues.apache.org/jira/browse/HDFS-10881 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-10861) Refactor StripeReaders and use ECChunk version decode API

2016-09-20 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508390#comment-15508390 ] SammiChen commented on HDFS-10861: -- Thanks Kai for take time review the patch and commit it! > Refactor

[jira] [Commented] (HDFS-10757) KMSClientProvider combined with KeyProviderCache can result in wrong UGI being used

2016-09-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508343#comment-15508343 ] Hadoop QA commented on HDFS-10757: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10687) Federation Membership State Store internal APIs

2016-09-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508341#comment-15508341 ] Hadoop QA commented on HDFS-10687: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10631) Federation State Store ZooKeeper implementation

2016-09-20 Thread Jason Kace (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Kace updated HDFS-10631: -- Assignee: Jason Kace Status: Patch Available (was: Open) > Federation State Store ZooKeeper

[jira] [Updated] (HDFS-10631) Federation State Store ZooKeeper implementation

2016-09-20 Thread Jason Kace (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Kace updated HDFS-10631: -- Attachment: HDFS-10631-HDFS-10467-001.patch Attaching first patch for the ZK state store backend. I

[jira] [Commented] (HDFS-10879) TestEncryptionZonesWithKMS#testReadWrite fails intermittently

2016-09-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508312#comment-15508312 ] Hudson commented on HDFS-10879: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10470 (See

[jira] [Updated] (HDFS-10879) TestEncryptionZonesWithKMS#testReadWrite fails intermittently

2016-09-20 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10879: - Summary: TestEncryptionZonesWithKMS#testReadWrite fails intermittently (was:

[jira] [Commented] (HDFS-10630) Federation State Store

2016-09-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508189#comment-15508189 ] Hadoop QA commented on HDFS-10630: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10879) TestEncryptionZonesWithKMS#testReadWrite fails intermitently

2016-09-20 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10879: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2 2.8.0

[jira] [Commented] (HDFS-10314) A new tool to sync current HDFS view to specified snapshot

2016-09-20 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508167#comment-15508167 ] Yongjun Zhang commented on HDFS-10314: -- Many thanks [~jingzhao] for the review and feedback. Please

[jira] [Commented] (HDFS-10800) [SPS]: Storage Policy Satisfier daemon thread in Namenode to find the blocks which were placed in other storages than what NN is expecting.

2016-09-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508168#comment-15508168 ] Hadoop QA commented on HDFS-10800: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-10824) MiniDFSCluster#storageCapacities has no effects on real capacity

2016-09-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508145#comment-15508145 ] Hadoop QA commented on HDFS-10824: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-7530) Allow renaming of encryption zone roots

2016-09-20 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated HDFS-7530: --- Target Version/s: 2.7.0, 2.6.5 (was: 2.7.0) Adding 2.6.5 to the target versions. We are looking to

[jira] [Updated] (HDFS-10757) KMSClientProvider combined with KeyProviderCache can result in wrong UGI being used

2016-09-20 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-10757: -- Attachment: (was: HADOOP-10757.02.patch) > KMSClientProvider combined with KeyProviderCache can

[jira] [Updated] (HDFS-10757) KMSClientProvider combined with KeyProviderCache can result in wrong UGI being used

2016-09-20 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-10757: -- Attachment: HDFS-10757.02.patch > KMSClientProvider combined with KeyProviderCache can result in wrong

[jira] [Commented] (HDFS-10879) TestEncryptionZonesWithKMS#testReadWrite fails intermitently

2016-09-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508137#comment-15508137 ] Hadoop QA commented on HDFS-10879: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-10757) KMSClientProvider combined with KeyProviderCache can result in wrong UGI being used

2016-09-20 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-10757: -- Attachment: HADOOP-10757.02.patch Thanks [~xiaochen] for the review. Attached a new patch to address

[jira] [Updated] (HDFS-10687) Federation Membership State Store internal APIs

2016-09-20 Thread Jason Kace (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Kace updated HDFS-10687: -- Status: Patch Available (was: Open) > Federation Membership State Store internal APIs >

[jira] [Updated] (HDFS-10687) Federation Membership State Store internal APIs

2016-09-20 Thread Jason Kace (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Kace updated HDFS-10687: -- Attachment: HDFS-10467-HDFS-10687-001.patch Attaching first patch version for review. This patch

[jira] [Created] (HDFS-10880) Federation Mount Table State Store internal API

2016-09-20 Thread Jason Kace (JIRA)
Jason Kace created HDFS-10880: - Summary: Federation Mount Table State Store internal API Key: HDFS-10880 URL: https://issues.apache.org/jira/browse/HDFS-10880 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-10877) Make RemoteEditLogManifest.committedTxnId optional in Protocol Buffers

2016-09-20 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508101#comment-15508101 ] Andrew Wang commented on HDFS-10877: Thanks for working on this Sean! Patch LGTM, though we should fix

[jira] [Commented] (HDFS-7878) API - expose an unique file identifier

2016-09-20 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508091#comment-15508091 ] Chris Douglas commented on HDFS-7878: - bq. Any changes to FileStatus has to be done so that external

[jira] [Commented] (HDFS-10879) TestEncryptionZonesWithKMS#testReadWrite fails intermitently

2016-09-20 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507967#comment-15507967 ] Andrew Wang commented on HDFS-10879: +1 LGTM, and yea definitely similar to that previous one we

[jira] [Updated] (HDFS-10630) Federation State Store

2016-09-20 Thread Jason Kace (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Kace updated HDFS-10630: -- Status: Patch Available (was: In Progress) First version of Federation State Store base code is ready

[jira] [Updated] (HDFS-10630) Federation State Store

2016-09-20 Thread Jason Kace (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Kace updated HDFS-10630: -- Attachment: HDFS-10630.002.patch Updating HDFS Federation state store patch. 1) Renaming elements to

[jira] [Commented] (HDFS-10879) TestEncryptionZonesWithKMS#testReadWrite fails intermitently

2016-09-20 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507849#comment-15507849 ] Xiao Chen commented on HDFS-10879: -- In my test run, it failed 2/300 before the patch and 0/300 after.

[jira] [Commented] (HDFS-10878) TestDFSClientRetries#testIdempotentAllocateBlockAndClose throws ConcurrentModificationException

2016-09-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507843#comment-15507843 ] Hadoop QA commented on HDFS-10878: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10879) TestEncryptionZonesWithKMS#testReadWrite fails intermitently

2016-09-20 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10879: - Status: Patch Available (was: Open) > TestEncryptionZonesWithKMS#testReadWrite fails intermitently >

[jira] [Updated] (HDFS-10879) TestEncryptionZonesWithKMS#testReadWrite fails intermitently

2016-09-20 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10879: - Labels: test (was: ) > TestEncryptionZonesWithKMS#testReadWrite fails intermitently >

[jira] [Updated] (HDFS-10879) TestEncryptionZonesWithKMS#testReadWrite fails intermitently

2016-09-20 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10879: - Attachment: HDFS-10879.01.patch This is stack trace reminds me of HADOOP-12699. The conclusion there was

[jira] [Commented] (HDFS-9688) Test the effect of nested encryption zones in HDFS downgrade

2016-09-20 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507817#comment-15507817 ] Chris Trezzo commented on HDFS-9688: Thanks for the pointer to HDFS-7530 [~xyao]! > Test the effect of

[jira] [Created] (HDFS-10879) TestEncryptionZonesWithKMS#testReadWrite fails intermitently

2016-09-20 Thread Xiao Chen (JIRA)
Xiao Chen created HDFS-10879: Summary: TestEncryptionZonesWithKMS#testReadWrite fails intermitently Key: HDFS-10879 URL: https://issues.apache.org/jira/browse/HDFS-10879 Project: Hadoop HDFS

[jira] [Updated] (HDFS-10800) [SPS]: Storage Policy Satisfier daemon thread in Namenode to find the blocks which were placed in other storages than what NN is expecting.

2016-09-20 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-10800: --- Attachment: HDFS-10800-HDFS-10285-03.patch Thank you [~rakeshr] for the review. I

[jira] [Work started] (HDFS-10872) Add MutableRate metrics for FSNamesystemLock operations

2016-09-20 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-10872 started by Erik Krogen. -- > Add MutableRate metrics for FSNamesystemLock operations >

[jira] [Commented] (HDFS-10314) A new tool to sync current HDFS view to specified snapshot

2016-09-20 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507688#comment-15507688 ] Jing Zhao commented on HDFS-10314: -- So the current patch actually adds a new distsync extension and

[jira] [Commented] (HDFS-9688) Test the effect of nested encryption zones in HDFS downgrade

2016-09-20 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507691#comment-15507691 ] Xiaoyu Yao commented on HDFS-9688: -- [~ctrezzo], move the the root of encryption zone is allowed from

[jira] [Commented] (HDFS-10877) Make RemoteEditLogManifest.committedTxnId optional in Protocol Buffers

2016-09-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507680#comment-15507680 ] Hadoop QA commented on HDFS-10877: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10824) MiniDFSCluster#storageCapacities has no effects on real capacity

2016-09-20 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507671#comment-15507671 ] Xiaobing Zhou commented on HDFS-10824: -- Posted v004. Waiting for data node fully started is correct

[jira] [Updated] (HDFS-10824) MiniDFSCluster#storageCapacities has no effects on real capacity

2016-09-20 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10824: - Attachment: HDFS-10824.004.patch > MiniDFSCluster#storageCapacities has no effects on real

[jira] [Commented] (HDFS-6984) In Hadoop 3, make FileStatus serialize itself via protobuf

2016-09-20 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507650#comment-15507650 ] Steve Loughran commented on HDFS-6984: -- FWIW, I'd like FileStatus in Hadoop 2 to implement

[jira] [Commented] (HDFS-10876) Dispatcher#dispatch should log IOException stacktrace

2016-09-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507649#comment-15507649 ] Hadoop QA commented on HDFS-10876: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-7878) API - expose an unique file identifier

2016-09-20 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507647#comment-15507647 ] Steve Loughran commented on HDFS-7878: -- hmmm. * S3a adds an {{S3AFileStatus}} with a new field

[jira] [Comment Edited] (HDFS-9688) Test the effect of nested encryption zones in HDFS downgrade

2016-09-20 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507419#comment-15507419 ] Chris Trezzo edited comment on HDFS-9688 at 9/20/16 7:56 PM: - Hi [~zhz]

[jira] [Commented] (HDFS-9333) Some tests using MiniDFSCluster errored complaining port in use

2016-09-20 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507620#comment-15507620 ] Andrew Wang commented on HDFS-9333: --- LGTM +1, test failures look unrelated. Thanks for the working on

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-09-20 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507610#comment-15507610 ] Konstantin Shvachko commented on HDFS-10301: Besides, what is the last report? Reports can

[jira] [Updated] (HDFS-10878) TestDFSClientRetries#testIdempotentAllocateBlockAndClose throws ConcurrentModificationException

2016-09-20 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-10878: -- Attachment: HDFS-10878.patch Here is a simple patch which removes the invocation arguments from

[jira] [Updated] (HDFS-10878) TestDFSClientRetries#testIdempotentAllocateBlockAndClose throws ConcurrentModificationException

2016-09-20 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-10878: -- Status: Patch Available (was: Open) > TestDFSClientRetries#testIdempotentAllocateBlockAndClose

[jira] [Commented] (HDFS-10876) Dispatcher#dispatch should log IOException stacktrace

2016-09-20 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507539#comment-15507539 ] Wei-Chiu Chuang commented on HDFS-10876: INFO may be fine. However, I am seeing an IOE in balancer

[jira] [Commented] (HDFS-10876) Dispatcher#dispatch should log IOException stacktrace

2016-09-20 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507476#comment-15507476 ] Manoj Govindassamy commented on HDFS-10876: --- Thanks for the review. Exception is because of the

[jira] [Commented] (HDFS-10876) Dispatcher#dispatch should log IOException stacktrace

2016-09-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507436#comment-15507436 ] Mingliang Liu commented on HDFS-10876: -- I'm also thinking of logging the exception stack trace in

[jira] [Updated] (HDFS-10877) Make RemoteEditLogManifest.committedTxnId optional in Protocol Buffers

2016-09-20 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10877: --- Component/s: qjm > Make RemoteEditLogManifest.committedTxnId optional in Protocol Buffers >

[jira] [Commented] (HDFS-10876) Dispatcher#dispatch should log IOException stacktrace

2016-09-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507431#comment-15507431 ] Mingliang Liu commented on HDFS-10876: -- +1 pending on Jenkins. > Dispatcher#dispatch should log

[jira] [Commented] (HDFS-9688) Test the effect of nested encryption zones in HDFS downgrade

2016-09-20 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507419#comment-15507419 ] Chris Trezzo commented on HDFS-9688: Hi [~zhz] [~andrew.wang].

[jira] [Updated] (HDFS-10877) Make RemoteEditLogManifest.committedTxnId optional in Protocol Buffers

2016-09-20 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10877: --- Affects Version/s: 3.0.0-alpha1 Target Version/s: 3.0.0-alpha2 Status: Patch

[jira] [Updated] (HDFS-10876) Dispatcher#dispatch should log IOException stacktrace

2016-09-20 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-10876: -- Target Version/s: 3.0.0-alpha2 Status: Patch Available (was: Open) >

[jira] [Updated] (HDFS-10876) Dispatcher#dispatch should log IOException stacktrace

2016-09-20 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-10876: -- Attachment: HDFS-10876.001.patch Attached v01 patch to log the exception stacktrace in

[jira] [Updated] (HDFS-10877) Make RemoteEditLogManifest.committedTxnId optional in Protocol Buffers

2016-09-20 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory updated HDFS-10877: - Attachment: HDFS-10877.001.patch Attaching a patch that modifies the .proto definition and the

[jira] [Updated] (HDFS-10878) TestDFSClientRetries#testIdempotentAllocateBlockAndClose throws ConcurrentModificationException

2016-09-20 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-10878: -- Summary: TestDFSClientRetries#testIdempotentAllocateBlockAndClose throws

[jira] [Updated] (HDFS-10878) TestDFSClientRetries#testIdempotentAllocateBlockAndClose throws ConcurrentModificationException

2016-09-20 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-10878: -- Description: This failed in our internal build {noformat}

[jira] [Created] (HDFS-10878) TestDFSClientRetries#testIdempotentAllocateBlockAndClose throwing ConcurrentModificationException

2016-09-20 Thread Rushabh S Shah (JIRA)
Rushabh S Shah created HDFS-10878: - Summary: TestDFSClientRetries#testIdempotentAllocateBlockAndClose throwing ConcurrentModificationException Key: HDFS-10878 URL: https://issues.apache.org/jira/browse/HDFS-10878

[jira] [Assigned] (HDFS-10876) Dispatcher#dispatch should log IOException stacktrace

2016-09-20 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy reassigned HDFS-10876: - Assignee: Manoj Govindassamy > Dispatcher#dispatch should log IOException

[jira] [Commented] (HDFS-10870) Wrong dfs.namenode.acls.enabled default in HdfsPermissionsGuide.apt.vm

2016-09-20 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507283#comment-15507283 ] John Zhuge commented on HDFS-10870: --- Thanks [~eddyxu] for the review and commit! Thanks [~raviprak],

[jira] [Moved] (HDFS-10877) Make RemoteEditLogManifest.committedTxnId optional in Protocol Buffers

2016-09-20 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory moved HADOOP-13629 to HDFS-10877: --- Issue Type: Improvement (was: Bug) Key: HDFS-10877 (was:

[jira] [Issue Comment Deleted] (HDFS-10870) Wrong dfs.namenode.acls.enabled default in HdfsPermissionsGuide.apt.vm

2016-09-20 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated HDFS-10870: Comment: was deleted (was: Would this not be a backward incompatible change?) > Wrong

[jira] [Commented] (HDFS-10870) Wrong dfs.namenode.acls.enabled default in HdfsPermissionsGuide.apt.vm

2016-09-20 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507175#comment-15507175 ] Ravi Prakash commented on HDFS-10870: - Sorry. Never mind. This is just a change in the doc. Thanks

[jira] [Commented] (HDFS-10870) Wrong dfs.namenode.acls.enabled default in HdfsPermissionsGuide.apt.vm

2016-09-20 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507172#comment-15507172 ] Ravi Prakash commented on HDFS-10870: - Would this not be a backward incompatible change? > Wrong

[jira] [Commented] (HDFS-10426) TestPendingInvalidateBlock failed in trunk

2016-09-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507013#comment-15507013 ] Hadoop QA commented on HDFS-10426: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-10876) Dispatcher#dispatch should log IOException stacktrace

2016-09-20 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-10876: -- Summary: Dispatcher#dispatch should log IOException stacktrace Key: HDFS-10876 URL: https://issues.apache.org/jira/browse/HDFS-10876 Project: Hadoop HDFS

[jira] [Commented] (HDFS-10874) libhdfs++: Public API headers should not depend on internal implementation

2016-09-20 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15506847#comment-15506847 ] Bob Hansen commented on HDFS-10874: --- Perhaps as another task, we should ensure that the tools and

[jira] [Updated] (HDFS-10426) TestPendingInvalidateBlock failed in trunk

2016-09-20 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-10426: - Attachment: HDFS-10426.006.patch > TestPendingInvalidateBlock failed in trunk >

[jira] [Commented] (HDFS-10426) TestPendingInvalidateBlock failed in trunk

2016-09-20 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15506656#comment-15506656 ] Yiqun Lin commented on HDFS-10426: -- Thanks [~iwasakims] for the comments, attach a new patch to address

[jira] [Commented] (HDFS-10861) Refactor StripeReaders and use ECChunk version decode API

2016-09-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15506620#comment-15506620 ] Hudson commented on HDFS-10861: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10465 (See

[jira] [Updated] (HDFS-10861) Refactor StripeReaders and use ECChunk version decode API

2016-09-20 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-10861: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2 Status:

[jira] [Commented] (HDFS-10861) Refactor StripeReaders and use ECChunk version decode API

2016-09-20 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15506548#comment-15506548 ] Kai Zheng commented on HDFS-10861: -- Thanks [~Sammi] for the update! The latest patch LGTM now. +1 and

[jira] [Updated] (HDFS-10869) Unused method checkId() in InodeId.java file

2016-09-20 Thread Jagadesh Kiran N (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jagadesh Kiran N updated HDFS-10869: Issue Type: Improvement (was: Bug) > Unused method checkId() in InodeId.java file >

[jira] [Commented] (HDFS-9668) Optimize the locking in FsDatasetImpl

2016-09-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15506007#comment-15506007 ] Hadoop QA commented on HDFS-9668: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10745) Directly resolve paths into INodesInPath

2016-09-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15505988#comment-15505988 ] Hadoop QA commented on HDFS-10745: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10861) Refactor StripeReaders and use ECChunk version decode API

2016-09-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15505975#comment-15505975 ] Hadoop QA commented on HDFS-10861: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10861) Refactor StripeReaders and use ECChunk version decode API

2016-09-20 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15505957#comment-15505957 ] SammiChen commented on HDFS-10861: -- Hadoop QA run the test with the old v5 patch > Refactor

[jira] [Updated] (HDFS-10861) Refactor StripeReaders and use ECChunk version decode API

2016-09-20 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-10861: - Attachment: HDFS-10861-v6.patch Resubmit patch v6 to trigger Hadoop QA run the test against v6 >

[jira] [Updated] (HDFS-10861) Refactor StripeReaders and use ECChunk version decode API

2016-09-20 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-10861: - Attachment: (was: HDFS-10861-v6.patch) > Refactor StripeReaders and use ECChunk version decode API >

[jira] [Commented] (HDFS-10861) Refactor StripeReaders and use ECChunk version decode API

2016-09-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15505937#comment-15505937 ] Hadoop QA commented on HDFS-10861: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10863) hadoop superusergroup supergroup issue

2016-09-20 Thread Yulei Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15505776#comment-15505776 ] Yulei Li commented on HDFS-10863: - According to your setup, I found my linux user matched hdfs:

[jira] [Updated] (HDFS-9668) Optimize the locking in FsDatasetImpl

2016-09-20 Thread Jingcheng Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingcheng Du updated HDFS-9668: --- Attachment: HDFS-9668-12.patch Upload a new patch V12 to fix the checkstyle warnings. Again, the

[jira] [Commented] (HDFS-9668) Optimize the locking in FsDatasetImpl

2016-09-20 Thread Jingcheng Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15505725#comment-15505725 ] Jingcheng Du commented on HDFS-9668: Checked the logs of the failed unit tests, the failures should not

  1   2   >