[jira] [Updated] (HDFS-12733) Option to disable to namenode local edits

2018-01-08 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-12733: Attachment: HDFS-12733-003.patch Missed {{hdfs-deault.xml}} in v2..Uploading the

[jira] [Updated] (HDFS-9049) Make Datanode Netty reverse proxy port to be configurable

2018-01-08 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-9049: Attachment: HDFS-9049-04.patch Thanks [~brahmareddy] for the review and suggestion. I have changed

[jira] [Updated] (HDFS-12935) Get ambiguous result for DFSAdmin command in HA mode when only one namenode is up

2018-01-08 Thread Jianfei Jiang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jianfei Jiang updated HDFS-12935: - Status: In Progress (was: Patch Available) > Get ambiguous result for DFSAdmin command in HA

[jira] [Updated] (HDFS-12986) Ozone: Update ozone to latest ratis snapshot build (0.1.1-alpha-00f80b4-SNAPSHOT)

2018-01-08 Thread Lokesh Jain (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lokesh Jain updated HDFS-12986: --- Attachment: HDFS-12986-HDFS-7240.004.patch [~szetszwo] thanks for posting the fix! I have included it

[jira] [Commented] (HDFS-12985) NameNode crashes during restart after an OpenForWrite file present in the Snapshot got deleted

2018-01-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16317368#comment-16317368 ] Hudson commented on HDFS-12985: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13462 (See

[jira] [Updated] (HDFS-12985) NameNode crashes during restart after an OpenForWrite file present in the Snapshot got deleted

2018-01-08 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-12985: -- Resolution: Fixed Fix Version/s: 2.10.0 3.1.0

[jira] [Commented] (HDFS-12792) RBF: Test Router-based federation using HDFSContract

2018-01-08 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16317426#comment-16317426 ] Wei Yan commented on HDFS-12792: +1 on the latest patch. [~elgoiri] could u double-check the

[jira] [Updated] (HDFS-12829) Moving logging APIs over to slf4j in hdfs

2018-01-08 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12829: -- Issue Type: Improvement (was: Bug) > Moving logging APIs over to slf4j in hdfs >

[jira] [Updated] (HDFS-12994) TestReconstructStripedFile.testNNSendsErasureCodingTasks fails due to socket timeout

2018-01-08 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-12994: - Attachment: HDFS-12994.01.patch fix javac warnings. >

[jira] [Commented] (HDFS-12802) RBF: Control MountTableResolver cache size

2018-01-08 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16317700#comment-16317700 ] genericqa commented on HDFS-12802: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12945) Switch to ClientProtocol instead of NamenodeProtocols in NamenodeWebHdfsMethods

2018-01-08 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated HDFS-12945: --- Resolution: Fixed Fix Version/s: 3.0.1 2.9.1 2.10.0

[jira] [Updated] (HDFS-12808) Add LOG.isDebugEnabled() guard for LOG.debug("...")

2018-01-08 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12808: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.1.0 Status: Resolved

[jira] [Commented] (HDFS-12808) Add LOG.isDebugEnabled() guard for LOG.debug("...")

2018-01-08 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16317600#comment-16317600 ] Bharat Viswanadham commented on HDFS-12808: --- [~goiri] Thanks for review and committing the

[jira] [Updated] (HDFS-12997) Move logging to slf4j in BlockPoolSliceStorage and Storage

2018-01-08 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-12997: -- Summary: Move logging to slf4j in BlockPoolSliceStorage and Storage (was: Moving logging to slf4j in

[jira] [Updated] (HDFS-12997) Move logging to slf4j in BlockPoolSliceStorage and Storage

2018-01-08 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-12997: -- Description: Move logging to slf4j in BlockPoolSliceStorage and Storage classes. (was: Moving logging

[jira] [Commented] (HDFS-12990) Change default NameNode RPC port back to 8020

2018-01-08 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16317507#comment-16317507 ] Aaron T. Myers commented on HDFS-12990: --- bq. No incompatible changes are allowed between 3.0.0 and

[jira] [Commented] (HDFS-12808) Add LOG.isDebugEnabled() guard for LOG.debug("...")

2018-01-08 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16317526#comment-16317526 ] Íñigo Goiri commented on HDFS-12808: Thanks [~bharatviswa], committing to trunk, let me know if you

[jira] [Commented] (HDFS-12994) TestReconstructStripedFile.testNNSendsErasureCodingTasks fails due to socket timeout

2018-01-08 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16317533#comment-16317533 ] genericqa commented on HDFS-12994: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12964) Read a opened file timely and effectively when it's being written by other

2018-01-08 Thread Yang Yun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16317619#comment-16317619 ] Yang Yun commented on HDFS-12964: - Yes, the pollnewData() has same function, with it user can make the

[jira] [Commented] (HDFS-12986) Ozone: Update ozone to latest ratis snapshot build (0.1.1-alpha-00f80b4-SNAPSHOT)

2018-01-08 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16317884#comment-16317884 ] Tsz Wo Nicholas Sze commented on HDFS-12986: > ... However I can see shadedclient failures

[jira] [Updated] (HDFS-12935) Get ambiguous result for DFSAdmin command in HA mode when only one namenode is up

2018-01-08 Thread Jianfei Jiang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jianfei Jiang updated HDFS-12935: - Status: Patch Available (was: In Progress) > Get ambiguous result for DFSAdmin command in HA

[jira] [Commented] (HDFS-12935) Get ambiguous result for DFSAdmin command in HA mode when only one namenode is up

2018-01-08 Thread Jianfei Jiang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16317933#comment-16317933 ] Jianfei Jiang commented on HDFS-12935: -- Thanks [~brahmareddy] for your suggestions. *

[jira] [Created] (HDFS-12999) When reach the end of the block group, it may not need to flush all the data packets(flushAllInternals) twice.

2018-01-08 Thread lufei (JIRA)
lufei created HDFS-12999: Summary: When reach the end of the block group, it may not need to flush all the data packets(flushAllInternals) twice. Key: HDFS-12999 URL: https://issues.apache.org/jira/browse/HDFS-12999

[jira] [Updated] (HDFS-12935) Get ambiguous result for DFSAdmin command in HA mode when only one namenode is up

2018-01-08 Thread Jianfei Jiang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jianfei Jiang updated HDFS-12935: - Attachment: HDFS-12935.005.patch > Get ambiguous result for DFSAdmin command in HA mode when only

[jira] [Comment Edited] (HDFS-12935) Get ambiguous result for DFSAdmin command in HA mode when only one namenode is up

2018-01-08 Thread Jianfei Jiang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16317933#comment-16317933 ] Jianfei Jiang edited comment on HDFS-12935 at 1/9/18 7:49 AM: -- Thanks

[jira] [Commented] (HDFS-12919) RBF: Support erasure coding methods in RouterRpcServer

2018-01-08 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16317904#comment-16317904 ] genericqa commented on HDFS-12919: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12919) RBF: Support erasure coding methods in RouterRpcServer

2018-01-08 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16317392#comment-16317392 ] genericqa commented on HDFS-12919: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12919) RBF: Support erasure coding methods in RouterRpcServer

2018-01-08 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16317622#comment-16317622 ] genericqa commented on HDFS-12919: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-12998) SnapshotDiff - Provide an iterator-based listing API for calculating snapshotDiff

2018-01-08 Thread Shashikant Banerjee (JIRA)
Shashikant Banerjee created HDFS-12998: -- Summary: SnapshotDiff - Provide an iterator-based listing API for calculating snapshotDiff Key: HDFS-12998 URL: https://issues.apache.org/jira/browse/HDFS-12998

[jira] [Commented] (HDFS-12997) Moving logging to slf4j in BlockPoolSliceStorage and Storage

2018-01-08 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16317463#comment-16317463 ] Bharat Viswanadham commented on HDFS-12997: --- Hi [~ajayydv] I have converted this to sub-task of

[jira] [Updated] (HDFS-12919) RBF: Support erasure coding methods in RouterRpcServer

2018-01-08 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12919: --- Attachment: HDFS-12919.013.patch > RBF: Support erasure coding methods in RouterRpcServer >

[jira] [Updated] (HDFS-12986) Ozone: Update ozone to latest ratis snapshot build (0.1.1-alpha-00f80b4-SNAPSHOT)

2018-01-08 Thread Lokesh Jain (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lokesh Jain updated HDFS-12986: --- Attachment: HDFS-12986-HDFS-7240.003.patch v3 patch fixes a checkstyle issue. > Ozone: Update ozone

[jira] [Commented] (HDFS-12051) Intern INOdeFileAttributes$SnapshotCopy.name byte[] arrays to save memory

2018-01-08 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16315994#comment-16315994 ] Tsz Wo Nicholas Sze commented on HDFS-12051: > The extra code on itself doesn't noticeably

[jira] [Commented] (HDFS-12982) [SPS]: Reduce the locking and cleanup the Namesystem access

2018-01-08 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16315991#comment-16315991 ] Brahma Reddy Battula commented on HDFS-12982: - +1, LGTM > [SPS]: Reduce the locking and

[jira] [Issue Comment Deleted] (HDFS-12982) [SPS]: Reduce the locking and cleanup the Namesystem access

2018-01-08 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-12982: Comment: was deleted (was: +1, LGTM) > [SPS]: Reduce the locking and cleanup the

[jira] [Commented] (HDFS-12051) Intern INOdeFileAttributes$SnapshotCopy.name byte[] arrays to save memory

2018-01-08 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16315999#comment-16315999 ] Tsz Wo Nicholas Sze commented on HDFS-12051: > I agree. What I meant is that this change

[jira] [Commented] (HDFS-12853) Ozone: Optimize chunk writes for Ratis by avoiding double writes

2018-01-08 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16316006#comment-16316006 ] Tsz Wo Nicholas Sze commented on HDFS-12853: > COMMIT_DATA should be sync'ed with WRITE_DATA

[jira] [Commented] (HDFS-12853) Ozone: Optimize chunk writes for Ratis by avoiding double writes

2018-01-08 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16316034#comment-16316034 ] Tsz Wo Nicholas Sze commented on HDFS-12853: Oops, I found it now. > Ozone: Optimize chunk

[jira] [Commented] (HDFS-12964) Read a opened file timely and effectively when it's being written by other

2018-01-08 Thread Yang Yun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16315926#comment-16315926 ] Yang Yun commented on HDFS-12964: - the DFSSpinInputStream is only useful for special case. It will hang

[jira] [Commented] (HDFS-12986) Ozone: Update ozone to latest ratis snapshot build (0.1.1-alpha-00f80b4-SNAPSHOT)

2018-01-08 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16315928#comment-16315928 ] Mukul Kumar Singh commented on HDFS-12986: -- Thanks for the patch [~ljain], the changes looks good

[jira] [Commented] (HDFS-9049) Make Datanode Netty reverse proxy port to be configurable

2018-01-08 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16315968#comment-16315968 ] genericqa commented on HDFS-9049: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12853) Ozone: Optimize chunk writes for Ratis by avoiding double writes

2018-01-08 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16316022#comment-16316022 ] Mukul Kumar Singh commented on HDFS-12853: -- If we don't have the synchronization mentioned the

[jira] [Commented] (HDFS-12853) Ozone: Optimize chunk writes for Ratis by avoiding double writes

2018-01-08 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16316033#comment-16316033 ] Tsz Wo Nicholas Sze commented on HDFS-12853: writeChunkMap not found in the 002 patch. Wrong

[jira] [Commented] (HDFS-12919) RBF: Support erasure coding methods in RouterRpcServer

2018-01-08 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16315862#comment-16315862 ] genericqa commented on HDFS-12919: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12919) RBF: Support erasure coding methods in RouterRpcServer

2018-01-08 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12919: --- Attachment: HDFS-12919.010.patch > RBF: Support erasure coding methods in RouterRpcServer >

[jira] [Commented] (HDFS-12919) RBF: Support erasure coding methods in RouterRpcServer

2018-01-08 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16316654#comment-16316654 ] genericqa commented on HDFS-12919: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12984) BlockPoolSlice can leak in a mini dfs cluster

2018-01-08 Thread Robert Joseph Evans (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16316626#comment-16316626 ] Robert Joseph Evans commented on HDFS-12984: [~ajayydv], I also ran into issues trying to

[jira] [Commented] (HDFS-12934) RBF: Federation supports global quota

2018-01-08 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16316598#comment-16316598 ] Íñigo Goiri commented on HDFS-12934: Thanks [~linyiqun], I think this is pretty much good to go. A few

[jira] [Commented] (HDFS-12919) RBF: Support erasure coding methods in RouterRpcServer

2018-01-08 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16316643#comment-16316643 ] genericqa commented on HDFS-12919: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12733) Option to disable to namenode local edits

2018-01-08 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16316677#comment-16316677 ] genericqa commented on HDFS-12733: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12993) Add an option to Balancer for excluding the paths

2018-01-08 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16316765#comment-16316765 ] Kihwal Lee commented on HDFS-12993: --- The requirement sounds fine at a high level, but {{getBlocks()}}

[jira] [Comment Edited] (HDFS-12934) RBF: Federation supports global quota

2018-01-08 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16316598#comment-16316598 ] Íñigo Goiri edited comment on HDFS-12934 at 1/8/18 5:11 PM: Thanks

[jira] [Assigned] (HDFS-12975) Changes to the NameNode to support reads from standby

2018-01-08 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun reassigned HDFS-12975: --- Assignee: Chao Sun > Changes to the NameNode to support reads from standby >

[jira] [Commented] (HDFS-12794) Ozone: Parallelize ChunkOutputSream Writes to container

2018-01-08 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16316441#comment-16316441 ] genericqa commented on HDFS-12794: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12990) Change default NameNode RPC port back to 8020

2018-01-08 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16316786#comment-16316786 ] Aaron T. Myers commented on HDFS-12990: --- Hey Nicholas, bq. We should first discuss changing the

[jira] [Updated] (HDFS-11187) Optimize disk access for last partial chunk checksum of Finalized replica

2018-01-08 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11187: --- Attachment: HDFS-11187.003.patch Patch v003 to address all other comments and the findbug

[jira] [Commented] (HDFS-12985) NameNode crashes during restart after an OpenForWrite file present in the Snapshot got deleted

2018-01-08 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16316929#comment-16316929 ] Yongjun Zhang commented on HDFS-12985: -- Thanks for working on this [~manojg]. +1, please correct the

[jira] [Commented] (HDFS-11187) Optimize disk access for last partial chunk checksum of Finalized replica

2018-01-08 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16316936#comment-16316936 ] Wei-Chiu Chuang commented on HDFS-11187: Thanks [~yzhangal] for the throughout review! bq. that

[jira] [Commented] (HDFS-12942) Synchronization issue in FSDataSetImpl#moveBlock

2018-01-08 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16316939#comment-16316939 ] genericqa commented on HDFS-12942: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12919) RBF: Support erasure coding methods in RouterRpcServer

2018-01-08 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16317030#comment-16317030 ] genericqa commented on HDFS-12919: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11187) Optimize disk access for last partial chunk checksum of Finalized replica

2018-01-08 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16317041#comment-16317041 ] genericqa commented on HDFS-11187: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-12994) TestReconstructStripedFile.testNNSendsErasureCodingTasks fails due to socket timeout

2018-01-08 Thread Lei (Eddy) Xu (JIRA)
Lei (Eddy) Xu created HDFS-12994: Summary: TestReconstructStripedFile.testNNSendsErasureCodingTasks fails due to socket timeout Key: HDFS-12994 URL: https://issues.apache.org/jira/browse/HDFS-12994

[jira] [Commented] (HDFS-12945) Switch to ClientProtocol instead of NamenodeProtocols in NamenodeWebHdfsMethods

2018-01-08 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16317112#comment-16317112 ] Íñigo Goiri commented on HDFS-12945: {{TestDataNodeVolumeFailureReporting}} seemed to fial before; it

[jira] [Commented] (HDFS-12051) Intern INOdeFileAttributes$SnapshotCopy.name byte[] arrays to save memory

2018-01-08 Thread Misha Dmitriev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16317025#comment-16317025 ] Misha Dmitriev commented on HDFS-12051: --- >> The extra code on itself doesn't noticeably affect the

[jira] [Commented] (HDFS-12945) Switch to ClientProtocol instead of NamenodeProtocols in NamenodeWebHdfsMethods

2018-01-08 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16317104#comment-16317104 ] genericqa commented on HDFS-12945: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12992) Ozone: Add support for Larger key sizes in Corona

2018-01-08 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16317116#comment-16317116 ] Chris Douglas commented on HDFS-12992: -- Corona is a benchmark for Ozone? Could we pick a different

[jira] [Updated] (HDFS-12919) RBF: Support erasure coding methods in RouterRpcServer

2018-01-08 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12919: --- Attachment: HDFS-12919.011.patch > RBF: Support erasure coding methods in RouterRpcServer >

[jira] [Updated] (HDFS-12945) Switch to ClientProtocol instead of NamenodeProtocols in NamenodeWebHdfsMethods

2018-01-08 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated HDFS-12945: --- Attachment: HDFS-12945.002.patch Rebase the patch and re-trigger Jenkins. > Switch to ClientProtocol instead

[jira] [Created] (HDFS-12995) [SPS] : Implement ExternalSPSContext for establishing RPC communication between SPS Service and NN

2018-01-08 Thread Uma Maheswara Rao G (JIRA)
Uma Maheswara Rao G created HDFS-12995: -- Summary: [SPS] : Implement ExternalSPSContext for establishing RPC communication between SPS Service and NN Key: HDFS-12995 URL:

[jira] [Updated] (HDFS-12984) BlockPoolSlice can leak in a mini dfs cluster

2018-01-08 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-12984: -- Attachment: HDFS-12984.001.patch > BlockPoolSlice can leak in a mini dfs cluster >

[jira] [Created] (HDFS-12996) DataNode Replica Trash

2018-01-08 Thread Hanisha Koneru (JIRA)
Hanisha Koneru created HDFS-12996: - Summary: DataNode Replica Trash Key: HDFS-12996 URL: https://issues.apache.org/jira/browse/HDFS-12996 Project: Hadoop HDFS Issue Type: New Feature

[jira] [Commented] (HDFS-12984) BlockPoolSlice can leak in a mini dfs cluster

2018-01-08 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16317249#comment-16317249 ] Ajay Kumar commented on HDFS-12984: --- @[~revans2] thanks for the info. Attaching a patch to address issue

[jira] [Comment Edited] (HDFS-12984) BlockPoolSlice can leak in a mini dfs cluster

2018-01-08 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16317249#comment-16317249 ] Ajay Kumar edited comment on HDFS-12984 at 1/8/18 10:36 PM: [~revans2] thanks

[jira] [Created] (HDFS-12997) Moving logging to slf4j in BlockPoolSliceStorage and Storage

2018-01-08 Thread Ajay Kumar (JIRA)
Ajay Kumar created HDFS-12997: - Summary: Moving logging to slf4j in BlockPoolSliceStorage and Storage Key: HDFS-12997 URL: https://issues.apache.org/jira/browse/HDFS-12997 Project: Hadoop HDFS

[jira] [Commented] (HDFS-12984) BlockPoolSlice can leak in a mini dfs cluster

2018-01-08 Thread Robert Joseph Evans (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16317259#comment-16317259 ] Robert Joseph Evans commented on HDFS-12984: Thanks [~ajayydv], Looks good to me I am +1

[jira] [Commented] (HDFS-12996) DataNode Replica Trash

2018-01-08 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16317266#comment-16317266 ] Wei-Chiu Chuang commented on HDFS-12996: Just FYI, you should be able to move the jira from HADOOP

[jira] [Commented] (HDFS-12996) DataNode Replica Trash

2018-01-08 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16317272#comment-16317272 ] Hanisha Koneru commented on HDFS-12996: --- Didn't know that. Thanks [~jojochuang] :). > DataNode

[jira] [Commented] (HDFS-12945) Switch to ClientProtocol instead of NamenodeProtocols in NamenodeWebHdfsMethods

2018-01-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16317278#comment-16317278 ] Hudson commented on HDFS-12945: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13461 (See

[jira] [Assigned] (HDFS-12995) [SPS] : Implement ExternalSPSContext for establishing RPC communication between SPS Service and NN

2018-01-08 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer reassigned HDFS-12995: --- Assignee: Anu Engineer > [SPS] : Implement ExternalSPSContext for establishing RPC

[jira] [Updated] (HDFS-12994) TestReconstructStripedFile.testNNSendsErasureCodingTasks fails due to socket timeout

2018-01-08 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-12994: - Status: Patch Available (was: Open) > TestReconstructStripedFile.testNNSendsErasureCodingTasks

[jira] [Updated] (HDFS-12994) TestReconstructStripedFile.testNNSendsErasureCodingTasks fails due to socket timeout

2018-01-08 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-12994: - Attachment: HDFS-12994.00.patch Attach the patch to shorter the socket timeout for new

[jira] [Commented] (HDFS-12945) Switch to ClientProtocol instead of NamenodeProtocols in NamenodeWebHdfsMethods

2018-01-08 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16317139#comment-16317139 ] Wei Yan commented on HDFS-12945: TestDataNodeVolumeFailureReporting passed in my local, and the above test

[jira] [Commented] (HDFS-12802) RBF: Control MountTableResolver cache size

2018-01-08 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16317200#comment-16317200 ] Chris Douglas commented on HDFS-12802: -- bq. We have a read/write lock for syncing the tree and the

[jira] [Commented] (HDFS-12990) Change default NameNode RPC port back to 8020

2018-01-08 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16317401#comment-16317401 ] Tsz Wo Nicholas Sze commented on HDFS-12990: > Maybe I'm missing something, but what part of

[jira] [Commented] (HDFS-12808) Add LOG.isDebugEnabled() guard for LOG.debug("...")

2018-01-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16317546#comment-16317546 ] Hudson commented on HDFS-12808: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13464 (See

[jira] [Commented] (HDFS-12994) TestReconstructStripedFile.testNNSendsErasureCodingTasks fails due to socket timeout

2018-01-08 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16317706#comment-16317706 ] genericqa commented on HDFS-12994: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12996) DataNode Replica Trash

2018-01-08 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16317342#comment-16317342 ] Rushabh S Shah commented on HDFS-12996: --- [~hanishakoneru]: Looks like a good improvement. Thanks for

[jira] [Updated] (HDFS-12997) Moving logging to slf4j in BlockPoolSliceStorage and Storage

2018-01-08 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12997: -- Issue Type: Sub-task (was: Improvement) Parent: HDFS-12829 > Moving logging to

[jira] [Updated] (HDFS-12919) RBF: Support erasure coding methods in RouterRpcServer

2018-01-08 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12919: --- Attachment: HDFS-12919.012.patch > RBF: Support erasure coding methods in RouterRpcServer >

[jira] [Comment Edited] (HDFS-12997) Moving logging to slf4j in BlockPoolSliceStorage and Storage

2018-01-08 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16317463#comment-16317463 ] Bharat Viswanadham edited comment on HDFS-12997 at 1/9/18 1:10 AM: --- Hi

[jira] [Updated] (HDFS-12829) Moving logging APIs over to slf4j in hdfs

2018-01-08 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12829: --- Description: Moving logging APIs over to slf4j in hdfs > Moving logging APIs over to slf4j in hdfs >

[jira] [Updated] (HDFS-12853) Ozone: Optimize chunk writes for Ratis by avoiding double writes

2018-01-08 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-12853: --- Hadoop Flags: Reviewed +1 patch looks good. > Ozone: Optimize chunk writes for Ratis

[jira] [Commented] (HDFS-12997) Move logging to slf4j in BlockPoolSliceStorage and Storage

2018-01-08 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16317711#comment-16317711 ] Ajay Kumar commented on HDFS-12997: --- [~bharatviswa], Thanks!! Ya, Its good Idea to track all these jiras

[jira] [Commented] (HDFS-12985) NameNode crashes during restart after an OpenForWrite file present in the Snapshot got deleted

2018-01-08 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16317352#comment-16317352 ] Manoj Govindassamy commented on HDFS-12985: --- Thanks for the review [~yzhangal]. Committed it to

[jira] [Comment Edited] (HDFS-12985) NameNode crashes during restart after an OpenForWrite file present in the Snapshot got deleted

2018-01-08 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16317352#comment-16317352 ] Manoj Govindassamy edited comment on HDFS-12985 at 1/9/18 12:31 AM:

[jira] [Updated] (HDFS-12990) Change default NameNode RPC port back to 8020

2018-01-08 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-12990: -- Release Note: HDFS NameNode default RPC port is changed back to 8020. The only official

[jira] [Commented] (HDFS-12808) Add LOG.isDebugEnabled() guard for LOG.debug("...")

2018-01-08 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16317494#comment-16317494 ] Bharat Viswanadham commented on HDFS-12808: --- [~goiri] [~busbey] Could you help in committing

[jira] [Updated] (HDFS-12802) RBF: Control MountTableResolver cache size

2018-01-08 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12802: --- Attachment: HDFS-12802.004.patch > RBF: Control MountTableResolver cache size >

[jira] [Updated] (HDFS-12853) Ozone: Optimize chunk writes for Ratis by avoiding double writes

2018-01-08 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-12853: --- Resolution: Fixed Status: Resolved (was: Patch Available) I have committed

[jira] [Commented] (HDFS-12982) [SPS]: Reduce the locking and cleanup the Namesystem access

2018-01-08 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16316041#comment-16316041 ] Surendra Singh Lilhore commented on HDFS-12982: --- +1 LGTM > [SPS]: Reduce the locking and

  1   2   >