[jira] [Updated] (HDFS-8004) Use KeyProviderCryptoExtension#warmUpEncryptedKeys when creating an encryption zone

[ https://issues.apache.org/jira/browse/HDFS-8004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8004: -- Status: Patch Available (was: Open) > Use KeyProviderCryptoExtension#warmUpEncryptedKeys when creating a

[jira] [Updated] (HDFS-8007) Lower RollingWindowManager log to debug

[ https://issues.apache.org/jira/browse/HDFS-8007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8007: -- Attachment: hdfs-8007.001.patch Trivial patch attached. > Lower RollingWindowManager log to debug >

[jira] [Created] (HDFS-8007) Lower RollingWindowManager log to debug

Andrew Wang created HDFS-8007: - Summary: Lower RollingWindowManager log to debug Key: HDFS-8007 URL: https://issues.apache.org/jira/browse/HDFS-8007 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Updated] (HDFS-8007) Lower RollingWindowManager log to debug

[ https://issues.apache.org/jira/browse/HDFS-8007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8007: -- Status: Patch Available (was: Open) > Lower RollingWindowManager log to debug >

[jira] [Updated] (HDFS-8004) Use KeyProviderCryptoExtension#warmUpEncryptedKeys when creating an encryption zone

[ https://issues.apache.org/jira/browse/HDFS-8004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8004: -- Fix Version/s: 2.8.0 thanks Arun, don't forget to set the fix version ;) > Use KeyProviderCryptoExtensio

[jira] [Updated] (HDFS-7979) Initialize block report IDs with a random number

[ https://issues.apache.org/jira/browse/HDFS-7979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7979: -- Attachment: HDFS-7979.003.patch Good point about 0 being an invalid value, I forgot about that on the NN

[jira] [Commented] (HDFS-7978) Add LOG.isDebugEnabled() guard for some LOG.debug(..)

[ https://issues.apache.org/jira/browse/HDFS-7978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391315#comment-14391315 ] Andrew Wang commented on HDFS-7978: --- I ran the failed test locally, seems independently f

[jira] [Updated] (HDFS-7978) Add LOG.isDebugEnabled() guard for some LOG.debug(..)

[ https://issues.apache.org/jira/browse/HDFS-7978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7978: -- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Available) > Add L

[jira] [Commented] (HDFS-8025) Addendum for HDFS-3087

[ https://issues.apache.org/jira/browse/HDFS-8025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391332#comment-14391332 ] Andrew Wang commented on HDFS-8025: --- Hey Ming, thanks for working on this. Did you consid

[jira] [Commented] (HDFS-7725) Incorrect "nodes in service" metrics caused all writes to fail

[ https://issues.apache.org/jira/browse/HDFS-7725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391353#comment-14391353 ] Andrew Wang commented on HDFS-7725: --- Thanks for working on this Ming. Nice find, patch lo

[jira] [Updated] (HDFS-8025) Addendum fix for HDFS-3087 Decomissioning on NN restart can complete without blocks being replicated

[ https://issues.apache.org/jira/browse/HDFS-8025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8025: -- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Available) Committ

[jira] [Commented] (HDFS-7725) Incorrect "nodes in service" metrics caused all writes to fail

[ https://issues.apache.org/jira/browse/HDFS-7725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14486253#comment-14486253 ] Andrew Wang commented on HDFS-7725: --- Hi Ming, the latest looks good to me. +1 will commit

[jira] [Updated] (HDFS-7979) Initialize block report IDs with a random number

[ https://issues.apache.org/jira/browse/HDFS-7979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7979: -- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Available) Thanks

[jira] [Updated] (HDFS-7979) Initialize block report IDs with a random number

[ https://issues.apache.org/jira/browse/HDFS-7979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7979: -- Attachment: HDFS-7979.004.patch Woops, one more try. I also discovered DFSUtil.getRandom() which saves us

[jira] [Updated] (HDFS-8025) Addendum fix for HDFS-3087 after HDFS-7411.

[ https://issues.apache.org/jira/browse/HDFS-8025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8025: -- Summary: Addendum fix for HDFS-3087 after HDFS-7411. (was: Addendum for HDFS-3087) > Addendum fix for H

[jira] [Updated] (HDFS-7725) Incorrect "nodes in service" metrics caused all writes to fail

[ https://issues.apache.org/jira/browse/HDFS-7725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7725: -- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Available) Committ

[jira] [Commented] (HDFS-8076) Code cleanup for DFSInputStream: use offset instead of LocatedBlock when possible

[ https://issues.apache.org/jira/browse/HDFS-8076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14486236#comment-14486236 ] Andrew Wang commented on HDFS-8076: --- +1 LGTM, will commit shortly > Code cleanup for DFS

[jira] [Commented] (HDFS-8091) ACLStatus and XAttributes not properly presented to INodeAttributesProvider before returning to client

[ https://issues.apache.org/jira/browse/HDFS-8091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14487943#comment-14487943 ] Andrew Wang commented on HDFS-8091: --- Nice find and fix Arun, +1 > ACLStatus and XAttribu

[jira] [Updated] (HDFS-8025) Addendum fix for HDFS-3087 Decomissioning on NN restart can complete without blocks being replicated

[ https://issues.apache.org/jira/browse/HDFS-8025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8025: -- Summary: Addendum fix for HDFS-3087 Decomissioning on NN restart can complete without blocks being replic

[jira] [Updated] (HDFS-8076) Code cleanup for DFSInputStream: use offset instead of LocatedBlock when possible

[ https://issues.apache.org/jira/browse/HDFS-8076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8076: -- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Available) Committ

[jira] [Commented] (HDFS-8025) Addendum for HDFS-3087

[ https://issues.apache.org/jira/browse/HDFS-8025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14486278#comment-14486278 ] Andrew Wang commented on HDFS-8025: --- +1 LGTM, will commit shortly > Addendum for HDFS-30

[jira] [Commented] (HDFS-8117) More accurate verification in SimulatedFSDataset: replace DEFAULT_DATABYTE with patterned data

[ https://issues.apache.org/jira/browse/HDFS-8117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14492869#comment-14492869 ] Andrew Wang commented on HDFS-8117: --- Couple comments: * I still see a raw {{12}} that's

[jira] [Commented] (HDFS-8117) More accurate verification in SimulatedFSDataset: replace DEFAULT_DATABYTE with patterned data

[ https://issues.apache.org/jira/browse/HDFS-8117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14492973#comment-14492973 ] Andrew Wang commented on HDFS-8117: --- LGTM +1 will commit shortly > More accurate verific

[jira] [Updated] (HDFS-8117) More accurate verification in SimulatedFSDataset: replace DEFAULT_DATABYTE with patterned data

[ https://issues.apache.org/jira/browse/HDFS-8117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8117: -- Target Version/s: 2.8.0 Affects Version/s: 2.6.0 Fix Version/s: 3.0.0 Committed to trunk. Zh

[jira] [Updated] (HDFS-8117) More accurate verification in SimulatedFSDataset: replace DEFAULT_DATABYTE with patterned data

[ https://issues.apache.org/jira/browse/HDFS-8117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8117: -- Resolution: Fixed Fix Version/s: (was: 3.0.0) 2.8.0 Status: Resol

[jira] [Commented] (HDFS-8142) DistributedFileSystem encryption zone commands should resolve relative paths

[ https://issues.apache.org/jira/browse/HDFS-8142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14498073#comment-14498073 ] Andrew Wang commented on HDFS-8142: --- LGTM, good find. Thanks Rakesh, will commit shortly.

[jira] [Updated] (HDFS-8142) DistributedFileSystem encryption zone commands should resolve relative paths

[ https://issues.apache.org/jira/browse/HDFS-8142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8142: -- Affects Version/s: 2.6.0 > DistributedFileSystem encryption zone commands should resolve relative paths >

[jira] [Updated] (HDFS-8142) DistributedFileSystem encryption zone commands should resolve relative paths

[ https://issues.apache.org/jira/browse/HDFS-8142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8142: -- Labels: encryption (was: ) > DistributedFileSystem encryption zone commands should resolve relative path

[jira] [Updated] (HDFS-8142) DistributedFileSystem encryption zone commands should resolve relative paths

[ https://issues.apache.org/jira/browse/HDFS-8142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8142: -- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Available) Committ

[jira] [Updated] (HDFS-8142) DistributedFileSystem encryption zone commands should resolve relative paths

[ https://issues.apache.org/jira/browse/HDFS-8142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8142: -- Summary: DistributedFileSystem encryption zone commands should resolve relative paths (was: DistributedF

[jira] [Commented] (HDFS-8182) Implement topology-aware CDN-style caching

[ https://issues.apache.org/jira/browse/HDFS-8182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503565#comment-14503565 ] Andrew Wang commented on HDFS-8182: --- Could this be achieved more simply with a block plac

[jira] [Commented] (HDFS-8191) Fix byte to integer casting in SimulatedFSDataset#simulatedByte

[ https://issues.apache.org/jira/browse/HDFS-8191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14504029#comment-14504029 ] Andrew Wang commented on HDFS-8191: --- Thanks Zhe, this looks good, explanation makes sense

[jira] [Commented] (HDFS-8182) Implement topology-aware CDN-style caching

[ https://issues.apache.org/jira/browse/HDFS-8182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14504105#comment-14504105 ] Andrew Wang commented on HDFS-8182: --- Hi Gera, just for my own edification, given the "spr

[jira] [Commented] (HDFS-8191) Fix byte to integer casting in SimulatedFSDataset#simulatedByte

[ https://issues.apache.org/jira/browse/HDFS-8191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14507882#comment-14507882 ] Andrew Wang commented on HDFS-8191: --- Couple notes: * Rather than adding another argument

[jira] [Commented] (HDFS-8182) Implement topology-aware CDN-style caching

[ https://issues.apache.org/jira/browse/HDFS-8182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14507939#comment-14507939 ] Andrew Wang commented on HDFS-8182: --- Thanks for the explanation Gera. This sounds like au

[jira] [Commented] (HDFS-8191) Fix byte to integer casting in SimulatedFSDataset#simulatedByte

[ https://issues.apache.org/jira/browse/HDFS-8191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14507991#comment-14507991 ] Andrew Wang commented on HDFS-8191: --- testInjectionNonEmpty I think still is using the 3-a

[jira] [Commented] (HDFS-8191) Fix byte to integer casting in SimulatedFSDataset#simulatedByte

[ https://issues.apache.org/jira/browse/HDFS-8191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14508144#comment-14508144 ] Andrew Wang commented on HDFS-8191: --- Missed that injection change, +1 again. Thanks for w

[jira] [Updated] (HDFS-8191) Fix byte to integer casting in SimulatedFSDataset#simulatedByte

[ https://issues.apache.org/jira/browse/HDFS-8191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8191: -- Target Version/s: 2.8.0 Affects Version/s: 2.6.0 > Fix byte to integer casting in SimulatedFSDataset

[jira] [Updated] (HDFS-8191) Fix byte to integer casting in SimulatedFSDataset#simulatedByte

[ https://issues.apache.org/jira/browse/HDFS-8191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8191: -- Affects Version/s: (was: 2.6.0) 2.7.0 > Fix byte to integer casting in Simulat

[jira] [Commented] (HDFS-8191) Fix byte to integer casting in SimulatedFSDataset#simulatedByte

[ https://issues.apache.org/jira/browse/HDFS-8191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14510048#comment-14510048 ] Andrew Wang commented on HDFS-8191: --- I kicked the precommit, dunno why it didn't run. ht

[jira] [Commented] (HDFS-8214) Secondary NN Web UI shows wrong date for Last Checkpoint

[ https://issues.apache.org/jira/browse/HDFS-8214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14511498#comment-14511498 ] Andrew Wang commented on HDFS-8214: --- Hi Charles, This change basically makes sense. We w

[jira] [Updated] (HDFS-8241) Remove unused Namenode startup option "FINALIZE"

[ https://issues.apache.org/jira/browse/HDFS-8241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8241: -- Hadoop Flags: Incompatible change > Remove unused Namenode startup option "FINALIZE" > -

[jira] [Commented] (HDFS-8241) Remove unused Namenode startup option "FINALIZE"

[ https://issues.apache.org/jira/browse/HDFS-8241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14511524#comment-14511524 ] Andrew Wang commented on HDFS-8241: --- I think we can only target this at trunk, since remo

[jira] [Updated] (HDFS-8241) Remove unused Namenode startup option "FINALIZE"

[ https://issues.apache.org/jira/browse/HDFS-8241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8241: -- Target Version/s: 3.0.0 Affects Version/s: 2.7.0 > Remove unused Namenode startup option "FINALIZE"

[jira] [Updated] (HDFS-8191) Fix byte to integer casting in SimulatedFSDataset#simulatedByte

[ https://issues.apache.org/jira/browse/HDFS-8191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8191: -- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Available) Pushed

[jira] [Commented] (HDFS-8214) Secondary NN Web UI shows wrong date for Last Checkpoint

[ https://issues.apache.org/jira/browse/HDFS-8214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14514585#comment-14514585 ] Andrew Wang commented on HDFS-8214: --- Hi Charles, this patch looks good, only two comments

[jira] [Assigned] (HDFS-8246) Get HDFS file name based on block pool id and block id

[ https://issues.apache.org/jira/browse/HDFS-8246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang reassigned HDFS-8246: - Assignee: feng xu (was: Andrew Wang) > Get HDFS file name based on block pool id and block id > -

[jira] [Assigned] (HDFS-8246) Get HDFS file name based on block pool id and block id

[ https://issues.apache.org/jira/browse/HDFS-8246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang reassigned HDFS-8246: - Assignee: Andrew Wang (was: feng xu) > Get HDFS file name based on block pool id and block id > -

[jira] [Updated] (HDFS-8246) Get HDFS file name based on block pool id and block id

[ https://issues.apache.org/jira/browse/HDFS-8246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8246: -- Status: Patch Available (was: In Progress) > Get HDFS file name based on block pool id and block id > --

[jira] [Commented] (HDFS-7678) Erasure coding: DFSInputStream with decode functionality

[ https://issues.apache.org/jira/browse/HDFS-7678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518401#comment-14518401 ] Andrew Wang commented on HDFS-7678: --- Thanks for the patch Zhe, some nice functionality he

[jira] [Commented] (HDFS-8214) Secondary NN Web UI shows wrong date for Last Checkpoint

[ https://issues.apache.org/jira/browse/HDFS-8214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518528#comment-14518528 ] Andrew Wang commented on HDFS-8214: --- +1 LGTM, thanks Charles. I rekicked Jenkins, should

[jira] [Commented] (HDFS-8214) Secondary NN Web UI shows wrong date for Last Checkpoint

[ https://issues.apache.org/jira/browse/HDFS-8214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520616#comment-14520616 ] Andrew Wang commented on HDFS-8214: --- OK, I'll commit this shortly. Thanks for looking at

[jira] [Updated] (HDFS-8214) Secondary NN Web UI shows wrong date for Last Checkpoint

[ https://issues.apache.org/jira/browse/HDFS-8214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8214: -- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Available) Committ

[jira] [Commented] (HDFS-8214) Secondary NN Web UI shows wrong date for Last Checkpoint

[ https://issues.apache.org/jira/browse/HDFS-8214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520624#comment-14520624 ] Andrew Wang commented on HDFS-8214: --- Ah, I see the JIRA has been created, thanks. I'll re

[jira] [Commented] (HDFS-8292) Move conditional in fmt_time from dfs-dust.js to status.html

[ https://issues.apache.org/jira/browse/HDFS-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14522612#comment-14522612 ] Andrew Wang commented on HDFS-8292: --- +1 will commit shortly, assuming you tested manually

[jira] [Updated] (HDFS-8292) Move conditional in fmt_time from dfs-dust.js to status.html

[ https://issues.apache.org/jira/browse/HDFS-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8292: -- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Available) Committ

[jira] [Commented] (HDFS-7678) Erasure coding: DFSInputStream with decode functionality

[ https://issues.apache.org/jira/browse/HDFS-7678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14523549#comment-14523549 ] Andrew Wang commented on HDFS-7678: --- Hi Zhe, two quick comments: * When fetching recover

[jira] [Commented] (HDFS-8306) Generate ACL and Xattr outputs in OIV XML outputs

[ https://issues.apache.org/jira/browse/HDFS-8306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14524189#comment-14524189 ] Andrew Wang commented on HDFS-8306: --- Nice patch here Eddy. Overall it looks good, just tw

[jira] [Commented] (HDFS-7339) NameNode support for erasure coding block groups

[ https://issues.apache.org/jira/browse/HDFS-7339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14266566#comment-14266566 ] Andrew Wang commented on HDFS-7339: --- Thanks for working on this Zhe, here are some quick

[jira] [Commented] (HDFS-7337) Configurable and pluggable Erasure Codec and schema

[ https://issues.apache.org/jira/browse/HDFS-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14266816#comment-14266816 ] Andrew Wang commented on HDFS-7337: --- Hey Kai, thanks for getting us started here. I gave

[jira] [Updated] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7411: -- Attachment: hdfs-7411.006.patch > Refactor and improve decommissioning logic into DecommissionManager > -

[jira] [Commented] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268306#comment-14268306 ] Andrew Wang commented on HDFS-7411: --- Thanks for the reviews Colin and Ming, new patch up.

[jira] [Commented] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14274361#comment-14274361 ] Andrew Wang commented on HDFS-7411: --- I just kicked Jenkins manually, the mysteries of the

[jira] [Commented] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14277677#comment-14277677 ] Andrew Wang commented on HDFS-7411: --- Hi Colin, thanks for reviewing. I'll rework the patc

[jira] [Commented] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14277909#comment-14277909 ] Andrew Wang commented on HDFS-7411: --- bq. Why is blocks.per.interval "more powerful" than

[jira] [Commented] (HDFS-7430) Refactor the BlockScanner to use O(1) memory and use multiple threads

[ https://issues.apache.org/jira/browse/HDFS-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14279501#comment-14279501 ] Andrew Wang commented on HDFS-7430: --- Hey Colin, thanks for revving, I took another look.

[jira] [Updated] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7411: -- Attachment: hdfs-7411.007.patch Here's a new patch addressing Colin's review feedback: * Got rid of the

[jira] [Commented] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14284438#comment-14284438 ] Andrew Wang commented on HDFS-7411: --- I think these test failures are unrelated. HDFS-7527

[jira] [Commented] (HDFS-6673) Add Delimited format supports for PB OIV tool

[ https://issues.apache.org/jira/browse/HDFS-6673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14284506#comment-14284506 ] Andrew Wang commented on HDFS-6673: --- Hi Eddy, thanks for doing these benchmarks. I only h

[jira] [Commented] (HDFS-7430) Rewrite the BlockScanner to use O(1) memory and use multiple threads

[ https://issues.apache.org/jira/browse/HDFS-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14286837#comment-14286837 ] Andrew Wang commented on HDFS-7430: --- +1 again if you need it, this patch has been through

[jira] [Commented] (HDFS-7337) Configurable and pluggable Erasure Codec and schema

[ https://issues.apache.org/jira/browse/HDFS-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14289686#comment-14289686 ] Andrew Wang commented on HDFS-7337: --- I don't think it's necessary to move to HADOOP. If a

[jira] [Updated] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7411: -- Attachment: hdfs-7411.008.patch > Refactor and improve decommissioning logic into DecommissionManager > -

[jira] [Updated] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7411: -- Attachment: (was: hdfs-7411.008.patch) > Refactor and improve decommissioning logic into Decommission

[jira] [Updated] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7411: -- Attachment: hdfs-7411.008.patch > Refactor and improve decommissioning logic into DecommissionManager > -

[jira] [Commented] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14290146#comment-14290146 ] Andrew Wang commented on HDFS-7411: --- Thanks again for reviewing Colin, fixed with the fol

[jira] [Commented] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14290173#comment-14290173 ] Andrew Wang commented on HDFS-7411: --- If you look at version 2 of the patch, you can see t

[jira] [Commented] (HDFS-6673) Add Delimited format supports for PB OIV tool

[ https://issues.apache.org/jira/browse/HDFS-6673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14290238#comment-14290238 ] Andrew Wang commented on HDFS-6673: --- Hey Haohui, Eddy's done performance testing with a

[jira] [Commented] (HDFS-6729) Support maintenance mode for DN

[ https://issues.apache.org/jira/browse/HDFS-6729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14290240#comment-14290240 ] Andrew Wang commented on HDFS-6729: --- Hey Eddy, quick question, this looks like soft state

[jira] [Commented] (HDFS-6673) Add Delimited format supports for PB OIV tool

[ https://issues.apache.org/jira/browse/HDFS-6673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14290294#comment-14290294 ] Andrew Wang commented on HDFS-6673: --- bq. The test is on a 3G fsimage which can easily fit

[jira] [Commented] (HDFS-6673) Add Delimited format supports for PB OIV tool

[ https://issues.apache.org/jira/browse/HDFS-6673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14290297#comment-14290297 ] Andrew Wang commented on HDFS-6673: --- Oops, realized Eddy still needs to address my previo

[jira] [Commented] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14292301#comment-14292301 ] Andrew Wang commented on HDFS-7411: --- This is the same testIncludeByRegistrationName failu

[jira] [Updated] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7411: -- Attachment: hdfs-7411.009.patch Added the @Ignore in this latest patch, no other changes. > Refactor and

[jira] [Commented] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14294037#comment-14294037 ] Andrew Wang commented on HDFS-7411: --- Looks like a flake, balancer. > Refactor and improv

[jira] [Commented] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14294345#comment-14294345 ] Andrew Wang commented on HDFS-7411: --- Hi Nicholas, Those methods you mentioned are pretty

[jira] [Updated] (HDFS-6673) Add delimited format support to PB OIV tool

[ https://issues.apache.org/jira/browse/HDFS-6673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6673: -- Summary: Add delimited format support to PB OIV tool (was: Add Delimited format supports for PB OIV tool

[jira] [Updated] (HDFS-6673) Add delimited format support to PB OIV tool

[ https://issues.apache.org/jira/browse/HDFS-6673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6673: -- Resolution: Fixed Fix Version/s: 2.7.0 Status: Resolved (was: Patch Available) Committ

[jira] [Created] (HDFS-7706) Switch BlockManager logging to use slf4j

Andrew Wang created HDFS-7706: - Summary: Switch BlockManager logging to use slf4j Key: HDFS-7706 URL: https://issues.apache.org/jira/browse/HDFS-7706 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Updated] (HDFS-7706) Switch BlockManager logging to use slf4j

[ https://issues.apache.org/jira/browse/HDFS-7706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7706: -- Attachment: hdfs-7706.001.patch Patch attached. Also refactored a common logging idiom I saw in tests int

[jira] [Updated] (HDFS-7706) Switch BlockManager logging to use slf4j

[ https://issues.apache.org/jira/browse/HDFS-7706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7706: -- Status: Patch Available (was: Open) > Switch BlockManager logging to use slf4j > ---

[jira] [Commented] (HDFS-7706) Switch BlockManager logging to use slf4j

[ https://issues.apache.org/jira/browse/HDFS-7706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14299104#comment-14299104 ] Andrew Wang commented on HDFS-7706: --- Hey Kihwal, I'd like to hit that in a follow-on patc

[jira] [Created] (HDFS-7712) Switch blockStateChangeLog to use slf4j

Andrew Wang created HDFS-7712: - Summary: Switch blockStateChangeLog to use slf4j Key: HDFS-7712 URL: https://issues.apache.org/jira/browse/HDFS-7712 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Updated] (HDFS-7706) Switch BlockManager logging to use slf4j

[ https://issues.apache.org/jira/browse/HDFS-7706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7706: -- Resolution: Fixed Fix Version/s: 2.7.0 Status: Resolved (was: Patch Available) Thanks

[jira] [Updated] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7411: -- Attachment: hdfs-7411.010.patch > Refactor and improve decommissioning logic into DecommissionManager > -

[jira] [Commented] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14299158#comment-14299158 ] Andrew Wang commented on HDFS-7411: --- I split the logging changes off to HDFS-7706 which I

[jira] [Updated] (HDFS-7712) Switch blockStateChangeLog to use slf4j

[ https://issues.apache.org/jira/browse/HDFS-7712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7712: -- Attachment: hdfs-7712.001.patch Patch attached. [~kihwal] willing to review? > Switch blockStateChangeLo

[jira] [Updated] (HDFS-7712) Switch blockStateChangeLog to use slf4j

[ https://issues.apache.org/jira/browse/HDFS-7712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7712: -- Status: Patch Available (was: Open) > Switch blockStateChangeLog to use slf4j >

[jira] [Updated] (HDFS-7712) Switch blockStateChangeLog to use slf4j

[ https://issues.apache.org/jira/browse/HDFS-7712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7712: -- Attachment: hdfs-7712.002.patch Woops missed a file. > Switch blockStateChangeLog to use slf4j > ---

[jira] [Commented] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14299413#comment-14299413 ] Andrew Wang commented on HDFS-7411: --- RAT complains about a psd file? seems spurious. > R

[jira] [Updated] (HDFS-7712) Switch blockStateChangeLog to use slf4j

[ https://issues.apache.org/jira/browse/HDFS-7712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7712: -- Attachment: hdfs-7712.003.patch Lots of casting within test cases, think I hit all of em. Also converted

[jira] [Commented] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14301881#comment-14301881 ] Andrew Wang commented on HDFS-7411: --- Thanks for reviewing Colin. I'll wait another day be

<    3   4   5   6   7   8   9   10   11   12   >