[jira] [Commented] (HDFS-12946) Add a tool to check rack configuration against EC policies

[ https://issues.apache.org/jira/browse/HDFS-12946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652115#comment-16652115 ] Andrew Wang commented on HDFS-12946: Hi folks, thanks for working on this! Catching up on the

[jira] [Commented] (HDFS-13672) clearCorruptLazyPersistFiles could crash NameNode

[ https://issues.apache.org/jira/browse/HDFS-13672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16553150#comment-16553150 ] Andrew Wang commented on HDFS-13672: Hi Gabor, I took a quick look. It doesn't look like the iterator

[jira] [Commented] (HDFS-13658) fsck, dfsadmin -report, and NN WebUI should report number of blocks that have 1 replica

[ https://issues.apache.org/jira/browse/HDFS-13658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16536996#comment-16536996 ] Andrew Wang commented on HDFS-13658: Hi Kitti, thanks for working on this! IIUC in your patch, it

[jira] [Updated] (HDFS-13719) Docs around dfs.image.transfer.timeout are misleading

[ https://issues.apache.org/jira/browse/HDFS-13719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-13719: --- Resolution: Fixed Fix Version/s: 3.0.4 3.1.1 3.2.0

[jira] [Commented] (HDFS-13719) Docs around dfs.image.transfer.timeout are misleading

[ https://issues.apache.org/jira/browse/HDFS-13719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16533545#comment-16533545 ] Andrew Wang commented on HDFS-13719: Nice find. This looks like a holdover from when we changed

[jira] [Commented] (HDFS-13672) clearCorruptLazyPersistFiles could crash NameNode

[ https://issues.apache.org/jira/browse/HDFS-13672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16531431#comment-16531431 ] Andrew Wang commented on HDFS-13672: Hi Gabor, to respond to your question, I think the very common

[jira] [Commented] (HDFS-13672) clearCorruptLazyPersistFiles could crash NameNode

[ https://issues.apache.org/jira/browse/HDFS-13672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16531371#comment-16531371 ] Andrew Wang commented on HDFS-13672: Hi Gabor, thanks for working on this, I don't think it's thread

[jira] [Updated] (HDFS-13712) BlockReaderRemote.read() logging improvement

[ https://issues.apache.org/jira/browse/HDFS-13712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-13712: --- Resolution: Fixed Fix Version/s: 3.0.4 3.1.1 3.2.0

[jira] [Commented] (HDFS-13712) BlockReaderRemote.read() logging improvement

[ https://issues.apache.org/jira/browse/HDFS-13712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16529970#comment-16529970 ] Andrew Wang commented on HDFS-13712: +1 LGTM pending Jenkins, thanks for filing this and posting a

[jira] [Updated] (HDFS-13712) BlockReaderRemote.read() logging improvement

[ https://issues.apache.org/jira/browse/HDFS-13712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-13712: --- Target Version/s: 3.2.0, 3.1.1, 3.0.4 (was: 3.2.0) > BlockReaderRemote.read() logging improvement >

[jira] [Updated] (HDFS-13702) Remove HTrace hooks from DFSClient to reduce CPU usage

[ https://issues.apache.org/jira/browse/HDFS-13702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-13702: --- Resolution: Fixed Fix Version/s: 3.0.4 3.1.1 3.2.0

[jira] [Updated] (HDFS-13702) Remove HTrace hooks from DFSClient to reduce CPU usage

[ https://issues.apache.org/jira/browse/HDFS-13702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-13702: --- Summary: Remove HTrace hooks from DFSClient to reduce CPU usage (was: HTrace hooks taking 10-15%

[jira] [Updated] (HDFS-13703) Avoid allocation of CorruptedBlocks hashmap when no corrupted blocks are hit

[ https://issues.apache.org/jira/browse/HDFS-13703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-13703: --- Resolution: Fixed Fix Version/s: 3.0.4 3.1.1 3.2.0

[jira] [Commented] (HDFS-13703) Avoid allocation of CorruptedBlocks hashmap when no corrupted blocks are hit

[ https://issues.apache.org/jira/browse/HDFS-13703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16529643#comment-16529643 ] Andrew Wang commented on HDFS-13703: +1 LGTM, will commit shortly. > Avoid allocation of

[jira] [Commented] (HDFS-13671) Namenode deletes large dir slowly caused by FoldedTreeSet#removeAndGet

[ https://issues.apache.org/jira/browse/HDFS-13671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16514115#comment-16514115 ] Andrew Wang commented on HDFS-13671: I'm fine with reverting if we're seeing production issues. I

[jira] [Commented] (HDFS-13616) Batch listing of multiple directories

[ https://issues.apache.org/jira/browse/HDFS-13616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16497016#comment-16497016 ] Andrew Wang commented on HDFS-13616: Would we be okay with making this a DistributedFileSystem-only

[jira] [Commented] (HDFS-13616) Batch listing of multiple directories

[ https://issues.apache.org/jira/browse/HDFS-13616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16491400#comment-16491400 ] Andrew Wang commented on HDFS-13616: bq. if I pass a file (instead of a directory), will I get back a

[jira] [Commented] (HDFS-13616) Batch listing of multiple directories

[ https://issues.apache.org/jira/browse/HDFS-13616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16491002#comment-16491002 ] Andrew Wang commented on HDFS-13616: Thanks for taking a look, Xiao and Aaron! bq. We currently FNFE

[jira] [Updated] (HDFS-13616) Batch listing of multiple directories

[ https://issues.apache.org/jira/browse/HDFS-13616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-13616: --- Attachment: BenchmarkListFiles.java > Batch listing of multiple directories >

[jira] [Commented] (HDFS-13616) Batch listing of multiple directories

[ https://issues.apache.org/jira/browse/HDFS-13616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16490068#comment-16490068 ] Andrew Wang commented on HDFS-13616: Latest patch addresses some precommit issues. As stated earlier,

[jira] [Updated] (HDFS-13616) Batch listing of multiple directories

[ https://issues.apache.org/jira/browse/HDFS-13616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-13616: --- Attachment: HDFS-13616.002.patch > Batch listing of multiple directories >

[jira] [Commented] (HDFS-13616) Batch listing of multiple directories

[ https://issues.apache.org/jira/browse/HDFS-13616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16490032#comment-16490032 ] Andrew Wang commented on HDFS-13616: Hi Zhe, thanks for taking a look! This API respects the existing

[jira] [Commented] (HDFS-13616) Batch listing of multiple directories

[ https://issues.apache.org/jira/browse/HDFS-13616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16489568#comment-16489568 ] Andrew Wang commented on HDFS-13616: Thanks for providing the additional context Todd, agree on all

[jira] [Updated] (HDFS-13616) Batch listing of multiple directories

[ https://issues.apache.org/jira/browse/HDFS-13616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-13616: --- Status: Patch Available (was: Open) > Batch listing of multiple directories >

[jira] [Commented] (HDFS-13616) Batch listing of multiple directories

[ https://issues.apache.org/jira/browse/HDFS-13616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16489518#comment-16489518 ] Andrew Wang commented on HDFS-13616: Patch attached to get some initial feedback on the API and a

[jira] [Updated] (HDFS-13616) Batch listing of multiple directories

[ https://issues.apache.org/jira/browse/HDFS-13616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-13616: --- Attachment: HDFS-13616.001.patch > Batch listing of multiple directories >

[jira] [Created] (HDFS-13616) Batch listing of multiple directories

Andrew Wang created HDFS-13616: -- Summary: Batch listing of multiple directories Key: HDFS-13616 URL: https://issues.apache.org/jira/browse/HDFS-13616 Project: Hadoop HDFS Issue Type: New

[jira] [Updated] (HDFS-13611) Unsafe use of Text as a ConcurrentHashMap key in PBHelperClient

[ https://issues.apache.org/jira/browse/HDFS-13611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-13611: --- Resolution: Fixed Fix Version/s: 3.0.4 3.1.1 3.2.0

[jira] [Commented] (HDFS-13611) Unsafe use of Text as a ConcurrentHashMap key in PBHelperClient

[ https://issues.apache.org/jira/browse/HDFS-13611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16487864#comment-16487864 ] Andrew Wang commented on HDFS-13611: Even simpler patch attached, if we make a copy of the Text for

[jira] [Updated] (HDFS-13611) Unsafe use of Text as a ConcurrentHashMap key in PBHelperClient

[ https://issues.apache.org/jira/browse/HDFS-13611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-13611: --- Attachment: HDFS-13611.002.patch > Unsafe use of Text as a ConcurrentHashMap key in PBHelperClient >

[jira] [Commented] (HDFS-13611) Unsafe use of Text as a ConcurrentHashMap key in PBHelperClient

[ https://issues.apache.org/jira/browse/HDFS-13611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16487849#comment-16487849 ] Andrew Wang commented on HDFS-13611: Simple patch attached, getFixedByteString(Text) wasn't even

[jira] [Updated] (HDFS-13611) Unsafe use of Text as a ConcurrentHashMap key in PBHelperClient

[ https://issues.apache.org/jira/browse/HDFS-13611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-13611: --- Affects Version/s: 3.0.4 3.1.1 3.2.0

[jira] [Updated] (HDFS-13611) Unsafe use of Text as a ConcurrentHashMap key in PBHelperClient

[ https://issues.apache.org/jira/browse/HDFS-13611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-13611: --- Attachment: HDFS-13611.001.patch > Unsafe use of Text as a ConcurrentHashMap key in PBHelperClient >

[jira] [Created] (HDFS-13611) Unsafe use of Text as a ConcurrentHashMap key in PBHelperClient

Andrew Wang created HDFS-13611: -- Summary: Unsafe use of Text as a ConcurrentHashMap key in PBHelperClient Key: HDFS-13611 URL: https://issues.apache.org/jira/browse/HDFS-13611 Project: Hadoop HDFS

[jira] [Updated] (HDFS-13601) Optimize ByteString conversions in PBHelper

[ https://issues.apache.org/jira/browse/HDFS-13601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-13601: --- Resolution: Fixed Fix Version/s: 3.0.3 3.1.1 3.2.0

[jira] [Commented] (HDFS-13601) Optimize ByteString conversions in PBHelper

[ https://issues.apache.org/jira/browse/HDFS-13601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16486777#comment-16486777 ] Andrew Wang commented on HDFS-13601: Thanks for reviewing Xiao! I think this current behavior is

[jira] [Commented] (HDFS-13601) Optimize ByteString conversions in PBHelper

[ https://issues.apache.org/jira/browse/HDFS-13601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16486602#comment-16486602 ] Andrew Wang commented on HDFS-13601: I think this latest rev will pass precommit, and also

[jira] [Updated] (HDFS-13601) Optimize ByteString conversions in PBHelper

[ https://issues.apache.org/jira/browse/HDFS-13601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-13601: --- Attachment: HDFS-13601.004.patch > Optimize ByteString conversions in PBHelper >

[jira] [Updated] (HDFS-13601) Optimize ByteString conversions in PBHelper

[ https://issues.apache.org/jira/browse/HDFS-13601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-13601: --- Attachment: HDFS-13601.003.patch > Optimize ByteString conversions in PBHelper >

[jira] [Updated] (HDFS-13601) Optimize ByteString conversions in PBHelper

[ https://issues.apache.org/jira/browse/HDFS-13601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-13601: --- Attachment: HDFS-13601.002.patch > Optimize ByteString conversions in PBHelper >

[jira] [Commented] (HDFS-13601) Optimize ByteString conversions in PBHelper

[ https://issues.apache.org/jira/browse/HDFS-13601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16483210#comment-16483210 ] Andrew Wang commented on HDFS-13601: I've attached a patch for some flavor and a precommit run. The

[jira] [Updated] (HDFS-13601) Optimize ByteString conversions in PBHelper

[ https://issues.apache.org/jira/browse/HDFS-13601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-13601: --- Status: Patch Available (was: Open) > Optimize ByteString conversions in PBHelper >

[jira] [Updated] (HDFS-13601) Optimize ByteString conversions in PBHelper

[ https://issues.apache.org/jira/browse/HDFS-13601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-13601: --- Attachment: HDFS-13601.001.patch > Optimize ByteString conversions in PBHelper >

[jira] [Created] (HDFS-13601) Optimize ByteString conversions in PBHelper

Andrew Wang created HDFS-13601: -- Summary: Optimize ByteString conversions in PBHelper Key: HDFS-13601 URL: https://issues.apache.org/jira/browse/HDFS-13601 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-13351) Revert HDFS-11156 from branch-2/branch-2.8

[ https://issues.apache.org/jira/browse/HDFS-13351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16416028#comment-16416028 ] Andrew Wang commented on HDFS-13351: +1 pending > Revert HDFS-11156 from branch-2/branch-2.8 >

[jira] [Commented] (HDFS-11156) Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API

[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16414187#comment-16414187 ] Andrew Wang commented on HDFS-11156: Sure, let's revert. I probably just missed it while pushing all

[jira] [Commented] (HDFS-11600) Refactor TestDFSStripedOutputStreamWithFailure test classes

[ https://issues.apache.org/jira/browse/HDFS-11600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16359055#comment-16359055 ] Andrew Wang commented on HDFS-11600: Sure, go for it Sammi :) > Refactor

[jira] [Commented] (HDFS-13009) Creation of Encryption zone should succeed even if directory is not empty.

[ https://issues.apache.org/jira/browse/HDFS-13009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335150#comment-16335150 ] Andrew Wang commented on HDFS-13009: Thanks for the reply Daryn. If this option is only intended for

[jira] [Commented] (HDFS-13009) Creation of Encryption zone should succeed even if directory is not empty.

[ https://issues.apache.org/jira/browse/HDFS-13009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16334973#comment-16334973 ] Andrew Wang commented on HDFS-13009: Hi Rushabh, The original design intent of the zone was to make

[jira] [Updated] (HDFS-11942) make new chooseDataNode policy work in more operation like seek, fetch

[ https://issues.apache.org/jira/browse/HDFS-11942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11942: --- Fix Version/s: (was: 3.0.0) 3.0.1 > make new chooseDataNode policy work in

[jira] [Updated] (HDFS-11201) Spelling errors in the logging, help, assertions and exception messages

[ https://issues.apache.org/jira/browse/HDFS-11201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11201: --- Fix Version/s: (was: 3.0.0) 3.0.1 > Spelling errors in the logging, help,

[jira] [Updated] (HDFS-12920) HDFS default value change (with adding time unit) breaks old version MR tarball work with new version (3.0) of hadoop

[ https://issues.apache.org/jira/browse/HDFS-12920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12920: --- Target Version/s: 3.0.1 (was: 3.0.0) > HDFS default value change (with adding time unit) breaks old

[jira] [Commented] (HDFS-12920) HDFS default value change (with adding time unit) breaks old version MR tarball work with new version (3.0) of hadoop

[ https://issues.apache.org/jira/browse/HDFS-12920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16288574#comment-16288574 ] Andrew Wang commented on HDFS-12920: Particularly since there's a workaround, let's bump this to

[jira] [Commented] (HDFS-12907) Allow read-only access to reserved raw for non-superusers

[ https://issues.apache.org/jira/browse/HDFS-12907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16287009#comment-16287009 ] Andrew Wang commented on HDFS-12907: xattr change makes sense based on the scope of this change. We

[jira] [Updated] (HDFS-12813) RequestHedgingProxyProvider can hide Exception thrown from the Namenode for proxy size of 1

[ https://issues.apache.org/jira/browse/HDFS-12813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12813: --- Fix Version/s: (was: 3.0.0) 3.1.0 > RequestHedgingProxyProvider can hide

[jira] [Updated] (HDFS-12814) Add blockId when warning slow mirror/disk in BlockReceiver

[ https://issues.apache.org/jira/browse/HDFS-12814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12814: --- Fix Version/s: (was: 3.0.0) 3.0.1 3.1.0 > Add blockId when

[jira] [Commented] (HDFS-12907) Allow read-only access to reserved raw for non-superusers

[ https://issues.apache.org/jira/browse/HDFS-12907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282579#comment-16282579 ] Andrew Wang commented on HDFS-12907: Solving this for WebHdfsFileSystem is a lot more tractable than

[jira] [Commented] (HDFS-12907) Allow read-only access to reserved raw for non-superusers

[ https://issues.apache.org/jira/browse/HDFS-12907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282487#comment-16282487 ] Andrew Wang commented on HDFS-12907: I think that would work, though of course I'd prefer not to open

[jira] [Commented] (HDFS-7240) Object store in HDFS

[ https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282441#comment-16282441 ] Andrew Wang commented on HDFS-7240: --- Hi Sanjay, Thanks for writing up that summary. It's clear there's

[jira] [Commented] (HDFS-12907) Allow read-only access to reserved raw for non-superusers

[ https://issues.apache.org/jira/browse/HDFS-12907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282250#comment-16282250 ] Andrew Wang commented on HDFS-12907: It's so they don't accidentally write data without xattrs or with

[jira] [Updated] (HDFS-11576) Block recovery will fail indefinitely if recovery time > heartbeat interval

[ https://issues.apache.org/jira/browse/HDFS-11576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11576: --- Fix Version/s: 3.0.0 > Block recovery will fail indefinitely if recovery time > heartbeat interval >

[jira] [Commented] (HDFS-12907) Allow read-only access to reserved raw for non-superusers

[ https://issues.apache.org/jira/browse/HDFS-12907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16281129#comment-16281129 ] Andrew Wang commented on HDFS-12907: SGTM, we locked it down originally since we didn't know of a

[jira] [Commented] (HDFS-10285) Storage Policy Satisfier in Namenode

[ https://issues.apache.org/jira/browse/HDFS-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16279550#comment-16279550 ] Andrew Wang commented on HDFS-10285: Thanks for chiming in Daryn, bq. My preference is this feature,

[jira] [Updated] (HDFS-12840) Creating a file with non-default EC policy in a EC zone is not correctly serialized in the editlog

[ https://issues.apache.org/jira/browse/HDFS-12840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12840: --- Summary: Creating a file with non-default EC policy in a EC zone is not correctly serialized in the

[jira] [Commented] (HDFS-10285) Storage Policy Satisfier in Namenode

[ https://issues.apache.org/jira/browse/HDFS-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16275034#comment-16275034 ] Andrew Wang commented on HDFS-10285: Hi Anu, thanks for the prompt responses, bq. Yes, [ZK] would be

[jira] [Commented] (HDFS-10285) Storage Policy Satisfier in Namenode

[ https://issues.apache.org/jira/browse/HDFS-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16274950#comment-16274950 ] Andrew Wang commented on HDFS-10285: Is it trivial? I think we still need some type of fencing so

[jira] [Commented] (HDFS-10285) Storage Policy Satisfier in Namenode

[ https://issues.apache.org/jira/browse/HDFS-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16274838#comment-16274838 ] Andrew Wang commented on HDFS-10285: How will clients find this new service? Is it highly available?

[jira] [Commented] (HDFS-12872) EC Checksum broken when BlockAccessToken is enabled

[ https://issues.apache.org/jira/browse/HDFS-12872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16273066#comment-16273066 ] Andrew Wang commented on HDFS-12872: If we can get it in before the other blockers are resolved, I'm

[jira] [Commented] (HDFS-12754) Lease renewal can hit a deadlock

[ https://issues.apache.org/jira/browse/HDFS-12754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263261#comment-16263261 ] Andrew Wang commented on HDFS-12754: Agree, please get it into branch-3.0.0 as well since we're

[jira] [Commented] (HDFS-7240) Object store in HDFS

[ https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257730#comment-16257730 ] Andrew Wang commented on HDFS-7240: --- Some Hortonworkers and Clouderans met yesterday, here are my meeting

[jira] [Updated] (HDFS-12257) Expose getSnapshottableDirListing as a public API in HdfsAdmin

[ https://issues.apache.org/jira/browse/HDFS-12257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12257: --- Target Version/s: 2.8.3, 3.1.0, 2.9.1 (was: 2.8.3, 3.0.0, 2.9.1) > Expose getSnapshottableDirListing

[jira] [Updated] (HDFS-12654) APPEND API call is different in HTTPFS and NameNode REST

[ https://issues.apache.org/jira/browse/HDFS-12654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12654: --- Target Version/s: 3.1.0, 2.9.1, 2.8.4 (was: 3.0.0, 2.9.1, 2.8.4) > APPEND API call is different in

[jira] [Updated] (HDFS-11885) createEncryptionZone should not block on initializing EDEK cache

[ https://issues.apache.org/jira/browse/HDFS-11885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11885: --- Target Version/s: 2.8.3, 3.1.0, 2.9.1 (was: 2.8.3, 3.0.0, 2.9.1) > createEncryptionZone should not

[jira] [Updated] (HDFS-12654) APPEND API call is different in HTTPFS and NameNode REST

[ https://issues.apache.org/jira/browse/HDFS-12654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12654: --- Target Version/s: 3.0.0, 2.9.1, 2.8.4 (was: 2.6.0, 2.7.0, 2.8.0, 3.0.0) > APPEND API call is

[jira] [Updated] (HDFS-12714) Hadoop 3 missing fix for HDFS-5169

[ https://issues.apache.org/jira/browse/HDFS-12714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12714: --- Fix Version/s: (was: 3.0.0-beta1) 3.0.0 > Hadoop 3 missing fix for HDFS-5169 >

[jira] [Updated] (HDFS-11096) Support rolling upgrade between 2.x and 3.x

[ https://issues.apache.org/jira/browse/HDFS-11096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11096: --- Target Version/s: 3.0.1 (was: 3.0.0) Thanks Sean, I'm going to bump this to 3.0.1 then. > Support

[jira] [Commented] (HDFS-12681) Fold HdfsLocatedFileStatus into HdfsFileStatus

[ https://issues.apache.org/jira/browse/HDFS-12681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227517#comment-16227517 ] Andrew Wang commented on HDFS-12681: Thanks for bringing this up Chris. In the interest of keeping the

[jira] [Commented] (HDFS-11096) Support rolling upgrade between 2.x and 3.x

[ https://issues.apache.org/jira/browse/HDFS-11096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227427#comment-16227427 ] Andrew Wang commented on HDFS-11096: Sean, given that we've run HDFS rolling upgrades successfully, do

[jira] [Commented] (HDFS-12699) TestMountTable fails with Java 7

[ https://issues.apache.org/jira/browse/HDFS-12699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227422#comment-16227422 ] Andrew Wang commented on HDFS-12699: Inigo, do you mind setting appropriate fix versions for this

[jira] [Commented] (HDFS-12485) expunge may fail to remove trash from encryption zone

[ https://issues.apache.org/jira/browse/HDFS-12485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227404#comment-16227404 ] Andrew Wang commented on HDFS-12485: I think the branch-3.0 backport was missed, I backported it. >

[jira] [Updated] (HDFS-12495) TestPendingInvalidateBlock#testPendingDeleteUnknownBlocks fails intermittently

[ https://issues.apache.org/jira/browse/HDFS-12495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12495: --- Fix Version/s: (was: 3.0.0) > TestPendingInvalidateBlock#testPendingDeleteUnknownBlocks fails

[jira] [Updated] (HDFS-12523) Thread pools in ErasureCodingWorker do not shutdown

[ https://issues.apache.org/jira/browse/HDFS-12523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12523: --- Fix Version/s: (was: 3.0.0) > Thread pools in ErasureCodingWorker do not shutdown >

[jira] [Commented] (HDFS-12544) SnapshotDiff - support diff generation on any snapshot root descendant directory

[ https://issues.apache.org/jira/browse/HDFS-12544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227399#comment-16227399 ] Andrew Wang commented on HDFS-12544: I think the branch-3.0 backport was missed, I backported it. >

[jira] [Commented] (HDFS-12573) Divide the total block metrics into replica and ec

[ https://issues.apache.org/jira/browse/HDFS-12573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227397#comment-16227397 ] Andrew Wang commented on HDFS-12573: I think the branch-3.0 backport was missed, I backported it. >

[jira] [Commented] (HDFS-12614) FSPermissionChecker#getINodeAttrs() throws NPE when INodeAttributesProvider configured

[ https://issues.apache.org/jira/browse/HDFS-12614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227395#comment-16227395 ] Andrew Wang commented on HDFS-12614: I think the branch-3.0 backport was missed, I backported it. >

[jira] [Commented] (HDFS-12619) Do not catch and throw unchecked exceptions if IBRs fail to process

[ https://issues.apache.org/jira/browse/HDFS-12619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227394#comment-16227394 ] Andrew Wang commented on HDFS-12619: I think the branch-3.0 commit was missed, I backported it. > Do

[jira] [Commented] (HDFS-12622) Fix enumerate in HDFSErasureCoding.md

[ https://issues.apache.org/jira/browse/HDFS-12622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227392#comment-16227392 ] Andrew Wang commented on HDFS-12622: I think the branch-3.0 commit was missed, I backported it. > Fix

[jira] [Commented] (HDFS-11467) Support ErasureCoding section in OIV XML/ReverseXML

[ https://issues.apache.org/jira/browse/HDFS-11467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227202#comment-16227202 ] Andrew Wang commented on HDFS-11467: Hey folks, are we planning to close on this in the next few days?

[jira] [Commented] (HDFS-12499) dfs.namenode.shared.edits.dir property is currently namenode specific key

[ https://issues.apache.org/jira/browse/HDFS-12499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227197#comment-16227197 ] Andrew Wang commented on HDFS-12499: I've reverted this from trunk and branch-3.0. Apologies for the

[jira] [Updated] (HDFS-12499) dfs.namenode.shared.edits.dir property is currently namenode specific key

[ https://issues.apache.org/jira/browse/HDFS-12499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12499: --- Fix Version/s: (was: 3.0.0) > dfs.namenode.shared.edits.dir property is currently namenode

[jira] [Reopened] (HDFS-12499) dfs.namenode.shared.edits.dir property is currently namenode specific key

[ https://issues.apache.org/jira/browse/HDFS-12499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang reopened HDFS-12499: > dfs.namenode.shared.edits.dir property is currently namenode specific key >

[jira] [Commented] (HDFS-12499) dfs.namenode.shared.edits.dir property is currently namenode specific key

[ https://issues.apache.org/jira/browse/HDFS-12499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16227185#comment-16227185 ] Andrew Wang commented on HDFS-12499: Sorry, I was off yesterday. I just checked, and Cloudera Manager

[jira] [Updated] (HDFS-12686) Erasure coding system policy state is not correctly saved and loaded during real cluster restart

[ https://issues.apache.org/jira/browse/HDFS-12686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12686: --- Priority: Blocker (was: Critical) > Erasure coding system policy state is not correctly saved and

[jira] [Updated] (HDFS-11467) Support ErasureCoding section in OIV XML/ReverseXML

[ https://issues.apache.org/jira/browse/HDFS-11467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11467: --- Priority: Blocker (was: Major) > Support ErasureCoding section in OIV XML/ReverseXML >

[jira] [Updated] (HDFS-12497) Re-enable TestDFSStripedOutputStreamWithFailure tests

[ https://issues.apache.org/jira/browse/HDFS-12497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12497: --- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-11096) Support rolling upgrade between 2.x and 3.x

[ https://issues.apache.org/jira/browse/HDFS-11096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16213176#comment-16213176 ] Andrew Wang commented on HDFS-11096: Folks, is this going to be committed by the end of the month?

[jira] [Updated] (HDFS-12682) ECAdmin -listPolicies will always show policy state as DISABLED

[ https://issues.apache.org/jira/browse/HDFS-12682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12682: --- Priority: Blocker (was: Major) > ECAdmin -listPolicies will always show policy state as DISABLED >

[jira] [Commented] (HDFS-12682) ECAdmin -listPolicies will always show policy state as DISABLED

[ https://issues.apache.org/jira/browse/HDFS-12682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210230#comment-16210230 ] Andrew Wang commented on HDFS-12682: My concern was actually for the clients, since there are apps

[jira] [Commented] (HDFS-12310) [SPS]: Provide an option to track the status of in progress requests

[ https://issues.apache.org/jira/browse/HDFS-12310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16208474#comment-16208474 ] Andrew Wang commented on HDFS-12310: Sorry, I don't think I'll have time to review this. Maybe

[jira] [Commented] (HDFS-12669) Implement toString() for EditLogInputStream

[ https://issues.apache.org/jira/browse/HDFS-12669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16208167#comment-16208167 ] Andrew Wang commented on HDFS-12669: Sure, I added you as a contributor to all the hadoop-y projects.

  1   2   3   4   5   6   7   8   9   10   >