[jira] [Commented] (HDFS-12946) Add a tool to check rack configuration against EC policies

[ https://issues.apache.org/jira/browse/HDFS-12946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16652115#comment-16652115 ] Andrew Wang commented on HDFS-12946: Hi folks, thanks for working on this! Catching u

[jira] [Commented] (HDFS-13672) clearCorruptLazyPersistFiles could crash NameNode

[ https://issues.apache.org/jira/browse/HDFS-13672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16553150#comment-16553150 ] Andrew Wang commented on HDFS-13672: Hi Gabor, I took a quick look. It doesn't look l

[jira] [Commented] (HDFS-13658) fsck, dfsadmin -report, and NN WebUI should report number of blocks that have 1 replica

[ https://issues.apache.org/jira/browse/HDFS-13658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16536996#comment-16536996 ] Andrew Wang commented on HDFS-13658: Hi Kitti, thanks for working on this! IIUC in yo

[jira] [Updated] (HDFS-13719) Docs around dfs.image.transfer.timeout are misleading

[ https://issues.apache.org/jira/browse/HDFS-13719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-13719: --- Resolution: Fixed Fix Version/s: 3.0.4 3.1.1 3.2.0

[jira] [Commented] (HDFS-13719) Docs around dfs.image.transfer.timeout are misleading

[ https://issues.apache.org/jira/browse/HDFS-13719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16533545#comment-16533545 ] Andrew Wang commented on HDFS-13719: Nice find. This looks like a holdover from when

[jira] [Commented] (HDFS-13672) clearCorruptLazyPersistFiles could crash NameNode

[ https://issues.apache.org/jira/browse/HDFS-13672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16531431#comment-16531431 ] Andrew Wang commented on HDFS-13672: Hi Gabor, to respond to your question, I think t

[jira] [Commented] (HDFS-13672) clearCorruptLazyPersistFiles could crash NameNode

[ https://issues.apache.org/jira/browse/HDFS-13672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16531371#comment-16531371 ] Andrew Wang commented on HDFS-13672: Hi Gabor, thanks for working on this, I don't t

[jira] [Updated] (HDFS-13712) BlockReaderRemote.read() logging improvement

[ https://issues.apache.org/jira/browse/HDFS-13712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-13712: --- Resolution: Fixed Fix Version/s: 3.0.4 3.1.1 3.2.0

[jira] [Commented] (HDFS-13712) BlockReaderRemote.read() logging improvement

[ https://issues.apache.org/jira/browse/HDFS-13712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16529970#comment-16529970 ] Andrew Wang commented on HDFS-13712: +1 LGTM pending Jenkins, thanks for filing this

[jira] [Updated] (HDFS-13712) BlockReaderRemote.read() logging improvement

[ https://issues.apache.org/jira/browse/HDFS-13712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-13712: --- Target Version/s: 3.2.0, 3.1.1, 3.0.4 (was: 3.2.0) > BlockReaderRemote.read() logging improvement >

[jira] [Updated] (HDFS-13702) Remove HTrace hooks from DFSClient to reduce CPU usage

[ https://issues.apache.org/jira/browse/HDFS-13702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-13702: --- Resolution: Fixed Fix Version/s: 3.0.4 3.1.1 3.2.0

[jira] [Updated] (HDFS-13702) Remove HTrace hooks from DFSClient to reduce CPU usage

[ https://issues.apache.org/jira/browse/HDFS-13702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-13702: --- Summary: Remove HTrace hooks from DFSClient to reduce CPU usage (was: HTrace hooks taking 10-15% CPU

[jira] [Updated] (HDFS-13703) Avoid allocation of CorruptedBlocks hashmap when no corrupted blocks are hit

[ https://issues.apache.org/jira/browse/HDFS-13703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-13703: --- Resolution: Fixed Fix Version/s: 3.0.4 3.1.1 3.2.0

[jira] [Commented] (HDFS-13703) Avoid allocation of CorruptedBlocks hashmap when no corrupted blocks are hit

[ https://issues.apache.org/jira/browse/HDFS-13703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16529643#comment-16529643 ] Andrew Wang commented on HDFS-13703: +1 LGTM, will commit shortly. > Avoid allocatio

[jira] [Commented] (HDFS-13671) Namenode deletes large dir slowly caused by FoldedTreeSet#removeAndGet

[ https://issues.apache.org/jira/browse/HDFS-13671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16514115#comment-16514115 ] Andrew Wang commented on HDFS-13671: I'm fine with reverting if we're seeing producti

[jira] [Commented] (HDFS-13616) Batch listing of multiple directories

[ https://issues.apache.org/jira/browse/HDFS-13616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16497016#comment-16497016 ] Andrew Wang commented on HDFS-13616: Would we be okay with making this a DistributedF

[jira] [Commented] (HDFS-13616) Batch listing of multiple directories

[ https://issues.apache.org/jira/browse/HDFS-13616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16491400#comment-16491400 ] Andrew Wang commented on HDFS-13616: bq. if I pass a file (instead of a directory), wi

[jira] [Commented] (HDFS-13616) Batch listing of multiple directories

[ https://issues.apache.org/jira/browse/HDFS-13616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16491002#comment-16491002 ] Andrew Wang commented on HDFS-13616: Thanks for taking a look, Xiao and Aaron! bq. We

[jira] [Updated] (HDFS-13616) Batch listing of multiple directories

[ https://issues.apache.org/jira/browse/HDFS-13616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-13616: --- Attachment: BenchmarkListFiles.java > Batch listing of multiple directories >

[jira] [Commented] (HDFS-13616) Batch listing of multiple directories

[ https://issues.apache.org/jira/browse/HDFS-13616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16490068#comment-16490068 ] Andrew Wang commented on HDFS-13616: Latest patch addresses some precommit issues. As

[jira] [Updated] (HDFS-13616) Batch listing of multiple directories

[ https://issues.apache.org/jira/browse/HDFS-13616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-13616: --- Attachment: HDFS-13616.002.patch > Batch listing of multiple directories > ---

[jira] [Commented] (HDFS-13616) Batch listing of multiple directories

[ https://issues.apache.org/jira/browse/HDFS-13616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16490032#comment-16490032 ] Andrew Wang commented on HDFS-13616: Hi Zhe, thanks for taking a look! This API respec

[jira] [Commented] (HDFS-13616) Batch listing of multiple directories

[ https://issues.apache.org/jira/browse/HDFS-13616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16489568#comment-16489568 ] Andrew Wang commented on HDFS-13616: Thanks for providing the additional context Todd,

[jira] [Updated] (HDFS-13616) Batch listing of multiple directories

[ https://issues.apache.org/jira/browse/HDFS-13616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-13616: --- Status: Patch Available (was: Open) > Batch listing of multiple directories > ---

[jira] [Commented] (HDFS-13616) Batch listing of multiple directories

[ https://issues.apache.org/jira/browse/HDFS-13616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16489518#comment-16489518 ] Andrew Wang commented on HDFS-13616: Patch attached to get some initial feedback on th

[jira] [Updated] (HDFS-13616) Batch listing of multiple directories

[ https://issues.apache.org/jira/browse/HDFS-13616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-13616: --- Attachment: HDFS-13616.001.patch > Batch listing of multiple directories > ---

[jira] [Created] (HDFS-13616) Batch listing of multiple directories

Andrew Wang created HDFS-13616: -- Summary: Batch listing of multiple directories Key: HDFS-13616 URL: https://issues.apache.org/jira/browse/HDFS-13616 Project: Hadoop HDFS Issue Type: New Feature

[jira] [Updated] (HDFS-13611) Unsafe use of Text as a ConcurrentHashMap key in PBHelperClient

[ https://issues.apache.org/jira/browse/HDFS-13611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-13611: --- Resolution: Fixed Fix Version/s: 3.0.4 3.1.1 3.2.0

[jira] [Commented] (HDFS-13611) Unsafe use of Text as a ConcurrentHashMap key in PBHelperClient

[ https://issues.apache.org/jira/browse/HDFS-13611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16487864#comment-16487864 ] Andrew Wang commented on HDFS-13611: Even simpler patch attached, if we make a copy of

[jira] [Updated] (HDFS-13611) Unsafe use of Text as a ConcurrentHashMap key in PBHelperClient

[ https://issues.apache.org/jira/browse/HDFS-13611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-13611: --- Attachment: HDFS-13611.002.patch > Unsafe use of Text as a ConcurrentHashMap key in PBHelperClient > -

[jira] [Commented] (HDFS-13611) Unsafe use of Text as a ConcurrentHashMap key in PBHelperClient

[ https://issues.apache.org/jira/browse/HDFS-13611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16487849#comment-16487849 ] Andrew Wang commented on HDFS-13611: Simple patch attached, getFixedByteString(Text) w

[jira] [Updated] (HDFS-13611) Unsafe use of Text as a ConcurrentHashMap key in PBHelperClient

[ https://issues.apache.org/jira/browse/HDFS-13611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-13611: --- Affects Version/s: 3.0.4 3.1.1 3.2.0

[jira] [Updated] (HDFS-13611) Unsafe use of Text as a ConcurrentHashMap key in PBHelperClient

[ https://issues.apache.org/jira/browse/HDFS-13611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-13611: --- Attachment: HDFS-13611.001.patch > Unsafe use of Text as a ConcurrentHashMap key in PBHelperClient > -

[jira] [Created] (HDFS-13611) Unsafe use of Text as a ConcurrentHashMap key in PBHelperClient

Andrew Wang created HDFS-13611: -- Summary: Unsafe use of Text as a ConcurrentHashMap key in PBHelperClient Key: HDFS-13611 URL: https://issues.apache.org/jira/browse/HDFS-13611 Project: Hadoop HDFS

[jira] [Updated] (HDFS-13601) Optimize ByteString conversions in PBHelper

[ https://issues.apache.org/jira/browse/HDFS-13601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-13601: --- Resolution: Fixed Fix Version/s: 3.0.3 3.1.1 3.2.0

[jira] [Commented] (HDFS-13601) Optimize ByteString conversions in PBHelper

[ https://issues.apache.org/jira/browse/HDFS-13601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16486777#comment-16486777 ] Andrew Wang commented on HDFS-13601: Thanks for reviewing Xiao! I think this current b

[jira] [Commented] (HDFS-13601) Optimize ByteString conversions in PBHelper

[ https://issues.apache.org/jira/browse/HDFS-13601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16486602#comment-16486602 ] Andrew Wang commented on HDFS-13601: I think this latest rev will pass precommit, and

[jira] [Updated] (HDFS-13601) Optimize ByteString conversions in PBHelper

[ https://issues.apache.org/jira/browse/HDFS-13601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-13601: --- Attachment: HDFS-13601.004.patch > Optimize ByteString conversions in PBHelper > -

[jira] [Updated] (HDFS-13601) Optimize ByteString conversions in PBHelper

[ https://issues.apache.org/jira/browse/HDFS-13601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-13601: --- Attachment: HDFS-13601.003.patch > Optimize ByteString conversions in PBHelper > -

[jira] [Updated] (HDFS-13601) Optimize ByteString conversions in PBHelper

[ https://issues.apache.org/jira/browse/HDFS-13601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-13601: --- Attachment: HDFS-13601.002.patch > Optimize ByteString conversions in PBHelper > -

[jira] [Commented] (HDFS-13601) Optimize ByteString conversions in PBHelper

[ https://issues.apache.org/jira/browse/HDFS-13601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16483210#comment-16483210 ] Andrew Wang commented on HDFS-13601: I've attached a patch for some flavor and a preco

[jira] [Updated] (HDFS-13601) Optimize ByteString conversions in PBHelper

[ https://issues.apache.org/jira/browse/HDFS-13601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-13601: --- Status: Patch Available (was: Open) > Optimize ByteString conversions in PBHelper > -

[jira] [Updated] (HDFS-13601) Optimize ByteString conversions in PBHelper

[ https://issues.apache.org/jira/browse/HDFS-13601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-13601: --- Attachment: HDFS-13601.001.patch > Optimize ByteString conversions in PBHelper > -

[jira] [Created] (HDFS-13601) Optimize ByteString conversions in PBHelper

Andrew Wang created HDFS-13601: -- Summary: Optimize ByteString conversions in PBHelper Key: HDFS-13601 URL: https://issues.apache.org/jira/browse/HDFS-13601 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-13351) Revert HDFS-11156 from branch-2/branch-2.8

[ https://issues.apache.org/jira/browse/HDFS-13351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16416028#comment-16416028 ] Andrew Wang commented on HDFS-13351: +1 pending > Revert HDFS-11156 from branch-2/bra

[jira] [Commented] (HDFS-11156) Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API

[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16414187#comment-16414187 ] Andrew Wang commented on HDFS-11156: Sure, let's revert. I probably just missed it whi

[jira] [Commented] (HDFS-11600) Refactor TestDFSStripedOutputStreamWithFailure test classes

[ https://issues.apache.org/jira/browse/HDFS-11600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16359055#comment-16359055 ] Andrew Wang commented on HDFS-11600: Sure, go for it Sammi :) > Refactor TestDFSStrip

[jira] [Commented] (HDFS-13009) Creation of Encryption zone should succeed even if directory is not empty.

[ https://issues.apache.org/jira/browse/HDFS-13009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16335150#comment-16335150 ] Andrew Wang commented on HDFS-13009: Thanks for the reply Daryn. If this option is onl

[jira] [Commented] (HDFS-13009) Creation of Encryption zone should succeed even if directory is not empty.

[ https://issues.apache.org/jira/browse/HDFS-13009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16334973#comment-16334973 ] Andrew Wang commented on HDFS-13009: Hi Rushabh, The original design intent of the zo

[jira] [Updated] (HDFS-11942) make new chooseDataNode policy work in more operation like seek, fetch

[ https://issues.apache.org/jira/browse/HDFS-11942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11942: --- Fix Version/s: (was: 3.0.0) 3.0.1 > make new chooseDataNode policy work in mo

[jira] [Updated] (HDFS-11201) Spelling errors in the logging, help, assertions and exception messages

[ https://issues.apache.org/jira/browse/HDFS-11201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11201: --- Fix Version/s: (was: 3.0.0) 3.0.1 > Spelling errors in the logging, help, asser

[jira] [Updated] (HDFS-12920) HDFS default value change (with adding time unit) breaks old version MR tarball work with new version (3.0) of hadoop

[ https://issues.apache.org/jira/browse/HDFS-12920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12920: --- Target Version/s: 3.0.1 (was: 3.0.0) > HDFS default value change (with adding time unit) breaks old v

[jira] [Commented] (HDFS-12920) HDFS default value change (with adding time unit) breaks old version MR tarball work with new version (3.0) of hadoop

[ https://issues.apache.org/jira/browse/HDFS-12920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16288574#comment-16288574 ] Andrew Wang commented on HDFS-12920: Particularly since there's a workaround, let's bu

[jira] [Commented] (HDFS-12907) Allow read-only access to reserved raw for non-superusers

[ https://issues.apache.org/jira/browse/HDFS-12907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16287009#comment-16287009 ] Andrew Wang commented on HDFS-12907: xattr change makes sense based on the scope of th

[jira] [Updated] (HDFS-12813) RequestHedgingProxyProvider can hide Exception thrown from the Namenode for proxy size of 1

[ https://issues.apache.org/jira/browse/HDFS-12813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12813: --- Fix Version/s: (was: 3.0.0) 3.1.0 > RequestHedgingProxyProvider can hide Except

[jira] [Updated] (HDFS-12814) Add blockId when warning slow mirror/disk in BlockReceiver

[ https://issues.apache.org/jira/browse/HDFS-12814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12814: --- Fix Version/s: (was: 3.0.0) 3.0.1 3.1.0 > Add blockId when w

[jira] [Commented] (HDFS-12907) Allow read-only access to reserved raw for non-superusers

[ https://issues.apache.org/jira/browse/HDFS-12907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16282579#comment-16282579 ] Andrew Wang commented on HDFS-12907: Solving this for WebHdfsFileSystem is a lot more

[jira] [Commented] (HDFS-12907) Allow read-only access to reserved raw for non-superusers

[ https://issues.apache.org/jira/browse/HDFS-12907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16282487#comment-16282487 ] Andrew Wang commented on HDFS-12907: I think that would work, though of course I'd pre

[jira] [Commented] (HDFS-7240) Object store in HDFS

[ https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16282441#comment-16282441 ] Andrew Wang commented on HDFS-7240: --- Hi Sanjay, Thanks for writing up that summary. It's

[jira] [Commented] (HDFS-12907) Allow read-only access to reserved raw for non-superusers

[ https://issues.apache.org/jira/browse/HDFS-12907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16282250#comment-16282250 ] Andrew Wang commented on HDFS-12907: It's so they don't accidentally write data withou

[jira] [Updated] (HDFS-11576) Block recovery will fail indefinitely if recovery time > heartbeat interval

[ https://issues.apache.org/jira/browse/HDFS-11576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11576: --- Fix Version/s: 3.0.0 > Block recovery will fail indefinitely if recovery time > heartbeat interval > -

[jira] [Commented] (HDFS-12907) Allow read-only access to reserved raw for non-superusers

[ https://issues.apache.org/jira/browse/HDFS-12907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16281129#comment-16281129 ] Andrew Wang commented on HDFS-12907: SGTM, we locked it down originally since we didn'

[jira] [Commented] (HDFS-10285) Storage Policy Satisfier in Namenode

[ https://issues.apache.org/jira/browse/HDFS-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16279550#comment-16279550 ] Andrew Wang commented on HDFS-10285: Thanks for chiming in Daryn, bq. My preference i

[jira] [Updated] (HDFS-12840) Creating a file with non-default EC policy in a EC zone is not correctly serialized in the editlog

[ https://issues.apache.org/jira/browse/HDFS-12840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12840: --- Summary: Creating a file with non-default EC policy in a EC zone is not correctly serialized in the ed

[jira] [Commented] (HDFS-10285) Storage Policy Satisfier in Namenode

[ https://issues.apache.org/jira/browse/HDFS-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16277679#comment-16277679 ] Andrew Wang commented on HDFS-10285: Responding to Anu's comment above inline: bq. Fr

[jira] [Updated] (HDFS-12860) TeraSort failed on erasure coding directory

[ https://issues.apache.org/jira/browse/HDFS-12860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12860: --- Component/s: erasure-coding > TeraSort failed on erasure coding directory > --

[jira] [Commented] (HDFS-10285) Storage Policy Satisfier in Namenode

[ https://issues.apache.org/jira/browse/HDFS-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16275034#comment-16275034 ] Andrew Wang commented on HDFS-10285: Hi Anu, thanks for the prompt responses, bq. Yes

[jira] [Commented] (HDFS-10285) Storage Policy Satisfier in Namenode

[ https://issues.apache.org/jira/browse/HDFS-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16274950#comment-16274950 ] Andrew Wang commented on HDFS-10285: Is it trivial? I think we still need some type of

[jira] [Commented] (HDFS-10285) Storage Policy Satisfier in Namenode

[ https://issues.apache.org/jira/browse/HDFS-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16274838#comment-16274838 ] Andrew Wang commented on HDFS-10285: How will clients find this new service? Is it hig

[jira] [Commented] (HDFS-12872) EC Checksum broken when BlockAccessToken is enabled

[ https://issues.apache.org/jira/browse/HDFS-12872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16273066#comment-16273066 ] Andrew Wang commented on HDFS-12872: If we can get it in before the other blockers are

[jira] [Commented] (HDFS-12754) Lease renewal can hit a deadlock

[ https://issues.apache.org/jira/browse/HDFS-12754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16263261#comment-16263261 ] Andrew Wang commented on HDFS-12754: Agree, please get it into branch-3.0.0 as well si

[jira] [Commented] (HDFS-7240) Object store in HDFS

[ https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16257730#comment-16257730 ] Andrew Wang commented on HDFS-7240: --- Some Hortonworkers and Clouderans met yesterday, her

[jira] [Updated] (HDFS-12257) Expose getSnapshottableDirListing as a public API in HdfsAdmin

[ https://issues.apache.org/jira/browse/HDFS-12257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12257: --- Target Version/s: 2.8.3, 3.1.0, 2.9.1 (was: 2.8.3, 3.0.0, 2.9.1) > Expose getSnapshottableDirListing

[jira] [Updated] (HDFS-12654) APPEND API call is different in HTTPFS and NameNode REST

[ https://issues.apache.org/jira/browse/HDFS-12654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12654: --- Target Version/s: 3.1.0, 2.9.1, 2.8.4 (was: 3.0.0, 2.9.1, 2.8.4) > APPEND API call is different in HT

[jira] [Updated] (HDFS-11885) createEncryptionZone should not block on initializing EDEK cache

[ https://issues.apache.org/jira/browse/HDFS-11885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11885: --- Target Version/s: 2.8.3, 3.1.0, 2.9.1 (was: 2.8.3, 3.0.0, 2.9.1) > createEncryptionZone should not bl

[jira] [Updated] (HDFS-12654) APPEND API call is different in HTTPFS and NameNode REST

[ https://issues.apache.org/jira/browse/HDFS-12654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12654: --- Target Version/s: 3.0.0, 2.9.1, 2.8.4 (was: 2.6.0, 2.7.0, 2.8.0, 3.0.0) > APPEND API call is differen

[jira] [Updated] (HDFS-12714) Hadoop 3 missing fix for HDFS-5169

[ https://issues.apache.org/jira/browse/HDFS-12714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12714: --- Fix Version/s: (was: 3.0.0-beta1) 3.0.0 > Hadoop 3 missing fix for HDFS-5169 >

[jira] [Updated] (HDFS-11096) Support rolling upgrade between 2.x and 3.x

[ https://issues.apache.org/jira/browse/HDFS-11096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11096: --- Target Version/s: 3.0.1 (was: 3.0.0) Thanks Sean, I'm going to bump this to 3.0.1 then. > Support ro

[jira] [Commented] (HDFS-12681) Fold HdfsLocatedFileStatus into HdfsFileStatus

[ https://issues.apache.org/jira/browse/HDFS-12681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227517#comment-16227517 ] Andrew Wang commented on HDFS-12681: Thanks for bringing this up Chris. In the interes

[jira] [Commented] (HDFS-11096) Support rolling upgrade between 2.x and 3.x

[ https://issues.apache.org/jira/browse/HDFS-11096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227427#comment-16227427 ] Andrew Wang commented on HDFS-11096: Sean, given that we've run HDFS rolling upgrades

[jira] [Commented] (HDFS-12699) TestMountTable fails with Java 7

[ https://issues.apache.org/jira/browse/HDFS-12699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227422#comment-16227422 ] Andrew Wang commented on HDFS-12699: Inigo, do you mind setting appropriate fix versio

[jira] [Commented] (HDFS-12485) expunge may fail to remove trash from encryption zone

[ https://issues.apache.org/jira/browse/HDFS-12485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227404#comment-16227404 ] Andrew Wang commented on HDFS-12485: I think the branch-3.0 backport was missed, I bac

[jira] [Updated] (HDFS-12495) TestPendingInvalidateBlock#testPendingDeleteUnknownBlocks fails intermittently

[ https://issues.apache.org/jira/browse/HDFS-12495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12495: --- Fix Version/s: (was: 3.0.0) > TestPendingInvalidateBlock#testPendingDeleteUnknownBlocks fails inte

[jira] [Updated] (HDFS-12523) Thread pools in ErasureCodingWorker do not shutdown

[ https://issues.apache.org/jira/browse/HDFS-12523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12523: --- Fix Version/s: (was: 3.0.0) > Thread pools in ErasureCodingWorker do not shutdown > --

[jira] [Commented] (HDFS-12544) SnapshotDiff - support diff generation on any snapshot root descendant directory

[ https://issues.apache.org/jira/browse/HDFS-12544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227399#comment-16227399 ] Andrew Wang commented on HDFS-12544: I think the branch-3.0 backport was missed, I bac

[jira] [Commented] (HDFS-12573) Divide the total block metrics into replica and ec

[ https://issues.apache.org/jira/browse/HDFS-12573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227397#comment-16227397 ] Andrew Wang commented on HDFS-12573: I think the branch-3.0 backport was missed, I bac

[jira] [Commented] (HDFS-12614) FSPermissionChecker#getINodeAttrs() throws NPE when INodeAttributesProvider configured

[ https://issues.apache.org/jira/browse/HDFS-12614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227395#comment-16227395 ] Andrew Wang commented on HDFS-12614: I think the branch-3.0 backport was missed, I bac

[jira] [Commented] (HDFS-12619) Do not catch and throw unchecked exceptions if IBRs fail to process

[ https://issues.apache.org/jira/browse/HDFS-12619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227394#comment-16227394 ] Andrew Wang commented on HDFS-12619: I think the branch-3.0 commit was missed, I backp

[jira] [Commented] (HDFS-12622) Fix enumerate in HDFSErasureCoding.md

[ https://issues.apache.org/jira/browse/HDFS-12622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227392#comment-16227392 ] Andrew Wang commented on HDFS-12622: I think the branch-3.0 commit was missed, I backp

[jira] [Commented] (HDFS-11467) Support ErasureCoding section in OIV XML/ReverseXML

[ https://issues.apache.org/jira/browse/HDFS-11467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227202#comment-16227202 ] Andrew Wang commented on HDFS-11467: Hey folks, are we planning to close on this in th

[jira] [Commented] (HDFS-12499) dfs.namenode.shared.edits.dir property is currently namenode specific key

[ https://issues.apache.org/jira/browse/HDFS-12499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227197#comment-16227197 ] Andrew Wang commented on HDFS-12499: I've reverted this from trunk and branch-3.0. Apo

[jira] [Updated] (HDFS-12499) dfs.namenode.shared.edits.dir property is currently namenode specific key

[ https://issues.apache.org/jira/browse/HDFS-12499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12499: --- Fix Version/s: (was: 3.0.0) > dfs.namenode.shared.edits.dir property is currently namenode specifi

[jira] [Reopened] (HDFS-12499) dfs.namenode.shared.edits.dir property is currently namenode specific key

[ https://issues.apache.org/jira/browse/HDFS-12499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang reopened HDFS-12499: > dfs.namenode.shared.edits.dir property is currently namenode specific key > --

[jira] [Commented] (HDFS-12499) dfs.namenode.shared.edits.dir property is currently namenode specific key

[ https://issues.apache.org/jira/browse/HDFS-12499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227185#comment-16227185 ] Andrew Wang commented on HDFS-12499: Sorry, I was off yesterday. I just checked, and C

[jira] [Updated] (HDFS-12686) Erasure coding system policy state is not correctly saved and loaded during real cluster restart

[ https://issues.apache.org/jira/browse/HDFS-12686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12686: --- Priority: Blocker (was: Critical) > Erasure coding system policy state is not correctly saved and loa

[jira] [Updated] (HDFS-11467) Support ErasureCoding section in OIV XML/ReverseXML

[ https://issues.apache.org/jira/browse/HDFS-11467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11467: --- Priority: Blocker (was: Major) > Support ErasureCoding section in OIV XML/ReverseXML > --

[jira] [Updated] (HDFS-12497) Re-enable TestDFSStripedOutputStreamWithFailure tests

[ https://issues.apache.org/jira/browse/HDFS-12497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12497: --- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available) Than

[jira] [Commented] (HDFS-11096) Support rolling upgrade between 2.x and 3.x

[ https://issues.apache.org/jira/browse/HDFS-11096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16213176#comment-16213176 ] Andrew Wang commented on HDFS-11096: Folks, is this going to be committed by the end o

[jira] [Updated] (HDFS-12682) ECAdmin -listPolicies will always show policy state as DISABLED

[ https://issues.apache.org/jira/browse/HDFS-12682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12682: --- Priority: Blocker (was: Major) > ECAdmin -listPolicies will always show policy state as DISABLED > --

[jira] [Commented] (HDFS-12682) ECAdmin -listPolicies will always show policy state as DISABLED

[ https://issues.apache.org/jira/browse/HDFS-12682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16210230#comment-16210230 ] Andrew Wang commented on HDFS-12682: My concern was actually for the clients, since th

  1   2   3   4   5   6   7   8   9   10   >