hdfs-dev
Thread
Date
Earlier messages
Later messages
Messages by Thread
[jira] [Created] (HDFS-17031) Reduce some repeated codes in RouterRpcServer
Chengwei Wang (Jira)
[jira] [Created] (HDFS-17030) Limit wait time for getHAServiceState in ObserverReaderProxy
Xing Lin (Jira)
[jira] [Created] (HDFS-17029) Support getECPolices API in WebHDFS
Hualong Zhang (Jira)
[jira] [Created] (HDFS-17028) RBF: Optimize toString method of class ConnectionContext
farmmamba (Jira)
[jira] [Created] (HDFS-17027) RBF: Add supports for observer.auto-msync-period when using routers
Simbarashe Dzinamarira (Jira)
[jira] [Created] (HDFS-17026) NamenodeHeartbeatService should update JMX report with configurable frequency
Hector Sandoval Chaverri (Jira)
[jira] [Created] (HDFS-17025) RBF: Support port based selective encryption from routers.
Simbarashe Dzinamarira (Jira)
[jira] [Created] (HDFS-17024) Potential data race introduced by HDFS-15865
Wei-Chiu Chuang (Jira)
[jira] [Resolved] (HDFS-16908) Fix javadoc of field IncrementalBlockReportManager#readyToSend.
Ayush Saxena (Jira)
[jira] [Resolved] (HDFS-17020) RBF: mount table addAll should print failed records in std error
Jira
[jira] [Resolved] (HDFS-16994) NumTimedOutPendingReconstructions metrics should not be accumulated
Ayush Saxena (Jira)
[jira] [Created] (HDFS-17023) Record proxy time when can invokeConcurrent method.
farmmamba (Jira)
[jira] [Resolved] (HDFS-17021) GENSTAMP_MISMATCH replica can not be removed by invalidateCorruptReplicas()
Shuyan Zhang (Jira)
[jira] [Resolved] (HDFS-17017) Fix the issue of arguments number limit in report command in DFSAdmin.
Ayush Saxena (Jira)
[jira] [Resolved] (HDFS-17022) Fix the exception message to print the Identifier pattern
Ayush Saxena (Jira)
[jira] [Resolved] (HDFS-17014) HttpFS Add Support getStatus API
Ayush Saxena (Jira)
[jira] [Resolved] (HDFS-16697) Add logs if resources are not available in NameNodeResourcePolicy
Ayush Saxena (Jira)
[jira] [Created] (HDFS-17021) GENSTAMP_MISMATCH replica can not be removed by invalidateCorruptReplicas()
Shuyan Zhang (Jira)
[jira] [Resolved] (HDFS-16653) Improve error messages in ShortCircuitCache
Ayush Saxena (Jira)
[jira] [Resolved] (HDFS-17018) Improve dfsclient log format
Ayush Saxena (Jira)
Issues with Github PR integration with Jira
Ayush Saxena
Re: Issues with Github PR integration with Jira
Ayush Saxena
[jira] [Resolved] (HDFS-16979) RBF: Add dfsrouter port in hdfsauditlog
Ayush Saxena (Jira)
[jira] [Created] (HDFS-17020) RBF: mount table addAll should print failed records in std error
Viraj Jasani (Jira)
[jira] [Created] (HDFS-17019) Optimize the logic for reconfigure slow peer enable for Namenode
Haiyang Hu (Jira)
[jira] [Resolved] (HDFS-17012) Remove unused DFSConfigKeys#DFS_DATANODE_PMEM_CACHE_DIRS_DEFAULT
Ayush Saxena (Jira)
[jira] [Resolved] (HDFS-17010) Add a subtree test to TestSnapshotDiffReport
Tsz-wo Sze (Jira)
[jira] [Created] (HDFS-17018) Normalizes log records on the hdfs client
Xianming Lei (Jira)
[jira] [Created] (HDFS-17017) Fix the issue of parameter length limit in report command in DFSAdmin.
Haiyang Hu (Jira)
[jira] [Resolved] (HDFS-17009) RBF: state store putAll should also return failed records
Jira
[jira] [Resolved] (HDFS-17015) Typos in HDFS Documents
Jira
[jira] [Created] (HDFS-17016) Cleanup method calls to static Assert and Assume methods in TestCodecRawCoderMapping
WangYuanben (Jira)
[jira] [Created] (HDFS-17015) Typos in HDFS Documents
Liang Yan (Jira)
[jira] [Created] (HDFS-17014) HttpFS Add Support getStatus API
Hualong Zhang (Jira)
[jira] [Created] (HDFS-17013) FSNamesystem.commitBlockSynchronization may not persistBlocks
zju_zsx (Jira)
[jira] [Created] (HDFS-17012) Remove unused DFSConfigKeys#DFS_DATANODE_PMEM_CACHE_DIRS_DEFAULT
JiangHua Zhu (Jira)
[jira] [Created] (HDFS-17011) Fix the metric of "HttpPort" at DataNodeInfo
Zhaohui Wang (Jira)
[jira] [Created] (HDFS-17010) Add a subtree test to TestSnapshotDiffReport
Tsz-wo Sze (Jira)
[jira] [Resolved] (HDFS-16985) Fix data missing issue when delete local block file.
Xiaoqiao He (Jira)
[jira] [Resolved] (HDFS-17008) Fix RBF JDK 11 javadoc warnings
Jira
[jira] [Resolved] (HDFS-17001) Support getStatus API in WebHDFS
Ayush Saxena (Jira)
[jira] [Resolved] (HDFS-16965) Add switch to decide whether to enable native codec.
Ayush Saxena (Jira)
[jira] [Created] (HDFS-17009) RBF: state store putAll should also return failed records
Viraj Jasani (Jira)
[jira] [Created] (HDFS-17008) Fix rbf jdk 11 javadoc warnings
Viraj Jasani (Jira)
[jira] [Created] (HDFS-17007) TestPendingReconstruction.testProcessPendingReconstructions verify HDFS-11960 test case is wrong
liuguanghua (Jira)
[jira] [Resolved] (HDFS-16978) RBF: Admin command to support bulk add of mount points
Ayush Saxena (Jira)
[jira] [Resolved] (HDFS-17002) Erasure coding:Generate parity blocks in time to prevent file corruption
farmmamba (Jira)
[jira] [Resolved] (HDFS-16990) HttpFS Add Support getFileLinkStatus API
Ayush Saxena (Jira)
RE: Call for Presentations, Community Over Code 2023
Ayush Saxena
Re: Call for Presentations, Community Over Code 2023
Wei-Chiu Chuang
Re: Call for Presentations, Community Over Code 2023
Ayush Saxena
[jira] [Created] (HDFS-17005) NameJournalStatus JMX is not updated with new JN IP address on JN host change
Prateek Agarwal (Jira)
[jira] [Created] (HDFS-17004) Mis-spellings about test
lihanran (Jira)
[jira] [Resolved] (HDFS-16999) Fix wrong use of processFirstBlockReport()
Xiaoqiao He (Jira)
Nightly Jenkins CI for Hadoop on Windows 10
Gautham Banasandra
Re: Nightly Jenkins CI for Hadoop on Windows 10
Ayush Saxena
Re: Nightly Jenkins CI for Hadoop on Windows 10
Gautham Banasandra
Re: Nightly Jenkins CI for Hadoop on Windows 10
Ayush Saxena
Re: Nightly Jenkins CI for Hadoop on Windows 10
Ayush Saxena
Re: Nightly Jenkins CI for Hadoop on Windows 10
Gautham Banasandra
[jira] [Created] (HDFS-17003) Erasure coding: invalidate wrong block after reporting bad blocks from datanode
farmmamba (Jira)
[jira] [Created] (HDFS-17002) [EC]:Generate parity blocks in time to prevent file corruption
farmmamba (Jira)
[jira] [Created] (HDFS-17001) Support getStatus API in WebHDFS
Hualong Zhang (Jira)
[jira] [Created] (HDFS-17000) Potential infinite loop in TestDFSStripedOutputStreamUpdatePipeline.testDFSStripedOutputStreamUpdatePipeline
Marcono1234 (Jira)
[jira] [Resolved] (HDFS-16880) modify invokeSingleXXX interface in order to pass actual file src to namenode for debug info.
Ayush Saxena (Jira)
[jira] [Resolved] (HDFS-16865) RBF: The source path is always / after RBF proxied the complete, addBlock and getAdditionalDatanode RPC.
Ayush Saxena (Jira)
[jira] [Created] (HDFS-16999) Fix wrong use of processFirstBlockReport()
Shuyan Zhang (Jira)
[DISCUSS] Hadoop 3.3.6 release planning
Wei-Chiu Chuang
Re: [DISCUSS] Hadoop 3.3.6 release planning
Xiaoqiao He
Re: [DISCUSS] Hadoop 3.3.6 release planning
Steve Loughran
Re: [DISCUSS] Hadoop 3.3.6 release planning
Ayush Saxena
Re: [DISCUSS] Hadoop 3.3.6 release planning
Ayush Saxena
Re: [DISCUSS] Hadoop 3.3.6 release planning
Wei-Chiu Chuang
Re: [DISCUSS] Hadoop 3.3.6 release planning
Wei-Chiu Chuang
[jira] [Resolved] (HDFS-16998) RBF: Add ops metrics for getSlowDatanodeReport in RouterClientActivity
Jira
[jira] [Created] (HDFS-16998) RBF: Add ops metrics for getSlowDatanodeReport in RouterClientActivity
Viraj Jasani (Jira)
Re: [jira] [Resolved] (HADOOP-18134) Setup Jenkins nightly CI for Windows 10
Ayush Saxena
Re: [jira] [Resolved] (HADOOP-18134) Setup Jenkins nightly CI for Windows 10
Gautham Banasandra
[jira] [Resolved] (HDFS-16997) Set the locale to avoid printing useless logs in BlockSender
Xiaoqiao He (Jira)
[jira] [Resolved] (HDFS-16707) RBF: Expose RouterRpcFairnessPolicyController related request record metrics for each nameservice to Prometheus
Ayush Saxena (Jira)
[jira] [Resolved] (HDFS-16897) Fix abundant Broken pipe exception in BlockSender
Ayush Saxena (Jira)
[jira] [Resolved] (HDFS-16995) Remove unused parameters at NameNodeHttpServer#initWebHdfs
Ayush Saxena (Jira)
[jira] [Resolved] (HDFS-16972) Delete a snapshot may deleteCurrentFile
Tsz-wo Sze (Jira)
[jira] [Created] (HDFS-16996) TestFileCreation failed with ClassCastException
Uma Maheswara Rao G (Jira)
[jira] [Created] (HDFS-16995) Remove unused parameters NameNodeHttpServer#initWebHdfs
Zhaohui Wang (Jira)
[jira] [Created] (HDFS-16994) NumTimedOutPendingReconstructions metrics should not be accumulated
farmmamba (Jira)
[jira] [Created] (HDFS-16993) Datanode supports configure TopN DatanodeNetworkCounts
farmmamba (Jira)
[jira] [Created] (HDFS-16992) change log level in FSNamesystem#internalReleaseLease method
farmmamba (Jira)
[jira] [Resolved] (HDFS-16672) Fix lease interval comparison in BlockReportLeaseManager
Ayush Saxena (Jira)
[jira] [Created] (HDFS-16991) Fix testMkdirsRaceWithObserverRead
fanluo (Jira)
[jira] [Created] (HDFS-16990) HttpFS: Add Support getFileLinkStatus API
Hualong Zhang (Jira)
[jira] [Resolved] (HDFS-16981) Support getFileLinkStatus API in WebHDFS
Ayush Saxena (Jira)
[jira] [Resolved] (HDFS-16975) FileWithSnapshotFeature.isCurrentFileDeleted is not reloaded from FSImage.
Tsz-wo Sze (Jira)
[jira] [Resolved] (HDFS-16986) EC: Fix locationBudget in getListing()
Xiaoqiao He (Jira)
[jira] [Resolved] (HDFS-16988) Improve NameServices info at JournalNode web UI
Ayush Saxena (Jira)
[jira] [Created] (HDFS-16989) Large scale block transfer causes too many excess blocks
ZhangHB (Jira)
[jira] [Created] (HDFS-16988) Improve NameServices info at JournalNode web UI
Zhaohui Wang (Jira)
[jira] [Created] (HDFS-16987) HA Failover may cause some corrupted blocks
ZanderXu (Jira)
[jira] [Created] (HDFS-16986) EC: Fix locationBudget in getListing()
Shuyan Zhang (Jira)
[jira] [Resolved] (HDFS-16954) RBF: The operation of renaming a multi-subcluster directory to a single-cluster directory should throw ioexception
Ayush Saxena (Jira)
[jira] [Resolved] (HDFS-16977) Forbid assigned characters in pathname.
WangYuanben (Jira)
[jira] [Resolved] (HDFS-16982) Use the right Quantiles Array for Inverse Quantiles snapshot
Jira
[jira] [Created] (HDFS-16985) delete local block file when FileNotFoundException occurred may lead to missing block.
Chengwei Wang (Jira)
[jira] [Created] (HDFS-16984) Directory timestamp lost during the upgrade process
Ke Han (Jira)
[jira] [Created] (HDFS-16983) Whether checking path access permissions should be decided by dfs.permissions.enabled in concat operation
caozhiqiang (Jira)
[jira] [Created] (HDFS-16982) Use the right Quantiles Array for Inverse Quantiles snapshot
Ravindra Dingankar (Jira)
[jira] [Resolved] (HDFS-16974) Consider volumes average load of each DataNode when choosing target.
Xiaoqiao He (Jira)
[jira] [Resolved] (HDFS-16971) Add read time metrics for remote reads in Statistics
Jira
[jira] [Created] (HDFS-16981) Support getFileLinkStatus API in WebHDFS
Hualong Zhang (Jira)
[jira] [Created] (HDFS-16980) add rpc metrics for response time
liuguanghua (Jira)
[jira] [Created] (HDFS-16979) add dfsrouter port in hdfsauditlog
liuguanghua (Jira)
[jira] [Created] (HDFS-16978) RBF: New Router admin command to support bulk add of mount points
Viraj Jasani (Jira)
[jira] [Created] (HDFS-16977) Forbid assigned characters in pathname when new file or directory is created.
WangYuanben (Jira)
[jira] [Reopened] (HDFS-16976) hdfs auditlog add remote port info
liuguanghua (Jira)
[jira] [Resolved] (HDFS-16976) hdfs auditlog add remote port info
liuguanghua (Jira)
[jira] [Resolved] (HDFS-16952) Support getLinkTarget API in WebHDFS
Shilun Fan (Jira)
[jira] [Created] (HDFS-16976) hdfs auditlog add remote port info
liuguanghua (Jira)
[jira] [Created] (HDFS-16975) FileWithSnapshotFeature.isCurrentFileDeleted is not serialized to FSImage.
Tsz-wo Sze (Jira)
[jira] [Resolved] (HDFS-16911) Distcp with snapshot diff to support Ozone filesystem.
Uma Maheswara Rao G (Jira)
[jira] [Resolved] (HDFS-16949) Update ReadTransferRate to ReadLatencyPerGB for effective percentile metrics
Jira
[jira] [Created] (HDFS-16974) Consider load of every volume when choosing target
Shuyan Zhang (Jira)
[jira] [Resolved] (HDFS-16943) RBF: Implement MySQL based StateStoreDriver
Simbarashe Dzinamarira (Jira)
[jira] [Resolved] (HDFS-16973) RBF: MountTableResolver cache size lookup should take read lock
Jira
[jira] [Created] (HDFS-16973) RBF: MountTableResolver cache size lookup should take read lock
Viraj Jasani (Jira)
[jira] [Created] (HDFS-16972) Delete a snapshot may deleteCurrentFile
Tsz-wo Sze (Jira)
[jira] [Resolved] (HDFS-16967) RBF: File based state stores should allow concurrent access to the records
Takanobu Asanuma (Jira)
[jira] [Created] (HDFS-16971) Add read time metrics for remote reads in Statistics
Melissa You (Jira)
[jira] [Created] (HDFS-16970) EC: client copy wrong buffer from decode ouput during pread
MingHui Luo (Jira)
[jira] [Resolved] (HDFS-16951) Add description of GETSERVERDEFAULTS to WebHDFS doc
Shilun Fan (Jira)
[jira] [Created] (HDFS-16969) Restart DataNode but keep showing ClosedChannelException in DataNode
Huibo Peng (Jira)
[jira] [Created] (HDFS-16968) Corrupted blocks appear in files written with two replicas
leo sun (Jira)
[jira] [Created] (HDFS-16967) RBF: File based state stores should allow concurrent access to the records
Viraj Jasani (Jira)
[jira] [Created] (HDFS-16966) Optimize AvailableSpaceVolumeChoosingPolicy to avoid disk hotpoint
leo sun (Jira)
[jira] [Created] (HDFS-16965) Add switch to decide whether to enable native codec.
WangYuanben (Jira)
[jira] [Resolved] (HDFS-16959) RBF: State store cache loading metrics
Jira
A Message from the Board to PMC members
Ayush Saxena
[DISCUSS] hadoop branch-3.3+ going to java11 only
Steve Loughran
Re: [DISCUSS] hadoop branch-3.3+ going to java11 only
Viraj Jasani
Re: [DISCUSS] hadoop branch-3.3+ going to java11 only
Steve Loughran
Re: [DISCUSS] hadoop branch-3.3+ going to java11 only
Ayush Saxena
Re: [DISCUSS] hadoop branch-3.3+ going to java11 only
Wei-Chiu Chuang
Re: [DISCUSS] hadoop branch-3.3+ going to java11 only
Ayush Saxena
Re: [DISCUSS] hadoop branch-3.3+ going to java11 only
Chris Nauroth
Re: [DISCUSS] hadoop branch-3.3+ going to java11 only
Igor Dvorzhak
Re: [DISCUSS] hadoop branch-3.3+ going to java11 only
IƱigo Goiri
Re: [DISCUSS] hadoop branch-3.3+ going to java11 only
Nick Dimiduk
[jira] [Resolved] (HDFS-16964) Improve processing of excess redundancy after failover
Xiaoqiao He (Jira)
[jira] [Resolved] (HDFS-16958) EC: Fix bug in processing EC excess redundancy
Takanobu Asanuma (Jira)
Fwd: TAC supporting Berlin Buzzwords
Ayush Saxena
[jira] [Created] (HDFS-16964) Improve processing of excess redundancy after failover
Shuyan Zhang (Jira)
[ANNOUNCE] Apache Hadoop 3.3.5 release
Steve Loughran
[jira] [Resolved] (HDFS-16948) Update log of BlockManager#chooseExcessRedundancyStriped when EC internal block is moved by balancer
Xiaoqiao He (Jira)
[jira] [Created] (HDFS-16963) Remove the unnecessary use of Optional from DistributedFileSystem
Tsz-wo Sze (Jira)
[jira] [Resolved] (HDFS-16962) The blockReport RPC should not update the lastBlockReportTime if this blockReport is ignored
ZanderXu (Jira)
[jira] [Created] (HDFS-16962) The blockReport RPC should not update the lastBlockReportTime if this blockReport is ignored
ZanderXu (Jira)
[jira] [Created] (HDFS-16961) The blockReport RPC should throw UnregisteredNodeException when the storedDN is null
ZanderXu (Jira)
[jira] [Created] (HDFS-16960) Remove useless getEditLog().logSync() for setTimes(), setPermission() and setQuota() PRC
ZanderXu (Jira)
[jira] [Created] (HDFS-16959) RBF: state store cache loading metrics
Viraj Jasani (Jira)
[jira] [Resolved] (HDFS-16953) RBF: Mount table store APIs should update cache only if state store record is successfully updated
Jira
[jira] [Created] (HDFS-16958) Fix bug in processing EC excess redundancy
Shuyan Zhang (Jira)
[DISCUSS] Move HDFS specific APIs to FileSystem abstration
Wei-Chiu Chuang
Re: [DISCUSS] Move HDFS specific APIs to FileSystem abstration
Steve Loughran
Re: [DISCUSS] Move HDFS specific APIs to FileSystem abstration
Wei-Chiu Chuang
Re: [DISCUSS] Move HDFS specific APIs to FileSystem abstration
Ayush Saxena
Re: [DISCUSS] Move HDFS specific APIs to FileSystem abstration
Tsz Wo Sze
Re: [DISCUSS] Move HDFS specific APIs to FileSystem abstration
Ayush Saxena
Re: [DISCUSS] Move HDFS specific APIs to FileSystem abstration
Tsz Wo Sze
Re: [DISCUSS] Move HDFS specific APIs to FileSystem abstration
Ayush Saxena
Re: [DISCUSS] Move HDFS specific APIs to FileSystem abstration
Tsz Wo Sze
Re: [DISCUSS] Move HDFS specific APIs to FileSystem abstration
Tsz Wo Sze
Re: [DISCUSS] Move HDFS specific APIs to FileSystem abstration
Ayush Saxena
Re: [DISCUSS] Move HDFS specific APIs to FileSystem abstration
Steve Loughran
Re: [DISCUSS] Move HDFS specific APIs to FileSystem abstration
Steve Loughran
Re: [DISCUSS] Move HDFS specific APIs to FileSystem abstration
Wei-Chiu Chuang
Re: [DISCUSS] Move HDFS specific APIs to FileSystem abstration
Nick Dimiduk
Re: [DISCUSS] Move HDFS specific APIs to FileSystem abstration
Steve Loughran
[jira] [Created] (HDFS-16957) RBF: Exit status of dfsrouteradmin -rm should be non-zero for unsuccessful attempt
Viraj Jasani (Jira)
[jira] [Created] (HDFS-16956) Introduce inverse quantiles for metrics where higher numeric value is better
Ravindra Dingankar (Jira)
[jira] [Created] (HDFS-16955) Need to timeout grouplookup calls if delayed long
Franklinsam Paul (Jira)
[jira] [Created] (HDFS-16954) RBF: The operation of renaming a multi-subcluster directory to a single-cluster directory should throw ioexception
Max Xie (Jira)
[jira] [Created] (HDFS-16953) RBF Mount table store APIs should update cache only if state store record is successfully updated
Viraj Jasani (Jira)
[VOTE] Release Apache Hadoop 3.3.5 (RC3)
Steve Loughran
Re: [VOTE] Release Apache Hadoop 3.3.5 (RC3)
Steve Loughran
Re: [VOTE] Release Apache Hadoop 3.3.5 (RC3)
Viraj Jasani
Re: [VOTE] Release Apache Hadoop 3.3.5 (RC3)
Steve Loughran
Re: [VOTE] Release Apache Hadoop 3.3.5 (RC3)
Ashutosh Gupta
Re: [VOTE] Release Apache Hadoop 3.3.5 (RC3)
Chris Nauroth
Re: [VOTE] Release Apache Hadoop 3.3.5 (RC3)
Ayush Saxena
Re: [VOTE] Release Apache Hadoop 3.3.5 (RC3)
Masatake Iwasaki
Re: [VOTE] Release Apache Hadoop 3.3.5 (RC3)
Xiaoqiao He
Re: [VOTE] Release Apache Hadoop 3.3.5 (RC3)
Ayush Saxena
Re: [VOTE] Release Apache Hadoop 3.3.5 (RC3)
Chris Nauroth
Re: [VOTE] Release Apache Hadoop 3.3.5 (RC3)
Steve Loughran
Re: [VOTE] Release Apache Hadoop 3.3.5 (RC3)
Ayush Saxena
Re: [VOTE] Release Apache Hadoop 3.3.5 (RC3)
Steve Loughran
[jira] [Resolved] (HDFS-16947) RBF NamenodeHeartbeatService to report error for not being able to register namenode in state store
Wei-Chiu Chuang (Jira)
[jira] [Created] (HDFS-16952) Add description of GETSERVERDEFAULTS to WebHDFS doc
Hualong Zhang (Jira)
[jira] [Created] (HDFS-16951) Add description of GETSERVERDEFAULTS to WebHDFS doc
Hualong Zhang (Jira)
[jira] [Created] (HDFS-16950) Gap in edits after -initializeSharedEdits
Karthik Palanisamy (Jira)
[jira] [Created] (HDFS-16949) Update ReadTransferRate to ReadTransferTimePerByte for effective percentile metrics
Ravindra Dingankar (Jira)
Earlier messages
Later messages