hdfs-dev  

Messages by Thread

• • Re: Re: [DISCUSS] Release Hadoop 3.4.0 slfan1989
  • Re: [DISCUSS] Release Hadoop 3.4.0 slfan1989
• [ANNOUNCE] Hadoop 3.3.7-aws preview release Ahmar Suhail
• [jira] [Created] (HDFS-17319) Downgrade noisy InvalidToken log in ShortCircuitCache Bryan Beaudreault (Jira)
• [jira] [Created] (HDFS-17318) MountTableResolver#locationCache supports multi policies farmmamba (Jira)
• [jira] [Created] (HDFS-17317) DebugAdmin metaOut not need multiple close xy (Jira)
• [jira] [Created] (HDFS-17316) Compatibility Benchmark over HCFS Implementations Han Liu (Jira)
• [jira] [Created] (HDFS-17315) Optimize the namenode format code logic. huangzhaobo99 (Jira)
• [jira] [Created] (HDFS-17314) Add a metrics to record congestion backoff counts. farmmamba (Jira)
• [jira] [Created] (HDFS-17313) dfsadmin -reconfig option to start/query reconfig on all live namenodes. huangzhaobo99 (Jira)
• [jira] [Created] (HDFS-17312) packetsReceived metric should ignore heartbeat packet farmmamba (Jira)
• [jira] [Resolved] (HDFS-17277) Delete invalid code logic in namenode format Takanobu Asanuma (Jira)
• [jira] [Created] (HDFS-17311) RBF: ConnectionManager creatorQueue should offer a pool that is not already in creatorQueue. liuguanghua (Jira)
• [jira] [Created] (HDFS-17310) DiskBalancer: Enhance the log message Haiyang Hu (Jira)
• [jira] [Created] (HDFS-17309) Fix Router Safemode check contidition error liuguanghua (Jira)
• [jira] [Resolved] (HDFS-17301) Add read and write dataXceiver threads count metrics to datanode. Takanobu Asanuma (Jira)
• [jira] [Created] (HDFS-17308) docker-compose.yaml sets namenode directory wrong causing datanode failures on restart Matthew Rossi (Jira)
• [jira] [Resolved] (HDFS-17297) The NameNode should remove block from the BlocksMap if the block is marked as deleted. Takanobu Asanuma (Jira)
• [jira] [Created] (HDFS-17307) docker-compose.yaml sets namenode directory wrong causing datanode failures on restart Matthew Rossi (Jira)
• [jira] [Created] (HDFS-17306) RBF:Router should not return nameservices that does not enable observer nodes in RpcResponseHeaderProto liuguanghua (Jira)
• [jira] [Created] (HDFS-17305) Add avoid datanode reason count related metrics to namenode. huangzhaobo99 (Jira)
• [jira] [Resolved] (HDFS-17284) Fix int overflow in calculating numEcReplicatedTasks and numReplicationTasks during block recovery Takanobu Asanuma (Jira)
• [jira] [Created] (HDFS-17304) Update fsck -blockId to display slownode status of blocks. huangzhaobo99 (Jira)
• [jira] [Resolved] (HDFS-17275) Judge whether the block has been deleted in the block report Shuyan Zhang (Jira)
• [jira] [Created] (HDFS-17303) Make WINDOW_SIZE and NUM_WINDOWS configurable. huangzhaobo99 (Jira)
• [jira] [Resolved] (HDFS-17298) Fix NPE in DataNode.handleBadBlock and BlockSender Takanobu Asanuma (Jira)
• [jira] [Resolved] (HDFS-17215) RBF: Fix some method annotations about @throws Ayush Saxena (Jira)
• [jira] [Resolved] (HDFS-17056) EC: Fix verifyClusterSetup output in case of an invalid param. Ayush Saxena (Jira)
• [jira] [Created] (HDFS-17302) RBF: ProportionRouterRpcFairnessPolicyController-support proportional allocation of semaphores Jian Zhang (Jira)
• [jira] [Created] (HDFS-17301) Add read and write dataXceiver threads count metrics to datanode. huangzhaobo99 (Jira)
• [jira] [Created] (HDFS-17300) [SBN READ] Observer should throw ObserverRetryOnActiveException if stateid is always delayed with Active Namenode for a period of time liuguanghua (Jira)
• [jira] [Created] (HDFS-17299) HDFS is not rack failure tolerant while creating a new file. Rushabh Shah (Jira)
• [jira] [Resolved] (HDFS-16904) Close webhdfs during the teardown Ayush Saxena (Jira)
• [jira] [Resolved] (HDFS-17034) java.io.FileNotFoundException: File does not exist Ayush Saxena (Jira)
• [jira] [Resolved] (HDFS-17238) Setting the value of "dfs.blocksize" too large will cause HDFS to be unable to write to files Ayush Saxena (Jira)
• [jira] [Resolved] (HDFS-17240) Fix a typo in DataStorage.java Ayush Saxena (Jira)
• [jira] [Resolved] (HDFS-17170) add metris for datanode in function processQueueMessages and reportTo liuguanghua (Jira)
• [jira] [Resolved] (HDFS-17285) RBF: Add a safe mode check period configuration Shilun Fan (Jira)
• [jira] [Created] (HDFS-17298) Fix NPE in DataNode.handleBadBlock and BlockSender Haiyang Hu (Jira)
• Re: [DISCUSS][HDFS] Add rust binding for libhdfs Xuanwo
  • Re: [DISCUSS][HDFS] Add rust binding for libhdfs Xiaoqiao He
  • Re: [DISCUSS][HDFS] Add rust binding for libhdfs Xuanwo
  • Re: [DISCUSS][HDFS] Add rust binding for libhdfs Ayush Saxena
  • Re: [DISCUSS][HDFS] Add rust binding for libhdfs Steve Loughran
• [jira] [Created] (HDFS-17297) The NameNode should remove block from the BlocksMap if the block is marked as deleted. Haiyang Hu (Jira)
• [jira] [Resolved] (HDFS-17294) Reconfigure the scheduling cycle of the slowPeerCollectorDaemon thread. Takanobu Asanuma (Jira)
• [jira] [Created] (HDFS-17296) ACL inheritance broken for new files Emil Kleszcz (Jira)
• [jira] [Created] (HDFS-17295) 'hdfs dfs -put' may fail when more than half of the datanodes are unavailable Xuze Yang (Jira)
• [jira] [Created] (HDFS-17294) Reconfigure the scheduling cycle of the slowPeerCollectorDaemon thread. huangzhaobo99 (Jira)
• [jira] [Created] (HDFS-17293) First packet size will be set to 516 bytes when writing to a new block. farmmamba (Jira)
• [jira] [Created] (HDFS-17292) Show the number of times the slowPeerCollectorDaemon thread has collected SlowNodes. huangzhaobo99 (Jira)
• [jira] [Created] (HDFS-17291) DataNode metric bytesWritten is not totally accurate in some situations. farmmamba (Jira)
• [jira] [Created] (HDFS-17290) HDFS: add client rpc backoff metrics due to throttling from lowest priority queue Lei Yang (Jira)
• [jira] [Resolved] (HDFS-17282) Reconfig 'SlowIoWarningThreshold' parameters for datanode. Ayush Saxena (Jira)
• [jira] [Created] (HDFS-17289) Should not consider the size of non-lastBlocks equals to complete block size. farmmamba (Jira)
• [jira] [Created] (HDFS-17288) Add a metric to record the number of non-lastBlocks which have non-complete blocksize farmmamba (Jira)
• [jira] [Resolved] (HDFS-17242) Make congestion backoff time configurable Tao Li (Jira)
• [jira] [Created] (HDFS-17287) Parallel Maven Build Support for Apache Hadoop caijialiang (Jira)
• [jira] [Created] (HDFS-17286) Add UDP as a transfer protocol for HDFS Xing Lin (Jira)
• [jira] [Created] (HDFS-17285) [RBF] Decrease dfsrouter safe mode check period. liuguanghua (Jira)
• [jira] [Resolved] (HDFS-17278) Detect order dependent flakiness in TestViewfsWithNfs3.java under hadoop-hdfs-nfs module Ayush Saxena (Jira)
• [jira] [Resolved] (HDFS-16102) Remove redundant iteration in BlockManager#removeBlocksAssociatedTo(...) to save time lei w (Jira)
• [jira] [Created] (HDFS-17284) Fix int overflow in calculating numEcReplicatedTasks and numReplicationTasks during block recovery Hualong Zhang (Jira)
• [jira] [Resolved] (HDFS-17152) Fix the documentation of count command in FileSystemShell.md Shuyan Zhang (Jira)
• [jira] [Created] (HDFS-17283) Change the name of variable SECOND in HdfsClientConfigKeys farmmamba (Jira)
• [jira] [Created] (HDFS-17282) Reconfig 'SlowIoWarningThreshold' parameters for datanode. huangzhaobo99 (Jira)
• [jira] [Created] (HDFS-17281) Added support of reporting RPC round-trip time at NN. Xing Lin (Jira)
• [jira] [Created] (HDFS-17280) Pipeline recovery should better end block in advance when bytes acked greater than half of blocksize. farmmamba (Jira)
• [jira] [Resolved] (HDFS-17279) RBF: Fix link to Fedbalance document Ayush Saxena (Jira)
• [jira] [Created] (HDFS-17279) RBF: Fix link to Fedbalance document Haiyang Hu (Jira)
• [jira] [Resolved] (HDFS-17262) Transfer rate metric warning log is too verbose Xiaoqiao He (Jira)
• [jira] [Created] (HDFS-17278) Detect order dependent flakiness in TestViewfsWithNfs3.java under hadoop-hdfs-nfs module Ruby (Jira)
• [jira] [Resolved] (HDFS-17270) RBF: Fix ZKDelegationTokenSecretManagerImpl use closed zookeeper client to get token in some case Xiaoqiao He (Jira)
• [jira] [Created] (HDFS-17276) The nn fetch editlog failed in kerberos environment kuper (Jira)
• [VOTE] Hadoop 3.2.x EOL Xiaoqiao He
  • Re: [VOTE] Hadoop 3.2.x EOL Ayush Saxena
  • Re: [VOTE] Hadoop 3.2.x EOL Mingliang Liu
  • Re: [VOTE] Hadoop 3.2.x EOL Hui Fei
  • Re: [VOTE] Hadoop 3.2.x EOL Masatake Iwasaki
  • Re: [VOTE] Hadoop 3.2.x EOL Steve Loughran
  • Re: [VOTE] Hadoop 3.2.x EOL Akira Ajisaka
  • Re: [VOTE] Hadoop 3.2.x EOL Chao Sun
  • Re: [VOTE] Hadoop 3.2.x EOL Iñigo Goiri
  • Re: [VOTE] Hadoop 3.2.x EOL Xiaoqiao He
  • Re: [VOTE] Hadoop 3.2.x EOL Xiaoqiao He
  • Re: [VOTE] Hadoop 3.2.x EOL slfan1989
• [jira] [Created] (HDFS-17275) We should determine whether the block has been deleted in the block report lei w (Jira)
• [jira] [Created] (HDFS-17274) slow datanodes should be chosen when no more normal datanodes are available Xuze Yang (Jira)
• [jira] [Resolved] (HDFS-17250) EditLogTailer#triggerActiveLogRoll should handle thread Interrupted Xiaoqiao He (Jira)
• [jira] [Resolved] (HDFS-17218) NameNode should process time out excess redundancy blocks Xiaoqiao He (Jira)
• [DISCUSS] Make some release lines EOL Xiaoqiao He
  • Re: [DISCUSS] Make some release lines EOL Ayush Saxena
  • Re: [DISCUSS] Make some release lines EOL Xiaoqiao He
  • Re: [DISCUSS] Make some release lines EOL Steve Loughran
  • Re: [DISCUSS] Make some release lines EOL Masatake Iwasaki
  • Re: [DISCUSS] Make some release lines EOL Xiaoqiao He
  • Re: [DISCUSS] Make some release lines EOL slfan1989
• [jira] [Created] (HDFS-17273) Change some duration local filed in DataStream farmmamba (Jira)
• [jira] [Resolved] (HDFS-17268) when SocketTimeoutException happen, overwrite mode can delete old data, and make file empty katty he (Jira)
• [jira] [Resolved] (HDFS-17260) Fix the logic for reconfigure slow peer enable for Namenode. Ayush Saxena (Jira)
• [jira] [Created] (HDFS-17272) NNThroughputBenchmark should support specifying the base directory for multi-client test caozhiqiang (Jira)
• [jira] [Resolved] (HDFS-17233) The conf dfs.datanode.lifeline.interval.seconds is not considering time unit seconds Ayush Saxena (Jira)
• [jira] [Resolved] (HDFS-17271) Web UI DN report shows random order when sorting with dead DNs Ayush Saxena (Jira)
• [jira] [Created] (HDFS-17271) Web UI DN report shows random order when sorting with dead DNs Felix N (Jira)
• [DISCUSS] Hadoop 3.4.0 release Ahmar Suhail
  • Re: [DISCUSS] Hadoop 3.4.0 release Ayush Saxena
  • Re: [DISCUSS] Hadoop 3.4.0 release Xiaoqiao He
  • Re: [DISCUSS] Hadoop 3.4.0 release slfan1989
• [jira] [Created] (HDFS-17270) Fix ZKDelegationTokenSecretManagerImpl use closed zookeeper Client to get token in some case lei w (Jira)
• [jira] [Resolved] (HDFS-17261) RBF: Fix getFileInfo return wrong path when get mountTable path which multi-level Ayush Saxena (Jira)
• [jira] [Created] (HDFS-17269) [RBF] Make listStatus user root trash dir will return all subclusters trash subdirs if user has any mount points in nameservice. liuguanghua (Jira)
• [jira] [Created] (HDFS-17268) when SocketTimeoutException happen, overwrite mode can delete old data, and make file empty katty he (Jira)
• [jira] [Resolved] (HDFS-17259) Fix typo in TestFsDatasetImpl Class. Ayush Saxena (Jira)
• [jira] [Resolved] (HDFS-17263) RBF: Fix client ls trash path cannot get except default nameservices trash path Shilun Fan (Jira)
• [jira] [Created] (HDFS-17267) Client send the smae packet multiple times when method markSlowNode throws IOException. farmmamba (Jira)
• [jira] [Created] (HDFS-17266) upgrade Apache Derby dependency to 10.17.1.0 due to CVE PJ Fanning (Jira)
• [jira] [Created] (HDFS-17265) RBF: Throwing an exception prevents the semaphore from being released when using FairnessPolicyController Jian Zhang (Jira)
• [jira] [Created] (HDFS-17264) GetJournalEditServlet should check requestor principal against NameNode principal pattern Charles Connell (Jira)
• [jira] [Created] (HDFS-17263) [RBF] Fix client ls trash path cannot get except default nameservices trash path liuguanghua (Jira)
• [jira] [Created] (HDFS-17262) Transfer rate metric warning log is too verbose Bryan Beaudreault (Jira)
• [jira] [Created] (HDFS-17261) Fix getFileInfo return wrong path when get mountTable path which multi-level liuguanghua (Jira)
• [jira] [Created] (HDFS-17260) Fix the logic for reconfigure slow peer enable for Namenode. huangzhaobo99 (Jira)
• [jira] [Created] (HDFS-17259) Fix typo in TestFsDatasetImpl Class huangzhaobo99 (Jira)
• [jira] [Created] (HDFS-17258) add the configuration parameters of the async delete block liying (Jira)
• [jira] [Created] (HDFS-17257) Add configuration parameters of slow rpc into reconfigurableProperties liying (Jira)
• [jira] [Created] (HDFS-17256) add the individual namespaces isolation mode for router to avoid affecting other namespaces liying (Jira)
• [jira] [Resolved] (HDFS-17063) Support to configure different capacity reserved for each disk of DataNode. Xiaoqiao He (Jira)
• [jira] [Resolved] (HDFS-17172) Support FSNamesystemLock Parameters reconfigurable Xiaoqiao He (Jira)
• [jira] [Created] (HDFS-17255) There should be mechanism between client and NN to eliminate stale nodes from current pipeline sooner. Uma Maheswara Rao G (Jira)
• [jira] [Created] (HDFS-17254) DataNode httpServer has too many worker threads Liangjun He (Jira)
• [jira] [Resolved] (HDFS-17253) dfs.ha.tail-edits.period supports millisecond time unit Liangjun He (Jira)
• [jira] [Created] (HDFS-17253) dfs.ha.tail-edits.period supports millisecond time unit Liangjun He (Jira)
• [jira] [Created] (HDFS-17252) RBF: getListing results is incorrect. farmmamba (Jira)
• HDFS-17221: Pls review and merge NNThroughputBenchmark adoptation for RBF benchmarking PR Александр Богданов
  • Re: HDFS-17221: Pls review and merge NNThroughputBenchmark adoptation for RBF benchmarking PR ssanchozzz
  • Re: HDFS-17221: Pls review and merge NNThroughputBenchmark adoptation for RBF benchmarking PR Ayush Saxena
  • Re: HDFS-17221: Pls review and merge NNThroughputBenchmark adoptation for RBF benchmarking PR ssanchozzz
  • Re: HDFS-17221: Pls review and merge NNThroughputBenchmark adoptation for RBF benchmarking PR Александр Богданов
  • Re: HDFS-17221: Pls review and merge NNThroughputBenchmark adoptation for RBF benchmarking PR ssanchozzz
  • Re: HDFS-17221: Pls review and merge NNThroughputBenchmark adoptation for RBF benchmarking PR Ayush Saxena
  • Re: HDFS-17221: Pls review and merge NNThroughputBenchmark adoptation for RBF benchmarking PR ssanchozzz
• [jira] [Resolved] (HDFS-17249) Fix TestDFSUtil.testIsValidName() unit test failure Steve Loughran (Jira)
• How to restart build pipeline or mark Yetus check passed Александр Богданов
  • Re: How to restart build pipeline or mark Yetus check passed Ayush Saxena
• [jira] [Created] (HDFS-17251) Optimize MountTableResolver#TRASH_PATTERN farmmamba (Jira)
• [jira] [Created] (HDFS-17250) EditLogTailer#triggerActiveLogRoll should handle thread Interrupted Haiyang Hu (Jira)
• [jira] [Resolved] (HDFS-16791) Add getEnclosingRoot() API to filesystem interface and implementations Steve Loughran (Jira)
• [jira] [Resolved] (HDFS-17243) Add the parameter storage type for getBlocks method Shuyan Zhang (Jira)
• [jira] [Created] (HDFS-17249) Fix test case for HDFS-17246 liuguanghua (Jira)
• [jira] [Resolved] (HDFS-17248) Add Test case for for building Hadoop on Windows and liuguanghua (Jira)
• [jira] [Created] (HDFS-17248) Fix DFSUtilClient.ValidName ERROR liuguanghua (Jira)
• Review request for https://issues.apache.org/jira/browse/HDFS-15413 Bryan Beaudreault
  • Re: Review request for https://issues.apache.org/jira/browse/HDFS-15413 Xiaoqiao He
  • Re: Review request for https://issues.apache.org/jira/browse/HDFS-15413 Ayush Saxena
  • Re: Review request for https://issues.apache.org/jira/browse/HDFS-15413 Bryan Beaudreault
• [jira] [Resolved] (HDFS-17246) Fix shaded client for building Hadoop on Windows Jira
• [jira] [Created] (HDFS-17247) Improve AvailableSpaceRackFaultTolerantBlockPlacementPolicy logic Haiyang Hu (Jira)
• [jira] [Created] (HDFS-17246) Fix shaded client for building Hadoop on Windows Gautham Banasandra (Jira)
• [ANNOUNCE] New Hadoop PMC Member - Shilun Fan Xiaoqiao He
  • Re: [ANNOUNCE] New Hadoop PMC Member - Shilun Fan Tao Li
  • Re: [ANNOUNCE] New Hadoop PMC Member - Shilun Fan Samrat Deb
  • Re: [ANNOUNCE] New Hadoop PMC Member - Shilun Fan Ayush Saxena
• [jira] [Created] (HDFS-17245) Add getAverageLoadOneMinute RPC in ClientDatanodeProtocol. farmmamba (Jira)
• [jira] [Created] (HDFS-17244) Avoid affecting the overall logic of checkpoint when I/O exceptions occur liying (Jira)
• Re: 关于hadoop-3.3.1版本使用libhdfs3.so 访问hdfs联邦模式router节点rpc端口有20分钟延时问题 Xiaoqiao He
• [jira] [Created] (HDFS-17243) Add the parameter storage type for getBlocks method Haiyang Hu (Jira)
• [jira] [Created] (HDFS-17242) Make congestion backoff time configurable farmmamba (Jira)
• [jira] [Resolved] (HDFS-17024) Potential data race introduced by HDFS-15865 Wei-Chiu Chuang (Jira)
• [jira] [Created] (HDFS-17241) long write lock on active NN from rollEditLog() shuaiqi.guo (Jira)
• [jira] [Created] (HDFS-17240) Fix a typo in DataStorage.java Yu Wang (Jira)
• [jira] [Created] (HDFS-17239) Remove logging of method invalidate which is in BLOCK_POOl write lock. farmmamba (Jira)
• [jira] [Created] (HDFS-17238) Setting the value of "dfs.blocksize" too large will cause HDFS to be unable to write to files ECFuzz (Jira)
• [jira] [Resolved] (HDFS-17231) HA: Safemode should exit when resources are from low to available Xiaoqiao He (Jira)
• [jira] [Resolved] (HDFS-17237) Remove IPCLoggerChannel Metrics when the logger is closed Stephen O'Donnell (Jira)
• [jira] [Resolved] (HDFS-17235) Fix javadoc errors in BlockManager Ayush Saxena (Jira)
• [jira] [Created] (HDFS-17237) Remove IPCLogger Metrics when the logger is closed Stephen O'Donnell (Jira)
• [jira] [Created] (HDFS-17236) Namenode failover will make empty file? katty he (Jira)
• [jira] [Created] (HDFS-17235) Fix javadoc errors in BlockManager Haiyang Hu (Jira)
• [jira] [Created] (HDFS-17234) Fix the logic for reconfigure slow peer enable for Namenode huangzhaobo99 (Jira)
• [jira] [Created] (HDFS-17233) the conf dfs.datanode.lifeline.interval.seconds is not considering time unit seconds Hemanth Boyina (Jira)
• [jira] [Created] (HDFS-17232) RBF:fix NoNamenodesAvailableException for a long time, when use oberver Jian Zhang (Jira)
• [jira] [Created] (HDFS-17231) HA: Safemode should exit when resources are from low to available kuper (Jira)
• [jira] [Created] (HDFS-17230) add retrys to addBlock operations xiaogang zhou (Jira)
• [jira] [Resolved] (HDFS-17220) fix same available space policy in AvailableSpaceVolumeChoosingPolicy Tao Li (Jira)
• [jira] [Resolved] (HDFS-17228) Improve documentation related to BlockManager Ayush Saxena (Jira)
• [jira] [Created] (HDFS-17229) Zookeeper SSL/TLS support in HDFS DelegationTokenAuthenticationFilter Zita Dombi (Jira)
• Re: MODERATE for hdfs-iss...@hadoop.apache.org Xiaoqiao He
  • Re: MODERATE for hdfs-iss...@hadoop.apache.org Ayush Saxena
• [jira] [Created] (HDFS-17228) Add documentation related to BlockManager JiangHua Zhu (Jira)
• Join us at the Storage User Group Meetup! Wei-Chiu Chuang
• Fwd: [jira] [Created] (HADOOP-18933) upgrade netty to 4.1.100 due to CVE Steve Loughran
  • Re: [jira] [Created] (HADOOP-18933) upgrade netty to 4.1.100 due to CVE Ayush Saxena
• [jira] [Created] (HDFS-17227) EC: Fix bug in choosing targets when racks is not enough. Shuyan Zhang (Jira)
• [jira] [Created] (HDFS-17226) Building native libraries fails on Fedora 38 Kengo Seki (Jira)
• [jira] [Created] (HDFS-17225) Fix TestNameNodeMXBean#testDecommissioningNodes Ayush Saxena (Jira)
• [jira] [Created] (HDFS-17224) TestRollingUpgrade.testDFSAdminRollingUpgradeCommands failing Steve Loughran (Jira)
• [jira] [Created] (HDFS-17223) Add journalnode maintenance node list kuper (Jira)
• [jira] [Resolved] (HDFS-17222) fix Federation doc yanbin.zhang (Jira)
• [jira] [Created] (HDFS-17222) fix Federation doc yanbin.zhang (Jira)
• [jira] [Resolved] (HDFS-17217) Add lifeline RPC start up log when NameNode#startCommonServices Xiaoqiao He (Jira)

• Earlier messages
• Later messages