Re: [jira] [Created] (HDFS-8722) Optimize datanode writes for small writes and flushes

2015-08-05 Thread Colin McCabe
Hi Jean-Marc, Short-circuit covers reads, but this performance improvement covers writes. best, Colin On Wed, Aug 5, 2015 at 7:17 AM, Jean-Marc Spaggiari jean-m...@spaggiari.org wrote: Hi Nick, If we are doing short-circuit, we skip Hadoop CRC, right? So this should impact us only in case

Re: Disk space leak when using HBase and HDFS ShortCircuit

2014-08-31 Thread Colin McCabe
HDFS now notifies the client when the block file has been deleted. See HDFS-6750 for details. Best, Colin On Jun 26, 2014 11:39 AM, Giuseppe Reina g.re...@gmail.com wrote: On Thu, Jun 26, 2014 at 1:02 AM, Enis Söztutar e...@apache.org wrote: Agreed, this seems like an hdfs issue unless