Thanks, Milind!
I looked at potentially coming out for the workshop, however, the CfP asked
for up to 12 page papers. That gave me the impression that this meeting of
the workshop was starting to try to narrow its focus and go more in-depth
on topics, and get closer to converging on a final benchm
Erik,
Very useful info. As you may know (saw the reference to BDBC in your page),
we are organizing fourth workshop on Big Data Benchmarking on Oct 9-10 in
San Jose (http://clds.ucsd.edu/bdbc/workshops/fourth_wbdb). In this
workshop, we hope to get closer to defining a definitive Big Data
benchmar
interesting.
FWIW the work on formally specify (in the Computer Science notion of
"formally") is in HADOOP-9361; the HCFS work being driven by redhat is more
about testing.
Some extra ideas on benchmarking
# something to assess performance of cross FS operations
# it'd be nice to have something t
Hello all -
As part of a side project, I've been interested in HDFS benchmarking,
particularly of the Namenode. To get started, I tried to track down a
number of different benchmarks and collect a few observations about each.
I've put together a list here:
http://epaulson.github.io/HadoopInternal
Hi Thanh,
In July this year I installed a small Hadoop-Cluster with Cloudera CDH3 and
tried to run some performance tests with bonnie++ and iozone using fuse_dfs.
bonnie++ and iozone both didn't work.
Maybe today fuse_dfs has more features and bonnie++ and iozone are working...?!
Best Regards
TestDFSIO may be what you what.
2010/11/23 Thanh Do
> Hi all,
>
> Is there any benchmarks for HDFS available)
> (measuring read/write throughput, latency and such).
> It would be great if somebody point me to any source.
>
> Thanks much
> Thanh
>
Hi all,
Is there any benchmarks for HDFS available)
(measuring read/write throughput, latency and such).
It would be great if somebody point me to any source.
Thanks much
Thanh
