Hi all,
I was wondering if anyone could explain the results of the
media-streaming benchmark. The documentation on the website does not
talk about this.
1. The response time are in seconds. Is this the total time taken to
stream a complete video or time between sending request and receiving a
response from the server, at the client-side?
2. Similarly, what does it mean by "ops/sec". What are operations here?
Streaming a video?
The characteristic of performance of a media-streaming server at the
client-side, I think, are average latency of each frame (audio or video)
or frame transmission rate and % of user-perceivable stream
disruptions/violation, or something similar.
Is there an application-level metric in the result summary that is
characteristic of the media-streaming benchmark? Or, what should be used
as a metric for the media-streaming benchmark? Am I missing something?
One general comment about the cloudsuite 2.0 benchmark suite, the
documentation fails to explains the results/metrics for some of the
benchmarks. A benchmark is incomplete without a defined/standardized
metric that could be used to compare between different runs of the same
benchmark. It would be great if there are sections for each benchmark in
the website that also explains the metric that should be used for each.
Thanks,
Venkat
--
Venkatanathan Varadarajan (Venkat),
Graduate Student,
University of Wisconsin-Madison.
