Hi all,
initial benchmark UI (basic view) is ready. You can find some info about it
in my features overview blog post
<http://zalomiga.ba/blog/ui-first-look-viennacl-benchmark/>. Some features
are still missing and there's some design polishing to be done. But the
core benchmarking functionality is there.
Your feedback is welcome.
There are some specific questions I have:
***Basic View***
-start/pause/stop functionality: Benchmarks are run in threads (a blog post
with detailed description is here
<http://zalomiga.ba/blog/implementing-multithreading-in-viennacl-benchmark/>).
Stopping and pausing them equals stopping and pausing the thread in which
they run (as far as I can tell). Implementing this is fairly easy. What
interests me is if there are any requirements/obstacles/peculiarities I
should know about before attempting to implement stop/pause. I am dealing
with code that runs on a GPU, after all.
Also, I'm starting to think a pause functionality isn't the brightest idea.
Would pausing a benchmark affect resulting performance in any way?
-final result: my take on the final result is to take the averages of each
benchmark and add them together. Should some benchmarks carry more 'weight'
than others and have more impact on the final score? To get a final result
mark, all benchmarks should be executed in a single session. Any
suggestions?
-detailed individual results: while some may argue that seeing these is
unnecessary in the basic view, I would beg to differ. Here are my arguments:
1. realtime plotting of the sub-test results looks interesting.
Even when I add the "benchmark is running" animation, it still won't be
enough to catch the users attention. Showing all these small results makes
the benchmark process feel "alive".
2. users might want to see the highest result achieved in a benchmark
sub-test, since the final result of each benchmark is shown as the average
of all sub-tests.
I wasn't sure how to show the results of a benchmark in a single number, so
I took the average of all sub-tests. If this solution is acceptable, then
being able to see the highest result of sub-tests would be very valuable.
For example: blas3 benchmark gives me an average of 570 GFLOPs, but a quick
look at sub-tests shows me that the maximum achieved result was 1400
GFLOPs. Knowing this makes me feel damn good, even if I don't know what it
means. =)
Speaking of which, why does blas3 give such drastically better results than
any other benchmark? It's 1400 GFLOPs(blas3) vs 11 GFLOPs(vector) and makes
the result plot look ridiculous (even when average results are used).
3. there's really nothing else to put in its place. Without detailed
results, the basic view is plain and boring.
***Home***
-Karl mentioned a splash screen. It would be great to have one. Where can I
get it? :)
-Need some ideas on what else to put on it and feedback on whats currently
there(about, options, quickstart, system info)
***MatrixMarket***
-I implemented a simple browsing functionality of the Florida Matrix
Market. It's a basic rendering of matrix market's web page using QWebView.
Its only good to get a 'feel' for it. Any additional functionality will
have to be done from scratch.
-I'm thinking of making a custom matrix browser in the MatrixMarket screen.
It would parse the matrix market web page and create a customized matrix
table. Users could then browse through this table and download matrices
they like. Downloaded matrices would be saved locally for future use. Users
could then select a matrix from the local repository and use it in the
benchmark. Custom matrices could also be used in this way.
That's all I can think of. Hope this email isn't too long.
Once again, your feedback is welcome.
Best regards, Namik
------------------------------------------------------------------------------
Open source business process management suite built on Java and Eclipse
Turn processes into business applications with Bonita BPM Community Edition
Quickly connect people, data, and systems into organized workflows
Winner of BOSSIE, CODIE, OW2 and Gartner awards
http://p.sf.net/sfu/Bonitasoft
_______________________________________________
ViennaCL-devel mailing list
ViennaCL-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/viennacl-devel
