[ 
https://issues.apache.org/jira/browse/OAK-6209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16429106#comment-16429106
 ] 

Maksim Kviatkouski edited comment on OAK-6209 at 4/6/18 11:08 PM:
------------------------------------------------------------------

[~frm], I've made some progress and have more questions. Hopefully you can help 
me. I've decided to review and refactor output code of tests. Few of them were 
doing similar things in different way (some tests took parameter "doReport", 
some test was looking for system property "verbose" to decide whether to print 
extra info or not. Some tests were just printing everything.) I've changed it 
so now you can switch between printing stats only or stats + any extra info. 
Attached is example of how machine-readable stats-only output would look like. 
So far there are two questions:
 # Would you like me to make tests print exception stacktraces into error 
output stream rather than into regular output stream?
 # How would you like to present stats of Observation throughput benchmark. As 
you can see its stats are quite different from the rest.

[^sample-machine-readable-output.txt]

^Also I know it's not really the option you mentioned. So please let me know if 
you would like me to stick with one of the options you proposed: use of logging 
or put some prefix into each line so it's easy to filter it out.^


was (Author: maksim_kviatkouski):
[~frm], I've made some progress and have more questions. Hopefully you can help 
me. I've decided to review and refactor output code of tests. Few of them were 
doing similar things in different way (some tests took parameter "doReport", 
some test was looking for system property "verbose" to decide whether to print 
extra info or not. Some tests were just printing everything.) I've changed it 
so now you can switch between printing stats only or stats + any extra info. 
Attached is example of how machine-readable stats-only output would look like. 
So far there are two questions:
 # Would you like me to make tests print exception stacktraces into error 
output stream rather than into regular output stream?
 # How would you like to present stats of Observation throughput benchmark. As 
you can see its stats are quite different from the rest.

[^sample-machine-readable-output.txt]

> The benchmark runner should produce machine-friendly output
> -----------------------------------------------------------
>
>                 Key: OAK-6209
>                 URL: https://issues.apache.org/jira/browse/OAK-6209
>             Project: Jackrabbit Oak
>          Issue Type: Improvement
>          Components: benchmarks
>            Reporter: Francesco Mari
>            Assignee: Francesco Mari
>            Priority: Major
>         Attachments: sample-machine-readable-output.txt
>
>
> The benchmark runner currently produce output in the following format.
> {noformat}
> Apache Jackrabbit Oak 1.8-SNAPSHOT
> # LoginTest                        C     min     10%     50%     90%     max  
>      N 
> Oak-Segment-Tar                    1     472     494     522     552     631  
>    115
> # LoginLogoutTest                  C     min     10%     50%     90%     max  
>      N 
> Oak-Segment-Tar                    1     472     479     513     543     568  
>    118
> {noformat}
> While this format is well formatted and easy to read, it's a pain to process 
> with standard command line utilities. The benchmark runner should give the 
> possibility to produce machine-friendly output, like the following.
> {noformat}
> LoginTest,Oak-Segment-Tar,1,472,494,522,552,631,115
> LoginLogoutTest,Oak-Segment-Tar,1,472,479,513,543,568,118
> {noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to