Bug#888871: "better" summary and machine readable outputs

2018-02-04 Thread Ivano Primi
Dear Yaroslav,

Thank you very much for your suggestions.
In perticular, I agree with you that the output of -S should be less verbose.

However, the next months will be quite intensive at work, and I do not know
when I will have time to prepare a new release of Numdiff :-(
Hopefully, it will not come too late.

Kind regards,

Ivano



Bug#888871: "better" summary and machine readable outputs

2018-01-30 Thread Yaroslav Halchenko
Package: numdiff
Version: 5.9.0-1
Severity: wishlist
Tags: upstream

While using numdiff for comparing across a bulk of results files I came
up with some wishes which I have shared with Paolo and we decided to cement
them in an official bug report.

I was whining about "clutter" in the output which could have been reduced in
favor of more concise diff summary.  Here is an extract from our correspondence:

Me:

- 0 is == 0.00, so why not just to print 0 in those cases? ;)
- too many lines

   why not instead of  (changing for demo numbers not necessarily making
   sense ;) )

Sum of all absolute errors:
0.00
Sum of the major absolute errors:
0.1123456677
...

   give smth like

0 Sum of all absolute errors
0.1123456677  Sum of the major absolute errors

- and if I add -b make it nice one line (may be with better abbreviations)

sum_abs=0 sub_maj_abs=0.11 ...

?

- Another cool feature could be if those could be just output as a json
  record, so I could pipe it into some other tool (e.g.  our new
  https://github.com/pyout/pyout). E.g. with getting a stream of records

{
  'filename1': 'blah',
  'filename2': 'blah-a',
  'Sum of all absolute errors': 0,
  ...
}

 then I could build some nice view alike of "dstat" tool to visualize
 resources consumption which just would go through files, and have a
 common header, and then all those numbers underneath, e.g.

 #compar  #result  max_abs  max_rel...
file1..file2   12   8  3.9e-07  1.08e-04   ...
file3..file4   23   -

which would give me a super nice overview across files ;)


Paolo:

I strongly favor introducing a variant of the -S summary, say -J that outputs a 
JSON file.
This makes aggregating multiple test results and integration in CI workflows 
easy.

Changing the output of the current -S or adding a -S -b probably breaks 
existing use cases.

-- System Information:
Debian Release: buster/sid
  APT prefers unstable
  APT policy: (600, 'unstable'), (300, 'experimental'), (100, 
'unstable-debug'), (100, 'stable')
Architecture: amd64 (x86_64)
Foreign Architectures: i386

Kernel: Linux 4.14.0-3-amd64 (SMP w/4 CPU cores)
Locale: LANG=en_US.UTF-8, LC_CTYPE=en_US.UTF-8 (charmap=UTF-8), 
LANGUAGE=en_US.UTF-8 (charmap=UTF-8)
Shell: /bin/sh linked to /bin/dash
Init: systemd (via /run/systemd/system)
LSM: AppArmor: enabled

Versions of packages numdiff depends on:
ii  dpkg  1.19.0.4
ii  install-info  6.5.0.dfsg.1-1
ii  libc6 2.26-2

numdiff recommends no packages.

numdiff suggests no packages.

-- no debconf information