[PATCH] D83539: [analyzer][tests] Introduce analyzer benchmarking framework

vsavchenko added inline comments. Comment at: clang/utils/analyzer/SATestBenchmark.py:139-140 +import matplotlib +import seaborn as sns +from matplotlib import pyplot as plt + NoQ wrote: > Why shorten? It's not that we're saving a lot of typing, and

[PATCH] D83539: [analyzer][tests] Introduce analyzer benchmarking framework

This revision was automatically updated to reflect the committed changes. vsavchenko marked an inline comment as done. Closed by commit rG5b4f14356450: [analyzer][tests] Introduce analyzer benchmarking framework (authored by vsavchenko). Repository: rG LLVM Github Monorepo CHANGES SINCE LAST

[PATCH] D83539: [analyzer][tests] Introduce analyzer benchmarking framework

NoQ accepted this revision. NoQ added a comment. This revision is now accepted and ready to land. Box-and-whisker diagrams  Comment at: clang/utils/analyzer/SATestBenchmark.py:18 + +import pandas as pd +from typing import List, Tuple @Szelethus ???

[PATCH] D83539: [analyzer][tests] Introduce analyzer benchmarking framework

vsavchenko added a comment. Here is an example of how benchmarking chart looks like: F12321843: plot2.png It has 20 runs on each of those projects. It was the same revision of the analyzer, so it is still very sensitive to other stuff happening on the test

[PATCH] D83539: [analyzer][tests] Introduce analyzer benchmarking framework

vsavchenko updated this revision to Diff 276950. vsavchenko added a comment. Rebase Repository: rG LLVM Github Monorepo CHANGES SINCE LAST ACTION https://reviews.llvm.org/D83539/new/ https://reviews.llvm.org/D83539 Files: clang/utils/analyzer/SATest.py

[PATCH] D83539: [analyzer][tests] Introduce analyzer benchmarking framework

vsavchenko created this revision. vsavchenko added reviewers: NoQ, xazax.hun, dcoughlin. Herald added subscribers: cfe-commits, ASDenysPetrov, Charusso, dkrupp, donat.nagy, Szelethus, mikhail.ramalho, a.sidorin, rnkovacs, szepet, baloghadamsoftware. Herald added a project: clang. This commit