Update on the alert generator compliance: Some vendors cannot expose some of the APIs required by the Prometheus alert generator compliance test suite.
*We modified the test suite so it can be run by vendors themselves and submit results to Prometheus/CNCF. *CNCF will contractually protect against submitting wrong results on purpose. If there are any questions, please feel free to ask in this thread. Thanks, Jean-Philippe Quéméner (johnnyqqqq) On Friday, May 6, 2022 at 10:51:07 AM UTC+2 [email protected] wrote: > Hello everyone, > > I have run the alert-generator compliance test on Promscale and I am happy > to report that *Promscale passed the test with a score of 100%*. Please > find the logs of the alert generator attached to this message. > > I will open a PR on prometheus/compliance > <https://github.com/prometheus/compliance> shortly, with instructions on > how to run the alert-generator compliance test on Promscale. > > Thank you > Harkishen > > Promscale version: 0.11-alpha > Promscale recent commit: link > <https://github.com/timescale/promscale/commit/1c8efecc9b7a5d6fcf025dba58017e17f2194c2a> > TimescaleDB image: > ghcr.io/timescale/dev_promscale_extension:0.5.0-alpha-ts2-pg14 > > *Note:* The above image is a pre-release. While opening the PR in the > prometheus/compliance repository, I will use the stable version which will > be ready soon. > > *Links* > Promscale: https://github.com/timescale/promscale > Alert-generator compliance: > https://github.com/prometheus/compliance/tree/main/alert_generator > > On Wednesday, March 2, 2022 at 2:12:02 PM UTC+5:30 [email protected] > wrote: > >> Hello Promscale team, >> >> I hope this email finds you well. >> >> As a part of Prometheus conformance program >> <https://github.com/cncf/prometheus-conformance>, we had floated a doc >> on "Prometheus Alert-Generator Compliance" many months ago and had >> finalized the specification for that (see here >> <https://github.com/prometheus/compliance/blob/main/alert_generator/specification.md> >> ). >> >> The test suite to test the specification is now ready and instructions on >> how to run the test suite are present here >> <https://github.com/prometheus/compliance/blob/main/alert_generator/README.md> >> . >> >> If you wish Promscale to be compliant with Prometheus Alert-Generator, >> please test your software with the above test suite and report back the >> results by replying to this thread (results being the entire log output of >> the test run). >> >> If you do need any additional help from the test suite (for example >> setting custom headers to some requests), please let me know and I will add >> those abilities to the test suite. >> >> Going forward, we would like to automate this process. We ask you to add >> your test-suite config template by opening a PR against >> prometheus/compliance <https://github.com/prometheus/compliance/> and >> create test-promscale.yaml in the alert_generator directory. See >> test-.*.yaml files here >> <https://github.com/prometheus/compliance/tree/main/alert_generator> for >> example. Please also add instructions on how to set up as comments in the >> same file. >> >> If you face issues in running the test suite or understanding any error >> messages, I am happy to answer your queries. >> >> We plan to publish the results during the third week of May 2022 (during >> KubeCon EU). >> >> Thanks, >> Ganesh (codesome) >> Prometheus team >> > -- You received this message because you are subscribed to the Google Groups "Prometheus Developers" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-developers/02b774a2-a926-4122-9829-2d0313890b86n%40googlegroups.com.
