Re: [prometheus-users] snmp_exporter 0.25.0 + and prometheus 2.49.1 with "%" in label value - format issue

2024-02-12 Thread Alexander Wilke
indows? STATUS_BREAKPOINT appears here: > https://pkg.go.dev/golang.org/x/s...@v0.17.0/windows#pkg-constants > <https://pkg.go.dev/golang.org/x/sys@v0.17.0/windows#pkg-constants> > > On Monday 12 February 2024 at 15:58:44 UTC Ben Kochie wrote: > >> On Mon, Feb 12, 2

Re: [prometheus-users] snmp_exporter 0.25.0 + and prometheus 2.49.1 with "%" in label value - format issue

2024-02-12 Thread Alexander Wilke
Hope this is sufficient. If Something else is needed i will try to provide it. https://github.com/prometheus/snmp_exporter/issues/1115 Alexander Wilke schrieb am Montag, 12. Februar 2024 um 21:29:12 UTC+1: > Prometheus, snmp_exporter, node_exporter, smokeping_prober, > blackbox_ex

Re: [prometheus-users] blackbox_exporter - how to simplify my configuration

2024-02-19 Thread Alexander Wilke
Thanks for sharing your ideas. Chris Siebenmann schrieb am Montag, 19. Februar 2024 um 21:08:02 UTC+1: > > In our DataCenter we have different security zones. In each zone I > > want to place a blackbox_exporter. The goal is that each > > blackbox_exporter monitors the same destinations eg.

Re: [prometheus-users] Alert Query

2024-02-19 Thread Alexander Wilke
Did you try with topk(3,metrics) ? sri L schrieb am Di., 20. Feb. 2024, 05:19: > Hi all, > > I am looking for a way to send out an alert with top 3 cpu/memory > utilization processes when total cpu/memory utilization goes above 80% for > a node. > > I can create an alert using node metrics to

[prometheus-users] Prometheus MultiTenancy / separation of metrics / separation of passwords

2024-02-19 Thread Alexander Wilke
Hello, in our company I maintain a Prometheus Server to Monitor my own devices with so there is No need to separate metrics and credentials. There May be interest from other Departments to Monitor their devices with the Same Prometheus instance so they do Not have to maintain the Server

[prometheus-users] Smokeping_prober CPU usage optimization possible?

2024-02-19 Thread Alexander Wilke
Hello, I am running smokeping_prober from one VM to Monitor around 500 destinations. Around 30 devices are monitored with 0.2s Intervall and Others with 1.65s Intervall. Prometheus scrapes every 5s. So there are roughly 600 icmp ipv4 24byte pings per Seconds. CPU usage jumps between 700-1200%

[prometheus-users] blackbox_exporter - how to simplify my configuration

2024-02-17 Thread Alexander Wilke
Hello, In our DataCenter we have different security zones. In each zone I want to place a blackbox_exporter. The goal is that each blackbox_exporter monitors the same destinations eg. same DNS Server or same webserver. All exporters are controlled by one single prometheus server. If someone

Re: [prometheus-users] snmp_exporter 0.25.0 + and prometheus 2.49.1 with "%" in label value - format issue

2024-02-12 Thread Alexander Wilke
rAddrType` as well as > `ltmPoolMemberAddr` > > https://github.com/prometheus/snmp_exporter/issues > > It would also be helpful to have the sample data as text, rather than a > screenshot. This makes it easier to work with for creating test cases. > > On Mon, Feb 12, 2024 at

[prometheus-users] Re: snmp_exporter-0.20 cannot monitor SNMP V3?

2024-01-10 Thread Alexander Wilke
If you use Cisco devices then you have to use a "C" at the end of the privacy protocol because it seems Cisco has specific impelementation. I use *priv_protocol: AES256C* for Cisco IOS and IOS XE devices running 17.x.y version. Brian Candler schrieb am Mittwoch, 10. Januar 2024 um 12:32:08

[prometheus-users] Blackbox exporter - add Header dynamically after First requests to server

2024-01-10 Thread Alexander Wilke
Hello, i Connect with Blackbox exporter and http POST to an API. I Connect with body_file which contains credentials to Login and some other Parameters. The API answers with two Header sid: XYZ uid: ABC For further actions in the API I have to add These dynamic Headers to each requests. Is it

[prometheus-users] Re: smokeping_prober - $(target:raw) - help with ":raw" and how to use multiple targets

2024-01-11 Thread Alexander Wilke
a single target selection > and you *modified* it to allow multiple selections, then you broke it. At > this point you've become a Grafana dashboard developer, and again, the > Grafana Community would be the best place to ask for help. It's Grafana > that builds the query; Prom

[prometheus-users] Re: snmp_exporter 0.25.0 - IF-MIB and CISCO-IF-EXTENSION-MIB

2024-01-11 Thread Alexander Wilke
nderstanding: > https://www.robustperception.io/how-to-have-labels-for-machine-roles > https://www.robustperception.io/exposing-the-software-version-to-prometheus > https://www.robustperception.io/left-joins-in-promql > > On Tuesday 9 January 2024 at 10:04:36 UTC Alexander Wilke wrot

[prometheus-users] Windows_exporter what permissions are needed

2024-01-14 Thread Alexander Wilke
Hello, is there any documentation which Type of permissions are needed for the specific collectors? In node_exporter there is a hint it can Run without root and as a general User. If i Install the windows_exporter as MSI I probably need Higher rights because it Runs as a service. If I Run the

Re: [prometheus-users] Why is snmp_exporter not recognizing the custom OID added?

2024-01-14 Thread Alexander Wilke
Tell me the MIBs you want to use and maybe I can Tell you whats needed for Generator.yml and which additional MIBs are needed. Awemnhd schrieb am Sonntag, 14. Januar 2024 um 13:02:32 UTC+1: > Thank you. I will try to download the MIB file from this website later, > but I have a question. Why

[prometheus-users] Re: Weird node_exporter network metrics behaviour - NIC problem?

2024-01-14 Thread Alexander Wilke
Do you have the same scrape_interval for both machines? Are you running irate on both queties or "rate" on the one and "irate" on the other? Are the iperf intervals the same for both tests? Dito Windyaksa schrieb am Montag, 15. Januar 2024 um 00:02:26 UTC+1: > Hi, > > We're migrating to a new

Re: [prometheus-users] Smokeping_prober 0.7.1 - amount or buckets

2024-01-16 Thread Alexander Wilke
#native-histograms > > https://www.usenix.org/conference/srecon23emea/presentation/rabenstein > > This is already supported by the smokeping_prober, but you may need to > enable it in Prometheus. > > On Mon, Jan 15, 2024 at 4:35 PM Alexander Wilke > wrote: > >>

[prometheus-users] Smokeping_prober 0.7.1 - amount or buckets

2024-01-15 Thread Alexander Wilke
Hello, I would Like to know If there are any technical disadvantages or limitations If I use a high(er) amount of buckets? And is there a possibility to Aggregate buckets later in PromQL/Grafana? My Idea was so unsere more buckets to have detailed View in latencies If I want to investigate

[prometheus-users] Node_exporter 1.7.0 - http_server_config - Strict-Transport-Security

2024-01-16 Thread Alexander Wilke
Hello, I am running: node_exporter, version 1.7.0 (branch: HEAD, revision: 7333465abf9efba81876303bb57e6fadb946041b) build date: 20231112-23:53:35 go version: go1.21.4 platform: linux/amd64 tags: netgo osusergo static_build Vulnerability scan

[prometheus-users] Re: Node_exporter 1.7.0 - http_server_config - Strict-Transport-Security

2024-01-17 Thread Alexander Wilke
nnot put "Strict-Transport-Security". > > The documentation says that the only keys allowed under > "http_server_config" are "http2" and "headers". So it needs to be like this: > > http_server_config: > headers: > Strict-Transp

Re: [prometheus-users] delta/increase on a counter return wrong value

2024-01-18 Thread Alexander Wilke
Maybe you are looking for count_over_time https://promlabs.com/promql-cheat-sheet/ Jérôme Loyet schrieb am Do., 18. Jan. 2024, 18:56: > Hello, > > I have a counter and I want to counter the number of occurences on a > duration (let's say 15m). I'm using delta() or increase but I'm not getting

Re: [prometheus-users] delta/increase on a counter return wrong value

2024-01-18 Thread Alexander Wilke
sponding metric: > [image: image.png] > > There must be some black magic around increase/delta that I do not > understand that gets me unexpected results. > > Le jeu. 18 janv. 2024 à 19:14, Alexander Wilke a > écrit : > >> Maybe you are looking for >> >> count_over_time

[prometheus-users] snmp_exporter 0.25.0 - IF-MIB and CISCO-IF-EXTENSION-MIB

2024-01-09 Thread Alexander Wilke
Hello, I am using snmp-exporter to monitor CISCO IOS and IOS-XE devices. However I have issues with merging the "IF-MIB" and "CISCO-IF-EXTENSION-MIB". IF-MIB provides information with the following labels: ifIndex ifName ifDescr ifAlias if I add the "CISCO-IF-EXTENSION-MIB" to the generator I

[prometheus-users] Blackbox_Exporter 0.24.0 - probe endpoint every 15s with30s timeout ?

2024-01-09 Thread Alexander Wilke
Hello, I want to use blackbox_exporter and http prober to login to an API. My goal is to do the login every 15s which could be xx:yy:00 xx:yy:15 xx:yy:30 xx:yy:45 I could solve this with scrape_interval: 15s. But in addition I want to allow a scrape timeout of 30s which is longer than the

[prometheus-users] prometheus 2.48.1 - web-config.yml - cipher_suites "unknown cipher"

2024-01-09 Thread Alexander Wilke
Hello, I am running prometheus 2.48.1 and I have problems to find the correct syntax for the "cipher_suites" in web.config.yml file: https://cs.opensource.google/go/go/+/refs/tags/go1.21.5:src/crypto/tls/cipher_suites.go;l=656 https://pkg.go.dev/crypto/tls#CipherSuitesi web-config.yml

[prometheus-users] Re: prometheus 2.48.1 - web-config.yml - cipher_suites "unknown cipher"

2024-01-09 Thread Alexander Wilke
s instead listed in InsecureCipherSuites: > https://go.dev/play/p/ey1z_wG4Ezw > > Why is the cipher with SHA(1) secure, but SHA256 insecure??! I have no > idea. Maybe worth asking on golang-nuts. > > On Tuesday 9 January 2024 at 10:04:21 UTC Alexander Wilke wrote: > &

[prometheus-users] Re: Blackbox_Exporter 0.24.0 - probe endpoint every 15s with30s timeout ?

2024-01-09 Thread Alexander Wilke
>> This has to be in table view, not graph view. Don't mix any other targets >> into that scrape job, because they'll be spread together. >> >> Alternatively, KISS: use a 15 second scrape interval, and simply accept >> that "scrape failed" = "took long

Re: [prometheus-users] Maximum targets for exporter

2024-01-12 Thread Alexander Wilke
Hello, sorry to hijack this thread a little bit but Brian talks about "4 CPU cores" and Ben says "scale horizontally". Just for interest - why not just use 8, 16, or 32 CPU cores? Is Go limited at a specific CPU amount or is there a disadvantage to have to many cores? I think if someone is

Re: [prometheus-users] Why is snmp_exporter not recognizing the custom OID added?

2024-01-13 Thread Alexander Wilke
Keep in mind that you so Not only need the vendor specific MIBs but you need in Addition all MIBs which are listet at the to of the MIB as "IMPORTED". So you maybe need other MIBs in the folder to have the complete OID path. Maybe post: - Your MIBs folder with the MIBs you use - The

Re: [prometheus-users] Maximum targets for exporter

2024-01-13 Thread Alexander Wilke
fore > you run into actual CPU limits. > > It's not something a lot of people have tested/used in production that > scale. At least not enough that I've gotten any good feedback. > > On Sat, Jan 13, 2024 at 1:20 AM Alexander Wilke > wrote: > >> Hello, >> sorry

Re: [prometheus-users] snmp exporter & snmpv3

2024-01-20 Thread Alexander Wilke
If you have a working SNMP.yml thrn Just add this at the top of the File CustomName: version: 3 security_level: authPriv username: "username" auth_protocol: SHA password: 'password' priv_protocol: AES The "CustomName" is what you use in Prometheus.yml as auth Module. If

[prometheus-users] Metrics from PUSH Consumer - Relabeled Metrics? Check "Up" state?

2024-01-20 Thread Alexander Wilke
Hello, I have some Enterprise Firewalls which unfortunately only can PUSH metrics to remote_write API of Prometheus. Vendor has No Plans to offer PULL. Which possibilities do I have in Prometheus to Change some metrics at the time they arrive on the API? I want to add some Custom Labels based

[prometheus-users] Re: PromQL: understanding the and operator

2024-02-23 Thread Alexander Wilke
Another possibility could be QueryA + queryB == 0 #both down Or the other way QueryA + querxB == 2 # both up Alexander Wilke schrieb am Freitag, 23. Februar 2024 um 17:45:28 UTC+1: > In Grafana i create query A and Query B and then an Expression C with > "Math" and then I

[prometheus-users] Re: PromQL: understanding the and operator

2024-02-23 Thread Alexander Wilke
In Grafana i create query A and Query B and then an Expression C with "Math" and then I can compare Like $A > 0 && B > 0. Maybe there is "Transform Data" and then a calcukation Option. Puneet Singh schrieb am Donnerstag, 22. Februar 2024 um 21:58:08 UTC+1: > okay, So I think should this be the

Re: [prometheus-users] Smokeping_prober CPU usage optimization possible?

2024-02-25 Thread Alexander Wilke
Hello, any Chance to investigate the Reports and any suggestions? Alexander Wilke schrieb am Donnerstag, 22. Februar 2024 um 12:40:09 UTC+1: > Hello, > > sorry for the delay. here are the results. to be honest - I do not > understand anything of it. > > Smokeping_Prober

[prometheus-users] Blackbox_exporter TCP TLS - time for TLS Handshake ?

2024-02-25 Thread Alexander Wilke
Hello, Blackbox_exporter with http Prober and TLS Shows how Long the TLS Handshake needs. Is this Not possible with TCP + TLS which is Not http/s ? Is this Not possible or Not implemented? -- You received this message because you are subscribed to the Google Groups "Prometheus Users" group.

Re: [prometheus-users] Smokeping_prober CPU usage optimization possible?

2024-02-22 Thread Alexander Wilke
:9374/debug/pprof/heap > :9374/debug/pprof/profile?seconds=30 > > You can post the results to https://pprof.me/ for sharing. > > On Tue, Feb 20, 2024 at 6:22 AM Alexander Wilke > wrote: > >> Hello, >> I am running smokeping_prober from one VM to Monitor arou

[prometheus-users] Re: Metrics from PUSH Consumer - Relabeled Metrics? Check "Up" state?

2024-02-26 Thread Alexander Wilke
Will I run into issues with "staleness" if there aren't any metrics anymore for (more) than 5 minutes? Or perhaps can I use this "staleness" indicator in some way? Brian Candler schrieb am Montag, 26. Februar 2024 um 16:15:57 UTC+1: > > I am still looking for a solution to identify if a device

Re: [prometheus-users] Re: Metrics from PUSH Consumer - Relabeled Metrics? Check "Up" state?

2024-02-26 Thread Alexander Wilke
Hello, absent_over_time() Looks good. It should allow me to alert If metrics is Not available for 10min. This will not alert If system reboots. If i use a query with Offset I think it would alert only AeS Long as the Offset still hast a value, eg Offset 10m i will get an Alarm For 10m but

[prometheus-users] Re: Metrics from PUSH Consumer - Relabeled Metrics? Check "Up" state?

2024-02-26 Thread Alexander Wilke
es sharing the same labels like "host_name" so this is a label I could verify and they all share same metrics like "push_device_uptime(host_name: deviceName)" Alexander Wilke schrieb am Samstag, 20. Januar 2024 um 10:15:08 UTC+1: > Hello, > I have some Enterprise Firewal

[prometheus-users] Prometheus CPU usage for a query - Single threaded? Grafana Mimir?

2024-02-27 Thread Alexander Wilke
Hello, is it true that Prometheus 2.49.1 only uses a single thread/CPU for queries Like mentioned Here: https://grafana.com/blog/2022/07/20/how-we-improved-grafana-mimir-query-performance-by-up-to-10x/ How can I Check the Prometheus CPU usage for a query? -- You received this message because

Re: [prometheus-users] Smokeping_prober CPU usage optimization possible?

2024-02-27 Thread Alexander Wilke
he process use more memory, but it should reduce the CPU > time spent. > > On Sun, Feb 25, 2024 at 11:18 PM Alexander Wilke > wrote: > >> Hello, >> >> I attached a few screenshots showing the results and graphs for 1h and 6h. >> In addition I added a screens

[prometheus-users] Re: snmp_exporter adding trailing 0's to me oid's

2024-03-09 Thread Alexander Wilke
Hi, try this instead of the OID: inQueueSize Neil Stottler schrieb am Freitag, 8. März 2024 um 21:17:45 UTC+1: > Hey all, > > Weird issue I'm seeing. In my generator.yml file I'm looking to add a > barracuda module as follows: > #barracuda > barracuda-spam: > walk: > -

[prometheus-users] blackbox_exporter 0.24.0 and smokeping_prober 0.7.1 - DNS cache "nscd" not working

2024-03-15 Thread Alexander Wilke
Hello, I am running blackbox_exporter and smokeping_prober on a RHEL8 environment. Unfortunately with our configu wie have around 4-5 million DNS queries per 24hrs. The reason for that is that we do very frequent tcp queries to various destinations which results in many DNS requests. To

[prometheus-users] prometheus agent 2.49.1 - remote_write metrics while disconnected

2024-03-12 Thread Alexander Wilke
Hello, I am running a prometheus server as a central instance. I configured prometheus in agent mode on another system and send the logs via remote_write from agent to central prometheus. This works. I changed the password in web.config.yml on the central server so it does not match for the

[prometheus-users] Best practive: "job_name in prometheus agent? Same job_name allowed ?

2024-03-12 Thread Alexander Wilke
At the moment I am running the job with name "node_exporter" which has 20 different targets. (instances) With this configuration there should not be any conflict. my idea is to install the prometheus agent on the nodes itself. technically it looks like it work if I use the same job_name on the

[prometheus-users] Re: Best practive: "job_name in prometheus agent? Same job_name allowed ?

2024-03-14 Thread Alexander Wilke
roblem with all > the agents using the same "job" label when remote-writing. > > On Tuesday 12 March 2024 at 22:30:22 UTC Alexander Wilke wrote: > >> At the moment I am running the job with name >> "node_exporter" which has 20 different targets. (instances) &

[prometheus-users] Re: prometheus agent 2.49.1 - remote_write metrics while disconnected

2024-03-14 Thread Alexander Wilke
to describe the same issue I saw in my environment: https://github.com/prometheus/prometheus/issues/11919 Can someone confirm this is working with 2.49.1 to store metrics for some time on prometheus agent until remotw_write is available again? if yes how did you configure this? Alexander Wilke

Re: [prometheus-users] blackbox_exporter 0.24.0 and smokeping_prober 0.7.1 - DNS cache "nscd" not working

2024-03-15 Thread Alexander Wilke
to > expiring. > > [0]: https://coredns.io/plugins/cache/ > [1]: https://coredns.io/plugins/metrics/ > > On Fri, Mar 15, 2024 at 3:41 PM Alexander Wilke > wrote: > >> Hello, >> >> I am running blackbox_exporter and smokeping_prober on a RHEL8 >&g

[prometheus-users] Re: Correlation between snmp scrape time and massive rate output for ifHCInOctets

2024-03-15 Thread Alexander Wilke
Hello, 1.) is the timeout of 50s the same on prometheus scrape_config and snmp.yml file? 2.) is this really the name of the interface? ifHCInOctetsIntfName 3) the =~".*.\\/.*." maybo shows many interfaces, maybe som internal loppback which may count traffic twice? Further it may show

Re: [prometheus-users] Correlation between snmp scrape time and massive rate output for ifHCInOctets

2024-03-16 Thread Alexander Wilke
https://github.com/prometheus/snmp_exporter/tree/main/generator Alexander Wilke schrieb am Samstag, 16. März 2024 um 09:08:44 UTC+1: > Check File Format example. > > Time Out, retries, max-repetition. > > I use Repetition 50 or 100 with Cisco, retries 0 and Time Out 1s or

Re: [prometheus-users] Correlation between snmp scrape time and massive rate output for ifHCInOctets

2024-03-16 Thread Alexander Wilke
Check File Format example. Time Out, retries, max-repetition. I use Repetition 50 or 100 with Cisco, retries 0 and Time Out 1s or 500ms below Prometheus timeout Ben Kochie schrieb am Samstag, 16. März 2024 um 06:31:17 UTC+1: > This is very likely a problem with counter resets or some other

[prometheus-users] Prometheus Agent 2.51.1 - remote_write - write_relabel_configs

2024-04-17 Thread Alexander Wilke
Hello, i have several prometheus agents doing remote write to another central prometheus Agent. on this central prometheus agent I Do two remote_rewrite to two destinations. Destination A should receive all metrics, this seems to work. Destination B should only receive metrics from specific

[prometheus-users] Re: Prometheus Agent 2.51.1 - remote_write - write_relabel_configs

2024-04-17 Thread Alexander Wilke
nt_02" queue_config: min_shards: 3 write_relabel_configs: - source_labels: [job] regex: "(node_exporter|windows_exporter)" action: keep Alexander Wilke schrieb am Mittwoch, 17. April 2024 um 09:51:57 UTC+2: > Hello, > > i have several prometheus agents doing remote

Re: [prometheus-users] Generator snmp_exporter return error 500 in prometheus

2024-04-22 Thread Alexander Wilke
Is it possible the snmp.yml timeout is too Low? Scrape_co fig hast 1m but logs say 5s. Maybe you should try and Set timeout: 50s in SNMP.yml, too and retries: 0. Or retries: 3 and timeout: 15s. Ben Kochie schrieb am Dienstag, 16. April 2024 um 11:20:05 UTC+2: > I've got a new packet debugging

Re: [prometheus-users] snmp generator.yml fails error err="cannot find oid '1.22610.2.4.1.2.2' to walk

2024-04-27 Thread Alexander Wilke
You probably do not have alle required mibs in the folder. Please Post the MIBs which you want to use and the generator command you used. PS: On top of all MIBs there are comments Like IMPORT which describes which other MIBs are needed. Fürther use MIBv2 with names instead OIDs. Put the Name in

Re: [prometheus-users] snmp generator.yml fails error err="cannot find oid '1.22610.2.4.1.2.2' to walk

2024-04-28 Thread Alexander Wilke
ion: 2 > > > prometheus_v3: > username: user > password: pwd > auth_protocol: SHA > priv_protocol: AES > security_level: authPriv > priv_password: pwd > version: 3 > > modules: > > a10: > walk: > -

Re: [prometheus-users] snmp generator.yml fails error err="cannot find oid '1.22610.2.4.1.2.2' to walk

2024-05-03 Thread Alexander Wilke
- 1.3.6.1.4.1.22610.2.4.1.2.1 > > > before running the ./generator generate \ cmd I did make generate as > well to create the generator execution file. > getting the same error no matter what I change. > On Monday, April 29, 2024 at 8:18:19 AM UTC+1 Mehran Saeed wrote: > &

Re: [prometheus-users] snmp generator.yml fails error err="cannot find oid '1.22610.2.4.1.2.2' to walk

2024-05-04 Thread Alexander Wilke
epo, add the custom mib to the > mibs dir and run the make generate cmd to generate the executable generator > file and then run ./generator generate to run the generator. > > not sure what I am doing wrong here. > > > On Fri, May 3, 2024 at 6:45 PM Alexander Wilke > wr

[prometheus-users] Re: what insecure_skip_verify will do

2024-05-15 Thread Alexander Wilke
It will skip the certificate Check. So certificate May be valid or invalid and is Always trusted. Connection is still encrypted Sameer Modak schrieb am Mittwoch, 15. Mai 2024 um 17:04:07 UTC+2: > Hello Team, > > If i set insecure_skip_verify: true will my data be unsecured. Will it > be non