Hello Guys,
1. I'm getting for the first time a Readiness Probe issue with ly Prom
running on AWS EKS, the pod was running nice since weeks ant it suddenly
turns into failing.
*$ kdpon monitoring prometheus *(Kube pod describe command )
Unhealthy 4m (x182535 over 6d) kubelet,
I've installed Prometheus in my windows machine and installed Debian and
OpenSuse in VMware. I wanted to check the system metrics so, I installed
node_exporters in both(Debian and OpenSuse).
But from prometheus server I can only access debian metrics, opensuse
target is showing down. (Error:
I have a Grok exporter gauge metric which returning mysql checksum
completion percentage by reading and parsing from a file. I'm using grafana
dashboard to visualize Prometheus values.
[image: Screenshot 2020-05-24 at 9.51.00 PM.png]
Problem is Prometheus holding last value of metric until a
What is the exact command being used (with all the command line options)?
On 25 May 2020 09:50:16 BST, Harsh bhadoria wrote:
>./node_exporter. command starts the node_exporter server.
>On Monday, 25 May 2020 14:18:43 UTC+5:30, Stuart Clark wrote:
>>
>> What command line options are being
What configuration do you have set for the different node exporters in your
prometheus.yml?
On 25 May 2020 10:03:03 BST, Harsh bhadoria wrote:
>I used chrome in opensuse machine to check the metrics.
>
>On Monday, 25 May 2020 14:30:12 UTC+5:30, Stuart Clark wrote:
>>
>> When you say that you
That's almost right. Firstly, all these settings go under
"relabel_configs", none under "metric_relabel_configs"
Secondly, you need a final rule to set the __address__ to the actual target
you want to scrape:
- source_labels: ['__address__']
regex: '(.*);(.*);(.*);(.*)'
Hi Ben,
I looked into mtail it looks cool but probably doesn't fit my needs
I run a pod (DaemonSet) in k8s that counts the peer-pods (same host) log's
producing rate
On Monday, May 25, 2020 at 3:14:28 PM UTC+3, Ben Kochie wrote:
>
> In your code, you just add deltas to a counter metric. This
Until a new value is scraped, that 48% is the current value.
As a metrics system Prometheus scrapes values regularly. As a result it is
unlikely that a scrape will fall exactly on the moment needed for a query to be
processed. Instead Prometheus will look back to find the latest value and use
I just installed the node_exporter in my Suse env, then unzip it, went to
node_exporter folder, there is an node_exporter executable file, from there
I just give command (./node_exporter), it starts the server at port 9100,
now from use env if I go to my browser and go to URL(localhost:9100) it
./node_exporter. command starts the node_exporter server.
On Monday, 25 May 2020 14:18:43 UTC+5:30, Stuart Clark wrote:
>
> What command line options are being used for them? You can use ps to check
> or look at the systemd unit
>
> On 25 May 2020 09:47:11 BST, Harsh bhadoria > wrote:
>>
>>
If you use that IP address rather than localhost on the opensuse machine (in
the web browser) do you get metrics?
On 25 May 2020 10:14:03 BST, Harsh bhadoria wrote:
>In scrape_configs, i added the "job-name: 'node_exporter' " and in
>static
>config, I've added targets as IP address of debian
In your code, you just add deltas to a counter metric. This tracks the
local known state of how many lines it's seen. Prometheus tracks this over
time, allowing you to use rate() and increase() functions to calculate the
deltas over time.
If you're looking to observe log files, I highly recommend
In debian i've installed the node_exporter and ran it, now I can see the
metrics from prometheus which is in windows, same I've installed in
opensuse also, and running node_exporter, but I'm not getting info in
prometheus.
On Monday, 25 May 2020 14:14:54 UTC+5:30, Harsh bhadoria wrote:
>
>
No, firewall is off.
On Monday, 25 May 2020 14:16:39 UTC+5:30, Stuart Clark wrote:
>
> What is the configuration being used for the node exporter? Could you be
> binding to only localhost rather than and external network interface?
>
> Are there any firewalls between the server and Prometheus?
What command line options are being used for them? You can use ps to check or
look at the systemd unit
On 25 May 2020 09:47:11 BST, Harsh bhadoria wrote:
>In debian i've installed the node_exporter and ran it, now I can see
>the
>metrics from prometheus which is in windows, same I've installed
I used chrome in opensuse machine to check the metrics.
On Monday, 25 May 2020 14:30:12 UTC+5:30, Stuart Clark wrote:
>
> When you say that you check the opensuse metrics with your browser, which
> machine is that running on? Is that curl or a graphical browser?
>
> On 25 May 2020 09:57:26 BST,
Are you able to use curl or wget to access the node exporter from the box or
the Prometheus server?
On 25 May 2020 09:22:35 BST, Harsh bhadoria wrote:
>I've installed Prometheus in my windows machine and installed Debian
>and
>OpenSuse in VMware. I wanted to check the system metrics so, I
Yes, i can see the metrics from opensuse while going through
localhost:9100, but not getting it from prometheus
On Monday, 25 May 2020 14:00:52 UTC+5:30, Stuart Clark wrote:
>
> Are you able to use curl or wget to access the node exporter from the box
> or the Prometheus server?
>
> On 25 May
What is the configuration being used for the node exporter? Could you be
binding to only localhost rather than and external network interface?
Are there any firewalls between the server and Prometheus?
On 25 May 2020 09:44:54 BST, Harsh bhadoria wrote:
>Yes, i can see the metrics from
When you say that you check the opensuse metrics with your browser, which
machine is that running on? Is that curl or a graphical browser?
On 25 May 2020 09:57:26 BST, Harsh bhadoria wrote:
>I just installed the node_exporter in my Suse env, then unzip it, went
>to
>node_exporter folder,
Hi stuart,
Thanks for your prompt response.
I m trying to create a tabel dashboard on grafana showing current tabel
undergoing checksumming and its completion percentage. As i collect these
metrics from a file where these values get printed as things progress. But when
i plot this tabel
i was thinking of Running Prometheus server in i3en.xlarge as it has local
storage and will get better IO performance than ebs. Please can any one
share their opinion on this or may be suggest better EC2 instance type for
running Prometheus in Production environment. Thanks in advance
--
You
In which case I'd suggest producing an additional metric where the value is the
unix timestamp of the last update. You can then update your dashboard query to
exclude those which haven't been updated for a certain length of time.
However I would caution against getting too close to trying to
Awesome! That worked! Thanks for everything. Leaving the solution here.
- targets:
- server1;ad-1;domain-1;emea-1
- server2;ad-2;domain-2;emea-1
relabel_configs:
- source_labels: ['__address__']
regex: '(.*);(.*);(.*);(.*)'
target_label: 'ad'
replacement:
Hello,
Metrics are not saved when I put a timestamps with metrics.
I've got through github issue and some of prometheus codes but not yet
getting the root cause.
I would be happy if I can get why I'm getting below errors.
Errors
*Error 1*
I got below error when executing prometheus with
Hi all,
Thanks for all the guidance you all have given me.
I came across something regarding alert manager.
I have provisioned alertmanager to send alerts to slack.
Sometimes I notice that I get resolved notification for the alert that never
triggered.
Why is this happening. Is there something
Hi, I need to exclude all labels containing an error name. For example
those starting with '3scale'.
This in order to avoid this error during federation phase:
"prometheus | level=warn ts=2020-05-25T18:15:57.094907355Z
caller=scrape.go:867 component="scrape manager"
Hi,
How much approx size should be allocated for Thanos Object Storage where we
have to monitor OpenStack environment on 5 sites.
Also we have to use Node and Collectd Exporter to monitor system parameters
as well.
Pls advice.
Thanks,
Saurabh
--
You received this message because you are
Figured out the issue, there was firewall issue.
By the way, thanks for your suggestions.
On Monday, 25 May 2020 14:45:42 UTC+5:30, Stuart Clark wrote:
>
> If you use that IP address rather than localhost on the opensuse machine
> (in the web browser) do you get metrics?
>
> On 25 May 2020
Resolved.
Precision of timestamp must be millisecond but I've had put second.
On Tuesday, May 26, 2020 at 1:30:39 AM UTC+9, shimpeko wrote:
>
> Hello,
>
> Metrics are not saved when I put a timestamps with metrics.
> I've got through github issue and some of prometheus codes but not yet
>
On Tue, May 19, 2020 at 1:42 PM Colton Conor wrote:
> We are exploring the option of paying for Grafana Cloud's service. In
> addition to hosting Grafana, it comes with the ability to store metrics
> from Prometheus and Graphite. The documentation says:
>
> To send data using Prometheus you need
Prometheus doesn't typically require high performance storage. HDD or EBS
work just fine.
Sizing your instance depends on how much you're monitoring.
This might help you:
https://www.robustperception.io/how-much-ram-does-prometheus-2-x-need-for-cardinality-and-ingestion
On Mon, May 25, 2020 at
32 matches
Mail list logo
