Hello, Whenever we try to restart the Prometheus service, we are facing
some issues and Service is not starting...

*Issue1*: It is complaining about time ranges overlap after restart and not
starting, after deleting the directories named with uuid, service is
started successfully.
level=error ts=2020-03-16T05:46:32.648Z caller=main.go:736 err="opening
storage failed: invalid block sequence: block time ranges overlap: [mint:
1584151200000, maxt: 1584158400000, range: 2h0m0s, blocks: 5]: <ulid:
01E3BPKK6345WJCJBDJ6MD54X1, mint: 1584151200000, maxt: 1584158400000,
range: 2h0m0s>, <ulid: 01E3BPKSQ14ZX63XP7GNMYF9PB, mint: 1584151200000,
maxt: 1584158400000, range: 2h0m0s>, <ulid: 01E3BPPBV6Q1M7VQTWC0A16BMR,
mint: 1584151200000, maxt: 1584158400000, range: 2h0m0s>, <ulid:
01E3CCXVM5J72658E3YDK9WGZ8, mint: 1584151200000, maxt: 1584158400000,
range: 2h0m0s>, <ulid: 01E3D099N14KRHFF5XA2H6J2A8, mint: 1584151200000,
maxt: 1584158400000, range: 2h0m0s>"

*Issue2*:It is complaining about meta.json not found, and after deleting
those directory, started fine.
level=error ts=2020-03-14T09:02:29.497Z caller=db.go:604 component=tsdb
msg="compaction failed" err="plan compaction: open
/v../l../prometheus/01E3C4BBFR0VCQWZDPGJMAT2NB/meta.json: no such file or
directory"

*Issue3: *We have got luck but no issues on restart, then it is taking few
min to start the service, as it taking time on below process... WAL segment
loaded....
level=info ts=2020-03-16T05:50:21.522Z caller=head.go:560 component=tsdb
msg="WAL segment loaded" segment=405 maxSegment=534
level=info ts=2020-03-16T05:50:23.005Z caller=head.go:560 component=tsdb
msg="WAL segment loaded" segment=406 maxSegment=534
level=info ts=2020-03-16T05:50:24.612Z caller=head.go:560 component=tsdb
msg="WAL segment loaded" segment=407 maxSegment=534
level=info ts=2020-03-16T05:50:26.104Z caller=head.go:560 component=tsdb
msg="WAL segment loaded" segment=408 maxSegment=534

Prometheus is running as systemd, and trying to restart service as
"systemctl restart prometheus.service"

Any help or input is appreciated.

-- 
You received this message because you are subscribed to the Google Groups 
"Prometheus Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to [email protected].
To view this discussion on the web visit 
https://groups.google.com/d/msgid/prometheus-users/CAPs_AfiAWJ6z5ZNOOwNrRpyy18jLmZxT7U9beprVdHyu2s04cA%40mail.gmail.com.

Reply via email to