David, In Datadog events you can see the killed pods.
But, if you have containers that need to be killed because they don't die when receiving a stop, you'll see a lot of events like: KILLED, DESTROYED, and this is not necessarily an error, could be only a container being restarted, keep that in mind. On Wed, Aug 8, 2018 at 6:06 PM David Rosenstrauch <dar...@darose.net> wrote: > Thanks for the response, Marcio. We've actually recently started using > Datadog already. (At least in dev/qa.) But DD is a bit of a sea of > metrics, and I'm not clear how we would accomplish one of the specific > tasks I've mentioned - for example, alerting when k8s has killed a > container or pod. Any pointers on how I might go about setting up an > alert like that? > > Thanks, > > DR > > On 08/08/2018 04:45 PM, Marcio Garcia wrote: > > Hi David, > > > > You can use DataDog to achieve this. > > > > On 8/8/18, David Rosenstrauch <dar...@darose.net> wrote: > >> As we're getting ready to go to production with our k8s-based system, > >> we're trying to pin down exactly how we're going to do all the needed > >> monitoring/alerting for it. We can easily collect many of the metrics > >> we need (using kube-state-metrics to feed into prometheus, and/or > >> Datadog) and alert off of those. > >> > >> However, there's other important k8s-related info about our system that > >> we need to be able to access, monitor, and alert on, most notably things > >> like: > >> > >> * If a container crashes and is restarted by k8s > > >> How would would go about gaining access to those k8s-related events in > >> an automated fashion, and setting up monitoring/alerting off of those? > > -- > You received this message because you are subscribed to the Google Groups > "Kubernetes user discussion and Q&A" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to kubernetes-users+unsubscr...@googlegroups.com. > To post to this group, send email to kubernetes-users@googlegroups.com. > Visit this group at https://groups.google.com/group/kubernetes-users. > For more options, visit https://groups.google.com/d/optout. > -- You received this message because you are subscribed to the Google Groups "Kubernetes user discussion and Q&A" group. To unsubscribe from this group and stop receiving emails from it, send an email to kubernetes-users+unsubscr...@googlegroups.com. To post to this group, send email to kubernetes-users@googlegroups.com. Visit this group at https://groups.google.com/group/kubernetes-users. For more options, visit https://groups.google.com/d/optout.
