Collection Updated 3 months ago

The Kauri Stack

How do we build Kauri? learn the tools and techniques behind our decentralized content platform

kubernetes
ethereum
java
elasticsearch
ipfs

5

Articles

0

Collections
Curator
chrischinchilla
Monitoring

How Kauri monitors and logs events with Elasticsearch

(1/5) Getting started with Elastic Stack for monitoring on Kubernetes

Introduction In this article, we will learn how to set up a monitoring stack for your Kubernetes environment (k8s in short). This kind of solution allows your team to gain visibility on your infrastructure and each application with a minimal impact on the existing. The goal of observability is to provide tools to operators responsible of running the production to detect undesirables behaviours (service downtime, errors, slow responses) and have actionable information to find the root cause of an

Grégoire Jeanmart

9 min read

19 Oct 19

(2/5) Install ElasticSearch and Kibana to store and visualize monitoring data

ElasticSearch cluster As explained in the introduction of this article, to setup a monitoring stack with the Elastic technologies, we first need to deploy ElasticSearch that will act as a Database to store all the data (metrics, logs and traces). The database will be composed of three scalable nodes connected together into a Cluster as recommended for production. Moreover, we will enable the authentication to make the stack more secure to potential attackers. 1. Setup the ElasticSearch master no

Grégoire Jeanmart

18 min read

03 Sep 19

(3/5) Collect metrics with Elastic Metricbeat for monitoring Kubernetes

Metricbeat is a lightweight shipper installed on a server to periodically collect metrics from the host and services running. This represents the first pillar of observability to monitor our stack. Metricbeat captures by default system metrics but also includes a large list of modules to capture specific metrics about services such as proxy (NGINX), message bus (RabbitMQ, Kafka), Databases (MongoDB, MySQL, Redis) and many others (find the full list here) Prerequisite - kube-state-metrics First,

Grégoire Jeanmart

13 min read

19 Oct 19

(4/5) Collect logs with Elastic Filebeat for monitoring Kubernetes

In the next section of this series, we are now going to install Filebeat, it is a lightweight agent to collect and forward log data to ElasticSearch within the k8s environment (node and pod logs). Moreover, specific modules can be configured to parse and visualise logs format coming from common applications or system (databases, message bus). Configuration Similarly to Metricbeat, Filebeat requires a settings file to configure the connections to ElasticSearch (endpoint, username, password), the

Grégoire Jeanmart

13 min read

03 Sep 19

(5/5) Collect traces with Elastic APM for monitoring Kubernetes

Elastic APM is an application performance monitoring system built on the Elastic Stack. It allows you to monitor software services and applications in real time — collect detailed performance information on response time for incoming requests, database queries, calls to caches, external HTTP requests, and more. This makes it easy to pinpoint and fix performance problems quickly. Elastic APM is OpenTracing compliant which means you can take advantages of the large range of libraries already avail

Grégoire Jeanmart

9 min read

03 Sep 19