Logging and Monitoring in Kubernetes with PLG stack

We’ve checked out the the actors in PLG stack (Promtail, Loki, Node Exporter, Prometheus, Grafana) and whipped up a quick pipeline on MacOS. Now I’m going a little further to implement the same setup in a K8s cluster. This setup is for demo only, therefore no persistent storage is enabled. Test Workload I host a … Read moreLogging and Monitoring in Kubernetes with PLG stack

Intro to PLG stack -Prometheus, Loki and Grafana

Last month we discussed log shipping with EFK. This week I spent sometime checking out its alternative Loki. Having been exposed to the ELK stack extensively, I am also interested in exploring the counterparts in this new stack, such as Premetheus and Grafana. So I need to address the issues of shipping both metrics and … Read moreIntro to PLG stack -Prometheus, Loki and Grafana

File storage vs object storage

The competition Traditionally, enterprise storage product lines are built around three capabilities, as listed in this table below: Capability Typical Implementation Data served T1 – Block stroage DAS (e.g. SAS cable) or SAN (Fibre Cable for FCP protocol, or Ethernet for iSCSI protocol) Mission critical data that are extremely sensitive to latency (e.g. database). Client … Read moreFile storage vs object storage

Local multi-node Kubernetes cluster – Minikube, MicroK8s and Kind

Is Docker desktop bad? In the previous post about docker desktop as a single-node Kubernetes cluster setup, I touched on the deprecation of docker-shim. Now that CRI beats OCI as the standard for container runtime, the docker runtime will no longer be supported by Kubernetes. Also deprecated is docker-shim, the temporary interface that had make … Read moreLocal multi-node Kubernetes cluster – Minikube, MicroK8s and Kind

Log Shipping in Kubernetes with EFK stack

I first worked on log shipping with ELK stack three years ago. In the context of Kubernetes cluster, log shipping has similar challenges. In this post I will discuss the set up of log shipping with Kubernetes cluster. Logging Architecture As discussed, if the Kubernetes cluster has a runtime in compliant with CRI (e.g. containerd), … Read moreLog Shipping in Kubernetes with EFK stack

Single-node Kubernetes cluster – docker desktop

While there are many tools to set up single-node Kubernetes cluster (e.g. minikube, MicroK8s, kind, or k3s with the k3d wrapper), docker-desktop has a significant advantage: it comes with Docker installation, on MacOS, or on Windows. It is installed simply by enabling the option “Enable Kubernetes”. It can be blown away and reset in a … Read moreSingle-node Kubernetes cluster – docker desktop