[Troubleshooting] Fluentd not sending K8s logs occasionally

  1. Is the container writing lots of logs and causing log files in /var/log/pods rotated very fast?
[info]: #0 detected rotation of /var/log/containers/...
[info]: #0 following tail of /var/log/containers...
12–30 10:50 /var/log/pods/mycontainer-90162b4a21a9/0.log.20211230–104915.gz
12–30 10:51 /var/log/pods/mycontainer-90162b4a21a9/0.log.20211230–105015.gz
12–30 10:52 /var/log/pods/mycontainer-90162b4a21a9/0.log.20211230–105116.gz
12–30 10:53 /var/log/pods/mycontainer-90162b4a21a9/0.log
{
"log-driver": "json-file",
"log-opts": {
"max-size": "10m",
"max-file": "10"
}
}

--

--

--

Data Engineer from Taiwan, recently working on EFK and Kubernetes projects.

Love podcasts or audiobooks? Learn on the go with our new app.

Recommended from Medium

Explore AnimatedBuilder Widget In Flutter

DevOps: Software development and deployment made easy

NECO FUN Road Map

The Golden Hammer Anti-Pattern

Creating a side-scroller mobile game with Unreal Engine 4 — with no prior experience (Part 4)

Under the coding hood: Angelhack Kochi Hackathon 2018

Static libraries in C Language

Adapting an Android App for Web — Part II

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Jasmine H

Jasmine H

Data Engineer from Taiwan, recently working on EFK and Kubernetes projects.

More from Medium

Kubernetes Blue-Green Deployment

Use a label to determine whether to forward logs or not with Fluentd daemonset in K8s

Kubernetes Day-2 Operations — Part III: Network & Traffic Management, Auto Scaling, Associating…

Get Started With Kubernetes!