Apache Airflow Certification Exam: DAG Authoring: Practices Exams and Knowledge Sharing (2025)Airflow Exam informationJan 27Jan 27
Splitting Index in Elasticsearch through Ingest pipelineSometimes we’ll need to rename or split an index in Elasticsearch, for reasons like when we want to give them different lifecycle policies…Mar 23, 2024Mar 23, 2024
How to import json into MongoDB with Mongo-ExpressMongo-express is a web-based MongoDB admin interface (GitHub link) which provide some UI buttons for export and import. The version of…Nov 24, 2023Nov 24, 2023
Apache Airflow Certificate Practices Exams and Knowledge Sharing (2023)Exam informationSep 2, 20232Sep 2, 20232
Access Kubernetes resources with Airflow in different ways (DAG examples)Method 1: Call K8s API (REST endpoints) with PythonOperatorAug 4, 2023Aug 4, 2023
Apache Cassandra CertificateThis blog is written on my own experience on studying and taking the Datastax Apache Cassandra exam on July 2023.Jul 12, 2023Jul 12, 2023
Microsoft Certification Online Exam Procedure SharingThis article documents my experience in taking AZ204 and AZ400 exams online in 2021.Mar 27, 2023Mar 27, 2023
[EFK] How to set the Kibana timezone setting through APIKibana timezone can be set through Management in Advanced Kibana setting through UI, like:Dec 31, 2022Dec 31, 2022
K8s Cronjob with fluent-bit sidecar PracticesKubernetes Cronjob needs an exit code to make the job end (whether successful or failed), but with a sidecar container, for example, log…Jul 21, 2022Jul 21, 2022
How to combine Multiline log with Fluentd<Way 1> Use fluent filter plugin to combine log linesMay 19, 2022May 19, 2022
Use a label to determine whether to forward logs or not with Fluentd daemonset in K8sWhile Implementing logging architecture in Kubernetes, we often run Fluentd as a daemonset to collect console logs from all pods and ship…May 10, 2022May 10, 2022
Tools to help develop Kubernetes yamlK8s Yaml Generator : https://k8syaml.comApr 26, 2022Apr 26, 2022
A Prometheus Alert for Elasticsearch Single Shard too LargeAccording to Elasticsearch's official guide, there are no hard limits on shard size, but experience shows that shards between 10GB and 50GB…Apr 13, 2022Apr 13, 2022
Add kubernetes metadata to fluentd/ sidecarBackground: When using fluentd or fluent-bit as a daemonset, we can make use of fluent-plugin-kubernetes_metadata_filter to retrieve rich…Apr 8, 2022Apr 8, 2022
[EFK] Move shards/index away from an Elasticsearch Data NodeOn some occasions, such as server upgrades or disk replacement, we will need to move data away from an Elasticsearch data node for a period…Mar 2, 2022Mar 2, 2022
[Troubleshooting] Elasticsearch - Client did not trust this server’s certificate, closing…Situation:Feb 18, 2022Feb 18, 2022
[Troubleshooting] OpenSSL::SSL::SSLError Due to istioError message in a Kubernetes pod:Jan 27, 2022Jan 27, 2022
