A few months back, I worked on building an observability solution for data pipelines 🛠. Observability of data pipelines helps determine completeness, accuracy, efficiency and consistency for any data uploaded through either batch or streaming sources. There was the use case where I had to get the count of messages…

You break things, and you learn them more! — Recently at my work, I applied the wrong set of migrations in the database. It eventually broke the stuff and no one could access the system. I panicked, but I focused more on learning new things! This blog will take a deep dive into database migrations, what database schema migrations…

Hi, 2022 👋 2021 had been all about chaos, adapting, supporting each other, taking care of yourself, exploring and prioritising your needs. The first half of 2021 had been quite challenging with a lot of chaos. Human interaction almost went digital. We witnessed the most difficult phase of the pandemic…

We encounter load balancers every day. Even when you are reading this medium article, your requests flow through multiple load balancers, before this content reaches your browser. Load balancing is one of the most important and basic concepts we encounter every single day. …

This month has been very special to me. I got a chance to reconnect with people and took a break from work to recharge myself. People think overworking themselves will get more jobs done. …

Computers work with numbers. Computers talk to another computer using a numeric address called an IP address. Though structured and thus great for computers, it is tough for humans to remember. DNS acts as the phonebook of the internet 🌐. It converts a web address such as “example.com” to an…

High-performing teams usually ship faster, better, and often! Organizations irrespective of their level, focusing on stability and continuous delivery, will deploy frequently. Hundreds of continuous integration build run for every organization on a typical day. It indicates how CI has become an integral part of our development process. …

Prometheus is an open-source monitoring tool for collecting metrics from your application and infrastructure. As one of the foundations of the cloud-native environment, Prometheus has become the de-facto standard for visibility in the cloud-native landscape. How Prometheus Works? Prometheus is a time-series database and a pull-based monitoring system. It periodically scrapes HTTP endpoints…

Messaging Queues are widely used in asynchronous systems. In a data-intensive application using queues makes sure users have a fast experience while still completing complicated tasks. For instance, you can show a progress bar in your UI while your task is being completed in the background. …