Tech

Articles

background Coditation

How to design scalable ETL Workflows using Databricks Workflows and Delta Live Tables

This article explores the evolving landscape of ETL (Extract, Transform, Load) processes in data-driven organizations, focusing on the challenges faced by traditional ETL approaches in handling the ever-growing volumes of data. It introduces Databricks Workflows and Delta Live Tables (DLT) as powerful tools that offer simplicity, scalability, and reliability in ETL processes

Implementing distributed tracing with OpenTelemetry and Jaeger for microservices architectures

Discover how to implement distributed tracing in microservices using OpenTelemetry and Jaeger. This comprehensive guide covers setup, sample microservices, and best practices to enhance visibility and performance in your distributed systems.

How to optimize PostgreSQL Performance with pgBadger and Grafana

In this blog, we learn how to boost PostgreSQL performance with pgBadger and Grafana. Set up real-time monitoring, configure logs, and create custom dashboards to quickly identify and fix query issues.

How to Achieve Seamless Schema Evolution with Apache Iceberg

This article provides an in-depth exploration of Apache Iceberg's schema evolution capabilities and their impact on modern data strategies. It covers the fundamentals of Iceberg, its benefits, real-world use cases, performance benchmarks, and a hands-on tutorial for implementing schema changes using PySpark.

How Apache Iceberg brings ACID transactions to data lakes

In this post, we'll explore the theoretical underpinnings, practical implementations, and real-world benefits of ACID transactions in data lakes using Apache Iceberg.

How to Implement Custom Partitioning in Apache Kafka for Complex Event Processing

In this post, we'll explore the intricacies of custom partitioning, its impact on event processing parallelism, and walk through a detailed implementation that will elevate your Kafka-based systems to new heights of performance and scalability.

How to optimize Apache Flink's Checkpointing Mechanism for Large-Scale Stateful Stream Processing

In this blog, we talk about strategies and best practices for tuning Apache Flink's checkpointing mechanism to handle massive state and achieve optimal performance in production environments.

How to Build a Scalable Clinical Data Warehouse Using HL7, Kafka, Flink, and AWS Redshift

In this blog, we guide you through building a scalable clinical data warehouse using industry-standard technologies: HL7 for data exchange, Apache Kafka for real-time data streaming, Apache Flink for stream processing, and AWS Redshift for data storage and analytics.

How to Use Kafka Streams’ Interactive Queries for Real-Time Data Analysis in CEP Pipelines

In this blog we demonstrate how to utilize Kafka Streams’ interactive queries for real-time data analysis in complex event processing (CEP) pipelines through practical code examples, and understand how to implement a powerful fraud detection use case.

How to build scalable message processing system with RabbitMQ and millions of Goroutines

In this article, we cover the advantages of using RabbitMQ and Goroutines, setup instructions, system design, implementation, benchmarking, scaling, and real-world use cases.

How to optimize TensorFlow models for Production

This guide outlines detailed steps and best practices for optimizing TensorFlow models for production. Discover how to benchmark, profile, refine architectures, apply quantization, improve the input pipeline, and deploy with TensorFlow Serving for efficient, real-world-ready models.

How to Tune Spark Performance: Dynamic Partitioning Strategies for Balancing Uneven DataFrames

In this blog, we explore the intricacies of dynamic partitioning in Apache Spark and how to automate and balance DataFrame repartitioning to improve performance, reduce job times, and optimize resource utilization in big data pipelines.

How to build HIPAA-Compliant Data Pipelines for Healthcare Analytics using Apache Spark

In this blog we explore how Apache Spark can be utilized to build scalable, efficient, and HIPAA-compliant data pipelines for healthcare analytics. Further, we delve into key considerations, best practices, and practical examples to navigate the complexities of handling Protected Health Information (PHI) while maximizing the potential of Spark for healthcare data analytics.

Benchmarking Python Frameworks for Real-Time Dashboards: Django Channels vs Flask SocketIO

This post provides an in-depth comparison and benchmark of two popular Python frameworks for building real-time dashboards: Django Channels and Flask SocketIO. It covers their ease of use, architecture, performance, scalability, and overall development experience to help developers choose the right framework for their next real-time application.

Spring Cloud OpenFeign — REST client for Spring Boot App

Spring Cloud OpenFeign provides OpenFeign integrations for Spring Boot apps through autoconfiguration and binding to the Spring Environment and other Spring programming model idioms.

How to animate in CSS

A touch of CSS animation goes a long way in designing an immersive experience for visitors. The best animations can serve the content and user experience without distracting or appearing gimmicky. In this blog, we talk about how to animate in CSS with examples.

Structural Pattern Matching in Python II

In this blog, which is a second of a three-part series, we continue our discussion and introduce value pattern, sequence pattern, and mapping pattern.

Structural Pattern Matching in Python I

In this blog, which is a first of a three-part series, we talk about the structural pattern-matching support in Python.

Unit testing with Jest

In this blog, we have picked a library from the JavaScript testing framework, Jest to explain how to do unit testing with some interesting examples. We have utilized some of the key features of Jest library.

How to test JavaScript applications

Testing is an important part of any development process of an application. It can help build better, more reliable apps. In this blog, we talk about different ways to test JavaScript applications.

How to install Robot Framework on Windows

Robot Framework is an open-source test automation framework that is simple to use with minimal programming. In this blog, we give step-by-step instructions on how we installed the robot framework on windows.

Java Project Loom

Java Project Loom is a proposed new feature for the Java platform that aims to improve the support for concurrent programming in Java. In this blog, we talk about a few examples of how Project Loom could be used in Java programs.

Deep Linking in React Native

Want to know how to add deep linking to a React Native app for both iOS and Android? In this blog, we talk about one of our use case with an automotive powerhouse.

Django vs Frappe

Frappe is a full-stack web framework & is a bit different from the traditional ones like Django or Flask. In this blog, you will get a head-to-head comparison between Django & Frappe. We will then move on to the best use case & challenges of Frappe.

AWS security best practices for rapid and scalable web application infrastructure

Are you working on AWS? Are you looking for ways to enhance the security of your AWS infrastructure? If yes, then this blog is for you. Read here to know about the best AWS security practices.

Importance of User Experience in Product Adoption

Do you know what is the key factor in success of any app? Yes, user experience. This blog tells you why and how user experience impacts your app along with some important tips to improve it.

Guide 101: Apple Watch App Development And Integration With React Native

Are you an Apple Watch app developer? Are you wondering how to integrate it with React Native? If yes, this blog is for you.

Flutter vs React Native: Which is the Best Cross Platform App Development Framework?

Have you ever thought, how one app can work on different platforms? That's because of cross-platform development frameworks like Flutter and React Native. But, which one is better? Read this blog to find out

User Authentication with Azure Active Directory with Spring Boot

In this quick guide, you will learn about what an active directory is, how you can create an instance on Azure’s Active Directory, and also how to configure it from Spring boot which means how we can access the instance by configuring the instance properties

GraphQL has a role beyond API Query Language - being the backbone of Application Integration. Are you ready to embrace it?

GraphQL has gained pre-eminence in the last couple of years as the API Query Language of choice. It has been adopted by several hundreds of prominent enterprises and products. But is GraphQL only about API Query Language?

Decade Of Artificial Intelligence: A Summary

The world has seen a boom in the field of Artificial Intelligence in the past few years & What our AI community has achieved in the last decade has set a strong foundation for the future

Data – A Key Enabler For Patient Centric Healthcare

Technology – specifically Big Data, Cloud, IoT, Mobile, and AI will play a pivotal role in enabling the transformation of healthcare towards patient centricity.

Are You Measuring These 3 Important CX Metrics?

3 Most Important CX Metrics that everyone should keep track of to measure their product or service CX. NPS – Net Promoter Score Surveys CES – Customer Effort Score CSAT Score – Customer Satisfaction Score

Want to receive the latest technology insights? Subscribe Now!