Build reliable,

resilient and scalable

data pipelines

LET'S TALK
Data amico
Data Pipeline@4x e1598610202238

Data Integration Pipeline

Combine data from various internal and external data sources to enable downstream Dashboards/Reports, Business Intelligence, and Machine Learning/AI. We help build scalable – for petabytes of data and extensible – supporting hundreds of data sources – ETL/ELT data pipeline.

Data Pipeline: Orchestration and Choreography

Manage the data pipeline states and steps through Orchestration Engines, Schedulers, Choreography, and Orchestration/Choreography Hybrid Architecture.

Data Pipeline Orchestration And Choreography@4x e1598610379169
Data Mastering@4x

Data Validation, Transformation and Mastering

Build effective Data Validation, Data Transformation, and Data Mastering logic for preparation of data to power Business Intelligence and Machine Learning/AI use-cases.

Data Ops

Make analytics infrastructure agile and reliable: Build analytics infrastructure which responds to the changing business needs and achieves high reliability through monitoring, observation, lineage/governance, remediation, and collaboration.

Data Ops@4x e1598610398742
data engg stream processing

Stream and Complex Event Processing (CEP)

Integrate stream – audio/video data and event data – such as HL7 events, IoT events – and perform windowing, transforms and aggregations.

Blog

Coditation-Website-Beginners guide to handle missing data using Python-hero

Data Cleansing: Handling Missing Values

| Data Engineering | No Comments
Data cleansing plays a key role in building models in machine learning. A significant amount of any data scientists’ time is dedicated to data cleansing activity. In a lot of…
coditation-website-web-scrapers-blog-hero

Web Scrapers: Basic proxy authentication and headless Firefox

| Data Engineering | No Comments
Selenium, Web Proxy and HTTP Basic Auth Problem Statement: Please offer a solution for basic authentication · Issue #6644 · SeleniumHQ/selenium Solution Install Firefox version 66.0.5 from here - https://ftp.mozilla.org/pub/firefox/releases/66.0.5/…
Coditation-website-Exploratory Data Analysis with Trifacta and Mode-Tableau-hero

Exploratory Data Analysis with Trifacta and Mode/Tableau

| Data Engineering | No Comments
Use case: We wanted to process raw data to identify new patterns and grasp difficult concepts which later we could share with our customers in a pictorial or a graphical…