Available for new opportunities

Azure Data
Engineer
Vinith Singh

Microsoft Certified Data Engineer with 4+ years designing scalable data platforms on Azure. Expert in Databricks, OneLake, PySpark, SQL, Dataflow Gen 2, ADF & Microsoft Fabric and modern lakehouse architectures.

Experience
4+ Yrs
🧠
Team Leadership
8 Members
👥
Certifications
5+
🏆
Based in
Bangalore, IN
📍
Technology Stack
Tools & Technologies
⚙️Azure Data Factory
🔥Databricks
🏞️Delta Lake
🔧ETL Pipelines
🧩Data Modeling
🔁SCD Type-1 & Type-2
🗄️Data Warehouse
💾SQL
⚡PySpark
🔵Azure SQL DB
☁️Azure Data Lake Gen2
🤖Claude Code (AI Agent)
🔌Fabric MCP
⚙️Azure Data Factory
🔥Databricks
🏞️Delta Lake
🔧ETL Pipelines
🧩Data Modeling
🔁SCD Type-1 & Type-2
🗄️Data Warehouse
💾SQL
⚡PySpark
🔵Azure SQL DB
☁️Azure Data Lake Gen2
🤖Claude Code (AI Agent)
🔌Fabric MCP
🧵Microsoft Fabric
🔗Dataflow Gen 2
📚Unity Catalog
🚀Azure DevOps
🐙GitHub Actions
📊Power BI
📝T-SQL
📋SSRS
🔄Delta Live Tables
💻PowerShell
🤖Azure Automation
🛠️CI/CD Pipelines
🧵Microsoft Fabric
🔗Dataflow Gen 2
📚Unity Catalog
🚀Azure DevOps
🐙GitHub Actions
📊Power BI
📝T-SQL
📋SSRS
🔄Delta Live Tables
💻PowerShell
🤖Azure Automation
🛠️CI/CD Pipelines
📐Data Warehouse
🌊Data Lake
🔐Row-Level Security
📡API Ingestion
🧪Data Quality
🏗️Lakehouse Architecture
📈SSAS
🗂️Data Governance
⚖️ACID Compliance
🎛️Performance Tuning
📐Data Warehouse
🌊Data Lake
🔐Row-Level Security
📡API Ingestion
🧪Data Quality
🏗️Lakehouse Architecture
📈SSAS
🗂️Data Governance
⚖️ACID Compliance
🎛️Performance Tuning
Capabilities
What I Do

End-to-end data engineering — from raw ingestion to production-ready lakehouse architectures at enterprise scale.

⚡

ETL / ELT Pipeline Design

Build parameterized, dynamic pipelines using ADF, SSIS & Databricks that automate ingestion from APIs, flat files, on-prem databases and cloud sources.

🏗️

Lakehouse Architecture

Design and manage Delta Lake and Delta Live Tables with ACID compliance, data quality checks, and efficient large-scale storage across zones.

🔒

Data Governance & Security

Implement Unity Catalog, RBAC, row-level security in Power BI, and enterprise-grade data policies aligned with global compliance standards.

🚀

CI/CD & DevOps Automation

Automate pipeline deployments using Azure DevOps and GitHub Actions, enabling reliable, repeatable infrastructure and data workflow releases.

📊

Analytics & BI

Transform unrelated data sources into coherent Power BI dashboards and SSRS reports with tabular and multidimensional SSAS models.

⚙️

Performance Optimization

Tune database and pipeline performance for cost efficiency — from query optimization to tier scaling with Azure Automation and PowerShell Runbooks.

Work History
Experience

Building production-grade data platforms at scale for enterprise clients.

May 2026 — Nov 2026 · 6 Months
Fabric Data Engineer
BCT Consulting Bengaluru, India
  • Lead the migration of 250+ legacy KNIME workflows to Microsoft Fabric, re-engineering ingestion, cleansing and business logic across 5–6 sources, including PostgreSQL, Amazon Redshift and Excel file shares, processing 10–20 GB of data.
  • Rebuild complex KNIME transformation logic with Dataflows Gen2, PySpark notebooks and Fabric Pipelines, consolidating scattered workflows into a unified Lakehouse with Bronze-layer table handoffs between stages.
  • Use Claude Code as an AI agent to migrate KNIME workflows: it reads each workflow, orders its nodes, learns node types it has not seen before and generates a ready-to-run PySpark notebook with one labelled section per KNIME node.
  • Connect Claude to Microsoft Fabric through the Fabric MCP server, so reviewed migration logic is pushed straight into Fabric Lakehouses and Dataflows, shifting effort from manual rewriting to review and validation.
  • Achieve 99.99% data accuracy through source-to-target validation against legacy KNIME outputs, keeping business-logic parity while cutting manual effort and processing time.
  • Document end-to-end Dataflow Gen2 lineage, from dataflow to query to applied step, so complex migrated pipelines are easier to review, debug and hand over.
May 2022 — Sep 2025 · 3 Years 5 Months
Data Engineer
LTIMindtree Hyderabad, India
ClientMicrosoft
  • Built metadata-driven pipelines for Microsoft Cloud Services workloads, with Azure Data Factory orchestrating parameterized Azure Databricks notebooks across raw, processed and presentation layers in ADLS Gen2.
  • Designed scheduled, incremental loads using tumbling window triggers, Get Metadata and If Condition checks, and master pipelines that enforce ingest-before-transform dependencies, so any window could be safely rerun or backfilled.
  • Developed PySpark and SQL transformations using joins, window functions and aggregations, and delivered Delta Lake and Delta Live Tables with ACID guarantees and optimized large-scale storage.
  • Automated pipeline and infrastructure releases with Azure DevOps and GitHub Actions CI/CD, and scheduled data refreshes and tier scaling with Azure Automation and PowerShell runbooks.
  • Owned Tier 1 and Tier 2 tickets for Microsoft customers across SQL Server, SSIS, SSAS, SSRS, Power BI Report Server, Power BI, Fabric and Azure Analysis Services.
  • Reproduced customer issues in my own lab to confirm root cause, reported confirmed product bugs to the engineering team with full repros, and owned escalations through to resolution.
  • Acted as subject matter expert leading a team of 8 engineers, and held weekly syncs with Microsoft Field Technical Leaders to align on priorities and resolve issues.
  • Wrote 83 troubleshooting runbooks from closed cases, and tested Microsoft Fabric during its preview with the Microsoft product team.
Credentials
Certifications

Verified expertise across Microsoft Azure and modern data engineering tools.

Microsoft logo
Microsoft Certified: Fabric Data Engineer Associate
End-to-end data engineering, pipeline orchestration & optimization on Microsoft Fabric
Microsoft
View Certificate ↗
Microsoft logo
Microsoft Licensed: Azure Data Fundamentals
Core data concepts, relational/non-relational data, and Azure data services
Microsoft
View Certificate ↗
Microsoft logo
Microsoft Certified: Azure AI Fundamentals
AI workloads, machine learning, and responsible AI principles
Microsoft
View Certificate ↗
Microsoft logo
Microsoft Licensed: Power BI Data Analyst
Data modeling, DAX, visualization, semantic models and report publishing
Microsoft
View Certificate ↗
Microsoft logo
Microsoft Certified: Azure Fundamentals
Cloud concepts, core Azure services — networking, storage, RBAC & cost management
Microsoft
View Certificate ↗
Microsoft logo
Microsoft Certified: Azure Database Administrator Associate
Managing, securing, and optimizing Azure SQL databases with HA & disaster recovery
Microsoft
View Certificate ↗
Udemy logo
The SQL Bootcamp (30 Hours) With Project
SQL, SQL Server, Data Science, Data Warehouse, Data engineering, SSDT Tools & Business Analytics & Intelligence
Udemy
View Certificate ↗
Udemy logo
Azure Databricks & Spark for Data Engineers: Hands-on Project
Apache Spark (PySpark & Spark SQL), Delta Lake, ADLS Gen2, ADF (ETL/ELT, pipelines & triggers), Unity Catalog (Data Governance)
Udemy
View Certificate ↗
Featured Work
Projects

Enterprise-scale data engineering projects delivered for Microsoft and industry clients.

Academic Background
Education
2017 — 2021
B.Tech, Computer Science Engineering
2015 — 2017
Higher Secondary (PCMC)
2001 — 2015
Beyond Work
Content & Community

Sharing practical knowledge with the tech community — from everyday tech tips to advanced data engineering — through YouTube tutorials and in-depth blog posts.

YouTube
Daily Tech for Everyone

@Kingfisher Tech Tips

Learn all about technologies in your day-to-day life. Covers PC Tips, YouTube Tips, Mobile Phones, Online Transactions, Banking, Share Market, Mutual Funds, Education, and all other tech updates — simplified for your benefit.

Daily Tech TipsFinanceDevicesYouTube TipsGov UpdatesOS & ApplicationsVPNCloud Services
Visit Channel ↗
YouTube
Data & Cloud Engineering

@Vickey Rajpoot

Deep-dive data engineering tutorials focused on SQL Server stack & administration, Azure cloud services, and automation. Step-by-step how-to guides, TSGs, and learning courses for aspiring data engineers.

CoursesSQL BIADFAzureAutomationSQL ServerLearningMicrosoft Stack
Visit Channel ↗
KingfisherTechTips KingfisherTechTips
Tech Blog & Complex Solution

KingfisherTechTips.Com

Step-by-step guides, troubleshooting tips, and project insights on SQL Server, SSRS, PBIRS, SSAS, Azure cloud tools, Banking & Finance, PC Tips, OS and more. Simplifying complex tech — whether you're a beginner or a pro.

SQL ServerBusiness Intelligence (BI)AzurePC TipsBankingOSTSGsTroubleshooting
Read the Blog ↗
Get in Touch
Let's Work Together

Open to data engineering roles, consulting engagements, and collaboration on data platform projects.


vinithsingh2@gmail.com