adls

Real-time ADLs and Fall Detection implement TensorFlow

Datagenerator for Data Services

Fluentd output plugin for Azure Datalake Storage Gen2 (append support)

Microsoft Azure Data Lake Storage MCP Server

HDInsight provider for Airflow

Kafka Connect Sink for ADLS Gen2 with SAS auth, Avro support, GZIP compression, and partition-based file batching.

Workshop to build scalable architectures with Azure Data Explorer (ADX)

Tutorial on setup of online and offline feature stores in Azure Machine Learning (Azure ML), using command line interface (Az CLI)

Kafka Connect ADLS - a Kafka Sink connector for ADLS Gen1

End to end solution for writing USQL data into parquet and setup Presto to query the data

Upload data onto different cloud storages by HDFS client

Production-style Azure analytics engineering project for adult social care using ADF, ADLS, Synapse and Power BI.

End-to-end Azure Lakehouse + Operational Analytics demo with IaC (Bicep/ARM), secure data landing (ADLS, Fabric, Synapse), and can’t-mess-it-up automation (Cosmos upserts + DevOps). Scales with skills, satisfies auditors, and proves automation can be boringly reliable (that’s the point). Runs cleanly every time ... even under interview pressure.

Projeto para Extração de dados de um SQL Server e Carga em um Data Lake Storage Gen2 da Azure (ADLS) usando Airflow Astro CLI e spark para movimentação dos dados entre as camadas tipo medalhão com delta lake.

End-to-end data pipeline that ingests 12 Transfermarkt football datasets (1.9M+ records) into Azure Data Lake, transforms them through a medallion architecture in Databricks Unity Catalog, and serves analyst-ready KPIs to Power BI.

Azure-oriented geospatial data platform standardizing Canadian climate, hydrometric, wildfire, and disaster datasets into validated spatial risk products for Alberta and British Columbia, with Snowflake, dbt, Power BI, and MapLibre GL.

End-to-End Azure Data Engineering Pipeline using Azure Data Factory, Databricks, ADLS Gen2, PySpark, and Synapse Analytics for E-Commerce Analytics.

Terraform module for terraform-azure-adls-gen2

This project demonstrates a complete, real-world implementation of a modern data engineering pipeline using the Azure cloud ecosystem. Built around the AdventureWorks dataset, the pipeline follows the Medallion Architecture (Bronze → Silver → Gold), enabling structured data refinement from raw ingestion to business-ready insights.

Build an end-to-end, Azure-native streaming pipeline that captures 5 real-time e-commerce events, processes them through a Medallion Lakehouse on Databricks, and delivers live KPI dashboards in Power BI.