Projects

A selection of data engineering work - from real-time streaming pipelines to financial data platforms.

Real-Time Crypto Data Pipeline

Binance WebSocket -> Kafka (3-broker KRaft) -> ClickHouse OLAP -> Grafana dashboards. Fully containerised with Docker Compose.

PythonKafkaClickHouseDockerGrafana

Music Royalties Data Platform

End-to-end ingestion, transformation, validation, and LLM-assisted mapping for financial royalties data standardisation.

PythonSQLAWSAirflowLLM

Portfolio Website

This site - built with Astro, deployed to GitHub Pages via npm run deploy.

AstroTypeScriptGitHub Pages