Real-Time Crypto Data Pipeline
Binance WebSocket -> Kafka (3-broker KRaft) -> ClickHouse OLAP -> Grafana dashboards. Fully containerised with Docker Compose.
PythonKafkaClickHouseDockerGrafana
A selection of data engineering work - from real-time streaming pipelines to financial data platforms.
Binance WebSocket -> Kafka (3-broker KRaft) -> ClickHouse OLAP -> Grafana dashboards. Fully containerised with Docker Compose.
End-to-end ingestion, transformation, validation, and LLM-assisted mapping for financial royalties data standardisation.
This site - built with Astro, deployed to GitHub Pages via npm run deploy.