Mastercard
Senior Data Engineer
Dublin, Ireland
- Engineered large-scale data pipelines processing ~45 TB of daily transaction data across Mastercard systems, enabling advanced analytics use cases including segmentation, lifetime value, churn, affinity, loyalty, and share-of-wallet modeling.
- Contributed to the development of Pioneer, an internal privacy-enhanced analytics platform powering 200+ Mastercard users, providing real-time access to curated datasets with a Zeppelin-based notebook interface.
- Architected secure, high-performance data access layers replacing legacy Hadoop workflows, reducing data retrieval latency by >70% and improving query reliability.
- Prototyped Text-to-SQL capabilities into Pioneer using LLMs, enabling natural language query generation to democratize data access.
- Designed and maintained ML pipelines in Azure Databricks and MLflow, supporting end-to-end model lifecycle management.
- Ensured compliance with PCI-DSS and GDPR standards while enabling secure feature engineering and model deployment at scale.
- Advocated internal ML infrastructure evolution, driving automation using Terraform, reproducibility, and cost optimization via Photon compute, Delta Lake optimization, and parallelized data ingestion.
- PySpark
- Azure Databricks
- Delta Lake
- MLflow
- Terraform
- LLM
- Text-to-SQL
- PCI-DSS
- GDPR