James Ng

Senior Data Engineer | james_ng1@hotmail.co.uk

github.com/jamesng123 | linkedin.com/in/james-ng1

Summary

Data Engineer at KrakenFlex. Confident using Python and SQL to develop solutions for complex problems, and keen to deepen those skills further. Strong in communication and always eager to learn new skills and gain new knowledge. UK citizen living in Manchester.

Experience

Senior Data Engineer

KrakenFlex | Mar 2025 - Present

Led the regionalisation of the data platform

Data Engineer

KrakenFlex | Aug 2023 - Mar 2025

Mentored junior developers.
Improved IaC processes that deploy the data platform
Reduced runtime of data processing pipelines
Implemented business logic using dbt and SQL

Platform Engineer / Data Engineer

Cloud Technology Solutions | Sep 2020 - Aug 2023

Implemented logging and alerting for the National Census, hosted on Google Cloud Platform.
Worked in an agile environment using Cloud Native tooling and an IaC approach
Orchestrated data pipelines with Airflow and BigQuery, ingesting data formats such as Parquet and CSV
Presented visualisations built in Looker Studio to guide sales
Led the improvement of onboarding processes, and continually improved internal documentation
Organised social activites, including weekly football

Education

University of Manchester

MSc Advanced Computer Science | Distinction | Sep 2019 - Sep 2020

Built upon networking principles with cryptography and cyber security
Studied number theory and group theory and their relationship to cryptographic techniques
Used Wolfram Mathematica to build a replica of Turing’s Bombe
Specialised in software engineering, from design patterns to implementation and testing
Collaborated on a project using Test Driven Development
Built a music visualisation tool in Java for dissertation which was awarded a distinction

Manchester Metropolitan University

BSc Computer and Network Technology | 1st Class | Sep 2016 - Jul 2019

In-depth knowledge of computer systems, from hardware to software
Well-rounded knowledge of networking principles
Produced wearable sports tech for third year project which was awarded a first class

Personal Projects

Football Performance Visualiser – Built with Plotly, dbt and Postgres. Visualises football metrics from raw player telemetry.
Music Visualiser – Java application converting audio input into real-time visual output for analysis and display.
Personal Website – Designed and deployed using Tailwind CSS and Netlify, showcasing CV and blog posts.

Technologies and Skills

Programming Languages (Python, Java, SQL)
Infrastructure as Code (Terraform, Terragrunt, CloudFormation)
Version Control (Git, GitHub)
Data Ingestion and Pipelines (BigQuery, Databricks, Airflow, Blob Storage)
SIEM (Splunk)
Cloud Computing (GCP, AWS)
CI/CD (Google Cloud Build, AWS CodePipeline)
Containerisation (Docker)