This is an exciting opportunity for a skilled Lead Data Engineer to advance their career while remaining deeply technical. The role offers a clear path for progression without requiring a move into management or sales, allowing individuals to focus on what they do best—engineering high-quality, scalable data solutions.

Why Join?

This organisation values continuous learning and personal growth. Team members benefit from a dedicated learning allowance, enabling them to shape their own development journey. Paid overtime and a strong emphasis on work-life balance ensure that individuals are recognised and supported—especially during demanding projects. The business is committed to employee wellbeing and fosters a positive, inclusive culture.

Role Overview

The Lead Data Engineer will take a hands-on technical leadership role, guiding the delivery of high-impact solutions within cloud-based environments. This position is ideal for professionals who are passionate about modern data engineering and want to influence best practices, architectural decisions, and agile delivery across teams.

The role involves close collaboration with multidisciplinary teams and requires strong communication skills to translate technical approaches for non-technical audiences, including senior stakeholders and clients.

Key Responsibilities

• Lead the design, development, and optimisation of robust data pipelines and architectures in cloud environments
• Set and maintain high-quality code standards, including driving code reviews and engineering best practices
• Collaborate closely with cross-functional teams including Business Analysts and Data Scientists
• Act as a technical authority for client delivery, ensuring excellence in solution design and implementation
• Mentor and guide engineers within the team, contributing to their growth and development
• Apply agile methodologies (Scrum, pair programming, etc.) to deliver value iteratively

Essential Skills & Experience

• Extensive hands-on experience with programming languages such as Python, Scala, Spark, and SQL
• Strong background in building and maintaining data pipelines and infrastructure
• In-depth knowledge of cloud platforms and native cloud services (e.g., AWS, Azure, or GCP)
• Familiarity with database technologies such as Oracle, MySQL, MongoDB, etc.
• Proven understanding of data security principles and scalable system architecture
• Experience troubleshooting and resolving complex data-related issues
• Ability to define and uphold engineering standards in an agile environment
• Strong leadership and communication skills, with the ability to engage confidently with clients, including C-level stakeholders

Desirable Skills (Bonus Points)

• Experience with data engineering and analytics using native cloud tools (AWS Glue, Azure Data Factory, GCP Dataflow, etc.)
• Familiarity with data visualisation platforms like Tableau or Power BI
• Exposure to machine learning or data science application development
• Knowledge of modern data platform technologies such as Quantexa, Palantir, or Databricks
• Proficiency with open-source data tools and frameworks
• Experience with test automation within CI/CD pipelines