A forward-thinking tech organisation is seeking a Principal Data Engineer to lead the evolution of its next-generation data platform. This is a senior technical leadership role, ideal for someone who enjoys working at the intersection of architecture, platform design, and long-term data strategy.

This is not a pure data pipeline role. The position is best suited to individuals passionate about platform architecture, automation, and shaping scalable engineering practices.

Reporting to the Head of Data, the Principal Data Engineer will serve as a key technical authority, owning architectural decisions, defining roadmaps, and ensuring that the data platform is secure, scalable, and aligned with broader business goals. The role involves working closely with engineers, architects, and stakeholders while remaining hands-on enough to prototype and solve complex technical challenges.

Core Responsibilities

• Design and implement secure, high-performance Databricks environments including cluster setup, governance, and tuning

• Define and own the technical roadmap for the organisation’s data platform

• Ensure systems meet standards for performance, security, maintainability, and reliability

• Drive progress toward Service Level Objectives (SLOs)

• Collaborate with technical leads and architects to shape data solutions that meet product and business needs

• Support cross-functional teams in removing technical blockers and enabling delivery

• Maintain clear, high-quality technical documentation for data and BI systems

• Act as a visible, collaborative technical voice within the business

• Contribute to estimation and technical planning

• Align all solutions with the wider technical strategy

• Work with Solution Architects and Analysts to design scalable, forward-thinking solutions

• Apply architectural principles such as domain modelling and modular design

• Collaborate with team leads to guide delivery and implementation

• Provide hands-on support through code reviews, prototyping, and pair programming

• Support incident response efforts and assist with resolving critical technical issues

• Rapidly gain deep knowledge of internal BI tools and systems

• Create and maintain technical documentation, including integration guides and data contracts

• Support onboarding and knowledge transfer across teams

• Stay current with modern best practices in data engineering and architecture

What They’re Looking For

• Proven experience designing large-scale data platforms and Databricks infrastructure

• Strong understanding of Databricks internals, including cost and performance optimisation

• Advanced Python skills and software development best practices (e.g. testing, abstraction, modularity)

• Familiarity with modern data architecture (e.g. Lakehouse, domain-driven design, data contracts)

• Experience owning and driving platform-level technical roadmaps

• Active engagement with new technologies and the wider data engineering community

• Excellent collaboration and communication skills

• Strong organisational and time management skills

• A proactive, self-starting mindset with a focus on delivery and ownership

Apply now to find out more!