Role: Senior Data Enigneer
Location: Remote occasional travel to site London
Clearance: BPSS

Job Summary
 
We are seeking a skilled and detail-oriented Data Engineer to join our dynamic team. The ideal candidate will be responsible for designing, developing, and optimising our data pipeline architecture, as well as ensuring the availability, performance, and reliability of our data systems. This role involves close collaboration with data analysts, data scientists, and other stakeholders to support their data infrastructure needs.

Key responsibilities will include:
Perform updates and changes to the Physical Data Model
Designing and building PostgreSQL functions called from the API tier
Act as an SME on the Physical Data Model to become a trusted advisor to other teams that have data requirements and translate these into deployable changes
Collaborate with the Data Architect to improve the PDM and surrounding processes
Support and mentor members of the Physical Data Model team
Keep appraised of latest technology changes and data best practices to be used by the team
Work with the delivery manager to develop issues in Jira that are refined and detailed enough to be considered ready for development
Working closely with the Logical Data Model (LDM) team on collaborative tasks and helping keep both teams aligned
Lead data workshops with key stakeholders across business, data and system areas helping to formalise and document requirements. (Multi-Vendor Environment).
Own data architecture and design artefacts aligned to CDIO standards.
Refining of SQL queries and functions to be more performant
Design and implement unit and regression tests on the database
Co-own the CI/CD deployment pipeline with senior/lead DAL developer(s) deploying the PDM components as code, using Liqiubase
Performing impact analysis on releases to pre-empt any issues these may cause and performing deployments.
Ownership of cloud-based data platforms and their performance (e.g. Azure PostgreSQL Flexible Server)
Reviews reference data changes for impact to coupled code

Job Requirements
Essential skills/experience:       
Experience of designing/working with generic/abstract data models
Experience with data modelling tools - preferably SparxEA
Experience creating and maintaining data and design artefacts
Strong problem-solving abilities in the context of complex data models
Strong experience with PostgreSQL
Experience creating and tuning complex SQL queries (e.g. self-referencing hierarchies, KVP structures)
Strong experience with Database as Code tools – preferably Liquibase
Experience with cloud based database platforms – preferably Azure PostgreSQL Flexible Server
Experience working in Agile delivery – particularly Scrum & SAFe.

Experience:
Experience with Microsoft Dataverse
Experience creating data architecture artefacts/documentation
Qualifications:  Formal training/academic qualifications relevant to the role
SAFe Agile qualifications (desirable)
Any Microsoft data-based certifications (desirable)