Somerset Linked Data Platform MVP

Tender description

Work done so far Integrations: We want to bring in clean, structured, reliable data from each of the source systems across the ICS. This needs to be automated via APIs, initially on an overnight frequency, with a ‘new’ and ‘updated’ pull request. Source API's have been identified and in some cases tested during discovery. Standards and Terminology: Different systems record attributes like height, weight, ethnicity and address details in different ways, so over the 10 weeks we have agreed clear standards to make sure that when data comes together, it tells one coherent story. By bringing this consistency, we make it possible to compare like-for-like across Somerset. The following two principles will guide the LDP’s approach to terminology (and hierarchy): Flexibility - support configurable data structures to meet diverse user needs. Alignment with Standards - align with national standards and data dictionaries where applicable, while allowing for custom configurations. Data as a Product: Our approach focuses on collecting, analysing, and packaging data in a way that it can be easily consumed and utilised by its users (via our API platform). By developing data-driven products, we can provide insights, enhance decision-making, and offer greater research opportunities. Ultimately, data as a product fosters innovation and can lead to a thriving partner ecosystem. Architecture: Our objective is to build a lakehouse architecture that is secure, compliant, cost-efficient, and portable. Our recommendation is that Somerset’s LDP will operate on an AWS-native lakehouse built on S3, Glue, Redshift, Lake Formation, and Apache Iceberg. This architecture meets NHS security and DSPT requirements, scales economically, and avoids vendor lock-in. Which phase the project is in Beta Existing team Product Director (Chief Data Officer), Delivery Manager, Product Manager, Security & Compliance Specialist. You'll be working with all Somerset system partners, Somerset Council, Somerset Foundation Trust, Somerset GP's, Somerset Hospices and Voluntary Sector Organisations, South West Ambulance Service, Care Homes. You'll also be working with EMIS (Optum) and TPP. Address where the work will be done This will be a remote project. There may be some opportunities to meet the team and work on site here in Somerset (Yeovil or Taunton) but it will be by exception. Working arrangements The supplier will be required to work remotely. Expenses will be capped at £5,000 for the duration of the contract, and all travel and subsistence will require prior approval. Provide more information about your security requirements: Baseline Personnel Security Standard (BPSS) Latest start date 2026-01-30 Enter the expected contract length: 4 months Are you prepared to show your budget details?: Yes Indicative maximum: 600000 Confirm if you require a contracted out service or supply of resource Supply of resource: the off-payroll rules may apply Summary of work Deliver a production-grade Linked Data Platform that unifies priority Somerset datasets, standardises them into a canonical model, and powers core DiiS dashboards and one trusted-partner API. Where the supplied staff will work No specific location (for example they can work remotely) Why the work is being done Work must start end of January or early Feb. Goal: Develop a linked data platform centred around population health management so that the system will be equipped with data and intelligence capabilities to prevent ill-health, reduce health and care inequalities and drive integrated and joined-up thinking at a county and neighbourhood level. The Linked Data Platform is an ‘integration and governance layer' - this is the layer that joins the data together and makes sense of different coding and terminology. Ultimately this layer gives us one version of the truth across all partners and will allow existing population health and operational planning tools to sit on top of it. The business problem you need to solve A. Build the inbound pipelines to load the data into the LDP. • Ingest, merge, pseudonymise and link synthetic data from SFT/Council and GP Practices (via EMIS Explorer) • Implement deterministic matching and data quality rules • Enrich LDP data with ONS location reference data • Deliver a productionised Silver layer (CDM) B. Deliver the outbound feed to DiiS as a Gold snapshot in parquet • Deliver regular feeds to DiiS (TBC; daily, weekly, monthly) • Build or integrate with 1 dashboard C. Build the core platform services needed to run and operate the pipelines. (Dev and Production Environments) • AWS Data Platform (Bronze to Silver pipelines) • Cross-platform capabilities: security, automation, governance, RBAC, IAM, monitoring, observability, audit trails D. Knowledge Transfer • Handover including operational runbook, documentation (DRBC etc…)