Creation of a centralised data integration platform - Date Extension

Tender description

Why the Work is Being Done We are moving away from our current approach to decentralised management of data and data assets. This piece of work will be focused on creating a centralised data ecosystem, specifically building integration between internal systems and ensuring that data quality is maintained across all pipelines. Problem to Be Solved Currently our data is in silos, and this work will enable us to move to a centralised data ecosystem that can be used by all projects and services across the DVSA. Using Informatica and AWS we will begin to work on a Master Data Management (MDM) approach, with specific focus on data quality. Who Are the Users As a developer I need to access data in a central data ecosystem so that I can ensure that I am accessing data that is the same as that used across the organisation. As a CRM developer I need to be able to access and share data with other applications across the DVSA so that we can improve our interaction with our end users. As a Data Scientist I need to access data that is of high enough quality to produce meaningful output. Early Market Engagement We have been working with AWS and Informatica to come up with the best theoretical approach to this problem. Work Already Done We have defined a target architecture and high level design for the data environment. Research between projects has been undertaken and all potential issues have been resolved. This project will be the setup of an environment in accordance with our well defined requirements. Existing Team Our existing team is small, and consists of a Head of Data, Data Architect, Data Business Analyst, Project Manager and a small team of MI Analysts and Data Scientists. Current Phase Alpha Work Location The work will predominantly be undertaken in the Nottingham offices of the DVSA, although there will be a need for the successful team to work in Bristol and Swansea as and when the project dictates. Working Arrangments We will have daily stand ups, and our internal PM will act as the Scrum Master. All travel and accommodation should be covered within the quote. There will be at least 4 days on site each week given the nature of the project and the data and system access that will be required. Security Clearance SC will be required by all of the team that come in. Additional T&Cs Standard terms and conditions apply. Skills & Experience have experience of integrating a data platform using Informatica have experience of building connectors between systems using Informatica have experience of creating API's and working with API Gateways have experience of building data models within AWS (Aurora / Redshift) have experience of working with Informatica DQ (Data Quality) / ETL have experience of setting up and building Informatica MDM (Master Data Management) have experience of building connections between Dynamo DB and informatica have experience of working within an Agile environment Nice to Haves prove that they have delivered ecosystems like the one in our plans prove they have integrated Informatica within AWS previously show previous approaches to building fully functional / operational data models No. of Suppliers to Evaluate 5 Proposal Criteria How close the timelines are to our requirements How well their plan fits in with our overall strategy How well they have displayed they know the technologies at play Who they propose will carry out the work How well defined the sprint planning is Cultural Fit Criteria be able to blend into the internal DVSA data team be prepared to assist DVSA team members where their skill set isn't as well developed as the external supplier ensure that delivery updates are honest, allowing transparency throughout the DVSA be able to provide technical guidance when it doesn't exist internally Payment Approach Capped time and materials Assessment Method Written proposal Evaluation Weighting Technical competence 75% Cultural fit 5% Price 20% Questions from Suppliers Budget range the limit on this part of the project is £200k, which does not include licensing or infrastructure charges, as they are already covered. this is only for the standing up of the environment and creation of integrations.