Creation of data warehouse

Tender description

Summary of the work Design & build the CYP Cloud data warehouse using Azure Synapse. Use Synapse Pipelines for ETL functions and produce a model of the data into PowerBI Premium/Azure Analysis Service. Project Manage the project of work Upskill existing IT team to support ongoing and future work Expected Contract Length 3 to 6 months Latest start date Sunday 17 January 2021 Why the Work is Being Done We want to create a single view of a child across multiple systems allowing us to extract and/or link data from multiple systems and present this in a way to inform service delivery, support sufficiency planning and contextual safeguarding. Our CYP Data warehouse will support: Mapping of current pathways of individuals to provide analysis on groups/cohorts of children with similar needs to inform sufficiency planning and commissioning choices. Understanding of current demand and how this is met – incl. a detailed understanding of resources (time and cost) Identification of circularity (i.e., “children / families being passed around the system / organisations numerous times”) Scaling the one-off data sharing and collation exercise up in to a regular and embedded process as part of business as usual to ensure ongoing currency of data. We would like the project to be completed by Autumn 2022 Problem to Be Solved We have varying levels of data maturity across a number of core Children's systems. The tools we use to extract and present data also varies. The use of multiple systems and reporting tools can mean that our current presentation of data across systems is piecemeal and static, providing a snapshot in time that is instantly out of date. Who Are the Users As a Business Intelligence Analyst I need to model the data in the warehouse so that I can use the PowerBI service to report across Childrens data. As a Business Intelligence Analyst I need a Capita One Education integration to the warehouse so that I can can report on data from this system. As a Business Intelligence Analyst I need to setup a data integration from our on prem Liquid Logic warehouse so that I can can report on data from this system As a Business Intelligence Analyst I need to setup data integration from Servelec Core+ so that I can can report on data from this system As a Business Intelligence Analyst I need to setup a data integration from System1 so that I can can report on data from this system Early Market Engagement No market engagement Existing Team The supplier will be working with: our business intelligence team who focus on the data analytics and presentation of intelligence to the wider organisaiton. our in house IT team who focus on the Cloud Services / Data Engineering side of things Current Phase Not started Skills & Experience • Experience delivering a similar project • Experience upskilling internal teams • Be a Microsoft Certified Data Platform provider • Work with an Agile approach to delivery Nice to Haves Experience setting up integrations with systems such as Capita One Educations, Liquid Logic and System 1 Work Location The supplier will be working remotely with occasional visits to our head office in Ipswich/Suffolk Working Arrangments Largely remotely with occasional visits to our Ipswich office Participation in discovery meetings Any additional expenses would need to be agreed in advance Security Clearance No additional security clearance needed Additional T&Cs We would need to work with certified Microsoft partners with Data Platform No. of Suppliers to Evaluate 3 Proposal Criteria • Approach & Methodology • Technical solution • How the solution meets our business needs • Estimate timeframes of work • Team structure • Value for money Cultural Fit Criteria • Work as a team with our organisation • Be transparent and collaborative when making decisions • Share knowledge and experience with other team members • Take responsibility for their work Payment Approach Time and materials Evaluation Weighting Technical competence 40% Cultural fit 10% Price 50% Questions from Suppliers 1. Has any external supplier been involved in the initial scoping work? If so, who? We have not carried out a scoping exercise with any external partners, to date, this requirement has been scoped out by internal IT and business intelligence resource 2. Could you give an indication of budget please? We are prepared to pay market rates and have budget secured. 3. Can you please provide an anticipated timeline for this procurement that includes dates for: 1) Shortlisting Notification for Stage 2 2) Submission Deadline for Stage 2 3) Presentation 4) Evaluation period 5) Award Notification We are working to extremely tight timelines we are hoping to have a supplier onsite by Jan 17th at the very latest. Reviewing submissions 20/21st. Interviews w/c 4th Jan, awarding w/c 10th 4. Can you confirm if shortlisted suppliers will have the opportunity to present? Interviews and presentation will take place w/c4th Dec 5. Can you confirm if shortlisted suppliers will have the opportunity to present? Interviews and presentations will take place w/c 4th January 2022 6. Who is the incumbent and how long they have been the incumbent? There is no incumbent 7. Who from your team will be scoring applications for this opportunity and what positions do they hold? The core team will be: IT Tech LeadIT Product ManagersHead of Data & Intelligencehowever, this group my expand as required 8. Can you please advise the preferred tech stack skills for this opportunity? Azure data platform servicesT-SQLDAXapache sparkAzure DevOps Git and Pipelines 9. Could you share any results of your evaluation of cloud vendors which determined your choice of Azure platform for this requirement? We haven't carried out an evaluation of cloud vendors to determine the choice. We have had this platform in place for almost 2 years (in other areas of the Council) and we would like to expand this to include a Children's Data Warehouse. We do not have the internal capacity in place to carry out at the pace needed. 10. For the Question “Be a Microsoft Certified Data Platform provider”, we understand that the council is seeking a supplier who is been Certified in Microsoft Data Platform. Please correct if our understanding is otherwise. Yes this is correct, certified Data Platform/Data Analytics 11. Could the Authority share the high-level procurement timelines? Including Shortlisting, ITT, Presentation and results. We are working to extremely tight timelines we are hoping to have a supplier onsite by Jan 17th at the very latest. Reviewing submissions/shortlist 20/21st. Interviews/presentations w/c 4th Jan, awarding w/c 10th 12. What are the required Roles? Data ArchitectData EngineerProject ManagerPotentially Data/Business Analyst 13. Is there any requirement for SC-clearance/SC-eligible or will BPSS cleared staff to suffice SC-clearance/SC-eligible is not required