Data Science - Data Centric Testing Service Requirements

Tender description

Summary of the work Data Centric Testing Services to work in fast-paced agile delivery teams. We are seeking a supplier capable of providing specialised SQL and Data focussed QA service. This service will work closely with the current QA services supplier who is focussed on providing functional and non-functional testing on front end systems. Expected Contract Length 2 years, but may be shorter depending on progress to deliver the service. Latest start date Sunday 1 September 2019 Budget Range The budget could range up to a maximum of £3m consisting of multiple SoWs, but that scope could expand or contract. DfE does not commit to any minimum spend at this point. A pricing template will be given at the proposal stage to those suppliers we shortlist. Why the Work is Being Done The ESFA Data Collections systems are used to collect financial, participation, attainment and building information from Academy Trusts, Local Authorities, FE and Apprenticeship Providers and Diocese to inform its funding allocations, payments, services and market oversight remit. The data is collected through bulk upload, online forms and document exchange platforms. As Data Collections systems are the source and starting point of Data Flow in Data Science, Assurance of Data Flows is required at the point of collection, data storage, data transformation & reporting to meet quality assurance requirements and high quality product delivery demanded by GDS assessments (https://www.gov.uk/service-manual/service-standard) Problem to Be Solved During 2019, The ESFA is upgrading its data collections software, consolidating its platforms and upgrading the software to improve the quality and timeliness of its data and to reduce the burden on its data suppliers. The ESFA is also consolidating its data storage and data management systems and automating the data flows to reduce the reliance on manual processes to transform, upload and manipulate its data for its data scientists. We need to assure that data is processed and reported correctly and, as poor output will impact users referenced above and risks financial and reputational damage of ESFA and DfE. Who Are the Users As a provider of Primary/Secondary/Tertiary education, there is a need for providers to submit financial returns to the DfE so their financial status can be established for approved funding and the ESFA (DfE) can provide accurate reports on our Funding Allocations/ Achievement Rates/ Risk Assessment / Qualitative Reports. - As a DfE civil servant, I need to support critical services and support the development and improvement of essential Data Collections systems so that our users above recieve the highest quality ESFA Systems. Work Already Done A programme of work beginning with online collections, through to Data Transformation/Storage and Reporting. There are a number of new online forms being delivered, which are in Alpha and Beta stages. Our requirement here is to focus on quality assurance on the Data Flows from backend systems through to our Data Repository or Data Warehouse. We are seeking a supplier capable of providing a more specialised SQL and Data focussed QA service. We will require this service to work closely with our current QA services supplier who is more focussed on providing functional and non-functional testing on front end systems. Existing Team The supplier will be working with civil servants and multiple suppliers across various strands of work for delivery of the service. Typically within Agile delivery teams, working with Product Owners, Delivery Managers, Business Analysts, Developers, other Test Engineers and Test Analysts. Current Phase Not applicable Skills & Experience • At least 5 years demonstrable experience in a QA focussed role working in both Public and Private Sector. • At least 5 years demonstrable experience in Agile (preferably Scrum and/or Kanban) methodology to projects. • Experience of working to User Centred Design Standards • At least 5 years demonstrable experience in testing various stages in MS Data Warehouse implementations. • Experienced in using MS SQL Data Tools • Demonstrable experience of applying a risk based approach to testing • Demonstrate experience of quality assuring Schema design and development of a Data Warehouse • Proven experience of ETL testing • Proven experience of setting up Test Automation in Data Centric environments. • Proven experience of writing / maintaining test automation suites • ISEB foundation and practitioner qualified . Nice to Haves • Experience of working on Data Migrations • Passed certified Agile Tester course • Having worked on a Azure platform • Proven experience of QA of MS SQL MDM • Experience of working in multi disciplinary teams • Experience of working to Government Digital Services (GDS) standard Work Location Education and Skills Funding Agency, Cheylesmore House, 5 Quinton Road, Coventry CV1 2WT, with occasional travel to other locations nationwide. Working Arrangments Onsite full-time 5 days a week co-located with the rest of the team at the ESFA offices in Coventry. Occasional travel to other ESFA (or partner organisation) offices may be required, subject to DfE travel and subsistence policy. This programme uses agile methodology. Successful application of agile principles and techniques requires that the teams are co-located and able to work directly with colleagues representing digital delivery, operational and policy requirements. Security Clearance The successful supplier must be able to demonstrate that all proposed team members have been subject to Baseline Personnel Security Standards checks (BPSS). However higher levels of Security Clearance maybe required dependant on work agreed in the Data Science Programme of work. Additional T&Cs Expenses must be pre-agreed and comply with DfE Travel and Subsistence Policy. Any expenses shall be submitted in line with DfE standard T&C policy. Primary work location stated in SoW will not attract expenses. No parking is available on site. No. of Suppliers to Evaluate 4 Proposal Criteria • Describe the challenges experienced aligning Agile Testing techniques to a Data Centric testing environment. • Demonstrate/provide evidence of embedding test automation in Data Products within CI pipeline. • Demonstrate/provide examples of how the supplier has worked with delivery teams delivering Data Products in a Data Centric Testing role • Demonstrate/provide evidence of the supplier’s approach to incorporating user needs into the product backlog and prioritises work effectively and efficiently. • Demonstrate how you have supported your customer to deliver value for money (Evaluators looking for - good strong example of cost saving for customer.) • Describe how you have worked with an organisation with a mature Agile Testing culture • Demonstrate/provide evidence of how the supplier actively promotes understanding and acceptance of agile and user-centred delivery • Demonstrate/provide evidence of how the supplier has worked in a multi-team environment with multiple product owners collaborating to deliver a broader service Cultural Fit Criteria • Show a commitment to ensuring a team understands the user need over simply delivering work • Innovate – Act on initiative, drive improvements, balance risks • Build capability – Encourage learning, share knowledge, address capability gaps, act on feedback • Work as a team – Collaborate, establish good working relationships, generate team spirit • Experienced or working in multi-disciplined co-located teams Payment Approach Capped time and materials Evaluation Weighting Technical competence 45% Cultural fit 15% Price 40% Questions from Suppliers 1. Is there a current incumbent in this role? Yes 2. You are asking for experience with Microsoft Azure, can you please confirm if the solution you are developing is cloud-based Relational Database (structured data) or an unstructured "Big Data" (Data Lake) solution? We have structured data 3. Please clarify the scope of the submission: Pricing is one of your evaluation criteria, but we can see nowhere to submit pricing – please advise how we share this information. With Cultural fit being another key component of the evaluation, please advise where we can describe this specifically to allow you to evaluate. Indeed all the items in the "proposal criteria" seem to suggest we should be putting in a proposal to meet your need, yet the questions are all around existing experience. Please advise. DOS uses a two stage process. The first is focused on the Essential and Nice to have criteria. Suppliers are then sifted on their responses to these. For those that get through to the second stage, there will be an opportunity to submit a response on the Proposal, Cultural fit and Price elements.