Data Science - Data Centric Testing Service

Tender description

Why the Work is Being Done The ESFA Data Collections systems are used to collect financial, participation, attainment and building information from Academy Trusts, Local Authorities, FE and Apprenticeship Providers and Diocese to inform its funding allocations, payments, services and market oversight remit. The data is collected through bulk upload, online forms and document exchange platforms. As Data Collections systems are the source and starting point of Data Flow in Data Science, Assurance of Data Flows is required at the point of collection, data storage, data transformation & reporting to meet quality assurance requirements and high quality product delivery demanded by GDS assessments Problem to Be Solved During 2018 and 2019, ESFA is upgrading its data collections software, consolidating its platforms and upgrading the software to improve the quality and timeliness of data and reduce the burden on its data suppliers. The ESFA is also consolidating its data storage and data management systems and automating the data flows to reduce the reliance on manual processes to transform, upload and manipulate its data for its data scientists. We need to assure that data is processed correctly and data is reported correctly, poor output will impact users referenced above and risks financial and reputational damage of ESFA and DfE. Who Are the Users As a provider of Primary/Secondary/Tertiary education, I need to submit financial returns to the DfE so that our financial status can be established for approved funding and the DfE can provide accurate reports on our Funding Allocations/ Achievement Rates/ Risk Assessment / Qualitative Reports. As a DfE civil servant, I need to support critical services and support the development and improvement of essential Data Collections systems so that our users above recieve the highest quality ESFA Systems. Early Market Engagement Work Already Done Existing Team The supplier will be working with civil servants and multiple suppliers across various strands of work for delivery of the service. Typically within Agile delivery teams, working with Product Owners, Delivery Managers, Business Analysts, Developers, other Test Engineers and Test Analysts Current Phase Not applicable Work Location Education and Skills Funding Agency, Cheylesmore House, 5 Quinton Road, Coventry CV1 2WT, with occasional travel to other locations nationwide. Working Arrangments Onsite full-time 5 days a week co-located with the rest of the team at the ESFA offices in Coventry. Occasional travel to other ESFA (or partner organisation) offices may be required, subject to ESFA travel and subsistence policy. This programme uses agile methodology. Successful application of agile principles and techniques requires that the teams are co-located and able to work directly with colleagues representing digital delivery, operational and policy requirements. Security Clearance The successful supplier must be able to demonstrate that all proposed team members have been subject to Baseline Personnel Security Standards checks. However higher levels of Security Clearance maybe required dependant on work agreed in the Data Science Programme of work. Additional T&Cs Expenses must be pre-agreed and comply with DfE Travel and Subsistence Policy. Any expenses shall be submitted in line with DfE standard T&C policy. Primary work location stated in SoW will not attract expenses. No parking is available on site. Skills & Experience At least 5 years demonstrable experience in Agile (preferably Scrum and/or Kanban) methodology to projects. At least 5 years demonstrable experience in testing BI products including OLTP, ETL, SSIS, SSAS, OLAP, SSRS, Power BI. Reviewing Control Flow, Data Flow, Transformations, Variables, SCDs, SCD Design, Error Handling, Transactions and Checkpoints. Experience of reviewing Schema design; highlighting the advantages and disadvantages of Star vs Snowflake Schemas. Use quality characteristics such as functionality, reliability, usability, efficiency, maintainability and portability helps define the context of value and level and type of testing required to meet definition of done. Demonstrable experience of using a risk based approach to testing. Proven experience of ETL testing Proven experience of influencing design and development of a Data Warehouse Proven experience of QA of MS SQL MDM Proven experience of setting up Test Automation in Data Centric environments Proven experience of identifying DB Performance bottlenecks Proven experience of QA of DB / Package deployment configurations. Nice to Haves Experience of working on Data Migrations/ Data Warehouses / ETL / MSDT Strong understanding of the Government Digital Service Standard and Service Manual. Able to contribute to areas beyond the usual boundaries of the discipline, for example helping the team understand the service’s legal and regulatory environment. Knowledge of the Education and skills sector Experience of open source Passed certified Agile Tester course ISEB foundation and practitioner qualified. Having worked on a Azure platform Experienced in using the following tools, Visual Studio, MSDT, MS BI Stack, SQL Server, Power BI, Tabular Model, R, R-Shiny and Python No. of Suppliers to Evaluate 3 Proposal Criteria Demonstrate/provide evidence of experience and knowledge of agile testing and Data Centric skilled Quality Assurance testers (QA). Demonstrate/provide evidence of experience and knowledge test automation in Data Products within CI pipeline. Demonstrate/provide examples of working with delivery teams delivering on Data Warehouse implementations, from sourcing data, ETL, OLAP through to end point Dashboards and Reports in a Data Centric Testing role Demonstrate/provide examples of how the supplier has worked with delivery teams delivering Data Products in a Data Centric Testing role Demonstrate/provide evidence of how the supplier contributes to building an effective multidisciplinary team Demonstrate/provide evidence of the supplier’s approach to incorporating user needs and government needs into the product backlog and prioritises work effectively and efficiently Demonstrate/provide evidence of how the supplier actively promotes understanding and acceptance of agile, user-centred delivery Demonstrate/provide evidence of how the supplier has worked in a multi-team environment with multiple product owners collaborating to deliver a broader service Cultural Fit Criteria Work as a team – Collaborate, establish good working relationships, generate team spirit Show a commitment to ensuring a team understands the user need over simply delivering work Innovate – Act on initiative, drive improvements, balance risks Build capability – Encourage learning, share knowledge, address capability gaps, act on feedback Demonstrate responsibility (for example, act like a leader, serve your team, provide solutions to problems, engage in external/internal environments, seek the best for the organisation beyond your team) Focus on delivery – Focus on goals, set stretching targets, take responsibility for delivery Approach to developing a "One Team" approach Payment Approach Capped time and materials Assessment Method Written proposal Presentation Evaluation Weighting Technical competence 50% Cultural fit 20% Price 30% Questions from Suppliers Budget range the budget could range up to a maximum of £4.0m consisting of multiple sows, but that scope could expand or contract. dfe does not commit to any minimum spend at this point. a pricing template will be given at the proposal stage to those suppliers we shortlist.