Application Lifecycle Management (ALM) - Test Automation Skills Injection

Tender description

Why the Work is Being Done The testing capability within the Met Office is being transformed from a Quality Assurance (QA) to a Total Quality Engineering (TQE) model. This involves introducing new practices such as Behaviour Driven Development (BDD) and Specification by Example (SBE). These practices consider quality at the outset and support Continuous Integration which enables a ‘learn fast, learn often’ culture. The current test automation approach was found to be lacking and unable to fully support a Total Quality Engineering / Continuous Integration (CI) model. Problem to Be Solved A recent review identified the following challenges: • No common tooling strategy. • Duplicate tooling (e.g. 9 x Test Management tools). • Over reliance on unscripted testing (~60%). • Only ~20% of products have regression packs • Automation scripts not maintained post-delivery. • Emphasis on GUI automation. Addressing these challenges will: • Increase velocity. • Increase quality. • Increase repeatability. • Shorten feedback cycles (learn fast, learn often) • Reduce the overall time to market. • Reduce testing technical debt. • Drive a continuous improvement culture. • Link test artefacts and test execution results to requirements in a common tool. Who Are the Users Solution Engineering requires Supplier to: • Provide automation (CI) skills injection (coaching / consulting) • Work with teams to deliver automated tests • Form part of strategic team to deliver the test automation strategy Early Market Engagement Work Already Done An automated testing strategy was delivered in partnership with an existing supplier. We have begun to deliver against that strategy but have struggled to secure the right resources to help up skill the wider teams. The strategy recommends engaging a 3rd party to help implement the strategy and up-skill the current Met Office teams. Existing Team • Delivery Teams – Project Manager, Release Manager, Technical Lead, Solution Engineers, Product Owner. • As a Service – Solution Architects, Test Architects, Product Managers, Technical Testers, PMO. Current Phase Not started Work Location • Majority of engagements will be based in Exeter, UK. • Option to work remotely as appropriate. Working Arrangments Core team of to be based onsite with the potential for the other roles to work remotely. Supplier to rotate core team based onsite as appropriate. The Met Office is open to onshore / nearshore solutions. Security Clearance Please consider when responding, the necessity for all individuals to be willing and able to pass SC clearance. Additional T&Cs Skills & Experience Experience of implementating strategic vision for automation testing in an software development environment. Management of the adoption and running of testing processes and frameworks Effective engagement across internal IT teams including representation and championing of testing methodologies within the wider Enterprise, Solution Architect & IT Manager community Experience of supporting competency leadership from a testing perspective within internal IT teams. Experience working with various contributory groups in order to ensure that the ‘Toolset’ within Service Transition teams is both effective and efficient Provide advice and guidance on the levels and types of skilled resource, participate fully in recruitment campaigns and help with selection decisions for individual candidates The ability to provide hands on expertise as and when required to support the squads and Test Leads with implementing the automated engineering approach. Implementation and execution of relevant automated tests. Mentoring and coaching of permanent staff to ensure that knowledge persists. Expertise and knowledge about CI pipelines and dependencies & assistance with navigating challenges when they arise. Working with appropriate delivery teams to ensure adoption of automated testing and any associated techniques. Nice to Haves No. of Suppliers to Evaluate 5 Proposal Criteria The proposed approach, methodology and experience. How the approach or solution meets user needs The proposed technical solution The lead time to commence the engagement The value for money of the proposal Cultural Fit Criteria Work as a team with our organisation and other suppliers Timeliness and effectiveness of communication Willingness to engage as a partner Openness and approach to knowledge transfer/training Payment Approach Time and materials Assessment Method Written proposal Case study Work history Presentation Evaluation Weighting Technical competence 60% Cultural fit 15% Price 25% Questions from Suppliers Budget range between £500k and £900k based upon understanding of requirements from strategy.