DLS:DQS - SAS Data Quality and Remediation Functions copy

Tender description

Summary of the work HMRC is introducing data quality improvements. This requires the delivery of a data validation solution within the Data Loading Service (DLS). The first stages of the validation tool have been delivered using SAS software. A fully operational validation solution embedded in DLS will be delivered by 31/03/2021. Expected Contract Length 1 year Latest start date Friday 3 April 2020 Budget Range £700,000 to £800,000 Why the Work is Being Done It is essential that the quality of the data used in our planning and decision making processes is accurate and complete to enable HMRC to achieve its objectives. Under the Data Quality Strategy, HMRC is introducing data quality improvements. One element of this initiative is the delivery of a data validation solution within the Data Loading Service (DLS). The DLS loads and prepares 60 products for exploitation. The first stages of the validation tool have already been delivered using SAS software. A fully operational validation solution embedded in DLS is to be delivered no later than 31/03/2021. Problem to Be Solved HMRC requires delivery of: Development, Testing & Implementation of DQ assessment & validation for data sources, Remediation & enrichment capability for all data sources, Address verification, Entity verification, Refinements to data source specifications, rules, and thresholds, DLS Metadata enhancements for integration with DQ, Automated rejections and failure reports, processing & (re)assessing archived returns. Analysis: For each feed type: data quality metrics, providing comparisons of DQ issues; Iterative, ad-hoc aggregate analysis & operational metrics; DQ-integrated data quality dashboards, and DQ service monitoring & performance. Support: SAS tool upgrades, re-packaging and SRS revisions, and migrations. Assist developing Data Acquisition templates and formats. Who Are the Users As a system owner I require the data I use to be validated to ensure accuracy and completion, and the data validation functions to be completed, so that I can accurately advise the business to make decisions to achieve their objectives. Work Already Done Phases 1 to 3 delivered the framework for the solution, the ability to process a number of products through the DQ solution and produce processing reports. Proof of concept also commenced on remediation, enhancement and enrichment of data. Existing Team The supplier will be working with business areas within HMRC including RIS Analysis, CREST, and CDIO CDO CNI. Current Phase Not applicable Skills & Experience • Demonstrable experience of providing relevant skills/roles/resources against a variety of technologies required to form a Scrum Team, scaling up/down to accommodate new requirements or changes within the delivery pipeline. • Have demonstrable experience of working with SAS tools to improve data quality within a client's organisation. • Evidenced outcomes of delivering performance improvements through multi technology optimisation/implementation in the last 3 years. • A good understanding of DevOps principles and the benefits of CI/CD and able to demonstrate ability to stay up to speed with current developments in platform automation and DevOps principles. Nice to Haves Supplier would ideally have had a significant multi team contract with a public sector body Work Location Cardiff, Wales Working Arrangments Supplier must be prepared to work on an agile basis, in an in-house environment with the clients staff. Supplier should be prepared to provide support for the clients staff, including knowledge sharing. Security Clearance Staff must be minimum SC cleared. Additional T&Cs HMRC will add standard tax compliance clauses. No. of Suppliers to Evaluate 3 Proposal Criteria • Technical solution • Approach and methodology • How the approach or solution meets user needs • How the approach or solution meets your organisation's policy or goal • Estimated timeframes for the work • How they've identified risks and dependencies and offered approaches to manage them • Team structure • Value for money Cultural Fit Criteria • Have demonstrable experience of providing additional and/or value added activities when acting in the role of a partner supplier to an organisation • Have demonstrable experience of collaborative working with a client's ‘in-house’ teams, including coaching and mentoring, and knowledge sharing. Payment Approach Capped time and materials Evaluation Weighting Technical competence 60% Cultural fit 10% Price 30% Questions from Suppliers 1. Does the supplier need to provide additional SAS licences? If not what type of SAS licence does the Department hold? No, HMRC already has SAS site licences in place for a multi-tenant 9.4 grid using Data Management Advanced. 2. What key features you are currently using in the SAS software and how are they being used? The existing solution uses SAS Base, Macro, SQL and Stored Process, as well as EG, DI, DMS, SAS Studio, Custom Tasks, and the QKB. This interfaces with the existing Data Landing Service to import, validate and assess data for ingestion. 3. Does the question needs to showcase experience pertaining:a) only to various SAS technology, such as SAS Data Management, SAS Analytic Technogy(e.g. SAS EMiner) and SAS Visual Analytic.b) Across SAS Industry Solution such as SAS Tax Fraud offering for Government.c) Or a combination of SAS & other COT or Open source technology Responses need to evidence the experience in using uses SAS Base, Macro, SQL and Stored Process, as well as EG, DI, DMS, SAS Studio, Custom Tasks, and the QKB. Reference to experience in other COT or Open source technology would be useful. 4. Does the question needs to showcase experience pertaining:a) only to various SAS technology, such as SAS Data Management, SAS Analytic Technogy(e.g. SAS EMiner) and SAS Visual Analytic.b) Across SAS Industry Solution such as SAS Tax Fraud offering for Government.c) Or a combination of SAS & other COT or Open source technology Responses need to evidence the experience in using uses SAS Base, Macro, SQL and Stored Process, as well as EG, DI, DMS, SAS Studio, Custom Tasks, and the QKB. Reference to experience in other COT or Open source technology would be useful. 5. Demonstrable experience of providing relevant skills/roles/resources against a variety of technologies required to form a Scrum Team, scaling up/down to accommodate new requirements or changes within the delivery pipeline. Does the question needs to showcase experience pertaining:a) only to various SAS technology, such as SAS Data Management, SAS Analytic Technology (e.g. SAS EMiner) and SAS Visual Analytic. b) Across SAS Industry Solution such as SAS Tax Fraud offering for Government.c) Or a combination of SAS & other COT or Open source technology Responses need to evidence the experience in using uses SAS Base, Macro, SQL and Stored Process, as well as EG, DI, DMS, SAS Studio, Custom Tasks, and the QKB. Reference to experience in other COT or Open source technology would be useful. 6. Have demonstrable experience of working with SAS tools to improve data quality within a client's organisation.A) Request to please outline if experience should be with respect to:1) Base SAS via codes2) SAS Data Management Standard offering3) SAS Data Management Advanced offering.B) As part of the experience, what aspect of data quality should be showcased:1) Profiling2) Cleansing / Standardization3) Matchcode generation4) Single view of Entity ( e.g Customer)5) Governance such as remediation, etc. Responses need to evidence the experience in using uses SAS Base, Macro, SQL and Stored Process, as well as EG, DI, DMS, SAS Studio, Custom Tasks, and the QKB. Evidence of uses in B 1-5 would be beneficial. 7. Evidenced outcomes of delivering performance improvements through multi technology optimisation/implementation in the last 3 years.A) Is the experience related to technical aspect such as optimisation related to overall approach to DQ methodology.B) In case no DQ centric, Can we quote Non SAS experience as well. All evidence is welcome. 8. Have demonstrable experience of working with SAS tools to improve data quality within a client's organisation.A) Request to please outline if experience should be with respect to:1) Base SAS via codes2) SAS Data Management Standard offering3) SAS Data Management Advanced offering.B) As part of the experience, what aspect of data quality should be showcased:1) Profiling2) Cleansing / Standardization3) Matchcode generation4) Single view of Entity ( e.g Customer)5) Governance such as remediation, etc. Responses need to evidence the experience in using uses SAS Base, Macro, SQL and Stored Process, as well as EG, DI, DMS, SAS Studio, Custom Tasks, and the QKB. Evidence of uses in B 1-5 would be beneficial.