Environment Agency - Data Profiling and Data Quality Testing Project

Tender description

Why the Work is Being Done The Environment Agency (EA) are developing a Data Quality Service to help the management of its data quality. The goal is to make it quicker and easier to find out exactly the quality of the EAs data. The EA are tendering for an external consultant(s) to help create a process to commission Data Profiling and Data Quality Testing work. The three data sets being used in this project are: Complex spatial, Complex non-spatial and Simple non-spatial data. This work needs to be complete by the end of the financial year 2018/19. Problem to Be Solved Where we identify we cannot meet the need internally we want to gain experience of working with a supplier to outsource analysis of data and data quality. This will free up resource internally for decision making and continuous improvement work. The supplier will profile data, test the quality of the data and explore the best way to communicate or visualise the results. Using experience of this work, we need to create a process to follow for commissioning Data Quality work, with specifications, guidance, timeframes and cost estimations, varying by the different types of data that were assessed. Who Are the Users As a Data Custodian I need to understand the make-up and quality of my data, and use the experience of working with a supplier to understand the specification and information needed for commissioning future pieces of data quality analysis work. So that I can find the right improvements needed within the business to improve the fitness for purpose of the data in the most effective way. Early Market Engagement Work Already Done This is the second year of a three year project. The first year focused on gap analysis, requirements and scoping. This work highlighted the need for a different way to undertake data quality work. Currently we rely on internal resource and skills to undertake data quality work. The tools currently available for data quality work are not designed for this use and require technical knowledge and skills our staff do not possess. We need to make the best use of our staff’s knowledge and develop a Data Quality Service providing support for the gaps in technical ability and availability. Existing Team The supplier will be working with the Environment Agency (EA) only, no other suppliers are involved. Other EA staff working on the project include a Senior Advisor in the Data Integrity & Flood Data team and Technical Specialists of the datasets involved. Current Phase Not applicable Work Location We expect the work to be carried out offsite. There is a requirement for regular meetings to provide updates on how the work is progressing. These meetings would be a mixture of phone calls, WebEx and potentially face to face at the Environment Agency's head office in central Bristol. Working Arrangments The number of days per week expected to be worked by the successful supplier will be based on number of consultant(s) allocated to the task by the supplier and how long they believe the work will take to complete. We would expect this work to be carried out offsite, with regular progress meetings on the phone or via WebEx. Occasional face-to-face meetings may be required in central Bristol. Security Clearance Additional T&Cs Skills & Experience Data quality management knowledge and experience Data Profiling knowledge and experience Data Standards knowledge and experience Process building knowledge Excellent Communication skills (written, graphical and verbal) Ability to work collaboratively and share knowledge Nice to Haves ISO8000:150 accreditation would be an advantage, but not essential. No. of Suppliers to Evaluate 5 Proposal Criteria Approach and methodology How the approach or solution meets The Environment Agency's needs Value for money Cultural Fit Criteria Work as a team with our organisation and other suppliers Be transparent and collaborative when making decisions Take responsibility for their work Payment Approach Time and materials Assessment Method Written proposal Work history Evaluation Weighting Technical competence 50% Cultural fit 5% Price 45% Questions from Suppliers Budget range maximum budget of £50,000.