DAC 048 - C9622 - Digital Data Technology Data Matching

Tender description

Why the Work is Being Done The Data Matching service provide two main services; - regular matching of multiple streams of data to support analytical work and end services - technical oversight of matching as an end service (Enrichment) Problem to Be Solved The Data Matching services deal with a significant amount of data and requires ongoing support. The Home Office has determined that it requires a supplier to provide this service with a view to bringing this in-house in the future. Who Are the Users There are two key groups of users; • Data Scientists (c30), who need to use advanced tools to explore datasets to support business operations, policy making and decision making – some of which are business critical. • End Users (c1500), who rely on matched data to perform efficient searches Early Market Engagement Work Already Done The service has been running for over 2 years and is in the planning process of transitioning core matching capability from Infosphere to BigMatch Existing Team An existing matching team of 10 contractors has developed the systems, processing around 30-40 data sets, to the current state, but are approaching end of contract. The incumbent service provider will continue to support the Data Matching service during a transition period. There is expected to be a one-month overlap with existing contract, which will allow handover and smooth transition from one contract arrangement to the new. Current Phase Beta Work Location Work will be carried out from a Home Office location primarily in Croydon and 2 Marsham Street. Working Arrangments The supplier is expected to stand up a team made of up of the specialist skills required to deliver the outcomes. We expect the supplier to be flexible to our needs and make working with a mixed team across multiple sites effective. In general we would expect resources to be on site 5 days a week. Occasional travel to regional sites may be required, expenses incurred from travel outside of the M25/Greater London will be subject to Home Office Travel and Subsistence Policy. Security Clearance All staff must hold or be prepared to undergo SC Security Clearance to operate on this project, (with willingness to acquire resources with NPPV3 and DV clearance) Additional T&Cs • The work will be progressed by a number of SoWs which may be fixed priced, T&M or Capped T&M as appropriate. • Standard DOS framework and call-off terms & conditions. Skills & Experience Expertise in managing, configuring and improving IBM Infosphere MDM (SE) & IBM Big Match Expertise in Java, SQL, Python, SAMZA, KATFA & HBase Experience in optimising matching based on quality assurance processes & user feedback Experience in working with very large scale data Expertise with the POLE model Nice to Haves IBM Accredited Experience working with Government department(s) Experience working in an agile environment Experience of migration of data from / to different cloud provisions Knowledge of Greenplum database Working with business and teams to develop data Standards SC clearance already in place No. of Suppliers to Evaluate 3 Proposal Criteria Approach and methodology Technical skills and experience Service model Mobilisation plan A plan for optimising resources Identification of risks and dependencies Cultural Fit Criteria Work collaboratively with all teams in the Data Analytics Competency Centre to ensure smooth handoffs in an environment of continuous improvements and changes Ability to function effectively and collaborate in a multi-supplier environment Working successfully in complex public sector organisations Approach to proactive issue management, problem resolution and improving ways of working Payment Approach Time and materials Assessment Method Written proposal Reference Presentation Evaluation Weighting Technical competence 60% Cultural fit 5% Price 35% Questions from Suppliers No questions have been answered yet Budget range