Home Office Digital, Data and Technology Big Data Delivery

Tender description

Why the Work is Being Done The Home Office is transforming services with the introduction of new digital systems based on Cloud and Big Data technologies. This is part of the overall business transformation to deliver digital public services and reduce costs. Problem to Be Solved To develop, implement and maintain Big Data solution for Portfolio programmes and projects, within a large scale transactional and analytical data environment, utilising cloud technologies (such as AWS, Azure) and Big Data/MPP technologies (such as Hadoop, HBase and Kafka – ideally HortonWorks distribution), as well as other relational and non-relational database technologies (such as PostgreSQL and Oracle). The initial requirement is to stand up two Agile delivery teams with core skills in these technologies. Further delivery teams may be deployed over the course of the contract. Statements of work for specific deliverables will be agreed with the supplier in advance. Who Are the Users The Immigration IT Portfolio is responsible for maintaining and improving current and future immigration IT services. We are helping to deliver the future of immigration. Early Market Engagement There is no pre market engagement event. Work Already Done The Big Data solution is already in development. So any new supplier will be expected to take responsibility for any code that has been, or is in the process of being, developed after a suitable transition and handover period with the incumbent. We are keen to understand how quickly suppliers can mobilise to enable transition and handover to commence as we wish them to occur as soon as possible after contract award. Existing Team We anticipate that the contracted supplier will develop strong collaborate working relationships with the existing HO DDaT programme/project teams and with the other suppliers supporting HO DDaT with whom the supplier will work. It should also allow the supplier to develop a clear understanding of the aims and objectives of the HO DDaT programme/project they are working on, so that they can effectively support HO DDaT in terms of their day to day work and engagement with others. Current Phase Live Work Location London and Croydon Working Arrangments Your response should set out how you could maintain the availability of your services over time, the ability to supply up to 2 teams concurrently, and your ability to respond to immediate surge requirements. The Home Office reserves the right to both extend and shorten the services provision period, subject to discussion with the preferred supplier(s). The team is expected to work across the multiple sites as required. Expenses will conform to HO internal policies and will not be payable to Westminster, Croydon, or Heathrow Security Clearance Service Provider personnel need to be compliant with BPSS as a minimum, and CTC clearance if working in Home Office buildings. Depending on the nature of the role, if escalated and/or privileged access is necessary then there may be a requirement for SC clearance, and in certain circumstances, DV clearance. Additional T&Cs Skills & Experience Provide demonstrable experience implementing Big Data technologies, utilising Big Data technologies (such as Hadoop, HBase and Kafka) Provide demonstrable experience of designing, developing and optimising Big Data ingestion pipelines, utilising Big Data/MPP processing technologies (such as Samza and Spark). Provide evidence of resources with extensive experience of developing Java-based operations and data services, using open source technologies (such as Java 8, JBoss RESTEasy and Google Guice) Provide evidence of resources with extensive experience of deploying and managing Big Data solutions, utilising CI and containerisation technologies (such as Ambari, Puppet, Jenkins, Docker and Kubernetes). Provide evidence of resources capable of leading on innovation and performance engineering and that will be accountable for the availability, scalability and performance of the Big Data solution Provide evidence of resources capable of developing and maintaining an architecture roadmap for the Big Data solution and the supporting implementation and migration plan, based upon an agile delivery runway Provide evidence of resources capable of providing 3rd line support for the Big Data solution, that resolve high-priority bug fixes or continuous integration / deployment issues Nice to Haves Provide evidence of resources with experience of architecting and maintaining Big Data solutions in AWS cloud environments, with knowledge of AWS Policies, Security Groups, VPC creation and peering? No. of Suppliers to Evaluate 5 Proposal Criteria All essential and nice to have requirements will be evaluated further as part of the overall proposal criteria below Evaluation criteria have 8 categories: Specific Competencies 35%, Plan for initial phase 15%, Risk Management 15%, Ability to scale capability 10%, Performance Management 10%, Methodology 5%, Policy 5%, Security 5% Specific Competencies: Includes all essential and nice to have technology criteria Specific Competencies: Domain knowledge of business requirements and issues Specific Competencies: Ability to transfer to Business as Usual Security: Compliance with people security requirements Methodology: Agile - Government Digital Service - Service Readiness Policy: Cloud - Open Source - IPR and Licensing Plan: Quality of delivery plan for first phase of engagement and statement of work - Start up process performance - Quality and risk of delivery proposal Scale Capability: Capability of increasing delivery or service capability in the medium to long term - Scope and forward planning capability Performance: Delivery and Service management reliability and repeatability - Client reporting and Quality management Performance: Quality management process and culture - Team quality management and performance monitoring execution Risk Management:Medium Term Quality, resilience and scale of Technical or Service skills capability in specific project tools and techniques Risk Management: Quality, Consistency, and Surge Capability to meet specified requirement. Risk Management: Quality and sustainability of delivery proposal Risk Management: Approach of delivering scope and scale of requirements to the overall contract scope and project plan over contract life. Cultural Fit Criteria Cultural Fit: Stakeholder Management - One Team approach - Development of Client capability - People Development - Innovation and Value for Money Payment Approach Capped time and materials Assessment Method Written proposal Case study Work history Reference Presentation Evaluation Weighting Technical competence 65% Cultural fit 5% Price 30% Questions from Suppliers Budget range the budget range is between £6m to £8m excluding vat for a period of 2 years. for the purposes of the price evaluation only, it should be assumed that all team roles will be required for 100 working days. separate day rates for each role should be supplied, statement of works will be agreed periodically with the supplier on a fixed price, capped, or t&m basis with agreed deliverables. the initial statement of work is budgeted at up to £1m but will depend on the actual statement of work and deliverables agreed after contract award.