Natural Language Processing (NLP) Analysis Platform

Tender description

Why the Work is Being Done The Home Office is responsible for delivering analysis on terrorist and extremist communications and online behaviour that shapes HMG’s policy and the delivery of counter-terrorism & counter-extremism communications. We have identified a need to better track and recognise trends in terrorist and extremist propaganda over time at scale and compare this data to other terrorism and extremism datasets to understand the relationship between propaganda, attitudes and behaviours. This capability will help improve the speed, quality and variety of the Home Office's analysis and provide us with valuable data for the shaping and targeting of counter and alternative narrative communications campaigns. Problem to Be Solved We are seeking the development and delivery of a NLP analysis platform that enables the ingest and indexation of large text-based propaganda, allowing users to search within this platform for content by time, producer, title or keywords. In addition, it will assess propaganda against the following metrics: 1. Consistency of rhetorical/thematic focus over time. 2. Alignment to other terrorist/extremist rhetoric. 3. Influence of message/messenger (supplier to propose measures of influence). 4. Relationship between propaganda and behaviours (using open source data on terrorist activity). Initial data ingest for this project will be in the form of the Home Office's text data. Who Are the Users Home Office analysts need to be able to better understand macro and micro trends in terrorist and extremist propaganda and messaging over time in order to understand the threat this content poses and provide relevant policy and operational advice. Analysts would work with the supplier to ensure that the functionality of the solution meets their needs. Early Market Engagement Work Already Done The Home Office has carried out some concept work with a supplier on the application of Natural Language Processing for the detection of terrorist propaganda. We intend to use the results of this work, code, training data and the method adopted to inform the development of this project. This will enable the Home Office and the winning supplier of the procurement, to bring to market a tool based on proven learnings. Existing Team The supplier would be working with an internal team of Home Office analysts. Current Phase Alpha Work Location It is anticipated that the successful bidder will be able to work from their own location. Working Arrangments The Authority would look to hold an initial workshop followed by meeting at milestones and touchpoints, subject to further definition and input from the bidders proposal. Security Clearance SC level clearance is required for non-development staff working under the proposed contract. The supplier must have a location and technology that supports development at Official Sensitive. The successful supplier will also need to confirm they have Cyber Essentials accreditation or have it prior to receiving any data. Additional T&Cs 1. Payment will be via the Home Office's electronic payment system 2. Any travel and expenses will be in accordance with Home Office policy. 3. Key Supplier staff included in proposals will be expected to work on the contract. 4. Supplier will be required to agree to the Authority's security requirements including having Cyber Essentials 5. The Supplier shall (when designing, implementing and delivering the Services) ensure that it and its employees or sub-contractors work in alignment to the Government Commercial Function Supplier Partner Code of Conduct (September 2017) https://www.gov.uk/government/publications/supplier-code-of-conduct throughout the term of the contract. Skills & Experience Demonstrate experience of developing tooling for the purpose of data analysis. Demonstrate experience of applying a range of natural language processing techniques to support the analysis of text-based data. Nice to Haves Demonstrate experience of working in counter-terrorism & extremism and/or on the analysis of terrorist or extremist propaganda. Provide evidence of Government domain expertise and Government Digital Service Demonstrate experience of developing dashboards for data analysis. Experience of designing services to best practice industry standards. Provide evidence of providing a scalable, resource pool whilst maintaining governance and delivery. Demonstrate experience of supporting software development using natural language processing techniques Have a suitable location and technology to develop, manage and store Official-Sensitive data. No. of Suppliers to Evaluate 5 Proposal Criteria Approach and methodology - clear and detailed timeframes, considering all factors from develop through to delivery, future proofing, ongoing maintenance and upgrades (18%) Technical infrastructure - evidence that the organisation has the technical ability to develop, build, future and maintain the platform including upgrades (12%) How the approach or solution meets user needs - how the solution will be tailored to meeting the problem statement and how this might be managed during the process. (12%) Risks and dependencies and possible mitigation - evidence of consideration and understanding of risks (6%) Team structure and composition (including work histories for core staff) (6%) Value for money - demonstrates a clear method in ensuring that costs provided are managed effectively (6%) Cultural Fit Criteria Provide evidence of working with UK Government, local authorities or large organisations with a range of different stakeholders (2%). Provide evidence of sharing knowledge, experience and collaborating as part of a wider group (2%). Have the ability to communicate effectively and be responsive to client needs (1%). Has respect and understanding of client's internal governance and procedures (1%). Be innovative, cutting edge and not afraid to try new things (2%) Have security at the heart of its organisation (2%) Payment Approach Capped time and materials Assessment Method Written proposal Case study Work history Reference Presentation Evaluation Weighting Technical competence 60% Cultural fit 10% Price 30% Questions from Suppliers Budget range first statement of work has a limit of £200-250k