PU-17/0383 - Customise My Data (beta)

Tender description

Summary of the work Working as part of an in-house team to produce the Beta phase of "Customise My Data". This will allow users of the ONS website and API to find, customise and download data. It covers the end to end process of ingesting data and metadata and publishing it. Expected Contract Length 6-12 months Latest start date 30/04/2017 Budget Range n/a Why the Work is Being Done This work will deliver a beta phase to take the work done in Alpha and expand it into a stable and performant system. The system will be ready to be put into full operational service by the end of the beta. The beta will be part of the ONS website and API and this work will have to integrate everything that it does with the current ONS website and API. It will also support the full variety of datasets and supporting metadata that ONS produces. Problem to Be Solved We currently have no means of allowing users of the ONS website to navigate through data to choose data to download. The only option open to users is to download all data. This causes issues with publishing data in a number of areas, most noticeably with data that use geographical hierarchies. The 2016 customer satisfaction survey showed this to be a major cause of user dissatisfaction with the current website. This work will cover the provision of a system to ingest the data/metadata internally as well as the publishing of this data on the website and API. Who Are the Users As an ONS website or API user I need to find data and metadata and customise it so that I can download data that meets my needs. [This epic would include "As an ONS website or API user I need to find data and metadata and customise it to consist of data relating to geographic areas so that I can download data and metadata that meets my needs."] A full set of epics for the beta will be made available at the next stage of this process. Early Market Engagement n/a Work Already Done Alpha phase due to finish March 2017 (Alpha requirements https://www.digitalmarketplace.service.gov.uk/digital-outcomes-and-specialists/opportunities/798) The Alpha will prove the ability to load a representative selection of datasets into our (cloud) infrastructure and make them available to end users of the ONS website. Users will be able to navigate through and select dimensions (including geographical dimensions) of these datasets and to download their selected data. The dataset will also be available through the API. Alpha work available on GitHub here: https://onsdigital.github.io/dp-prototypes/ and repos prefixed with dp-hyhpen at https://github.com/onsdigital Existing Team The supplier team will be working as part of an in-house multi-disciplinary team who have end-to-end responsibility for the ONS website and publishing platform. Current Phase Alpha Skills & Experience • Expert in delivery of solutions that utilise micro services (2 points) • Expertise in development/delivery using PaaS, Go and Java (2 points) • Expertise in development using event driven architecture (e.g. Kafka and RabbitMQ) (2 points) • Expertise in the design and delivery of internal and public facing RESTful APIs (inc: security reqs) and use of appropriate tooling such as Swagger (2 points) • Expert in cloud technologies: design, planning. security, integration, whilst remaining Cloud provider agnostic (2 points) • Experience in relational and non-relational databases in multiple formats (2 points) • Experience in using automated (testing) environments and continuous integration, delivery & deployment, particularly GitHub and Jenkins/Concourse (2 points) • Expertise in Agile delivery as outlined in the Government Service Design Manual using BDD and TDD as well as iterating on the outputs from user research (2 points) • Experience of delivery in Data Architecture Services, especially in a sensitive data environment (2 points) • Demonstrable experience of providing the training, coaching and assurance necessary to develop relationships and manage phased handover to an internal team (2 points) • Experience in performance testing and tuning cloud based services and databases for optimum performance (2 points) • Able to respond to, prioritise and resolve incidents on the service during normal working hours (1 point) • Expertise in delivering services that follow GDS design patterns (as laid out in the Service Standard) a mobile first design approach, meeting accessibility standards (2 points) Nice to Haves • Experience of working across government agencies (1 point) • Knowledge of working with geographic data (1 point) • Experience of working with 'linked data' technologies (i.e. triple stores, GraphDB, SPARQL) (1 point) Work Location Office for National Statistics, Government Buildings, Cardiff Road, Newport, NP10 8XG Working Arrangments The team is expected to be on-site and co-located with the in-house team. Security Clearance All team members must be in possession of a current Disclosure Scotland clearance prior to starting contractual work. Additional T&Cs Standard Framework Ts and Cs No. of Suppliers to Evaluate 3 Proposal Criteria • Technical Solutions (7 points) • Approach and methodology (7 points) • How you ensure the product meets user needs (7 points) • Team structure and cultural integration (7 points) • Value for money (4 points) Cultural Fit Criteria • Work with existing staff within our organisation (4 points) • Be transparent and collaborative when making decision (4 points) • Have the website and API user and ONS needs at the core of decision making (4 points) • No blame culture and encourage people to learn from their mistakes (4 points) • Skills and knowledge transfer and coaching/mentoring of team members (4 points) Payment Approach Capped time and materials Evaluation Weighting Technical competence 60% Cultural fit 20% Price 20% Questions from Suppliers 1. Could you please update us on: 1. Maximum number of resources we could provide2. Lead time for the application feedback 1. There is no maximum number of resources, the resource profile will be agreed with the winning supplier.2. Feedback will be provided within 5 working days. 2. Q1. What are the next procurement steps and time frames following initial submission of evidence for skills and experience on Monday 27th March? Q2. When does ONS expect to notify the successful supplier that they have been awarded the contract? Q1. ONS will be evaluating the skills and experience evidence w/c 28/3/17.Q2. Suppliers will be requested to supply their proposal on 11/4/2017. Presentations are due to take place w/c 17/4/17. ONS are looking to award immediately after supplier presentations. Please note these dates are subject to change. 3. 1. What is ONS’s position on how this work relates to off-payroll working in the public sector i.e. the reform of intermediaries legislation? Will you classify the selected supplier as inside the new legislation i.e. will the supplier be responsible for defining whether individuals working on the project are inside IR35? Can ONS provide a view on whether individual roles fall inside IR35 and if so, what is your view? Part OneAny engagements through this procurement ONS believes will fall outside of IR35. This is due to a number of factors:• ONS has tested existing engagements procured through the DOS framework. These engagements have been assessed as outside of scope by the tool HMRC released;• the substitution/swap out clauses within the DOS contract prove engagements will be outside of scope;• ONS has issued a list of behaviours to ensure delivery managers treat engagements of this nature in a specific way and not as employees. 4. 1. What is ONS’s position on how this work relates to off-payroll working in the public sector i.e. the reform of intermediaries legislation? Will you classify the selected supplier as inside the new legislation i.e. will the supplier be responsible for defining whether individuals working on the project are inside IR35? Can ONS provide a view on whether individual roles fall inside IR35 and if so, what is your view? Part TwoONS will only be in a position to provide certification that the role is outside of scope once the supplier that's successful, has proposed a set of services to provide the outcome. Whilst ONS doesn't expect this assessment to show as inside of scope given our experience so far, if the tool has changed and they are classed as inside scope, ONS will engage with the supplier to have a commercial discussion regarding what this means.Please note, if your organisation uses permanent members of staff for the engagements, they will automatically be classed as outside of scope. 5. Projected transaction volume including content authors and business users? • The service is designed to be part of the existing ONS website. Metrics for this site can be found on our performance platform - https://performance.ons.gov.uk/ 6. Does data passes through approvals workflow before data is published? Yes, data is reviewed and approved by the data owner after importing but prior to publication 7. What is the content management platform used for data management and publishing? An proprietary CMS (Florence) which was built specifically for the ONS website. It's open source, and code is available on GitHub - https://github.com/ONSdigital/florence, and it's API https://github.com/ONSdigital/zebedee 8. Can we make assumptions technology stack is expected to scale and adopted for BETA phase? The technology stack is expected to align with the existing ONS website and Data Discovery Alpha (technologies listed in tender), should scale horizontally, and will be taken through to Live at the end of the Beta phase 9. Key deliverables expected from the supplier and projected team size/resource count and how many work packages are scheduled? The resource profile will be agreed with the winning supplierMore detailed information on the deliverables, in the form of epics, will be made available at the next procurement stage 10. Is Alpha phase delivered by the internal team or by the supplier? Alpha phase has already been delivered by a combined in-house team and external supplier 11. Development workstations, tools for design, development and testing provided by ONS? Tools for design, development and testing are all open source or freely available (e.g. Go, Java, Atom, IntelliJ, Concourse, Selenium) 12. Development kit to be provided by supplier? Expected Linux/MacOS based devices, Windows is possible but unsupported.