DPS Data Reporting Dashboarding Requirements (Emerging Technologies)

Tender description

Summary of the work Impact assessments Demand Management Delivery Management including testing & rollback capabilities Business Requirements Solution Design Reporting and Dashboarding Code Delivery Incident/problem management Change management Batch operation-support/recovery Event Management–Provide support when required HPI Management-Provide support when required Change Management–Evaluate change within SLA’s Code Change to support evergreening Capacity/performance management Knowledge management Expected Contract Length 16 months Latest start date Monday 8 February 2021 Budget Range £1,000,000 Why the Work is Being Done Data Platform Services (DPS) provides enterprise-wide data platform engineering capabilities that enable the acquisition, administration (management) and application (exploitation and consumption) of enterprise data. DPS provides the core platform capabilities and building blocks needed by: • CDIO Chief Data Office to implement enterprise data management (governance, models & standards), implement / manage data sharing and provide advanced analytics exploitation services. • CDIO Customer Groups to assemble, build and run line of business data services. • Data consumers (standard and advanced) within the wider HMRC Business to access and exploit data, within a supported self-serve framework. DPS will also provide the support offerings that enable HMRC to become a data-driven and insight-led organisation, drive data innovation and drive adoption of emerging technologies like AI (Artificial Intelligence) and ML (Machine Learning). Problem to Be Solved HMRC has a large and complex legacy Data Analytics estate which needs simplification, and consolidation and transformation to meet the challenges the department now faces. We design and build reporting and dashboarding services to expose data to the organisation and to provide services to exploit that data across the organisation, and other government departments. Who Are the Users All HMRC customer groups (Customer Compliance, Customer Services, Customer Strategy and Tax Design, Corporate, VOA) need platform services they can consume for data on which they can build their specific line of business exploitation services. HMRC Chief Data Office needs platform services which enable Data Management, Governance and Data sharing. Other Government Departments rely on the Platform for receiving data for use within HMRC, and sharing HMRC data for their use. Work Already Done DPS has been working since 2018 on a new strategy for provision of Data and Analytics services based around a hybrid hosting model with a Logical Data Warehouse at its core. DPS has strategic reporting tools (Pentaho Business Analytics and others being on-boarded) to execute its strategy. There is a significant amount of work remaining to continue delivery of the evolving reporting and dashboarding capabilities. Existing Team HMRC and other suppliers Typically teams comprise of the following roles: Technical Project Manager Scrum Master Solution Architect Product Owner Data Engineer (Report and Dashboard development) Data Analysts Business Analysts Technical Analyst QA Service Manager Current Phase Not applicable Skills & Experience • Please provide evidence to support each criterion below: • Experience working with and leveraging the benefits of AWS and Microsoft Azure Cloud hosted services • Experience working with Pentaho Business Analytics and/or PowerBI • Creating performant and resilient Reports and Dashboards capable of serving 1000’s of users • Automated and Performance testing of Reports and Dashboards • Designing and implementing physical data models to enable reporting requirements • Designing and building solutions fully conformant with WCAG 2.2 • Experience with dynamic, drill down and static Reports and Dashboards • Creation of Cubes to deliver performant and accurate reporting and dashboarding services • Advanced SQL skills • Experience of customer facing issue and incident resolution • Producing and maintaining technical documentation and a knowledge base • Working safely within our UK based secure engineering environments at SC level Nice to Haves • Please provide evidence to support each criterion below: • Experience building performant and resilient reports and dashboards using PowerBI • Experience with Red Hat Linux • Experience working with large databases and data lakes • Experience working with public sector organisations Work Location The base locations where the work will take place are: Trinity Bridge House 2 Dearmans Place Salford Manchester UK M3 5BS Alexander House 21 Victoria Avenue Southend on Sea UK SS99 1AA Stratford Regional Centre 14 Westfield Avenue Stratford London UK E20 1HZ Working Arrangments The supplier will be required to co-locate with existing platform teams (mixed teams comprising internal staff and other contractors) 5 days per week. No expenses will be chargeable for travel or accommodation relating to agreed base locations. Where travel is necessary outside the base locations, this will be referenced in the Statement of Works with expenses agreed in line with HMRC travel policy. Current working practices dictate that work will be undertaken remotely. The supplier will be required to work with Chief Digital Information Office (CDIO) teams nationwide. The supplier will provide upskilling to HMRC staff to increase internal capability. Security Clearance Must have BPSS before employment commences and resources come on site. Must be SC eligible. SC process can start after employment commences. Clearance costs to be met by supplier. Additional T&Cs HMRC Mandatory Terms to be added No. of Suppliers to Evaluate 4 Proposal Criteria • Shortlisted suppliers will be asked to provide Case-Study, Written Proposal and Presentation. These will be scored using a selection of Essential Criteria outlined above to be provided with Proposal Scenario. • Below outlines the expected ways of working to be evidenced: • Demonstrate how you as a supplier have been fully accountable for delivery of a project or outcome and successfully delivered to specification, time and with value for money • Demonstrate how you as a supplier have been fully accountable for operating/running a service to agreed service levels and standards • Demonstrate as a supplier how you have taken remedial action where outcomes have not been to agreed standards • Agility - delivering iteratively and incrementally within a context of evolving requirements following SCRUM and Kanban approaches • Making knowledge capture and sharing part of day to day activities • Ensuring successful handover at any required stage of a project or a service • Delivering business value – making sure business requirements are understood, validated via positive challenge and delivered against while understanding the value being generated (i.e. business intent) • Innovative thinking – think outside the set of existing organisational constraints to arrive the most appropriate and efficient route to deliver desired outcomes • MVPs (Minimum Viable Product) – effective definition and delivery of true MVPs that shorten time to delivering business value • Reusability by design – ensuring solutions are formulated from reusable capabilities as well as ensuring new capabilities are reusable • Simplicity by design – a clear focus on producing and positively challenging solutions to be as simple as possible • Design for minimising build and run costs • Responsive mobilisation – ability to resource work and start delivering in 4-5 weeks • Enough capacity to ensure supplier can cope with DPS demand, in the specified locations Cultural Fit Criteria • Demonstrate how you would support DPS in growing in-house skills and capability. • Evidence how you deliver in multi supplier environments adhering to DPS behaviours, including inclusivity and collaboration. Payment Approach Fixed price Assessment Method • Case study • Presentation Evaluation Weighting Technical competence 60% Cultural fit 10% Price 30% Questions from Suppliers 1. Under working arrangements it stats "the supplier will be required to co-locate with existing platform teams" and that "current working practices dictate that work will be undertaken remotely". Please can you advise if you are happy for the majority of the work under this contract to be undertaken remotely? Exceptional circumstances will define the need to work remotely, Business as usual conditions dictate collaborative working at specified secure sites. 2. This looks similar to a procurement initiated in January 2020 "Data Platform Services – Reporting & Dashboarding Requirements". Can you please clarify the main differences between the two services? This requirement has excluded our legacy technologies where demand is stable and met through existing contracts. Particularly on our new platforms we are seeing unprecedented demand exceeding previous estimates and need to respond to that, ensuring we have sufficient capacity and supplier diversity. 3. Please can you clarify if this is a rebid of https://www.digitalmarketplace.service.gov.uk/digital-outcomes-and-specialists/opportunities/11573 published beginning of the year and if the contract was ended early? This is not a rebid. This opportunity is in addition. 4. The questions "Creating performant and resilient Reports and Dashboards capable of serving 1000’s of users" and "Experience building performant and resilient reports and dashboards using PowerBI" are potentially similar, can you confirm PowerBI is your preferred tool for reporting or do you have others you would like to see covered? The preferable and essential criterion tool is Pentaho Business Analytics. PowerBI is a nice-to-have criterion. 5. Would you consider a proposal based on the supplier's personnel working remotely post-Covid or will you only consider teams which can work on-site in Manchester / Southend-on-Sea / East London? Exceptional circumstances will define the need to work remotely, Business as usual conditions dictate collaborative working at specified secure sites. 6. Would you consider different technology if, in our experience, we could demonstrate that you would gain far more from the solution in value, portability, performance and TCO? Currently, HMRC has its Data and Analytics vision and the roadmap to realise it. This includes a set of strategic products to use. However, DPS is open to know about various suppliers views and experience. 7. Please could the Authority explain how this requirement relates to the Digital Outcome and specialist opportunity of the same title opened and closed in April of this year, following supplier presentations. Is this an extension to those services or a new requirement? This is not a rebid. This opportunity is in addition. 8. TechUK ran an event in October providing an overview of the Technology Sourcing Programme at which HMRC provided a summary of anticipated procurements, including a number for Data & Analytics services. Please could you confirm if this procurement is part of the TSP Programme? This is not part of the TSP procurement. 9. What is the balance of the Pentaho vs PowerBI requirement and skills? As stated in the opportunity, Pentaho is an essential skill, while PowerBI is a nice to have one. 10. What is the balance of the AWS vs Azure requirement and skills? Most of the work is on AWS, while DPS is still ramping up with Azure deployments. 11. Is the solution to be on-premise or cloud based? DPS is in cloud migration journey. Every new service will be hosted on cloud. In the mean time, there are some work might be performed on the on-prem legacy estate. 12. Is the solution to be based on COTS or bespoke delivery ? DPS has a product catalogue, which is mostly a set of COTS products used to build solutions. However, in few solutions, bespoke Java component might be included in the solutions. 13. Additional information in response to question 7: Please could the Authority explain how this requirement relates to the Digital Outcome and specialist opportunity of the same title opened and closed in April of this year, following supplier presentations. Is this an extension to those services or a new requirement? This requirement has excluded our legacy technologies where demand is stable and met through existing contracts. Particularly on our new platforms we are seeing unprecedented demand exceeding previous estimates and need to respond to that, ensuring we have sufficient capacity and supplier diversity. 14. Were these services awarded to a Supplier and if so, please could the Authority confirm which Supplier? This is not a rebid. This opportunity is in addition. 15. We note that clause 34.2 states that the indemnity given in respect of a breach of clause 14 (Data Protection and Disclosure) is unlimited. Market trends however show that customers are not asking for unlimited liability and indeed CCS have agreed after consultation with suppliers to future cap liability breaches. Therefore in consideration of the new position being taken by CCS can you please confirm if you are willing to discuss a separate cap for data breach liability with the down selected supplier. The work involves accessing high volumes of data including some personal identifiable information data held within our environments. As a result all personnel with direct unsupervised access are required to hold or be able to achieve SC clearance. HMRC’s standard position in respect of Personal Data or GDPR is to require the Supplier to indemnify HMRC, without limit, against all losses, fines and/or expenses arising in connection with any breach on the part of the Supplier (or Sub-Processor) of any relevant obligations. This encompasses both GDPR regulatory fines and other potential litigation and charges arising from breaches of personal data.