Implementation, configuration and maintenance of a logical data warehousing and master data management solution for the Data Analytics Unit in the Department of Agriculture, Food and the Marine

Tender description

DAFM is a dynamic organisation that requires a multi-disciplinary LDW solution to bridge the gap between the services DAU provide and their respective existing technological data systems. The LDW solution must support compliance with ISO 127001 and GDPR legislation. The respondent is expected to define a business and technical architecture to support the DAFM statement of strategy. This architecture should provide a framework for organising the data, information management, and technology components that will be used to build the LDW and its architecture. This RFT is requesting a response to supply, implement and support the LDW system with a view to DAFM assuming day to day administration and response to the alerts in due course. Further details are contained in the Request For Tender document. Lot 1: DAFM is looking for a LDW solution that; • Houses our current data requirements in a LDW architecture including but not limited to the following components; Data Warehouse, Data Marts, Data Lake, Master Data Management, Data virtualisation/Federation/access Layer, Cloud computing (if appropriate), Named user sandboxes • Is scalable and can provide additional resources to address both the computational and data storage needs of big data analysis for the DAU. • Support conceptual, logical and physical data modelling and include graphical interface data modelling tools. • Plan, design, implement and test the ETL process into the new data platform and to provide the ETL scripts to DAFM. • Provide compute resources for high speed data analysis. A solution that can monitor and orchestrate workload either on-premise or cloud based data structures based on the proposed architecture. • Provides a data catalogue, metadata, taxonomy and a data dictionary for the LDW. Provide a searchable data/metadata catalogue and a data lineage tool. • Supports historical and real-time BI and analytics and integrates with our current BI and analytics tool set. • Has a system backup and disaster recovery regimen that integrates with the departments backup and recovery policies. • Has a robust governance and security controls that allow monitoring and regulation of access to the LDW. The solution should have the facility to leverage user authentication technologies such as Active Directory. • Can monitor data stability and create and issue alarms and alerts through the creation of incidence tickets. • Includes an auditing and reporting feature that records access to logs, data structures and system performance.