Implementation, configuration and maintenance of a logical data warehousing and master data management solution for the Data Analytics Unit in the Department of Agriculture, Food and the Marine

Tender description

DAFM is looking for a LDW solution that; • Houses our current data requirements in a LDW architecture including but not limited to the following components; Data Warehouse, Data Marts, Data Lake, Master Data Management, Data virtualisation/Federation/access Layer, Cloud computing (if appropriate), Named user sandboxes • Is scalable and can provide additional resources to address both the computational and data storage needs of big data analysis for the DAU. • Support conceptual, logical and physical data modelling and include graphical interface data modelling tools. • Plan, design, implement and test the ETL process into the new data platform and to provide the ETL scripts to DAFM. • Provide compute resources for high speed data analysis. A solution that can monitor and orchestrate workload either on-premise or cloud based data structures based on the proposed architecture. • Provides a data catalogue, metadata, taxonomy and a data dictionary for the LDW. Provide a searchable data/metadata catalogue and a data lineage tool. • Supports historical and real-time BI and analytics and integrates with our current BI and analytics tool set. • Has a system backup and disaster recovery regimen that integrates with the departments backup and recovery policies. • Has a robust governance and security controls that allow monitoring and regulation of access to the LDW. The solution should have the facility to leverage user authentication technologies such as Active Directory. • Can monitor data stability and create and issue alarms and alerts through the creation of incidence tickets. • Includes an auditing and reporting feature that records access to logs, data structures and system performance.