Big Data Developer

Tender description

Who Speclialist Work With Specialist will be part of data architecture team working closely with the Enterprise Data Architect. Specialist will be required to work with multiple development teams and existing vendor to understand legacy and new data structures, develop migration routines, and perform data migration activities to migrate data from Oracle to Big Data Platform. What Specialists Work On Specialist required to work in the data migration team to identify source data requirements, assess data quality, map and specify the required transformations from the source to the target data, validate and perform trial data migration in production, cleanse data, and conduct a post implementation review of the data migration. Where the Work Takes Place Westminster,Victoria Early Market Engagement Working Arrangements We expect the specialist to work collaboratively with existing in house project teams that are transforming the HMPO business processes/applications. Service design and development must align with the HM Passport Office strategic technical architecture and technologies. There may be an occasional need to attend our other office in Central London (Petty France). No travel expenses will be paid for this purpose. Expenses for any exceptional travel authorised outside of Central London will fall under the Standard Government Terms and Conditions for Expenses as covered in the DOS Contract. Work Location Westminster,Victoria Security Clearance DV (Developed Vetting) clearance is required Additional T&Cs We expect this engagement to be outside IR35, however status is assessed on a case-by-case basis. Standard Government Terms and Conditions for Expenses as covered in the DOS Contract. Skills & Experience Have demonstrable experience of successfully designing and implementing data migration, data transformation, data quality, modelling, testing and post production reviews. Have demonstrable experience of mapping source and target data models, identify gaps, data cleansing, schema modelling (Relational/XML/JSON). Have demonstrable experience of successfully delivering digital solutions that collect and manage personal and/or sensitive information with appropriate controls and protection. Have demonstrable hands-on experience of Kafka, Big Data, Hadoop, HBase, Map Reduce, Storm, Java, JMS. Nice to Haves Have demonstrable experience of successfully and collaboratively working, coaching and sharing knowledge with Public Sector client teams, particularly those with limited agile development experience. Have demonstrable experience of successfully design, implementation and migration of relational databases to Big data based data stores utilising Amazon AWS. Have demonstrable hands-on experience using ETL, JMS, Apache Nifi, HDF, SAM. Have exisiting, valid DV Clearance No. of Specialists to Evaluate 3 Cultural Fit Criteria Be transparent and collaborative when making decisions. Take responsibility for their work. Can work with clients with low technical expertise. Able to work within HMPO design, delivery and governance framework. Assessment Method Evaluation Weighting Technical competence 60% Cultural fit 15% Price 25% Questions from Suppliers Budget range