DWP Dataworks Developer (Senior Data Engineer)

Tender description

Summary of the work Working as part of a multidisciplinary agile team, they will identify, build, modify and manage data flows between complex systems. These data flows must make use of open source technologies, be maintainable and be delivered in a timely fashion. Strong collaboration across disciplines is a must. Specialist role Developer Expected Contract Length This will be a two year contract with an initial Statement of Works for up to 2 months Latest start date Monday 24 July 2017 Maximum Day Rate The maximum rate DWP is willing to pay is £870 which is exclusive of VAT and reasonable and agreed expenses up to a cap of £90 per day. The day rate will be evaluated as per the evaluation criteria %. Who Speclialist Work With Working as part of a multidisciplinary agile team maintaining and improving the Universal Credit Data Platform, they’ll work with Network Architects, Technical Architects, Data Engineers, DevOps Engineers and Business Analysts within the team. They will also liaise with the Users of the platform to ensure their needs are considered as the platform develops. What Specialists Work On They will identify, build, modify and manage data flows between complex systems using the appropriate solution. They will lead the design and implementation of a data streaming service, API's to expose data to our users and their systems. Use their Big Data knowledge to optimise the current platform to ensure it is working efficiently as possible. Manage code versioning using Git. Work in an agile environment following a prioritised backlog. Skills & Experience • Designs, write and iterate code from prototype to production-ready. Understands security, accessibility and version control. Can use a range of coding tools and languages. • Has led the introduction of a data stream service based on Java, Scala or python. • Optimises the code to ensure processes perform optimally • Has knowledge of specific technologies Hadoop, Flume, Sqoop, Map Reduce, Hive/Impala, Hbase, Kafka, Spark Streaming, experience with ETL tools incorporating Big Data (like Informatica, Talend etc...), Shell Scripting, Python • Has a demonstrable understanding of how to expose data from systems (for example, through APIs), link data from multiple systems and deliver streaming services. • Data Manipulation (SQL/No-SQL) • DevOps (GitHub, Ansible, Continuous Integration, Test Driven Deployment) • Produces data models and understands where to use different types of data models. Able to reverse engineer a data model from a live system. Work Location One Leeds City Office Park Meadow Lane Leeds LS11 5BD Working Arrangments 5 days a week with minimum 3 days on-site in Leeds working as part of a multi-disciplinary agile delivery team with work being specified by a work management system (JIRA). You will attend daily stand-ups and relevant show & tells to monitor/discuss progress. Security Clearance Security Check (SC) Additional T&Cs Additional DWP Terms and Conditions will apply. No. of Specialists to Evaluate 3 Cultural Fit Criteria • Work as a team with our organisation and other suppliers • Be transparent and collaborative when making decisions • Have a no-blame culture and encourage people to learn from their mistakes • Share knowledge and experience with other team members • Challenge the status quo Evaluation Weighting Technical competence 70% Cultural fit 10% Price 20% Questions from Suppliers 1. Will the role fall within IR35 legislation? At this time the role has been deemed as outside of IR35 however, should the features of the engagement change, a further assessment will be made which could change the determination. 2. It states: Additional DWP Terms and Conditions will apply. Please could you confirm if the T&Cs are available to suppliers? DWP additional terms and conditions are specified on our e-procurement system Bravo. https://dwp.bravosolution.co.uk/web/login.shtml 3. With regards to the T&Cs on the DWP bravo portal, it is not clear where these are available to download. Please could you confirm where we can find them? If you go to the Bravo homepage and click the hyperlink to go to the 'view current opportunities' page, you'll be able to find this position listed there. If you then click on it and scroll down, you'll find the additional T&Cs attached at the bottom. https://dwp.bravosolution.co.uk/web/login.shtml 4. Does the resource needs to be eligible for SC clearance which would be processed by DWP once the resource joins (Supplier will ensure they are BPSS cleared) OR the resource being proposed must be SC cleared before the work start date? Preference is for SC clearance to be in place and this will be used when scoring submissions. BPSS cleared only are not excluded from applying and we will sponsor clearance for a successful candidate. 5. Will you sponsor the clearance? Preference is for SC clearance to be in place and this will be used when scoring submissions. BPSS cleared only are not excluded from applying and we will sponsor clearance for a successful candidate. 6. Can a candidate with DV clearance be considered for this role? Yes. 7. What is the lead time for feedback once the application is submitted? We will attempt to give feedback as quickly as we are able to. 8. Can more than one candidate per supplier be submitted for this role? No, in line with the framework, we are unable to accept more than one candidate per a supplier for each role advertised. 9. Any chances of change in start date? No. 10. What are the other expenses which will be paid? Reasonable travel and subsistence up to a limit of £90 per day. 11. Any specific format (pdf,doc) in which CVs are to be sent later? The shortlisted suppliers will be sent a Work History template to be completed. 12. Is occasional remote working allowed? Yes, as per working arrangements:5 days a week with minimum 3 days on-site in Leeds working as part of a multi-disciplinary agile delivery team with work being specified by a work management system (JIRA). 13. What is the total number for positions open for this role? One. 14. Is there any travel involved in this role and will the travel expenses be paid? Base office is Leeds with additional travel to other DWP offices particularly London. Reasonable travel expenses will be paid. 15. Would you consider work permit holders (e.g. Tier 2 General Visa) and EU passport holders for this role ? Yes.