Borders Data Engineer

Tender description

Summary of the work The role is for a Data Engineer to work on the continuing design, build, commission and test a big data platform for a Home Office department. Specialist role Developer Expected Contract Length Up to 2 years Latest start date Thursday 31 August 2017 Maximum Day Rate Maximum day rate of up to £800. Early Market Engagement N A Who Speclialist Work With Home Office Civil Servants, other government Civil Servants, other contractors and suppliers. What Specialists Work On The developer will need to be an SME in: Hadoop / HDFS, HBase, Kafka, Kerberos, Drools, Graph DBs, Big data architecture, Real time data processing, Spark, Storm, Solr, Java 8, Algorithms, Data Science, Systems Engineering, ZooKeeper, Spring / Spring Boot and spring data rest, REST, TDD , BDD (specifically Cucumber), Microservices architecture, GitHub / GitLab, use of branching and merging strategies, Clean code Skills & Experience • • Hadoop / HDFS • • HBase, Kafka, Kerberos, Drools • • Graph DBs • • Big data architecture, Real time data processing, Spark, Storm • • Solr • • Java 8, Algorithms, Data Science, Systems Engineering • • ZooKeeper • • Spring / Spring Boot and spring data rest • • REST • • TDD • • BDD (specifically Cucumber) • • Microservices architecture • Fluent in English and have good communication skills • Scrum Team Working Experience • Familiar with CI development techniques and environments. Nice to Haves • • Postgres • • Apache Camel, Knox, Ranger • • Enterprise Integration Patterns • • Kubernetes • • Docker • • Ansible, Terraform • • JIRA • • Confluence Work Location Lunar House, Croydon. Working Arrangments The Developer should be physically on site Monday – Friday. Approximate hours are 09:00 – 18:00. Specialists will work primarily on-site with teams as required and report to management on site. Specialists are expected to work across the multiple sites as required. Expenses will conform to HO internal policies and will not be payable to Westminster, Croydon, or Heathrow. Security Clearance Security clearance of Security Check (SC) is required. Additional T&Cs Essential skills and experience – bullet points : • Hadoop / HDFS • HBase, Kafka, Kerberos, Drools • Graph DBs • Big data architecture, Real time data processing, Spark, Storm • Solr • Java 8, Algorithms, Data Science, Systems Engineering • ZooKeeper • Spring / Spring Boot and spring data rest • REST • TDD • BDD (specifically Cucumber) • Microservices architecture * Fluent in English and good communicator They must have experience working within a Scrum team and be familiar with CI development techniques and environments. The role is outside scope of IR35 No. of Specialists to Evaluate 5 Cultural Fit Criteria • Work well in a team within our organisation. • Mentor members of the team. • Transparent and collaborative when making decisions. • Have a flexible attitude and temperament. • A no-blame culture and encourage people to learn from their mistakes. Evaluation Weighting Technical competence 70% Cultural fit 10% Price 20% Questions from Suppliers 1. Can you please confirm whether the role is inside or outside of IR35? The role is outside scope of IR35 2. A supplier has asked a question about ‘Borders Data Engineer’.They asked:Is there currently, or has there recently been, an incumbent carrying out similar work for the Authority yes 3. A supplier has asked a question about ‘Borders Data Engineer’.They asked:Do applicants require experience in all of the essential skills or is there flexibility All essential. Hence essential 4. A supplier has asked a question about ‘Borders Data Engineer’.They asked:What is the size of the development team that they will be part of? We have a number of small multi-disciplined teams that are around 8 – 10 strong 5. A supplier has asked a question about ‘Borders Data Engineer’.They asked:What is the earliest date someone can start? Date of contract award – but dependent on security clearance 6. We are very keen to supply personnel but we feel it is unrealistic to find all of these skills in one person. I would like to get your opinion on why you think this is achievable or have i misunderstood? Essential skills experience – • Hadoop / HDFS • HBase, Kafka, Kerberos, Drools • Graph DBs • Big data architecture, Real time data processing, Spark, Storm • Solr • Java 8, Algorithms, Data Science, Systems Engineering • ZooKeeper • Spring / Spring Boot and spring data rest • REST • TDD • BDD (specifically Cucumber) • Microservices architecture We understand this will be difficult, but this is our requirement