Borders Senior Data Engineer

Tender description

Summary of the work The role is for a Data Engineer to work on the continuing design, build, commission and test a big data platform for a Home Office department. Specialist role Developer Expected Contract Length Up to 2 years Latest start date Thursday 31 August 2017 Maximum Day Rate Maximum day rate of up to £900. Early Market Engagement N A Who Speclialist Work With Home Office Civil Servants, other government Civil Servants, other contractors and suppliers. What Specialists Work On The developer will need to be an SME in: Hadoop / HDFS, HBase, Kafka, Kerberos, Drools, Graph DBs, Big data architecture, Real time data processing, Spark, Storm, Solr, Java 8, Algorithms, Data Science, Systems Engineering, ZooKeeper, Spring / Spring Boot and spring data rest, REST, TDD , BDD (specifically Cucumber), Microservices architecture, GitHub / GitLab, use of branching and merging strategies, Clean code Skills & Experience • • Hadoop / HDFS • • HBase, Kafka, Kerberos, Drools • • Graph DBs • • Big data architecture, Real time data processing, Spark, Storm • • Solr • • Java 8, Algorithms, Data Science, Systems Engineering • • ZooKeeper • • Spring / Spring Boot and spring data rest • • REST • • TDD • • BDD (specifically Cucumber) • • Microservices architecture • Fluent in English and have good communication skills • Scrum Team Working Experience • Familiar with CI development techniques and environments. Nice to Haves • • Postgres • • Apache Camel, Knox, Ranger • • Enterprise Integration Patterns • • Kubernetes • • Docker • • Ansible, Terraform • • JIRA • • Confluence Work Location Lunar House, Croydon. Working Arrangments The Developer should be physically on site Monday – Friday. Approximate hours are 09:00 – 18:00. Specialists will work primarily on-site with teams as required and report to management on site. Specialists are expected to work across the multiple sites as required. Expenses will conform to HO internal policies and will not be payable to Westminster, Croydon, or Heathrow. Security Clearance Security clearance of Security Check (SC) is required. Additional T&Cs Essential skills and experience – bullet points : • Hadoop / HDFS • HBase, Kafka, Kerberos, Drools • Graph DBs • Big data architecture, Real time data processing, Spark, Storm • Solr • Java 8, Algorithms, Data Science, Systems Engineering • ZooKeeper • Spring / Spring Boot and spring data rest • REST • TDD • BDD (specifically Cucumber) • Microservices architecture * Fluent in English and good communicator They must have experience working within a Scrum team and be familiar with CI development techniques and environments. The role is outside scope of IR35 No. of Specialists to Evaluate 5 Cultural Fit Criteria • Work well in a team within our organisation. • Mentor members of the team. • Transparent and collaborative when making decisions. • Have a flexible attitude and temperament. • A no-blame culture and encourage people to learn from their mistakes. Evaluation Weighting Technical competence 70% Cultural fit 10% Price 20% Questions from Suppliers 1. A supplier has asked a question about ‘Borders Senior Data Engineer’.They asked:Do you have an opinion on whether this will fall inside or outside IR35 and would you allow substitution? The role is outside scope of IR35 2. A supplier has asked a question about ‘Borders Senior Data Engineer’.They asked:Is this role to replace a resource that is leaving the project or for an additional head to join an already ongoing project? Both or either. It depends on the precise skill set of the successful bidder there are opportunities to restructure teams around key roles 3. A supplier has asked a question about ‘Borders Senior Data Engineer’.They asked:Would it be possible to submit a candidate above the Suppliers max rate ? as the max rate that was set by the supplier is a lot lower than the budget rate and market rate. yes 4. A supplier has asked a question about ‘Borders Senior Data Engineer’.They asked:Would it be possible to submit a candidate above the Suppliers max rate ? as the max rate that was set by the supplier is a lot lower than the budget rate and market rate. yes 5. A supplier has asked a question about ‘Borders Senior Data Engineer’.They asked:Could you please let us know - 1. Maximum number of applications that we could submit for this role. 2. Date on which feedback would be provided for the applications submitted One application only per resource. Feedback will be issues as soon as possible – date will depend on the volume of bidders 6. A supplier has asked a question about ‘Borders Senior Data Engineer’.They asked:Can you sponsor SC Clearance? The SC process is the same for everyone and is not ‘sponsored’ as such. The HO would undertake the management of the process. 7. A supplier x2 has asked a question about ‘Borders Senior Data Engineer’.They asked:Will candidates who are sc eligible be considered? Or must they already have valid SC clearance? Eligibility fine 8. A supplier has asked a question about ‘Borders Senior Data Engineer’.They asked:Is there a Technical Architect already in place for this team No 9. A supplier has asked a question about ‘Borders Senior Data Engineer’.They asked:Will the Home Office be happy to reactivate a lapsed SC (i.e not used in last 12 months but effective until 2022) Clearances expire if they are not used in 12 months so this requires a new application