Senior Data Engineer - Java, Storm, Spark Permanent
- Location: London, England
- Salary: £90000 - £100000 per annum
- Sector: Big Data and Analytics (including business intelligence)
- Consultant: Matthew Dixie
With significant & long term backing they're building a truly disruptive, and exciting proprietary technology they're currently looking for a talented Senior Data Engineer - Java, Storm, Spark.
The Senior Data Engineer - Java, Storm, Spark will work closely alongside an exceptional data science team and will be responsible for creating new data flows, as well as maintaining, extending, and possibly rewriting existing flows to improve robustness, scalability, and efficiency.
Key experience required:
* Extensive Data Engineering experience building and supporting data pipelines.
*Highly competent in SQL, NoSQL and at least two of the following programming languages: Java, Python, or Scala.
*Experience with data processing frameworks such as: Storm, Spark (2.x, Databricks, EMR, Glue) etc.
*Experience of data processing on cloud providers such as AWS. You will have reasonable levels of spoken and written English.
*Knowledge of Docker and containerisation.
Propel are the UK's largest independent provider of permanent and contract recruitment services to the global digital economy, specialising in commercial, marketing, technical and creative talent.
Services advertised by Propel are those of an Agency and/or an Employment Business. Please be aware that we receive a high volume of applications for our roles, many from people who meet or exceed the requirements. Whilst we try to respond to as many applicants as possible, you can assume that you have not been selected for interview if you do not hear from us within 14 days.