Data Engineer

Senior Data Engineer (Databricks) – Fully Remote – £80,000 to £120,000

Do you want to work with a cutting-edge fresh company revitalising the tech environment? Want to collaborate with a global team of professionals all experts in their respective fields?
Then look no further, if you’re a skilled data engineer with strong background working with Databricks then we have the opportunity for you!
We are on the hunt for a senior data professional to join our client operating in the Blockchain space, actively looking to add to their diverse team. Ideally looking for a candidate who had previously worked on a data lake project and built pipelines to fill it with raw data. You would be responsible for the architecture, design and development associated.
This is a fully remote role with the opportunity to work remotely from almost anywhere within Europe and the UK.

Required Experience with the following:

* Databricks
* Spark Streaming
* Data transformation solution design and development with both batch and streaming data sources
* Development of ETL (Extract, Transform, Load) pipelines with Python and SQL
* Development of CI/CD (Continuous Integration & Continuous Deployment) pipelines using GitHub Actions and JavaScript
* Traditional ETL tools
* Spark and MapReduce
* Cloud-native tooling for AWS
* Apache Hadoop, Cloudera, HortonWorks, HDInsight etc.
* Apache Big Data products such as Hive, Impala, Oozie etc.
* Apache Atlas or an equivalent
* Spark, Python or Nifi
* Infosphere Data Architect, Erwin, or equivalents
* Understanding of GDPR and DPA (Data Protection Act)
* Agile and Waterfall delivery processes

stream is acting as an Employment Agency in relation to this vacancy.

Okay

We use cookies to improve your experience on our site find out more

As part of our evolution we are undergoing a visual transformation and adopting a new name (Insignis) but rest assured, we will still be offering the same exceptional recruitment expertise.
As part of our evolution we are undergoing a visual transformation and adopting a new name (Insignis) but rest assured, we will still be offering the same exceptional recruitment expertise.
powered by bulletin