0 Jobs

Job Shortlist

Apply to these jobs


Senior Data Engineer

  • Data

  • London, UK

  • £70,000 - £80,000

  • Permanent

Apply now

Recruiting this role:

Jordan Frost

Jordan Frost

Senior Data Engineer

Package: £70,000-£80,000 + 10% bonus

Tech: Python - AWS - Data Streaming - DataOps

Working: Hybrid Working (1 day a week in office)

building their next-generation e-commerce platform. The Data Team is looking for talented engineers to help create solutions that drive data driven decisions (for business stakeholders and customers alike), build robust and scalable platforms, and champion our data-driven way of working.

A few facts and insight into the business:

* Ship to over 170 countries around the world.

* Millions of people visit the site each month.

* Site typically takes between 1 and 5 million GBP in sales a day.

* Products sold range from less than £10 to over £40,000.

* The engineering team has doubled in the last two years.

The Role

You will deliver elements of the intelligence automation driving personalisation, merchandising and planning, as well contribute to enhancements of the data lake, streaming services and various other data services based on a big data platform, within AWS, using Databricks as the core transformation platform.

The initial focus will be to iterate the data pipelines into and out of the data lake as well as establishing a streaming platform to support a Kappa architecture. You will be passionate about good software engineering principles and development standards and there is opportunity to additionally work on maturing the API layer using Python.

A good level of understanding of software testing and automation is also key as TDD, BDD and CI/CD are applied to ensure a high standard of code quality and to deploy frequently. You will work directly alongside other data engineers, ML engineers, data scientists, product managers and software engineers in other departments to help us gradually embed intelligence into all of our business processes and customer journeys.


* You are a passionate and expert Data Engineer using Scala, Spark, Java or Python.

* Highly familiar with either the AWS technology set or other major cloud platforms.

* Good working experience of either data lakes and warehouses or data streaming or both, with an appetite to learn the other if appropriate.

* Comfortable with containerisation, in particular Docker and Kubernetes.

* Experience with REST web services and APIs.

* Experience of CI/CD principles and DevOps methods.

* Experience and knowledge of test automation including TDD and BDD.

* Good working experience of Python frameworks FastApi, Flask or Django would be an advantage.

Data & Engineering

Writing and managing software is complex. A portion of time is scheduled to remove tech debt and for personal development. There are regular lunch 'n learn sessions to encourage knowledge-sharing and growth, and investment is made in the teams by providing access to professional training and certifications.

The cross-functional engineering teams work with product managers and stakeholders to deliver high-value, strategic work. Regular lightweight agile ceremonies keep teams aligned and provide opportunities to challenge assumptions.

The company leadership behaviours are integral to everyday roles and allow ALL staff to "act like owners" and make decisions at every level of the organisation. In engineering, this means teams have the autonomy to demonstrate creativity and innovation around solutions.

To be considered for this Senior Data Engineering role please apply as soon as possible

Senior Data Engineer

Package: £70,000-£80,000 + 10% bonus

Tech: Python - AWS - Data Streaming - DataOps

Working: Hybrid Working (1 day a week in office)

Burns Sheehan Ltd will consider applications based only on skills and ability and will not discriminate on any grounds.

Apply now

Apply for this Job

UploadAttach a CV

To find out about how we process your data, please read our privacy policy.


Similar open positions