Email Alert for
ⓘ There was an unexpected error processing your request.
Please refresh the page and try again.
If the problem persists, please contact us with your issue.
You can always manage your preferences and update your interests to ensure you receive the most relevant opportunities.
Get ready to discover your next great opportunity.
Ventula Consulting
London
Job DescriptionSenior Data Engineer contract - Snowflake / Python - Greenfield - £650 per day insideLeading eCommerce client are now searching for a Senior Data Engineer to play a pivotal role in delivering their new greenfield data platform.This role will shape our client’s data function, delivering end to end data requirements and designing data
Job Source: Ventula ConsultingOliver Bernard
London
Job Description JVM / Data Engineer - Permanent Looking for a Senior JVM/Data Engineer to work on a new project at a Fintech client of ours. Ideally looking for a Java or Kotlin Developer who has a strong understanding in the Data Engineering space. Client - Fintech Stack - Java, Kotlin, Python, Airflow, Snowflake, Terraform, Spark, AWS. 1
Job Source: Oliver BernardBurns Sheehan
London
Job DescriptionSenior Data Engineer💰 £85,000-£100,000🖥️ AWS, Python, Docker🌍 London, 3 days a week in officeWe are exclusively partnered with a high growth, early stage startup operating in the beauty and wellness industry (in the UK and now US!) and supporting them on their search for a Senior Data Engineer.The role...As the company's 1st Data
Job Source: Burns SheehanAmicus
London
Job DescriptionSenior Data Platform Engineer – Python / AWS / Snowflake – Remote (UK) OR London I am partnered with an European BioTech start-up having recently secured the next round of funding they are looking to expand their Engineering steam with addition of multiple mid-Senior engineers.CompanyThe business specialises in building tools and sys
Job Source: AmicusOho Group Ltd
London
Job DescriptionA leading MediaTech is seeking a Senior Data Engineer to join their growing team!Onsite in their swish London officeDesign and building complex pipelines using SnowflakePython and JavaScript development Advancing Machine Learning across AWS and Azure platformsWorking alongside senior stakeholders and Data ScientistsThis is a great op
Job Source: Oho Group LtdDatatech Analytics
London
Job DescriptionSenior Data EngineerSalary Negotiable to £70,000 DoEHybrid working with 2 days in LondonJob Reference J12785Work with an award-winning independent protection adviser. Develop the data engineering capabilities. Data is a key enabler for the business and developing enterprise grade data engineering services is a central pillar in the d
Job Source: Datatech AnalyticsData Idols
London
Job DescriptionSenior Data EngineerSalary: up to £85,000Location: London (Hybrid)Data Idols are working with an exciting scale-up revolutionising delivery logistics and moving items across the UK with efficiency and ease all whilst cutting emissions. Trusted by millions of customers already they are expanding their data team to manage increased vol
Job Source: Data IdolsHarrington Starr
London
Job Description Senior Data Engineer AWS / Bedrock / Glue / EKS / Redshift Contract - Inside - London Harrington Starr have partnered exclusively with a long-standing client of ours within the commodities trading space who are looking to increase headcount within their Data Engineering team at the start of the year here with 2024. The role wi
Job Source: Harrington StarrLondon
Job Description Senior Data Engineer
About us
HENI is a technology company pioneering art markets and information. We work with world-leading artists and estates across various sectors, including printmaking, book publishing, NFTs, digital content, and art research – all underpinned by cutting-edge research in analytics, AI, and machine learning.
Our team comprises of talented web developers, data engineers, data scientists, and infrastructure specialists who thrive on solving complex problems. We enjoy developing machine learning tools and embracing the latest in infrastructure and coding methodologies. We maintain high standards of technical quality via thorough testing and a dedication to clean, efficient code.
HENI’s mission is to make art accessible to everyone, by giving people the chance to learn about and collect art. We want to inspire people to love art and we pride ourselves on broadening people’s mindsets, to look at things from different perspectives. Many of our projects and commercial decisions are driven by this innovative collection of art market data.
Role overview
We are seeking a highly skilled and experienced Senior Data Engineer. You would be joining a strong team of roughly 20 people (software and data engineers, data scientists, analysts), in a fast-paced and collaborative environment.
You will be designing and building robust data pipelines – using the best of open-source data engineering and scientific Python toolset. Our tech stack includes Airbyte for data ingestion, Prefect for pipeline orchestration, AWS Glue for managed ETL, along with Pandas and PySpark for pipeline logic implementation. We utilize Delta Lake and PostgreSQL for data storage, emphasizing the importance of data integrity and version control in our workflows. Day-to-day, you will collaborate with the team via daily stand ups, as well as engage with stakeholders at various levels across the business.
We are open to the role being remote working, however we would prefer candidates who could accommodate hybrid working i.e. 2-3 days a week in the London office.
Responsibilities include:
Design, test, implement, and maintain scalable and secure data pipelines.
Ensure high levels of data availability and good data quality.
Monitor and optimise pipelines, to ensure high performance and minimal downtime.
Collaboratively develop adaptable data models with different teams, proactively adapting to suit evolving business needs.
Collaborate with data scientists and analytics teams to gather requirements, ingest, process, transform and aggregate data at scale.
Mentor other data engineers and team members on best practices in data engineering.
The Ideal Candidate Profile:
A minimum of 5 years of experience.
A proven track record of deploying, monitoring, and maintaining production data pipelines, with a commitment to best practices in data engineering including operational metrics and observability.
Strong foundation in data engineering principles, with a particular focus on data quality and implementing data quality testing frameworks.
Proficiency in Python and familiarity with modern software engineering practices, including 12factor, CI/CD, and Agile methodologies.
Deep understanding of Spark (PySpark), Python (Pandas), orchestration software (e.g. Airflow, Prefect) and databases, data lakes and data warehouses.
Experience with cloud technologies, particularly AWS Cloud services, with a particular focus on using AWS Glue, S3, RDS and AWS Lambda.
Experience in implementing Infrastructure as Code (e.g. AWS Cloud Development Kit (CDK), Terraform, Ansible).
Familiarity with container technologies such as Docker, including the basics of building, managing, and optimizing containers.
Knowledge of Kubernetes is a plus i.e. understanding containerized workflows and Kubernetes operations, through practical experience in developing, packaging, deploying, and managing applications within Kubernetes environments.
Strong qualifications in computing or quantitative fields (such as a First-Class Bachelor’s Degree) would be advantageous.
What We Offer
Unique approach and insights into data in creative industries.
A dynamic and challenging work environment with opportunities for growth and development.
A culture of innovation and continuous learning.
Flexible working hours and remote work options.
Open-plan and modern office located in central London.
Competitive salary and benefits package.
How to Apply
Please submit your CV which includes a link to your GitHub profile, and any relevant open-source contributions to illustrate your background. If you have any questions, you can contact us via [email protected]
Email Alert for Senior Data Engineer jobs in London
ⓘ There was an unexpected error processing your request.
Please refresh the page and try again.
If the problem persists, please contact us with your issue.
You can always manage your preferences and update your interests to ensure you receive the most relevant opportunities.
Get ready to discover your next great opportunity.