Data Engineer (Airflow) in London

Our client are seeking a Data Engineer to join their Data & Insights team.

They are seeking someone with Airflow experience and experience developing big data cloud platforms.

This position can be remote (within the UK) or hybrid (2 days a week) in London or Portsmouth.

Overview:

You'll work alongside our team of Data Engineers, Data Scientists and Data Analysts to support with the development of an AWS state of the art data platform. You'll be focused on developing new data models, core data sets, data extractions, transformations and loading processes. You'll support with the existing processes and own data quality for various functions, implement new data integrations and write custom plugins in Airflow. Additionally, you'll own and maintain the data architecture elements and its performance and security as well as manage SLAs for key data set.

Skills/Experience:

• Previous experience in a similar Data Engineer role developing big data cloud platform.
• Hands on experience with Python, AWS (or other cloud platform), S3, Airflow, SQL, Presto, Hive and NoSQL database.
• Experienced in writing complex SQL statements and data transformations in SQL.
• Business acumen.
• Ideally from a Software Engineer, Business Intelligence or Data Analyst background.

Disclaimer

This vacancy is being advertised by either Advanced Resource Managers Limited, Advanced Resource Managers IT Limited or Advanced Resource Managers Engineering Limited ("ARM"). ARM is a specialist talent acquisition and management consultancy. We provide technical contingency recruitment and a portfolio of more complex resource solutions. Our specialist recruitment divisions cover the entire technical arena, including some of the most economically and strategically important industries in the UK and the world today. We will never send your CV without your permission.