Senior Data Engineer (Python, Databricks)

London

Hybrid (3/2 split)

6-month contract

£500 - £900 per day (via Umbrella)

cer Financial are working alongside an international bank who are looking for an experienced Senior Data Engineer to join their team on an initial 6-month contract . This is a hybrid role , requiring 3 days per week in the office.

Responsibilities:

1. Design, build and optimise scalable data pipelines using Python and Databricks.
2. Develop ETL/ELT workflows with Spark and Delta Lake.
3. Build and maintain Lakehouse data models and architectures.
4. Ensure data quality, governance and platform reliability.
5. Optimise large-scale data processing and support analytics and ML initiatives.
6. Mentor junior engineers and promote engineering best practices.

What the candidate needs:

1. 10+ years' experience in Data Engineering.
2. Strong Python and Databricks expertise, including Spark/PySpark and Delta Lake.
3. Experience building scalable ETL pipelines and working with SQL.
4. Knowledge of cloud platforms (AWS, Azure or GCP).
5. Experience with modern data warehouses such as Snowflake, Redshift or BigQuery.
6. Familiarity with Airflow or Databricks Workflows.
7. Databricks certifications and experience with Kafka, Docker, Kubernetes or CI/CD are advantageous.