Software Developer

Job Advertisement: Software Developer / Senior Data Engineer

Location: London
Contract Length: 12 Months
Daily Rate: £700 (Umbrella)

Are you ready to be part of a transformative journey? Our client is embarking on a major enterprise-wide data platform transformation, and they need a talented Software Developer / Senior Data Engineer to join their dynamic team!

About the Role:

You will play a pivotal role in designing and building a state-of-the-art data platform that consolidates data from various business areas into a centralised environment for reporting, analytics, and business consumption. This is your opportunity to contribute significantly as the project progresses towards crucial go-live milestones between March and June 2027!

Key Responsibilities:

• Design & Build: Create and maintain scalable data pipelines using Python and SQL.


• Optimise Solutions: Develop, optimise, and support enterprise data platform solutions.


• Data Integration: Build and manage data ingestion, transformation, and integration processes.


• Infrastructure Management: Create and maintain data models, tables, and supporting infrastructure within Databricks and associated data lake/lakehouse environments.


• Business Logic Development: Implement business logic, calculations, and data processing solutions using Python.


• Collaboration: Work closely with business stakeholders and engineering teams to deliver high-quality data assets.


• Quality Assurance: Ensure data quality, performance, scalability, and governance standards are met.


• Documentation: Produce technical documentation, architecture artefacts, and data flow specifications.


• Performance Improvement: Identify and resolve performance bottlenecks across pipelines and processing workflows.

Required Skills & Experience:

Essential:

• Strong commercial experience in Python development.


• Proficient in SQL, including query optimisation and data modelling.


• Hands-on experience with Databricks.


• Proven track record in designing and building enterprise data platforms.


• Experience in developing ETL/ELT pipelines and data integration solutions.


• Strong understanding of data lakes and lakehouse architectures.


• Experience working with large-scale datasets and modern data engineering practises.


• Ability to design and deliver end-to-end data solutions.


• Strong analytical and problem-solving skills.


• Excellent stakeholder management and communication skills.

Highly Desirable:

• Experience with Spark / PySpark.


• Familiarity with Azure Data Lake, Snowflake, or similar platforms.


• Knowledge of orchestration tools like Airflow or Azure Data Factory.


• Exposure to financial services environments.


• Experience supporting large-scale data transformation or migration programmes.

What We're Looking For:

• A senior-level contractor who can hit the ground running.


• Someone comfortable working autonomously with minimal oversight.


• Proven experience in delivering long-term contract engagements (12 months or longer).


• Strong interpersonal skills with a team-oriented approach.


• Immediate availability or able to start quickly.

Key Deliverables:

• Delivery of scalable, reliable, and performant data pipelines.


• Development of robust data models and platform structures.


• Successful implementation of data engineering solutions that support the enterprise data platform.


• High-quality data assets for reporting, analytics, and business consumption.


• Contribution to platform go-live milestones between March and June 2027.

Join our client and be part of something big! If you are ready to take on a challenging and rewarding role, we want to hear from you! Apply now and help shape the future of data!