Job Description
We are looking for a Data Engineer to join the data platform team of a trafing company based in London.
You will work in the same team as a Lead Data Engineer already in place and focus mainly on enhancements of the data platform.
The environment is strongly cloud-oriented (AWS), with Python and PySpark at the core of all data pipelines and processing. You will help keep mission-critical trading and risk data reliable, performant, and available to users across the business.
Key Responsibilities
• Monitor and operate existing data pipelines and jobs (Python / PySpark / AWS).
• Perform bug fixes, small evolutions, and refactoring on existing codebases.
• Work closely with the Lead Data Engineer and business stakeholders to understand issues and prioritize fixes.
• Maintain documentation for pipelines, workflows, and operational procedures.
• Contribute to the development of new data ingestion and transformation pipelines in Python / PySpark on AWS.
• Impl...
You will work in the same team as a Lead Data Engineer already in place and focus mainly on enhancements of the data platform.
The environment is strongly cloud-oriented (AWS), with Python and PySpark at the core of all data pipelines and processing. You will help keep mission-critical trading and risk data reliable, performant, and available to users across the business.
Key Responsibilities
• Monitor and operate existing data pipelines and jobs (Python / PySpark / AWS).
• Perform bug fixes, small evolutions, and refactoring on existing codebases.
• Work closely with the Lead Data Engineer and business stakeholders to understand issues and prioritize fixes.
• Maintain documentation for pipelines, workflows, and operational procedures.
• Contribute to the development of new data ingestion and transformation pipelines in Python / PySpark on AWS.
• Impl...
Apply for this Position
Ready to join Darwin Partners? Click the button below to submit your application.
Submit Application