Data Engineer

Job Description
- Maintain, upgrade, and evolve data pipeline architectures to ensure optimal performance and scalability.
- Orchestrate the integration of new data sources into existing pipelines for further processing and analysis.
- Keep documentation up to date for pipelines and data feeds to facilitate smooth operations and collaboration within the team.
- Collaborate with cross-functional teams to understand data requirements and optimize pipeline performance accordingly.
- Troubleshoot and resolve any issues related to pipeline architecture and data processing.
- Role Requirements and Qualifications:
- Experience with cloud platforms for deployment and management of data pipelines.
- Familiarity with AWS / Azure for efficient data processing workflows.
- Experience with constructing FAIR data products is highly desirable.
- Basic understanding of computational clusters to optimize pipeline performance.
- Prior experience in data engineering or op...