Job Description
- Develop, deploy and manage data pipelines following CI/CD practices
- Orchestrate data pipelines with tools such as Airflow, Oozie, Azure Data Factory, etc.
- Develop Python scripts or Scala code for data processing
- Collect and analyse pipeline requirements
- Consult about best architectural and design principles in developing pipelines
- A degree in Statistics, Computer Science or Telecommunication Engineering, Informatics or related degree.
- Proven experience with Python or Scala
- Experience with orchestration tools like Airflow or Oozie
- Ability to use CI/CD & DevOps tools such as Git, AWS CI/CD Pipelines, Azure DevOps, etc.
- Knowledge on SQL
- KNIME knowledge is nice to have
- Ability in solutioning covering data ingestion, data cleansing, ETL, data mart creation and exposing data for consumers.
- Technology expertise of solutioning ...
Apply for this Position
Ready to join Synvert? Click the button below to submit your application.
Submit Application