DATA ENGINEER (Data Science & Big Data Analytics)

EURECAT - Technology Center of Catalonia is seeking a highly motivated DATA ENGINEER for its Data Science & Big Data Analytics Technological Unit .

FUNCTIONS AND RESPONSIBILITIES OF THE JOB:

· Design and deploy data pipelines for bringing data and control metadata lineage from different source systems to a data warehousing system, including queue management and real-time data processing.

· Architect reusable software practices using state of the art orchestration systems such as Airflow or Dagster and containerization stack such as Docker or Kubernetes.

· Deploy data sharing and cataloguing existing software tools to enable Data Spaces through standard building blocks from IDSA, Gaia-X and Fiware.

· Contribute to Machine Learning projects by adopting technologies for data storing, serving and versioning capabilities from blob-Storage to traditional SQL solutions and NoSQL.

...