Expert Algorithm Data Engineer - Marketplace Intelligence & Data

Expert Algorithm Data Engineer – Marketplace Intelligence & Data

Join Shopee’s Marketplace Intelligence and Data Team to build data and intelligence products powering the company’s growth. The Algorithm Data Engineering team is the most reliable data partner for algorithm development, delivering efficient, high‑quality data services and transforming data into commercial value.

Responsibilities

• Develop and maintain a unified feature platform and feature store, ensuring online/offline feature consistency, real‑time processing, and high availability.
• Design high‑performance, low‑latency offline and real‑time datasets for training, evaluation, and inference of models, optimizing data pipelines and ETL processes.
• Build core data pipelines for algorithm experimentation, providing end‑to‑end support from data preparation, configuration, runtime monitoring to metrics analysis and result evaluation.
• Extract high‑value user profiles, product tags, and relationship graphs from massive behavioral data to enable algorithm performance and business strategy.
• Continuously improve data architecture, including real‑time processing, batch‑stream systems, multimodal data processing, and compute resource optimization, maintaining a cutting‑edge technology stack.

Requirements

• Bachelor’s degree or above in Computer Science or a related field, with 5+ years of experience in big data.
• Hands‑on experience with Spark, Flink, Hadoop, HBase, Kafka, Druid, ClickHouse, or similar big data technologies.
• Proficient in Python, Java, Scala, or SQL.
• Experience in data architecture design, data warehouse modeling, or performance tuning is preferred.
• Prior experience with feature platforms, algorithm experimentation pipelines, or graph construction is a plus.
• Strong logical thinking, communication skills, and project coordination abilities.
• Strong self‑motivation and resilience, with a willingness to experiment and drive business impact.

Mid‑senior level, Full‑time, Information Technology, Software Development, Internet Marketplace Platforms, and Technology, Information and Internet.