Sarvagram - AWS DE

Job Description

Role Summary:

As a Senior Data Engineer, you will design, develop, and maintain robust and scalable data pipelines and infrastructure on AWS Ubuntu. You will leverage your expertise in Python-based frameworks and a wide range of data platforms to build and optimize data warehouses, distributed query engines, ETL processes, and business intelligence solutions. You will be responsible for ensuring data quality, performance, and reliability while collaborating with cross-functional teams to deliver impactful data products.

Responsibilities:

• Data Pipeline Development:  Design, develop, and implement efficient and scalable ETL/ELT pipelines using Apache NiFi, Airflow, and Airbyte.Efficient data processing via Pyspark,Apache Flink
• Data Warehousing:  Build and maintain data warehouses using ClickHouse, StarRocks,...