Principal Data Engineer

Role - Principal Data Engineer
Location - Fort Mill SC or Austin (Hybrid)


We are looking for a skilled Data Engineer to join our team and help build robust, scalable, and efficient data pipelines. The ideal candidate will have strong expertise in AWS, Python, Spark, ETL Pipelines, SQL, and Pytest. This role involves designing, implementing, and optimizing data pipelines to support analytics, business intelligence, and machine learning initiatives.


Key Responsibilities:

· Design, develop, and maintain ETL pipelines using AWS services, Python, and Spark.

· Optimize data ingestion, transformation, and storage processes for high-performance data processing.

· Work with structured and unstructured data, ensuring data integrity, quality, and governance.

· Develop SQL queries to extract and manipulate data efficiently from relational databases.

· Implement data validation and testing frameworks...