Director, Data Engineering

Masters degree in in Computer Science, Information Technology with 2 years of experience; Lead architecture and design decisions for Marketing Solutions' Core Data Asset Maintenance and Data Product development using advanced technologies including Snowflake Data Cleanrooms, Databricks, and Apache Kafka, with experience in Python, SQL, PySpark, Snowpark, Jinja SQL, and AWS EMR. Provide technical input and decide for all components of the data infrastructure, using AWS technologies (S3 data lake, Lambda, Glue, Airflow), Apache Hive, Amazon Redshift, Workflow Orchestration using Airflow for system design. Design and architect pipelines and data ingestion and transformation, requiring advanced skills in big data technologies including Apache Spark, distributed systems, and performance optimization using Bash scripting, and CI/CD pipelines with Jenkins. Define SLAs for data availability and architect automated monitoring solutions, utilizing experience in DevOps tools, CloudWatch, and inci...