Job Description
Key Skills & Technologies
• Programming Languages: Python (primary), SQL
•Cloud Platforms: AWS (S3, Glue, Lambda, Redshift, EC2, EMR)
•Data Tools: Apache Spark, Pandas, PySpark, Airflow
•Databases: PostgreSQL, MySQL, NoSQL (e.g., DynamoDB)
•ETL & Workflow Orchestration: AWS Glue, Apache Airflow
•Version Control: Git
•DevOps & CI/CD: Basic understanding of CI/CD pipelines and infrastructure as code (e.g., Terraform, CloudFormation)
Job Summary
•Data Pipeline Development - Design, build, and maintain scalable and reliable data pipelines to ingest, process, and transform data from various sources.
• Data Integration & Management - Integrate structured and unstructured data from internal and external systems.
•Ensure data quality, consistency, and availability across platforms.
• Cloud-Based Data Engineering- Leverage AWS services (e.g., S3, Lambd...
• Programming Languages: Python (primary), SQL
•Cloud Platforms: AWS (S3, Glue, Lambda, Redshift, EC2, EMR)
•Data Tools: Apache Spark, Pandas, PySpark, Airflow
•Databases: PostgreSQL, MySQL, NoSQL (e.g., DynamoDB)
•ETL & Workflow Orchestration: AWS Glue, Apache Airflow
•Version Control: Git
•DevOps & CI/CD: Basic understanding of CI/CD pipelines and infrastructure as code (e.g., Terraform, CloudFormation)
Job Summary
•Data Pipeline Development - Design, build, and maintain scalable and reliable data pipelines to ingest, process, and transform data from various sources.
• Data Integration & Management - Integrate structured and unstructured data from internal and external systems.
•Ensure data quality, consistency, and availability across platforms.
• Cloud-Based Data Engineering- Leverage AWS services (e.g., S3, Lambd...
Apply for this Position
Ready to join TechDigital Corporation? Click the button below to submit your application.
Submit Application