GCP Data Engineer

Role: GCP Data Engineer

Years of Experience: 5 to 12 yrs

Location: Pune, Chennai, Bangalore, Hyderabad, Gurugram

Notice Period: 0-60 days

Mode of Interview: Virtual

Date of Drive: 23rd Jan, 26

Time: 11am to 2pm

Required Technical Skill Set

Data Engineer with hands-on experience in Google Cloud Platform (GCP) services to work on implementing and managing data ingestion. Work with services such as GCS, BigQuery, Dataflow, Composer, Data Fusion, DataProc for ETL/ELT operations

Must Have experience:

• 5+ years of experience as a Data Engineer or in a similar role. •
• Strong working knowledge of Google Cloud Storage (GCS), BigQuery, Composer, Data Fusion, Dataproc.
• Proficiency in Python for scripting, debugging, and automation tasks.
• Experience with Terraform for infrastructure-as-code.
• Knowledge of Git for version control.
• Understanding of data ingestion concepts, file formats, and ETL workflows.
• Ability to debug and resolve runtime data issues independently. •
• Strong problem-solving and analytical skills.
• Configure and execute data ingestion pipelines using our reusable GCP-based • framework.
• Work with services such as GCS, BigQuery, Dataflow, Composer, Data Fusion, DataProc for ETL/ELT operations.
• Strong experience in data engineering/migration projects in GCP (along with Python) is required and should be able to work independently.
• Manage parameters, job configurations, and metadata for ingestion. • Debug and resolve issues related to data, parameters, and job execution.
• Escalate framework-related bugs to the core development team when required.
• Monitor daily job runs, troubleshoot failures, and ensure SLAs are met.
• Collaborate with cross-functional teams for smooth delivery. • Follow version control best practices using Git.
• Maintain deployment scripts and infrastructure configurations via Terraform.

Thanks & Regards

Shilpa Silonee

BFSI TAG Team

Tata Consultancy Services