Sr. Software Engineer

Epergne Solutions is looking for Sr. Software Engineer

Payroll: Epergne Solutions

Position: Contract

Relevant and Total years of experience : 8+ years

Detailed job description -

Skill Set:

Mandatory Skills

GCP, Cloud Composer, Big query ,Pyspark, Skava

Salary - As per market Standards

Work Location - Hyderabad, Bangalore

Mode: Hybrid ,WFO

Must- Have:

Hands-on development experience on Google Cloud Platform (GCP), on Following Cloud services: Cloud Composer, Big query, Pub sub, Data proc, Data flow, CDAP, Big table, GCS

Hands-on development Experience on Airflow DAG creation.

Hands-on development experience on Data migration Pipeline creation on PubSub with DataProc \ DataFlow.

Hands-on development Experience on Cloud function creation.

Hands-on development experience in shell scripting, PySpark, Scala programming language

Hands-on development experience in Big Query and performance tuning of BQ queries, BQ Data Load Jobs

ETL jobs development using Spark and Python

Python / Java / Scala programming

Debugging/troubleshooting of Spark jobs

Performance tuning experience for Hadoop/Spark jobs

Good understanding on Datawarehouse knowledge and data modelling

Good Telecom domain knowledge

Good to-Have

Data Ingestion & ETL: Sqoop, Flume, Nifi, Stream sets, Logstash

Data processing: Spark

Messaging system: Kafka

Scheduling and workflows: Google cloud composer

Data warehousing knowledge

Knowledge and implementation of Lambda/Kappa architecture

Knowledge on Microservices, Docker, Kubernetes,etc.,

DevOps CI/CD

Looking for 30 days/lesser Notice Period Candidates