Job Description
Role: Senior Data Engineer - (AWS, Opensearch)
Years of Experience: 5-8 Years
Location: Ahmedabad, Pune, Indore
Notice Period: Immediate to 45 Days Max
Job Description: We are seeking a highly motivated and enthusiastic Senior Data Engineer with 5- 8 years of experience to join our dynamic team. The ideal candidate will have a strong background in Data Engineering/Data analytics and a passion for leveraging data to drive business insights and innovation.
Qualifications:
Bachelor’s degree in Computer Science, Data Science, or a related field.
Required Skills and Qualifications:
5-8 years of experience in data engineering, with a proven track record of building and managing data solutions.
Design, develop, and manage scalable data solutions on AWS (RDS, Dynamo DB, S3)
Build and optimize Logstash pipelines to push Kafka events into Open Search for real-time search and monitoring.
Work on Open Search indexing and query optimization to improve performance and scalability.
Collaborate with cross-functional teams to design and implement efficient ETL/ELT pipelines using Logstash, AWS Glue, Lambda, Py Spark, and other tools.
Manage and optimize data warehouses such as Dynamo DB and SQL
Ensure high availability, performance tuning, and reliability of relational and No SQL databases.
Work with structured and unstructured data formats (JSON, CSV, XML, Excel).
Integrate data solutions with BI tools like Power BI or any reporting.
Having Knowledge on LLM/NLP techniques, providing basic integration knowledge where applicable.
Collaborate using version control (Git Hub, SVN), ticketing systems (Jira)
Excellent problem-solving, analytical, and communication skills.
Must Have
AWS
Amazon RDS
Dynamo DB
Data warehouse
Logstash
Kafka
Open Search
Elasticsearch (alternative keyword to for Open Search)
Should Have
Power BI
LLM and NLP Awareness
Years of Experience: 5-8 Years
Location: Ahmedabad, Pune, Indore
Notice Period: Immediate to 45 Days Max
Job Description: We are seeking a highly motivated and enthusiastic Senior Data Engineer with 5- 8 years of experience to join our dynamic team. The ideal candidate will have a strong background in Data Engineering/Data analytics and a passion for leveraging data to drive business insights and innovation.
Qualifications:
Bachelor’s degree in Computer Science, Data Science, or a related field.
Required Skills and Qualifications:
5-8 years of experience in data engineering, with a proven track record of building and managing data solutions.
Design, develop, and manage scalable data solutions on AWS (RDS, Dynamo DB, S3)
Build and optimize Logstash pipelines to push Kafka events into Open Search for real-time search and monitoring.
Work on Open Search indexing and query optimization to improve performance and scalability.
Collaborate with cross-functional teams to design and implement efficient ETL/ELT pipelines using Logstash, AWS Glue, Lambda, Py Spark, and other tools.
Manage and optimize data warehouses such as Dynamo DB and SQL
Ensure high availability, performance tuning, and reliability of relational and No SQL databases.
Work with structured and unstructured data formats (JSON, CSV, XML, Excel).
Integrate data solutions with BI tools like Power BI or any reporting.
Having Knowledge on LLM/NLP techniques, providing basic integration knowledge where applicable.
Collaborate using version control (Git Hub, SVN), ticketing systems (Jira)
Excellent problem-solving, analytical, and communication skills.
Must Have
AWS
Amazon RDS
Dynamo DB
Data warehouse
Logstash
Kafka
Open Search
Elasticsearch (alternative keyword to for Open Search)
Should Have
Power BI
LLM and NLP Awareness
Apply for this Position
Ready to join ? Click the button below to submit your application.
Submit Application