Data Engineer

Job Title: Data Engineer

Experience: 5–10 Years.
Location: Pan India
Joining Time: Immediate to 15 Days Maximum

About the Role:

Indus Net Technologies is looking for an experienced Data Engineer to design, build, and maintain robust data pipelines leveraging Databricks and Azure Cloud Services. The ideal candidate will have hands-on expertise in processing large-scale IoT sensor data from manufacturing equipment, ensuring data quality, integrity, and high performance across multi-plant operations.

Key Responsibilities:

Design and implement ETL/ELT pipelines using Databricks and PySpark.

Process and transform real-time IoT sensor data from multiple manufacturing plants.

Manage data storage, versioning, and optimization using Delta Lake.

Integrate data from diverse sources (SQL Server, JSON, CSV, APIs, etc.).

Write and optimize complex SQL queries and stored procedures for performance.

Implement data quality monitoring, testing, and CI/CD pipelines using Azure DevOps.

Collaborate closely with manufacturing and analytics teams to deliver actionable IoT data insights.

Top 4 Mandatory Skills:

Databricks & Apache Spark (PySpark) – Minimum 3 years of hands-on experience

Azure Cloud Services – Experience with ADF, Blob Storage, and DevOps

Python – Advanced proficiency with OOP concepts, pandas, and robust error handling

Delta Lake – Strong knowledge of data versioning, time travel, and optimization

Good-to-Have Skills:

Advanced SQL and stored procedure development

Experience in JSON data processing and schema handling

Git-based version control and CI/CD integration using Azure DevOps

Exposure to manufacturing or industrial IoT data patterns

Preferred Domain Knowledge:

Industrial IoT and time-series data management

Machine data and equipment performance monitoring

Multi-plant data integration and central data architecture

Data quality frameworks, downtime, and defect analytics

Qualifications:

Bachelor’s degree in Computer Science, Engineering, or a related field

4–6 years of proven experience in Data Engineering

2+ years of strong exposure to Databricks/Spark ecosystem

Azure Data Engineer Associate or Databricks certification is preferred

Soft Skills:

Excellent communication skills in English (written and verbal)

Strong analytical and problem-solving mindset

Collaborative and proactive approach with cross-functional teams

High attention to detail and commitment to data accuracy