Job Description
Role Overview :
We are seeking a Senior Data Engineer with strong developer DNA — someone who codes daily in Py Spark, SQL, and Python, builds end-to-end data solutions, and leads design of robust, production-grade data platforms on Microsoft Fabric, Azure Databricks, and ADF. This is a hands-on leadership role for engineers who can think architecturally and code efficiently.
Key Responsibilities:
• Design, develop, and optimize complex data pipelines and lakehouse architectures.
• Lead development of batch and streaming ingestion frameworks using ADF, Databricks, and Event Hubs.
• Write optimized Py Spark/SQL transformations for performance, scalability, and cost efficiency.
• Build reusable data frameworks and automation scripts for continuous integration and deployment.
• Establish unit testing, code review, and versioning standards across engineering teams.
• Integrate with Dev Ops CI/CD pipelines for automated releases and environment management.
• Mento...
We are seeking a Senior Data Engineer with strong developer DNA — someone who codes daily in Py Spark, SQL, and Python, builds end-to-end data solutions, and leads design of robust, production-grade data platforms on Microsoft Fabric, Azure Databricks, and ADF. This is a hands-on leadership role for engineers who can think architecturally and code efficiently.
Key Responsibilities:
• Design, develop, and optimize complex data pipelines and lakehouse architectures.
• Lead development of batch and streaming ingestion frameworks using ADF, Databricks, and Event Hubs.
• Write optimized Py Spark/SQL transformations for performance, scalability, and cost efficiency.
• Build reusable data frameworks and automation scripts for continuous integration and deployment.
• Establish unit testing, code review, and versioning standards across engineering teams.
• Integrate with Dev Ops CI/CD pipelines for automated releases and environment management.
• Mento...
Apply for this Position
Ready to join EClerx? Click the button below to submit your application.
Submit Application