Job Description
The Databricks Engineer will design, develop, and optimize large-scale data pipelines using Databricks and Azure cloud services.
This role requires advanced expertise in Spark/PySpark, Delta Lake technologies, data governance, and cloud-based data engineering.
The engineer will collaborate with cross-functional teams to deliver scalable, reliable, and high-performance data solutions that support analytics, BI, and business initiatives.
Key Responsibilities
- Build and maintain scalable ETL/ELT data pipelines using Databricks.
- Use PySpark/Spark and SQL to process, cleanse, and transform large datasets.
- Integrate data from diverse sources such as Azure Blob Storage, ADLS, and relational/non-relational databases.
- Work with teams across the organization to prepare data for BI dashboards and reporting tools.
- Partner with business stakeholders to understand requirements and deliver tailored data solutions.
Apply for this Position
Ready to join Compunnel, Inc.? Click the button below to submit your application.
Submit Application