Job Description
Databricks, ADFA Databricks Job Description (JD) typically involves designing, developing, and maintaining scalable data pipelines, ETL processes, and data solutions using the Databricks platform (Lakehouse Architecture, Spark, Delta Lake) on cloud services (AWS, Azure, GCP).
Key responsibilities include data modeling, performance optimization, ensuring data quality security, collaborating with data scientists analysts, and implementing governance (like Unity Catalog) for big data analytics and AIML initiatives. Common Roles Responsibilities Databricks Developer Engineer Architect Builds data infrastructure, optimizes Spark jobs, creates ETLELT pipelines, and integrates with cloud services. Responsibilities Design develop data solutions on Databricks (Delta Lake, Unity Catalog).Optimize data pipelines (batch streaming) for performance. Collaborate with stakeholders (scientists, analysts).Implement data quality, security, and governance. Troubleshoot performance issue...
Key responsibilities include data modeling, performance optimization, ensuring data quality security, collaborating with data scientists analysts, and implementing governance (like Unity Catalog) for big data analytics and AIML initiatives. Common Roles Responsibilities Databricks Developer Engineer Architect Builds data infrastructure, optimizes Spark jobs, creates ETLELT pipelines, and integrates with cloud services. Responsibilities Design develop data solutions on Databricks (Delta Lake, Unity Catalog).Optimize data pipelines (batch streaming) for performance. Collaborate with stakeholders (scientists, analysts).Implement data quality, security, and governance. Troubleshoot performance issue...
Apply for this Position
Ready to join Q1 Technologies, Inc? Click the button below to submit your application.
Submit Application