Job Description
Role: Data Architect - Databricks
Required Technical Skill Set: AWS/Azure, Databricks, Spark/ Py Spark, SQL
No of Requirements: 6
Desired Experience Range: 10-11 Years
Location of Requirement: Kochi / Bangalore / Chennai
Desired Competencies (Technical/Behavioral Competency)
Must-Have(Ideally should not be more than 3-5)
- Strong experience in programming languages such as Python, Py Spark, or Scala for data engineering tasks.
- Expereince in guideing high-performing teams to design and implement scalable data solutions leveraging Databricks and cloud-native tools.
- Hands-on experience with cloud technologies, expertise in Databricks data engineering services to handle large-scale data processing and real-time data streams.
- Good understanding of Databricks best practices
- Deep expertise in Databricks (DLT, Unity Catalog, Workflows, SQL Warehouse)
- Experience with data security (RBAC, row/column-level security policies).
Good-to-Have(Ideally should not be more than 3-5)
- Strong understanding of data modeling concepts and techniques to create efficient and scalable data models.
- Experience with version control systems such as Git for code management and collaboration.
- Knowledge of data governance, data quality standards, and data security practices to ensure compliance and protection of sensitive information
Responsibility of / Expectations from the Role
Design, develop, and maintain scalable data pipelines for extracting, transforming, and loading data from various sources to ensure seamless data flow and accessibility.
Collaborate with cross-functional teams to integrate data from multiple disparate sources, ensuring consistency, accuracy, and reliability of data.
Optimize data processing workflows and storage solutions for performance, scalability, and cost-efficiency
Implement data quality checks and validation processes to ensure the accuracy, completeness, and consistency of data throughout the data lifecycle.
Monitor the performance of data pipelines and infrastructure, identifying and resolving issues to maintain system stability and reliability.
Required Technical Skill Set: AWS/Azure, Databricks, Spark/ Py Spark, SQL
No of Requirements: 6
Desired Experience Range: 10-11 Years
Location of Requirement: Kochi / Bangalore / Chennai
Desired Competencies (Technical/Behavioral Competency)
Must-Have(Ideally should not be more than 3-5)
- Strong experience in programming languages such as Python, Py Spark, or Scala for data engineering tasks.
- Expereince in guideing high-performing teams to design and implement scalable data solutions leveraging Databricks and cloud-native tools.
- Hands-on experience with cloud technologies, expertise in Databricks data engineering services to handle large-scale data processing and real-time data streams.
- Good understanding of Databricks best practices
- Deep expertise in Databricks (DLT, Unity Catalog, Workflows, SQL Warehouse)
- Experience with data security (RBAC, row/column-level security policies).
Good-to-Have(Ideally should not be more than 3-5)
- Strong understanding of data modeling concepts and techniques to create efficient and scalable data models.
- Experience with version control systems such as Git for code management and collaboration.
- Knowledge of data governance, data quality standards, and data security practices to ensure compliance and protection of sensitive information
Responsibility of / Expectations from the Role
Design, develop, and maintain scalable data pipelines for extracting, transforming, and loading data from various sources to ensure seamless data flow and accessibility.
Collaborate with cross-functional teams to integrate data from multiple disparate sources, ensuring consistency, accuracy, and reliability of data.
Optimize data processing workflows and storage solutions for performance, scalability, and cost-efficiency
Implement data quality checks and validation processes to ensure the accuracy, completeness, and consistency of data throughout the data lifecycle.
Monitor the performance of data pipelines and infrastructure, identifying and resolving issues to maintain system stability and reliability.
Apply for this Position
Ready to join ? Click the button below to submit your application.
Submit Application