Job Description
**Job Family** **:**
Data Engineering & Architecture Consulting
**Travel Required** **:**
Up to 10%
**Clearance Required** **:**
Ability to Obtain Public Trust
**What You Will Do** **:**
+ Develop and implement CI/CD pipelines for Databricks notebooks and jobs.
+ Develop ETL pipelines using PySpark and Databricks.
+ Implement Delta Lake for ACID transactions and data reliability.
+ Optimize ingestion from APIs, streaming, and batch sources.
+ Ensure compliance with data governance and security standards.
+ Collaborate with data engineers and scientists to support data pipelines and ML workflows.
+ Conduct ETL and data quality analysis using various technologies (i.e., Python, Databricks).
+ Ensure data governance and quality assurance standards are met.
+ Organize and lead meetings, including scheduling meetings; drafting and delivering agendas and meeting minutes; providing and archiving require...
Data Engineering & Architecture Consulting
**Travel Required** **:**
Up to 10%
**Clearance Required** **:**
Ability to Obtain Public Trust
**What You Will Do** **:**
+ Develop and implement CI/CD pipelines for Databricks notebooks and jobs.
+ Develop ETL pipelines using PySpark and Databricks.
+ Implement Delta Lake for ACID transactions and data reliability.
+ Optimize ingestion from APIs, streaming, and batch sources.
+ Ensure compliance with data governance and security standards.
+ Collaborate with data engineers and scientists to support data pipelines and ML workflows.
+ Conduct ETL and data quality analysis using various technologies (i.e., Python, Databricks).
+ Ensure data governance and quality assurance standards are met.
+ Organize and lead meetings, including scheduling meetings; drafting and delivering agendas and meeting minutes; providing and archiving require...
Apply for this Position
Ready to join Guidehouse? Click the button below to submit your application.
Submit Application