Job Description
We have partnered with our client in their search for a Software Engineer to support and develop our Databricks-based data platform during the development phase. This role focuses on building, improving, and validating reliability patterns early, rather than production firefighting. The ideal candidate is hands-on with Databricks, PySpark, Python, and has working knowledge of Azure cloud services. This role partners closely with Data Engineering teams to ensure solutions are scalable, efficient, and production-ready.
Responsibilities
* Develop and support Databricks notebooks, jobs, and workflows
* Write and optimize PySpark and Python code for data processing
* Assist in designing scalable and reliable data pipelines
* Apply Spark best practices (partitioning, caching, joins, file sizing)
* Work with Delta Lake tables and data models
* Perform data validation and quality checks during development
* Support cluster configurati...
Apply for this Position
Ready to join Infinity Consulting Solutions? Click the button below to submit your application.
Submit Application