Job Description

Preferences specifically for knowledge of Python, Databricks, and Pyspark experience

Requirements

  • 7+ years of hands-on experience in software development, with a strong emphasis on Python programming.
  • Deep expertise in PySpark for building and optimizing scalable data pipelines.
  • Proficient in designing and implementing real-time data streaming solutions using Spark SQL, DataFrames, and Datasets.
  • Solid experience with Azure Databricks, including working with Delta tables, workflows, and scripting in Python.
  • Familiar with Azure cloud services, especially Azure Data Lake, Azure Data Factory, and EventHub or Kafka for streaming data ingestion.
  • Skilled in writing complex SQL queries and building views involving joins across multiple tables.
  • Experience across the Software Development Lifecycle (SDLC), with a strong grasp of Agile Scrum methodologies.
  • P...

Apply for this Position

Ready to join Galent? Click the button below to submit your application.

Submit Application