Job Description
Job Description: Technical Architect (DataBricks, BigData, Python & PySpark):
- 10+ years of experience in data engineering with strong proficiency in Python and PySpark.
- 3–5+ years of hands-on experience with Databricks platform on Azure, AWS, or GCP.
- Deep understanding of Apache Spark internals and distributed computing concepts.
- Strong knowledge of Delta Lake, Lakehouse architecture, and data lake management.
- Proven experience with large-scale Big Data platforms (Hadoop, Hive, HDFS, etc.).
- Proficiency in SQL and working with relational and non-relational databases.
- Solid understanding of CI/CD, version control (Git), and DevOps for data pipelines.
- Experience with data orchestration tools (e.g., Airflow, Azure Data Factory).
- Experience in data warehouse design and maintenance
- Experience in agile development processes using Jira and Confluence.
- Experience in cross-functional...
Apply for this Position
Ready to join Bilvantis Technologies? Click the button below to submit your application.
Submit Application