Senior Data Engineer / Backend Developer (Databricks & PySpark)

We are seeking an experienced Senior Data Engineer / Backend Developer with strong hands-on expertise in Databricks, PySpark, SQL, and backend development . This role requires close collaboration with architects, technical leads, business analysts, and testing teams while supporting production systems in a fast-paced environment. The ideal candidate is proactive, detail-oriented, cost-conscious, and able to quickly adapt to new technologies.

Essential Job Functions

• Develop, enhance, and maintain data-driven applications using Databricks, PySpark, SQL, and backend technologies
• Understand end-to-end system architecture and support operations with monitoring, dashboards, and observability
• Collaborate with architects and technical leads on solution design and implementation
• Continuously monitor and optimize system cost, scalability, and performance
• Work closely with Business Analysts (BA) to understand and implement integration requirements
• Partner with TCOE/testing teams to define test scenarios and support testing activities
• Troubleshoot performance issues, production defects, and functional problems
• Document key technical decisions, designs, and implementation details
• Handle fast-paced projects and actively support production issues when required
• Act as a self-driven learner , quickly adopting new tools and technologies
• Maintain prompt and clear communication with all stakeholders

Other Responsibilities

• Document and maintain project artifacts and technical documentation
• Follow industry standards, methodologies, and best practices
• Safeguard company assets and comply with organizational security and compliance policies
• Promptly report any known or suspected loss, theft, or unauthorized disclosure of sensitive information
• Maintain a strong focus on customer service, efficiency, quality, and growth
• Collaborate effectively with cross-functional team members
• Perform other duties as assigned

Minimum Qualifications

• Minimum 5 years of IT development experience
• Strong analytical, problem-solving, and troubleshooting skills
• Proven experience in:
• Designing technical solutions
• Performing code reviews
• Mentoring junior engineers
• Strong SQL and backend development experience
• Experience working on data-driven and large-scale systems
• Team-oriented mindset with excellent communication skills

Required Technical Skills

• Python / PySpark
• SQL / PL-SQL
• Databricks
• Java and/or C#

Preferred Skills

• Azure Cloud Platform
• Kafka
• Azure Data Factory
• Node.js