Senior Data Engineer

Interpret business requirements and work with internal resources as well as application vendors. • Design, develop and maintain Data Bricks solutions and relevant data quality rules. • Troubleshoot and resolve data-related issues. • Configure and create data models and data quality rules to meet customer needs. • Handle multiple database platforms like Microsoft SQL Server and Oracle. • Review and analyze data from multiple internal and external sources. • Analyze existing Python/ PySpark complex code and identify areas for optimization. • Write new optimized SQL queries or Python scripts to improve performance and reduce time. • Identify opportunities for efficiency and innovative approaches to completing the scope of work. • Write clean, efficient, and well-documented code that adheres to best practices and Council IT coding standards. • Maintain and operate existing custom code processes. • Participate in team problem-solving efforts and offer ideas to solve client issues. • Query writing skills with the ability to understand and implement changes to SQL functions and stored procedures. • Effectively communicate with business and technology partners, peers, and stakeholders. • Deliver results under demanding timelines to real-world business problems. • Work independently and multi-task effectively. • Configure system settings and options and execute unit/integration testing. • Develop end-user release notes, training materials, and deliver training to a broad user base. • Identify and communicate areas for improvement. • Responsible for quality checks and adhering to the agreed Service Level Agreement (SLA) / Turn Around Time