Data Engineer

DeepLightAI is a specialist AI and data consultancy with extensive experience implementing intelligent enterprise systems across multiple industries, withparticular depthin financial services and banking. Our team combines deepexpertisein data science, statisticalmodeling, AI/ML technologies, workflow automation, and systems integration with a practical understanding of complex business operations.

Responsibilities of the role:

• Design, build, and optimises scalable data solutions, primarily utilising the Lakehouse architecture to unify data warehousing and data lake capabilities. Advise stakeholders on the strategic choice between Data Warehouse, Data Lake, and Lakehouse architectures based on specific business needs, cost, and latency requirements.
• Design, develop, and maintain scalable and reliable datapipelines to ingest, transform, and load diverse datasets from various sources, including structured and unstructured data, streaming data, and ...