Big Data Lead

Job TItle: Big Data Lead

Job Type: Contract

Job Location: Wimbledon , UK

Job Description:

For this role, senior experience of Data Engineering and building automated data pipelines on IBM Datastage & DB2, AWS and Databricks from source to operational databases through to curation layer is expected using the latest cloud modern technologies where experience of delivering complex pipelines will be significantly valuable to how D&G maintain and deliver world class data pipelines.

Knowledge in the following areas essential:

Data Engineering Experience:

• Databricks: Expertise in managing and scaling Databricks environments for ETL, data science, and analytics use cases.
• AWS Cloud: Extensive experience with AWS services such as S3, Glue, Lambda, RDS, and IAM.
• IBM Skills: DB2, Datastage, Tivoli Wo...