Data Engineer Advisor

Req ID: 350694 

We are currently seeking a Data Engineer Advisor to join our team in Remote, Karnātaka (IN-KA), India (IN).

"The SAP-to-Databricks Migration Engineer will lead and execute the migration of SAP data (including SAP BW, ECC, and related modules) into the Databricks platform, ensuring seamless integration, optimized performance, and adherence to governance standards. This role requires deep expertise in SAP systems and Databricks architecture, with a strong focus on data engineering and transformation.

Key Responsibilities

Migration Strategy & Execution

Design and implement migration plans for SAP data to Azure Databricks using tools like Qlik Replicate, ADF, and Airflow.
Convert SAP BW data models and ETL jobs into PySpark workflows on Databricks.
Develop Bronze, Silver, and Gold layers following Medallion Architecture for structured ingestion and transformation. [NTT DATA S...s Perrigo | PowerPoint], [RevvityDat...ewPlanning | PowerPoint], [D&A Design...Recording | Video]

Data Integration & Quality

Ensure accurate mapping of SAP tables and business objects to Databricks Delta tables.
Implement data quality checks, lineage tracking, and governance using Unity Catalog.

Performance Optimization

Optimize ingestion pipelines for large SAP datasets to minimize latency and maximize throughput.
Conduct performance tuning for queries and transformations.

Collaboration & Documentation

Work closely with SAP SMEs, data architects, and business analysts to validate requirements.
Produce comprehensive documentation for migrated jobs and provide support during UAT and hypercare phases. [NTT DATA S...s Perrigo | PowerPoint]

Security & Compliance

Ensure compliance with enterprise security policies and manage RBAC for Databricks workspaces.

Required Skills

SAP Expertise

Strong knowledge of SAP BW, ECC, and related modules.
Experience with SAP data extraction and transformation.

Databricks & Big Data

Proficiency in Databricks, PySpark, and Delta Lake.
Familiarity with Azure Data Lake Storage (ADLS) and orchestration tools like Airflow.

ETL/ELT Tools

Hands-on experience with Qlik Replicate, Informatica, or similar tools.

Cloud & Governance

Understanding of Unity Catalog, RBAC, and data governance frameworks.

Soft Skills

Strong analytical, problem-solving, and communication skills.

"

About NTT DATA

NTT DATA is a $30 billion business and technology services leader, serving 75% of the Fortune Global 100. We are committed to accelerating client success and positively impacting society through responsible innovation. We are one of the world's leading AI and digital infrastructure providers, with unmatched capabilities in enterprise-scale AI, cloud, security, connectivity, data centers and application services. our consulting and Industry solutions help organizations and society move confidently and sustainably into the digital future. As a Global Top Employer, we have experts in more than 50 countries. We also offer clients access to a robust ecosystem of innovation centers as well as established and start-up partners. NTT DATA is a part of NTT Group, which invests over $3 billion each year in R&D.