Data Engineer

Job Description: The Data Engineer will be responsible for developing and maintaining Arab Development Portal (ADP) Data Ecosystem following client client-established standards for web development, IT technologies, programming languages, and tools. The contractor will prepare, maintain, and reference project-based technical, user, and functional specifications and documentation. Tasks and Responsibilities The Data Engineer will perform the following tasks: • Design, build, and maintain ETL/ELT pipelines. • Automate data ingestion from various sources (databases, APIs, streaming services). • Implement data validation and quality checks. • Use platforms like Azure for cloud-based data solutions. • Work with Data Scientists and Full Stack Web Developers to provide clean, reliable data. • Create and maintain comprehensive technical documentation, including user manuals, training materials, and product specifications, also developing functional specifications. • Provide ongoing support for deployed pipelines including version control, data recovery processes, and deployment strategies. • Research emerging technologies and industry trends, staying up to date with developments in the field, and actively assisting in testing and evaluating new products, tools, and technologies. Objective The Data Engineer is expected to fulfill the following deliverables: • Completed project plan at project inception. • Technical documentation and user manuals for assigned tasks, including dataflow and entity relationship diagrams. • Progress reports with time sheets reflecting task fulfillment and project progress. • Final source code, design assets, documentation and all related components to pipelines and applications are being developed. • Other related deliverables as needed, following the client’s strategy. Qualifications A minimum high school diploma with a certification or degree in Information Systems, Information Technology, Computer Science, Statistics or related area is required. • A minimum of 2 years of professional experience with Python, SQL, cloud environments (Azure), container orchestration (Kubernetes), and DevOps automation is required. • Strong familiarity with semantic modeling, knowledge graphs, and AI/ML integration for data systems is desirable. • Excellent analytical, problem-solving, and communication skills is required. • Knowledge in database design, and development using MS SQL Relational Database is required. English and French are the working languages and Arabic is a working language of the client. For this position, fluency in English is required and knowledge of Arabic is desirable.