Data Engineer

100% Remote

Yearlong contract with extensions

Large Fortune 500 company

We are seeking a Data Engineer with AI expertise to design and maintain scalable data pipelines while integrating advanced language model applications. The role requires proficiency in Python, PySpark, and web frameworks like FastAPI. You will be responsible for leveraging vector stores and retrievers to enable real-time document processing and querying, while deploying robust, scalable solutions on AWS to solve complex business challenges at the intersection of data engineering and applied AI.

Required Technical Skills

• Proficiency in Python, with practical experience using web frameworks such as FastAPI.
• Advanced expertise in data technologies, including SQL, PySpark, and Databricks.
• Hands-on experience with Retrieval-Augmented Generation (RAG) pipelines, LangChain, and related Generative AI libraries and APIs.
• Exp...