Senior Data Engineer (Databricks / Apache Spark)

Job Description Job Description Senior Data Engineer (Databricks / Apache Spark) Agency: US Coast Guard Location: Remote / Hybrid (as permitted by contract) must be proximate to Washington DC Metro area (within 60 miles) Experience Level: Senior (8 years) Salary Range: $190- 200K Clearance: Ability to Obtain Public Trust US Citizenship Required Position Overview World Services LLC, an IT engineering, solutions, and management consulting firm, is seeking an experienced Senior Data Engineer to support a federal agency on an enterprise-wide digital transformation initiative. The Senior Data Engineer designs, builds, and optimizes scalable, secure data pipelines and analytics platforms in support of mission-critical federal data initiatives. This role translates complex business, analytical, and mission requirements into high-performance data solutions using Databricks, Apache Spark, Python, and SQL within cloud-based environments. This is a hands-on senior delivery role requiring deep Spark expertise, advanced data modeling skills, and experience operating data platforms in regulated or high-availability environments. At World Services LLC, you’ll work in a collaborative, people-first culture within a stable, mission-driven federal environment, building secure, resilient systems that support critical programs alongside experienced teams. KEY RESPONSIBILITIES Senior Data Engineering & Architecture · Design, develop, and maintain large-scale ETL/ELT data pipelines using Databricks and Apache Spark. · Architect and implement Databricks Lakehouse solutions leveraging Delta Lake. · Develop advanced SQL transformation layers and analytics-ready datasets. · Implement dimensional data models (star and snowflake schemas). · Assess current state data solutions and provide recommendations for improvements. Performance Optimization & Data Quality • Tune Spark jobs, cluster configurations, and Databricks workflows. • Diagnose and remediate complex data quality issues. • Implement validation frameworks, monitoring, and data checks. Cloud & DevSecOps Integration • Build and maintain data pipelines across cloud platforms (AWS, Azure, or GCP). • Integrate workflows into CI/CD pipelines with DevSecOps teams. • Maintain non-production environments without impacting production. • Ensure compliance with federal security and governance requirements. Collaboration & Technical Leadership · Translate mission and analytical requirements into technical solutions. · Mentor junior and mid-level data engineers. · Support production operations and issue resolution. · Produce technical documentation. · Align with the agency’s data Program Management Office (PMO) related requirements and governance standards REQUIRED QUALIFICATIONS • 8 years of overall data engineering experience. • 3 years of hands-on Databricks and Apache Spark experience. • Expert proficiency in Spark, Python, and SQL. • Experience delivering enterprise-scale cloud data platforms. • Familiarity with federal or regulated environments. STRONGLY PREFERRED QUALIFICATIONS • Databricks Certified Data Engineer (Professional or Associate). • Experience supporting DHS, DoD, or other federal agencies. • Experience with streaming architectures (Kafka, Spark Structured Streaming). • Cloud certifications (AWS, Azure, or GCP). EDUCATION • Bachelor’s degree in Computer Science, Data Engineering, Information Systems, or related field. • Master’s degree preferred. Company Description World Services, LLC is a Service-Disabled Veteran-Owned Small Business (SDVOSB), headquartered in Alexandria, Virginia. We offer a wide variety of IT services to support enterprises at every level. These include Management Consulting, Cloud Architecture, Software Development, Agile Implementation, Data Science and Analytics, Systems Engineering, Augmented Reality, and Cyber Security services. World Services commitment to a quality delivery of technology and services is backed by the ISO 9000 certified and CMMI Level 3 in Services and Development to ensure a quality framework of policies, tools, and procedures. This is one of the factors that allow our company as a ISO certified and CMMI Level 3 rated small business to deliver consistent, scalable solutions to the Federal, State and Local Government, healthcare, and commercial clients. Our quality processes ensure our customers receive shorter lead time, delivery reliability, and consistent, high-quality services and products. Company Description World Services, LLC is a Service-Disabled Veteran-Owned Small Business (SDVOSB), headquartered in Alexandria, Virginia. We offer a wide variety of IT services to support enterprises at every level. These include Management Consulting, Cloud Architecture, Software Development, Agile Implementation, Data Science and Analytics, Systems Engineering, Augmented Reality, and Cyber Security services. World Services commitment to a quality delivery of technology and services is backed by the ISO 9000 certified and CMMI Level 3 in Services and Development to ensure a quality framework of policies, tools, and procedures. This is one of the factors that allow our company as a ISO certified and CMMI Level 3 rated small business to deliver consistent, scalable solutions to the Federal, State and Local Government, healthcare, and commercial clients. Our quality processes ensure our customers receive shorter lead time, delivery reliability, and consistent, high-quality services and products.