Full Stack Developer (AI)

Job Description

○ Strong expertise with Apache Spark for batch/scheduled processing.
○ Experience with Spark Streaming for real-time data pipelines.
○ Proficiency in the Kafka ecosystem, including Kafka Streams and Kafka Avro schemas.
○ Strong programming skills in Python (primary for data platform jobs) and Java.
○ Hands-on experience with SQL for data modeling, transformation, and analytics.
○ Experience working with Databricks (notebooks, jobs, clusters).
○ Knowledge of Azure Data Factory (ADF) for orchestrating pipeline workflows.
○ Demonstrated AI-assisted coding proficiency using modern LLM-based developer tools.
○ Experience with build tools: Maven and Gradle.
○ Familiarity with Grafana dashboards and observability practices.
○ Experience with Jenkins and/or ArgoCD for DevOps and CI/CD.
○ Hands-on experience working with Kubernetes clusters.
○ Familiarity with Docker and docker-compose.
○ Exposure to Spring...