Senior Engineer Software

AI Engineer (Backend, Python) 69 Years

Whatyoulldo

• Lead architecture for scalable AI backend platforms (multi-service workflows, tool layer, retrieval, evaluation/monitoring)
• Set standards for workflow reliability: idempotency, compensation, isolation, multi-tenant readiness, cost/latency controls
• Drive system design for throughput: streaming (SSE/WebSocket ), concurrency limits, queueing/backpressure, benchmarking
• Own production excellence: SLOs, incident playbooks, observability strategy, capacity planning
• Establish security posture:AuthN/AuthZ (JWT/OAuth/service-to-service), secrets, auditing, access controls

Must-have

• 6+ years building/operating backend systems in Python at scale
• Expert async/concurrency/parallelism + distributed systems depth
• Strong platform/API architecture (gRPCnice-to-have), operational leadership
• AuthN/AuthZ design and security fundamentals for production systems
• Proven delivery of AI-backed systems in production (agents/RAG/tooling)

Nice-to-have

• K8s/service mesh, policy/guardrails, evaluation pipelines, developer platform experience

Screening Keywords

• Backend architecture, platform engineering
• Distributed systems design, scalability, reliability, SLO/SLI
• Async/concurrency strategy, queueing, load/performance testing, capacity planning
• Workflow/state machine orchestration, idempotency, compensation patterns
• Security: AuthN/AuthZ, OAuth2, JWT, service-to-service auth, secrets management, auditing
• Multi-tenant design, isolation, rate limiting, cost controls
• Observability strategy, incident management, postmortems, on-call leadership
• Docker + Kubernetes (preferred)
• AI systems in production: agents, RAG, tool execution, evaluation/monitoring