Software Engineer —Automation Infrastructure

Software Engineer —Automation Infrastructure
About the role
Were
looking for a Software Engineer to build and operate high-throughput,
reliable data pipelines that ingest logs and sensor data at scale. Youll
work end-to-end: from ingestion services and interfaces to cloud
infrastructure, to testing/automation and data quality checks that keep
datasets trustworthy and usable.
What youll do

• Design, build, and maintain high-volume log data pipelines (batch and/or streaming) with strong reliability and performance characteristics.
• Build pipeline components and services in Python, writing clean, maintainable, well-tested code.
• Interface pipeline systems with cloud infrastructure (compute, storage, networking, IAM), ensuring secure and scalable operation.
• Develop and maintain test automation frameworks for pipeline services and data processing jobs (unit, integration, end-to-end).
• Implement monitoring, alert...