Job Description

Required Skills

  • 3+ years' experience working in a similar Software Engineer role within a data platform/data engineering team
  • Experience with Big Data and distributed systems.
  • Experience with focus on working with Debezium for change data capture and real-time data streaming.
  • Experience working with Kubernetes, AWS, Docker, and Terraform.
  • Prior experience in building data platforms using Big Data stack (Kafka, Hadoop, Spark, Flink, Hive ..) on the public cloud.
  • Excellent programming skills in Java.
  • Understanding of distributed systems concepts and principles (consistency and availability, liveness and safety, durability, reliability, fault-tolerance, consensus algorithms).
  • Deep understanding of Algorithms, Data Structures, and Performance Optimization Techniques.
  • Eager to learn new things and passionate about technology!

    • What you would do

  • Design, develop and run cloud native data platform and analytics SaaS services
  • Design and build large scale real-time stream processing systems
  • Develop and run micro-services and analytics SaaS solutions
  • Perform test driven unit and end to end testing of any code you develop.
  • Own Continuous Integration (CI) and Continuous Deployment (CD) for your services
  • Own scalability, availability and data security for your services
  • Own, troubleshoot & resolve code defects
  • Mentor other developers in best practices

    • What you would need to succeed

  • Extensive experience working on a public cloud-like AWS
  • Prior experience and passion for building a large-scale multi-tenant cloud-native data platform
  • Emphasize team wins over individual success
  • Strong technical interpersonal skills
  • Excellent software development skills in one or more of the following languages: Java/Scala
  • Extensive experience with Big Data and distributed systems.
  • Expertise in Spark or Flink, Kafka, and Hadoop ecosystem
  • Ability to design large-scale distributed systems
  • Have developed in more than one language and ready to pivot to any language/framework
  • Understand microservices architecture patterns pattern like Service Discovery/API Gateway/Domain Driven Design etc
  • Experience with containers technology
  • Ability to work in an agile fast-paced environment
  • BS or MS degree (Computer Science or Math)

    • Bonus

  • AWS (EMR, S3, Glue, Kinesis)
  • Debezium
  • ELK
  • Experience in building SaaS/PaaS on AWS/GCP/Azure.
    • $110000 - $130000 a year

    Apply for this Position

    Ready to join ? Click the button below to submit your application.

    Submit Application