Job Description
Key Responsibilities:
- Build & maintain high tps, reliable, performant and cost-effective data collection and extraction modules using Node.js & Python, using streaming solutions like Kafka.
- Deploy, maintain and support these modules on AWS & GCP cloud.
- Index, archive and retain necessary data in multiple persistence stores like Object stores(S3), Key value store (Dynamo DB), and Elastic Search based on the use case.
- Manage the quality of data collected using data quality libraries built using SQL/Python/Spark on AWS Glue and exposed as Dashboards for monitoring using AWS Quick sight and Kibana.
Apply for this Position
Ready to join Clear Demand Inc? Click the button below to submit your application.
Submit Application