Data Engineer

2 Data Engineer Qualifications B.S. in Computer Science or a related technical discipline 3+ Yrs experience with Java programming language Intermediate knowledge of SQL(AWS Redshift//MySQL/Postgres/Oracle) Experience in Hadoop, Streaming, and the Hadoop ecosystem. Experience designing, developing, and maintaining software frameworks on Spark, Hadoop MR, Kafka, Java/Scala/Python, etc. Experience with AWS cloud services such as S3, Lambda, RDS, Airflow Hands-on experience in developing data pipeline and data prep modules using Java, Scala, or Python on MR /Python/Spark Experience in one or many of the following is a plus: Experience in building large-scale infrastructure for machine learning use cases Experience in delivering machine learning-based solutions in production is a big plus
Show more Show less