Big Data, GCP-AMEX

<table border="0" cellpadding="0" cellspacing="0"> <tbody> <tr> <td> <div>A Data Engineer with expertise in Google's data platforms is responsible for designing, building, and maintaining data engineering solutions on Google's Cloud ecosystem. This includes utilizing services such as Google DataProc, DataFlow, PubSub, BigQuery, Big Table, Cloud Spanner, CloudSQL, and AlloyDB for batch and real-time data pipelines, data migration, and data layer design. The Data Engineer should be proficient in using Google Cloud Storage, BigTable, BigQuery DataProc with Spark and Hadoop, Google DataFlow with Apache Beam or Python, and other open source technologies like Apache Airflow, dbt, Spark/Python, or Spark/Scala. Experience in developing and managing batch and real-time data pipelines for Data Warehouse and Datalake, as well as scheduling and managing the data platform using Google Cloud Scheduler and Cloud Composer (Airflow), is essential.</div> </td> </tr> </tbody> </table>