Design, build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services in combination with 3rd parties - Spark, EMR, Kinesis, Kafka, API data,.
• Experience of Big data and Hive
• Analyze, re-arch itect and re-platform on-premise data warehouses to data platforms on AWS cloud using AWS or 3rd party services.
• Design and build production data pipelines from ingestion to consumption within a big data architecture, using Java, Python, Scala.
• Design and implement data engineering, ingestion and curation functions on AWS cloud using AWS native or custom programming.
• Perform detail assessments of current state data platforms and create an appropriate transition path to AWS cloud.
• Experience of Snowflake knowledge preferable
• Experience of ELK (Elasticsearch, Logstash, and Kibana) preferable