Technical/Functional Skills

AWS, Glue, Athena, RDS, Kafka, Kinesis, Pyspark

Experience Required

• Data engineering background and hands-on work experience building data pipelines, ETL/ELT, using AWS services (Ex. S3, Glue, Step Function, Athena, DMS, Storage Gateway, flavors of RDS),
• Strong SQL skills
• Solid understanding of relational and dimensional data modeling
• Good Python programming skills
• Experience sourcing and exposing data via Rest API
• Applications Integration experience
• Any exposure to Snowflake, Redshift is a big plus.
• NoSQL and columnar DB experience
• Pyspark programming experience
• Knowledge/Implementation of streaming architectures is also desired (Kafka, Kinesis Data Streams, Kinesis Data Analytics, EMR).
• Good understanding of Hudi/Iceberg/Delta lake file/table formats