Report this job

---

What is the problem? *

Incorrect company
Incorrect location
Job is expired
Job may be a scam
Other

Sr. AWS Data Engineer

Location: 100% Remote

Duration : 1+ Year

Job Summary:

We are seeking an experienced AWS Data Engineer to join our team. The successful candidate will be responsible for designing, building, and maintaining our AWS-based data infrastructure, as well as ingesting, processing, and enriching data from various sources into our data warehouse. The ideal candidate will have a strong background in data warehousing, ETL processes, data ingestion, data processing, data enrichment, and cloud-based technologies, particularly AWS. The role will be responsible for mentoring team members and will participate in more architect level activities.

Responsibilities:

• Mentor/lead team members
• Create data ingestion approaches and architect solutions
• Design, build, and maintain AWS-based data infrastructure.
• Ingest data from various sources such as APIs, logs, and databases.
• Process data using technologies such as Spark, Hive, or Presto to prepare it for analysis.
• Enrich data using tools such as AWS Glue or Lambda to add additional information or context.
• Develop ETL processes to move data from various sources into our data warehouse.
• Develop and maintain documentation for data infrastructure and processes.

Must have requirements:

• 10+ years of experience in building High-available, Resilient, Scalable and Performant applications
• Examples of where they have played a senior/leadership/mentoring role
• Extensive experience on Python programming language
• Build data pipelines in a scalable cloud environment
• Proficiency with the following
  • Data - Python, PySpark, sparkSQL , managed in AWS ( Glue , Athena, Step Functions, Event Bridge Rules, SQS, SNS, S3, lambda, Sagemaker notebook)
  • Infra/DevOps - AWS (Service Catalog, Cloudformation Stacks, Code Pipeline), Git, CircleCI, SonarCube, Docker
• Strong background with system design, documentation, implementation and deployment on
  Hands on experience in Relational or NoSQL Databases
• Strong relational or NoSQL skills and experience with data warehousing concepts and practices.

Nice to have requirements:

• Experience with Docker Containers, Microservices and AWS technologies like Lambda, Step Functions, DynamoDB, CloudWatch, Elastic Container Service
• Experience building REST APIs
• Good understanding of Virtual machines, Linux/Unix OS and commands.
• Hands on experience on complete CICD tooling (GIT, Circle CI)