Report this job

---

What is the problem? *

Incorrect company
Incorrect location
Job is expired
Job may be a scam
Other

Qualifications:
Job Description:
This role will be required to employ state of the art technologies that are part of the AWS, Hadoop ecosystem, which includes tools used for data ingestion, integration, modeling, and analytics. In this role, you will contribute to high quality technology solutions that address business needs by developing solutions for the platform and applications for an important business area at the Client. The business area is currently undergoing a migration from an on-premises data storage platform to a cloud platform, of which this position will play a key role. This role will be required to maintain and troubleshoot issues as they arise on the legacy on-premises platform and contribute to development and maintenance of the cloud platform. You should have strong communication skills as you will work closely with business stakeholders and data analysts. You will be required to develop and test efforts of your assigned application components to ensure successful delivery of the project.

Experience:
Bachelor degree in Computer Science, Information Systems, or other related field
5+ years of data engineering, cloud engineering experience
Experience in Agile project methodologies and DevOps
Experience with AWS (certification preferred; including Athena, Redshift, Glue), Cloudera
Experience building a CI/CD pipeline to deploy applications on AWS (GitLab, Terraform)
Advanced experience programming and scripting on Unix/Linux (i.e. Python, Bash)
Experience with CTRL-M, Cron (other) scheduling of batch jobs
Experience migrating legacy systems to cloud-ready architectures (preferred)

Responsibilities:
Responsibilities:
Capture requirements from business stakeholders and data analysts
Develop and maintain end-to-end data solutions using open-source, data lake, and enterprise data warehouse technologies (Hadoop, Spark, AWS, etc.)
Create and update data repository schema; automated processes for schema and data source validation
Ensure consistency and compliance with Client security standards and protocols
Collaborate with other internal development teams; participate in Agile development activities (e.g. daily standup, sprint planning, sprint demo)
Provide production support troubleshooting any ingestion and storage errors
Communicate effectively with stakeholders both orally and written format