|
Search Jobvertise Jobs
| |
Jobvertise
|
Data Engineer-AWS
Location: IN-Pune
Jobcode: 6481beab4fcff314c0ce405e
Email this job to a friend
Report this Job
- Roles & Responsibilities
- Role: Big Data Engineer
- About Organization
- Agivant Technologies is IT consulting organization focused on providing AI Led Digital Transformation Consulting services to enterprise customers. Agivant has adopted AI First strategy to drive value in form of Agility, Quality, Efficiency, Competitive advantage, Customer experience as core principles. Our focus is to drive data driven decision culture by analyzing vast amount of amount at scale.
- At Agivant, Mentorship and enablement is the core culture of the organization, we believe in The only way to do great work is to love what you do.
- Role Description
- 1. Designing, implementing, and managing highly scalable, fault-tolerant, and secure data pipelines on AWS.
- 2. Developing and maintaining data processing solutions using AWS technologies such as Amazon S3, AWS Glue, AWS Lambda, AWS EMR, AWS Redshift, and AWS Athena.
- 3. Writing complex ETL (Extract, Transform, Load) jobs to ingest data from various sources, cleanse and transform the data, and load it into the target systems.
- 4. Building data models and data warehouses to support reporting, analytics, and business intelligence initiatives.
- 5. Developing data visualization and reporting solutions using tools such as Tableau, Power BI, or AWS QuickSight.
- 6. Ensuring data security and compliance with industry standards such as GDPR, HIPAA, and PCI DSS.
- 7. Troubleshooting and optimizing data pipelines and infrastructure to ensure high performance and reliability.
- 8. Continuously monitoring and improving the data infrastructure to ensure scalability, availability, and cost-effectiveness.
- 9. Staying up-to-date with the latest AWS technologies, trends, and best practices in data engineering.
- Required Qualifications
- - Degree in computer science, information technology, or a related field
- - Experience with technologies such as Data Lake, SQL, PostgreSQL, Spark, and Kafka
- - Proficiency in programming languages such as Scala, Java or Python, and experience with distributed computing and database systems.
- - Strong problem-solving and analytical skills, as well as excellent communication and collaboration skills, are also important for success in this role.
- - Industry experience: 4 Years to 7 years
- Engineers needs to be self-motivated and objective driven. He / She should be ready to learn new domain and technology based on organization strategy.
R3 Consultant
|
