Report this Job
Spark AWS
Experience 11 to 12 years
Required Technical Skills apache spark hive
Nice to have skills apache spark hive technology
1 Provide technical leadership and responsible for all aspects of data engineering including requirements analysis application design and code
2 Must have strong technical ability in Designing and implementing highly performant data ingestion and processing pipelines using Apache SparkScala and or AWS Databricks and related cloud and big data technologies AWS Spark Hive Airflow RDS S3 API gateway Streamsets etc
3 Very Strong SQL with any knowledge of Snowflake data modelling is nice to have
4 Ability to perform Poc for evaluating performance and tools against new requirements
5 Participate in discussions with key Stakeholders and ability to present and collaborate effectively towards the desired recommended solution architecture
6 Lead from the front to troubleshoot issues and propose solutions Coordinate with team for resolution of technical functional issues
7 Developing scalable and reusable frameworks for data ingestion and processing Ability to work in factory model environments and lead multiple projects
8 Coordinate with Solution Architects and Business Analyst to ensure all requirements are implemented accurately
9 Support during SIT and UAT phase on providing clarifications fixes closure of all defects
10 Work with Platform DevOps team with code reviews and migration to higher environments
11 Strong verbal and written communication skills
12 Strong knowledge of business protocol time management and organizational skills
13 Must be able to multitask and able to work with team guide and lead the offshore team
Peritus Inc
