Develop and support ETL pipelines using Python & Pyspark with robust monitoring and alarming.
Develop data models that are optimized for business understand-ability and usability.
Develop and optimize divisional data lake using best practices for partitioning, compression, parallelization, etc.
Develop and maintain metadata, data catalog, and documentation for internal business customers.
Help internal business customers troubleshoot and optimize SQL and ETL solutions to solve reporting problems.
9+ years of Datawarehouse Experience with Oracle/teradata/Redshift.
Nityo Infotech
