Role Title: Big Data and Analytics Administrator

The following functions are the responsibility of the Big Data and Analytics Administrator within Data Team

Position Responsibilities

• Administration knowledge and experience in various data and analytics software from SAP, IBM, Informatica, Cloudera, Hortonworks


• Design and deploy a hadoop cluster, maintaining a hadoop cluster, adding and removing nodes using cluster monitoring tools like Ganglia Nagios or Cloudera Manager, configuring the NameNode high availability and keeping a track of all the running hadoop jobs


• Implementing, managing and administering the overall hadoop infrastructure.


• Takes care of the day-to-day running of Hadoop clusters


• A hadoop administrator will have to work closely with the database team, network team, BI team and application teams to make sure that all the big data applications are highly available and performing as expected


• Hadoop admin is responsible for capacity planning and estimating the requirements for lowering or increasing the capacity of the hadoop cluster


• Manage and review Hadoop log files.


• Backup and recovery tasks


• Resource and security management


• Troubleshooting application errors and ensuring that they do not occur again


• Experience in data operations and production support processes


• Work as an integrated member of the big data technology team and drive cross functional international Big Data initiatives from beginning to end with various business units


• Admin responsibility for Data Lake, Master Data Management, Data Warehouse, and Distributed Master Data


• Work with department and team leads to expand current architecture’s scalability


• Help design, instantiate, and maintain data storage setups for analytics and data science


• Troubleshoot all parts of the data pipelines as necessary

Unique Competencies:

• Required – 5+ years’ administration experience in various big data integration technologies focusing on Cloudera, Hortonworks, Informatica Big Data Management, PowerCenter, and Data Quality


• Preferred – 2+ years’ administration or development experience in reporting and analytics i.e. SAP BW, SAP Hana and SAP BI

Educational Requirements:

• Bachelors Degree in Computer Science, Information Systems, or equivalent