Hadoop Cluster Administrator

Newport Beach Contract Live

Required Skills

My Compatibility Score

Choose Match Score option:

hadoop Linux Perl Python ruby Shell Chef Cloudera HBase Impala infrastructure management Nagios Puppet scripting Spark Unix YARN
show more
Automatch with LinkedIn
Technical Skills:
• Extensive working knowledge of Linux (RHEL) administration and engineering
• Advanced shell scripting in Python/Perl/Ruby
• Expert knowledge of HDFS, Spark, YARN, HBase, and Impala
• Hadoop and UNIX capacity planning and performance tuning
• Advanced working knowledge of automation tools (Chef, Puppet) a plus
• Experience in grid monitoring tools (Ganglia, Nagios, Cloudera Manager, etc.)
• Cloudera Certified Administrator a plus
• B.S. in Computer Science a plus

Responsibilities:
• Design and administer multi-clusters of Hadoop ecosystems (Cloudera distribution)
• Install and upgrade Hadoop ecosystem (patch management, upgrading modules, etc.)
• Perform capacity planning and performance tuning
• Debug Hadoop jobs
• Work with infrastructure engineers to diagnose system failures and performance bottlenecks
• Work with developers to derive at Hadoop use cases and solutions
• On-call rotation for off-hours support and administration read more