Hadoop Cloudera Administrator

Virginia Beach, VA
Aug 01, 2019
Aug 16, 2019
Full Time
Hadoop Cloudera Administrator

  • Bachelor's Degree in computer science or related degree and 7+ years of IT experience
  • 3 to 5 years of Hadoop administration experience, preferably using Cloudera
  • 3+ years of experience on Linux, preferably RedHat/SUSE
  • 1+ years of experience creating map reduce jobs and ETL jobs in Hadoop, preferably using Cloudera
  • Healthcare industry experience preferred

Job Duties
  • Stewardship the overall Cloudera architecture and infrastructure. Responsible for of sizing, scaling and supporting 60+ nodes in a new implementation.
  • Working with data application teams and customers to setup new Hadoop users, Linux users, Kerberos principals and LDAP integration and verification of HDFS, Hive, Pig and MapReduce access for the new users
  • Cluster maintenance as well as the creation and removal of nodes using tools like Ganglia, Nagios, or Cloudera Manager Enterprise.
  • Performance tuning and troubleshooting of Hadoop clusters and Hadoop MapReduce routines
  • Performance tuning and troubleshooting of Spark/SQL performance when using Impala, SAP Vora or similar SQL/Spark engine.
  • Mentoring and maintain Hadoop cluster job performances and capacity planning
  • Monitor and maintain Hadoop cluster connectivity, security and log files
  • Monitor and maintain File system and HDFS
  • Ability to work with the storage, network, database, and business intelligence teams to provide data quality and high availability
  • Coordinate with Unix team and vendors to install operating system updates, Hadoop updates, patches, version upgrades when required
  • General DBA responsibilities such as database backup and recovery, database connectivity and security, automation of tasks, and database provisioning.
  • Participate in call rotation for all products supported by the BI systems architecture team

  • Experience with Hadoop architecture, administration and database management
  • Experience maintaining Hadoop clusters.
  • Experience sizing and scaling clusters, adding and removing nodes, provisioning resources for jobs, job maintenance and scheduling
  • Strong understanding of JVM debugging, management and tuning
  • Operational experience with Hadoop technologies include Ambari, Ranger, Atlas, Knox, NiFi, Kafka, Storm, Hive, Pig, MapReduce, HDFS, HBase, Accumulo, Spark
  • Experience with relational databases (preferably Microsft SQL Server) and data warehouse concepts
  • Experience with IBM MDM Infosphere/Datastage in a Hadoop environment.
  • Familiarity with Java programming


Education Level
Bachelor's Level Degree - COMPUTER SCIENCE - Experience in lieu of education: Yes

Required: Database Management - 7 years, Information Technology - 7 years

Preferred: None, unless noted in the "Other" section below

None, unless noted in the "Other" section below

Required: Complex Problem Solving, Microsoft Office, Microsoft Visio, Project, Project Management, Service Orientation, Technology Design, Time Management

Preferred: None, unless noted in the "Other" section below

Expert knowledge of relational and star schema databases; stored procedure development; data modeling and application data design; enterprise-level, N-tier architectures in a Microsoft environment; and MS/SQL server. Bachelors Degree or 4 years of related experience required.

Similar jobs

More searches like this