Hadoop Administrator

Lumen Solutions Inc
Reston, VA
Jan 05, 2021
Jan 15, 2021
Full Time
Company Description Lumen Solutions Inc. is a technology consulting Services Company based in Virginia. We provide a wide array of experienced business and IT professionals supporting clients from solution design to implementation and support. We specialize in strategy development, portfolio management and enterprise architecture. We need only Local candidate to DCVAMD area Job Description We have an urgent job opening of Hadoop Administrator for our direct client based in Reston, VA please check below job description and share your resume ASAP. Hadoop Administrator Location Reston, VA Duration Contract to Hire MUST HAVE -- Kafka streaming, NiFi (Data pipeline). HBASE and SOLR. On hands on experience in ldquoBig Data Adminrdquo NO development Full time production support role ETL experience is going to be helpful Some weekends work 5+ experience with backend tools Independently installs and maintains Big Data (Cloudera, Horton Works, etc.) clusters in high available, load balanced configuration across multiple (Production, User Acceptance, Development) environments. Under general supervision, manage Big Data Administration activities, technical documentation, system performance support, and internal customer support. May provide input into the development of Systems Architecture for mission critical corporate development projects. The incumbent will work with Solutions Architects, Infrastructure Architects, Lead Big Data Administrator, Big Data Supplier and Developers to setup environments and support the development teams. 3-5 Years Experience installConfigureMaintain Apache Cloudera tools like Hive, Impala, Sqoop, Flume, Kafka, HBase, SOLR and File formats like Avro, Parquet. Develop the scripts to Monitor the services on top of the Clusters and send out the Alerts if necessary. Working on the user Incidents who have issues with the Cloudera Services and assisting them accordingly. Developing the Best practices documentation to the Application Developer partners to educate how to use the Cloudera Services. Write the shell scripts to monitor the health check of Hadoop daemon services and respond accordingly to any warning or failure conditions. Monitoring the health of all the services running in the production cluster using the Cloudera Manager. PerformingAccessing the databases, Metastore tables and writing Hive, Impala queries using HUE. Setting up the High Availability of the Services like Hue, Hive, HBase REST, SOLR and IMPALA on top of the all new clusters that were built on the BDPaas Platform. Responsible for monitoring the health of the Services on top of the all clusters. Working closely with different teams like Application development team, Security team, Platform Support to identify and implement the Configurational changes that are needed on top of the cluster for better performance of the services. apache Kafka - strong Administration troubleshooting skills Kafka Streams API stream processing with KStreams Ktables Kafka integration with MQ Kafka broker management Topic management offset management Apache Nifi - Administration Flow management registry server management controller service management Nifi to kafka integration Nifi to Hbase integration Nifi to solr integration Flume - integration with Kafka , Nifi IBM MQ Hbase - administration database management troubleshooting solr - administration managing Logging level managing shards managing shard high availability collection management troubleshooting resource intensive long running solr queries Additional information Interview format 1st ndash Phone Screen, 2nd - Skype Location Reston, VA Compensation and benefits ndash Lumen Solutions offers competitive compensation package as well as an array of benefits matching with current industry standard based on experience and qualifications. Overview of benefits Medical, Dental, Vision, Rx Insurance Vacation, Sick Leave, Holidays 401K, Employee Referral Bonus Lumen Solutions is an EEO and presents an incredible opportunity for growth and advancement with initiatives in transportation, healthcare, and financial sectors. Contact Information Phone Number of assigned recruiter - Posted By Jaiprakash Singh Lumen Solutions, Inc. Please send resume to