Big Data/ Hadoop Developer
- Employer
- Techgene Solutions LLC
- Location
- Ashburn, VA
- Closing date
- Aug 25, 2019
View more
- Industry
- Technology and Software
- Function
- Front End Developer, IT
- Hours
- Full Time
- Career Level
- Experienced (Non-Manager)
You need to sign in or create an account to save a job.
Ashburn, VA Verizon 1+ year Linkedin profile is mandatory Notes Solid experience in Hadoop Automation and Scripting experience- Jenkins or Screwdriver or any Devops idea to automate script with Github. Spark with Python(Pyspark), Scala, Hive, Teradata, Postgres, Kafka are the most essential Skills. Any prior experience with Java, NiFi, PrestoDB, Oozie is highly desired. If they have little Machine Learning Idea that would be a huge plus Description Big Data Developer to work on multiple projects in Datawarehouse. Qualifications 1. At least 5 years working experience in a Big Data Environment 2. Knowledge on design and development best practices in datawarehouse environments 3. Experience developing large scale distributed computing systems 4. Knowledge of Hadoop ecosystem and its components HBase, Pig, Hive, Sqoop, Flume, Oozie, etc. 5. Experience of Pyspark Spark SQL 6. Experience with integration of data from multiple data sources 7. Implement ETL process in Hadoop (Develop big data ETL jobs that ingest, integrate, and export data.) Converting Teradata SQL to PySpark SQL. 8. Experience in Presto, Kafka, Nifi. Roles and Responsibilities 1. Understanding business requirements helping in assessing them with the development teams. 2. Creating high quality documentation supporting the designcoding tasks. 3. Participate in architecture design discussions and Develop the ETLELT using PySpark and SparkSql 4. Conduct code and design reviews and provide review feedback. 5. Identify areas of improvement in framework and processes and strive them to make better.
You need to sign in or create an account to save a job.
Get job alerts
Create a job alert and receive personalized job recommendations straight to your inbox.
Create alert