Big Data Engineer

Employer
Mindlance
Location
Henrico County, VA
Posted
Jul 20, 2021
Closes
Jul 23, 2021
Ref
2129099335
Function
Engineer, IT, QA Engineer
Hours
Full Time
Big Data Engineer (Data Engineer) Job Description Advance your career with Mindlance! We have been connecting talented IT professionals with world-class companies since 1999. Mindlance is here to help you to find the perfect fit with just the right company. Currently, we are seeking a Big Data Engineer for an exciting career growth oppor tunity. Make your next big career move with the kind of position that will allow you to be genuinely passionate about the work you do! Our recruiters will work closely with you to help you get the edge over the competition. Let Mindlance advocate for you - apply today! "Mindlance is an Equal Opportunity Employer and does not discriminate in employment on the basis of - Minority/Gender/Disability/Religion/LGBTQI/Age/Veterans."A' Big Data Engineer - Data Engineer - IT - Information Technology Job Responsibilities A' . Partner with product owners, peers, and end-users to understand business requirements and identify risk/issues in a timely matter and escalate as necessary. A' . Be the intersection with lines of business, Finance and technology. The ability to understand various perspectives is critical when optimizing an engineering solution A' . Provide technical guidance concerning business implications of application development projects A' . Leverage ETL programming skills in open-source languages including Python, Scala and SQL on various frameworks especially Apache Spark A' . Deploy DevOps techniques and practices like Continuous Integration, Continuous Deployment, Test Automation, Build Automation and Test-Driven Development to enable the rapid delivery of working code utilizing tools like Jenkins, Nexus, Git and Docker Big Data Engineer - Data Engineer - IT - Information Technology Job Requirements:Job Requirements A' A' .A' A' A' A' A' A' A' A' Solid understanding and experience in Cloud computing, preferably AWS and its services including S3, EMR/EC2 and Lambda functions A' .A' A' A' A' A' A' A' A' Solid understanding and experience in big data solutions using open-source languages such as Python and Scala on Apache Spark framework A' .A' A' A' A' A' A' A' A' Experience working on data projects and data management involving querying databases and/or transforming legacy data platforms to future data streaming platforms. A' .A' A' A' A' A' A' A' A' Solid understanding and experience in the following scripting languages. (eg Unix shell scripting, Perl etc.) A' Basic Qualification: A' .A' A' A' A' A' A' A' A' At least 2 years of experience delivering data solutions using open-source languages A' .A' A' A' A' A' A' A' A' At least 2 years of experience utilizing scripting languages A' .A' A' A' A' A' A' A' A' At least 3 years of experience developing ETL solutions A' .A' A' A' A' A' A' A' A' At least 3 years of experience utilizing SQL in complex solutions Big Data Engineer - Data Engineer - IT - Information Technology