Data Engineer

Employer
Procession Systems
Location
Manassas, VA
Posted
May 12, 2021
Closes
May 16, 2021
Ref
1976412994
Function
Engineer, IT, QA Engineer
Hours
Full Time
LOCATIONS AVAILABLEAlexandria, Arlington, McLean, Herndon, Chantilly, Washington DCOVERVIEWSupport the configuration and ingestion of designated structured, unstructured, and semi-structured data repositories into capabilities that satisfy mission partner requirements and support a data analytics and DevOps pipeline to drive the client's rapid delivery of functionality. Maintain all operational aspects of data transfers, accounting for the security posture of the underlying infrastructure and the systems and applications supported and monitor the health of the environment through a variety of health tracking capabilities. Automate configuration management, leveraging tools, including NiFi, and stay current on data extract, transfer, and load (ETL) technologies and services. Work undergeneral guidance, demonstrate an initiative to develop approaches to solutions independently, review architecture, and identify areas for automation, optimization, right-sizing, and cost reduction to support the environment's overall health. Apply specialized knowledge of data engineering-specific technologies and services, leverage expertise indatabases and various approaches to structuring and retrieving of data, comprehend Cloud architectural constructs, and support the establishment and maintenance of Cloud environments programmatically using vendor consoles. Engage with multiple functional groups to comprehend client challenges, prototype new ideas and new technologies, help to create solutions to drive the next wave of innovation, and design, implement, schedule, test, and deploy fullfeatures and components of solutions.REQUIRED QUALIFICATIONS2+ years of experience with machine learning, data science, or data engineeringExperience with the design, implementation and ETL process for databasesExperience with creating data pipelinesExperience with building machine learning models and predictive analyticsExperience with common programming languages, including SQL, Python, or RAbility to articulate workflows and explain technical concepts to non-technical audiencesAbility to interact with multidisciplinary teams including data scientists and technical consultants in project- based areasBA or BS degreeDESIRED QUALIFICATIONSExperience with Big Data technologies, including HDFS, Impala, AWS, Glue, Azure, Cloudera, Hadoop, or SparkExperience with data science frameworks including DataBricks, Data Robot, or ClouderaExperience with distributed computing and optimizing pipelinesExperience with parsing a variety of data sources including Oracle, XML, JSON, or parquetExperience with data visualization development and role of data integrationCLEARANCESecret

Similar jobs