Description:The Contractor shall develop new tools, code, and services to execute data engineering activities on Sponsor provided systems. Data engineering activities for each Mission Center and/or mission partner organization shall include the following tasks:Movement of structure and unstructured data (gigabyte to terabyte range) using Sponsor approved methodsExecute data ingestion activities for storing data in a local or enterprise level (Integrated Data Layer) locationView data in its source formatDevelop code to format data that facilitates explorationAnalyze source data formats and work with Data Scientists and Mission Partners to determine the formats and transforms that best meet mission objectivesDevelop code and tools to provide one-time and on-going data formatting and transformations into enterprise or boutique data modelsImplement existing ETL code and best practices/standards that are currently in use in the enterpriseDevelop an ETL Code Transition Plan when the Sponsor identifies a specific project. Projects will be identified periodically. The draft is due after 30 days of notification from the Sponsor. The plan should include details on how the code can be integrated into the enterprise ETL service portfolio. The final plan is due 30 days after receiving comments from the SponsorDevelop and deliver Software Documentation for each code project that includes ETL mappings, code use guide, code location (generally GitHub) and access instructions), and anomalies encountered.Facilitate Code Reviews twice a year for each Mission Center or mission partner organization and one for each project. Code Reviews shall identify bugs and areas for code improvement to ensure high quality software. Contractor shall document results.The Contractor shall provide consulting services to the Mission Partner to support mission needs for data transport, ingestion, conditioning, access, and management. The Contractor shall support code review with the Sponsor up to two times a year.Required skills:AWS (Intermediate)Linux (Intermediate)Python (Intermediate)SQL (Intermediate)HTTP API Usage/Integration (Intermediate)Experience analyzing diverse file types (text, image, video, audio, and binary) (Basic)Experience with geospatial tools/data (Basic)Active Fullscope Lifestyle Polygraph clearance (no exceptions)Desired skills:Docker (Intermediate)Puppet (Intermediate)Solr (Basic)Postgres Admin(Basic)MariaDB Admin (Basic)Hadoop/Spark (Intermediate)ElasticSearch (Intermediate)Kibana (Basic)Kafka (Beginner)NiFi (Intermediate)Powered by JazzHRRNS32wQ7Sl