Data Engineer - Big Data (TS Clearance)

May 25, 2023
Jun 24, 2023
Full Time
Job Title: Software Engineer / Data Engineer

Location: Hybrid - Crystal City, VA and 1- 2 days remote

Clearance: Active TS; TS/SCI is preferred

The Challenge:

We need an engineer who knows how hardware and software components fit together and integrate with cloud based resources, to help us modernize a DoD client's data pipelines. We are seeking an engineer who is comfortable stepping outside of their comfort zone and learning new technologies in order to propel our command into the future.

As a data engineer on our team, you'll leverage expertise in data pipeline services and architectures to support mission-critical operations. You'll recommend tools and capabilities based on your research of the current environment and knowledge of various on-premise, cloud based, and hybrid resources. You'll work with the client's migration teams to implement strategy and data pipeline design. This is an opportunity to stay on top of the latest data architecture resources as you prototype using multiple data pipelines. You'll be able to gain experience in designing data pipelines while providing critical support to the client's mission. Join our team as we transform the client's critical data pipelines by taking advantage of emerging technologies

You Have:
  • 5+ years of experience with demonstrated strength in data lake/warehouse technical architecture, infrastructure components, and ETL/ELT pipelines
  • 5+ years of experience with workflow management engines (i.e Airflow, AWS Step Functions, Prefect)
  • Experience with non-proprietary big data technologies (Presto, Hive, Spark, Flink etc.) - Presto/Trino is preferred
  • Experience understanding requirements, analyzing data, discovering opportunities, addressing gaps and communicating them to multiple individuals and stakeholders
  • 5+ years with hands-on experience in writing complex, highly-optimized SQL queries across large data sets
  • 5+ years of experience with scripting languages like Python
  • Experience in leading and delivering end-to-end data pipelines
  • Top Secret Clearance required to apply, candidates must be eligible for and obtain TS/SCI clearance before starting
  • BA or BS degree preferred

Nice If You Have:
  • Experience with deploying containerized microservices in kubernetes infrastructure
  • Experience with working in defense or intelligence community cloud environments is a plus
  • Experience with developing and managing machine images or templates to automate cloud deployments
  • Experience with optimizing data pipelines, including leveraging native cloud capabilities, right-sizing servers, expanding storage, and tracking cost efficiencies at the microservice level
  • Experience with configuring and aggregating logs for data analysis using Splunk or ELK solutions


Applicants selected will be subject to a security investigation and may need to meet eligibility requirements for access to classified information; TS/SCI

About Us:

IntelliBridge delivers IT strategy, cloud, cybersecurity, application, data and analytics, enterprise IT, intelligence analysis, and mission operation support services to accelerate technical performance and efficiency for Defense, Civilian, and National Security & Federal Law Enforcement clients.