Data Engineer - Big Data (TS Clearance)
- Employer
- IntelliBridge
- Location
- VA
- Salary
- Competitive
- Posted
- May 25, 2023
- Closes
- Jun 24, 2023
- Ref
- 3387
- Function
- IT
- Industry
- Technology and Software
- Hours
- Full Time
Job Title: Software Engineer / Data Engineer
Location: Hybrid - Crystal City, VA and 1- 2 days remote
Clearance: Active TS; TS/SCI is preferred
The Challenge:
We need an engineer who knows how hardware and software components fit together and integrate with cloud based resources, to help us modernize a DoD client's data pipelines. We are seeking an engineer who is comfortable stepping outside of their comfort zone and learning new technologies in order to propel our command into the future.
As a data engineer on our team, you'll leverage expertise in data pipeline services and architectures to support mission-critical operations. You'll recommend tools and capabilities based on your research of the current environment and knowledge of various on-premise, cloud based, and hybrid resources. You'll work with the client's migration teams to implement strategy and data pipeline design. This is an opportunity to stay on top of the latest data architecture resources as you prototype using multiple data pipelines. You'll be able to gain experience in designing data pipelines while providing critical support to the client's mission. Join our team as we transform the client's critical data pipelines by taking advantage of emerging technologies
You Have:
Nice If You Have:
Clearance:
Applicants selected will be subject to a security investigation and may need to meet eligibility requirements for access to classified information; TS/SCI
About Us:
IntelliBridge delivers IT strategy, cloud, cybersecurity, application, data and analytics, enterprise IT, intelligence analysis, and mission operation support services to accelerate technical performance and efficiency for Defense, Civilian, and National Security & Federal Law Enforcement clients.
Location: Hybrid - Crystal City, VA and 1- 2 days remote
Clearance: Active TS; TS/SCI is preferred
The Challenge:
We need an engineer who knows how hardware and software components fit together and integrate with cloud based resources, to help us modernize a DoD client's data pipelines. We are seeking an engineer who is comfortable stepping outside of their comfort zone and learning new technologies in order to propel our command into the future.
As a data engineer on our team, you'll leverage expertise in data pipeline services and architectures to support mission-critical operations. You'll recommend tools and capabilities based on your research of the current environment and knowledge of various on-premise, cloud based, and hybrid resources. You'll work with the client's migration teams to implement strategy and data pipeline design. This is an opportunity to stay on top of the latest data architecture resources as you prototype using multiple data pipelines. You'll be able to gain experience in designing data pipelines while providing critical support to the client's mission. Join our team as we transform the client's critical data pipelines by taking advantage of emerging technologies
You Have:
- 5+ years of experience with demonstrated strength in data lake/warehouse technical architecture, infrastructure components, and ETL/ELT pipelines
- 5+ years of experience with workflow management engines (i.e Airflow, AWS Step Functions, Prefect)
- Experience with non-proprietary big data technologies (Presto, Hive, Spark, Flink etc.) - Presto/Trino is preferred
- Experience understanding requirements, analyzing data, discovering opportunities, addressing gaps and communicating them to multiple individuals and stakeholders
- 5+ years with hands-on experience in writing complex, highly-optimized SQL queries across large data sets
- 5+ years of experience with scripting languages like Python
- Experience in leading and delivering end-to-end data pipelines
- Top Secret Clearance required to apply, candidates must be eligible for and obtain TS/SCI clearance before starting
- BA or BS degree preferred
Nice If You Have:
- Experience with deploying containerized microservices in kubernetes infrastructure
- Experience with working in defense or intelligence community cloud environments is a plus
- Experience with developing and managing machine images or templates to automate cloud deployments
- Experience with optimizing data pipelines, including leveraging native cloud capabilities, right-sizing servers, expanding storage, and tracking cost efficiencies at the microservice level
- Experience with configuring and aggregating logs for data analysis using Splunk or ELK solutions
Clearance:
Applicants selected will be subject to a security investigation and may need to meet eligibility requirements for access to classified information; TS/SCI
About Us:
IntelliBridge delivers IT strategy, cloud, cybersecurity, application, data and analytics, enterprise IT, intelligence analysis, and mission operation support services to accelerate technical performance and efficiency for Defense, Civilian, and National Security & Federal Law Enforcement clients.