Senior Data Engineer

Washington, DC
Dec 05, 2022
Dec 07, 2022
Engineer, IT, QA Engineer
Full Time
A$ A' "A' ?We are looking for a mid-level to senior Data Engineer to join our Infrastructure team located in Washington, DC. The Infrastructure team is an integral part of our Engineering division and works closely with our Software Engineering & Data Science teams, as well as other key stakeholders across the business.What You Will Do: As a member of our engineering team, you will work to maintain existing ETL pipelines and add additional pipelines to implement new features. These pipelines terminate in several different databases including Apache Cassandra, Elasticsearch, Postgres, and Tigergraph (a cutting edge in-memory graph database). In addition to developing pipelines, you'll contribute to the design of the database schemas to ensure that data can be efficiently retrieved by the application.What You Will NeedStrong experience with Scala and Python2+ years of experience designing and maintaining ETL pipelinesExperience using Apache SparkExperience with data orchestration frameworks like Apache AirflowSolid experience working with multiple databases, for example: Cassandra, Neo4J, or ElasticsearchExperience working on a cloud platform like GCP, AWS, or AzureExperience working collaboratively with gitWhat We Would LikeExperience with, or interest in, graph databasesExperience with Docker and KubernetesWho You AreStrong process-oriented self-starter, with impeccable organizational skillsExperienced in supporting and working with cross-functional teams in a dynamic environmentInterested in learning from and mentoring team membersPassionate about open source development and innovative technologyPlease note: No sponsorship is available for this position. Applicants must be currently authorized to work in the United States for any employer.

Similar jobs