Senior Data Engineer

Location
Washington, DC
Posted
Aug 04, 2021
Closes
Sep 08, 2021
Ref
JR-90272150
Function
Engineer, IT, QA Engineer
Industry
Engineering
Hours
Full Time
Job Description

Arc XP ( www.arcxp.com ) is a cloud-based digital experience platform that helps enterprise companies, retail brands and media and entertainment organizations create and distribute content, drive digital commerce, and deliver powerful multichannel experiences. A division of The Washington Post, Arc XP has powered the digital transformation of customers across the globe, currently serving more than 1,500 sites in 25 countries that reach more than 1.5 billion unique visitors monthly.

We're looking for a Senior Data Engineer to join the Commercial Business Intelligence team. The Commercial Business Intelligence Team is architecting new ways to surface insights to both the Washington Post and our SAAS customers. We are looking for a self-motivated engineer with a conscientious mentality and a relentless commitment to quality and stability.

Responsibilities
  • Participate in all stages of software development - from early brainstorming to coding and bug fixing
  • Model, query, and analyze large, business-critical datasets
  • Architect, build and deploy on AWS
  • Plan and then execute successful complex technical projects in an Agile process.
  • Help in on call activities when the ETL is broken or have data issues.
  • Assist business with ad hoc reports and business requirements.


Qualifications

Minimum Qualifications
  • BA/BS in Computer Science or related technical field or equivalent practical experience.
  • 6+ years of experience modeling, querying and analyzing large datasets using SQL
  • 6+ years ETL/ELT experience
  • 3+ years of Python programming skills
  • Strong Hive and Pyspark skills
  • Experience building business-critical, data processing pipelines on AWS


Preferred Qualifications
  • Experience using stream and batch processing technologies including Hadoop, Spark, and Kafka
  • Experience with AWS data warehouse technologies including GLUE ETL, Lambda, S3, EMR, and EC2
  • Experience with multiple database technologies including Postgres, MySQL, MongoDB, and DynamoDB


The Post strives to provide its readers with high-quality, trustworthy news and information while constantly innovating. That mission is best served by a diverse, multi-generational workforce with varied life experiences and perspectives. All cultures and backgrounds are welcomed.

The innovation doesn't end in the Newsroom - dozens of teams power The Washington Post. We are now hiring the next innovator - how will you Impact Tomorrow?

#washpostlife

Similar jobs