Lead Data Engineer

Employer
Capital One
Location
Studley, VA
Posted
Oct 13, 2020
Closes
Oct 19, 2020
Ref
1299750513
Function
Engineer, IT, QA Engineer
Hours
Full Time
Locations: VA - Richmond, United States of America, Richmond, Virginia Lead Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who love to solve real problems and meet real customer needs. We are seeking Data Engineers who will be a part of a team that s building new analytical and machine learning tools and frameworks to exploit advantages in the latest developments in cloud computing. As a Capital One Data Engineer , you ll have the opportunity to be on the forefront of driving a major transformation within Capital One. Learn more about #lifeatcapitalone and our commitment to diversity & inclusion by jumping to slides 25-40 on our Corporate Social Responsibility Report. What You ll Do: Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies Work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Snowflake Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment Perform unit tests and conducting reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance Basic Qualifications: Bachelor s Degree At least 6 years of experience in application development At least 2 years of experience in big data technologies (Cassandra, Accumulo, HBase, Spark, Hadoop, HDFS, AVRO, MongoDB, or Zookeeper) Preferred Qualifications: Master's Degree 8+ years of experience in application development 3+ year experience working on streaming data applications (Spark Streaming, Kafka, Kinesis, and Flink 1+ years of experience with Amazon Web Services (AWS), Microsoft Azure or another public cloud service 2+ years of experience with Ansible / Terraform 3+ years of experience with Agile engineering practices 3+ years in-depth experience with the Hadoop stack (MapReduce, Pig, Hive, Hbase) 2+ years of experience with NoSQL implementation (Mongo, Cassandra) 3+ years of experience developing Java based software solutions 5+ years of experience in at least one scripting language (Python, Perl, JavaScript, Shell) 5+ years of experience developing software solutions to solve complex business problems 3+ years of experience with UNIX/Linux including basic commands and shell scripting Capital One will consider sponsoring a new qualified applicant for employment authorization for this position.