Sr. Data Engineer - Creditwise
McLean 2 (19052), United States of America, McLean, Virginia At Capital One, we're building a leading information-based technology company. Still founder-led by Chairman and Chief Executive Officer Richard Fairbank, Capital One is on a mission to help our customers succeed by bringing ingenuity, simplicity, and humanity to banking. We measure our efforts by the success our customers enjoy and the advocacy they exhibit. We are succeeding because they are succeeding. Guided by our shared values, we thrive in an environment where collaboration and openness are valued. We believe that innovation is powered by perspective and that teamwork and respect for each other lead to superior results. We elevate each other and obsess about doing the right thing. Our associates serve with humility and a deep respect for their responsibility in helping our customers achieve their goals and realize their dreams. Together, we are on a quest to change banking for good. Sr. Data Engineer - Creditwise As a CreditWise Sr. Data Engineer, you'll work on everything from customer-facing web and mobile applications using cutting-edge open source frameworks, to highly-available RESTful services and backend Java-based systems using the hottest techniques in Big Data. We leverage both emerging and traditional technologies like Node, Java, Angular, React, Python, REST, Ruby, HTML/HTML5, CSS, NoSQL databases, relational databases, Maven, iOS, Android, and AWS/Cloud Infrastructure, just to name a few. We believe in our people and provide endless opportunities for you to grow and expand your skillset. CreditWise is a free credit monitoring tool that helps users understand, improve, and protect their credit. With tens of million users across our Web, Android, and iOS apps, it's a fantastic place to exercise your development skills and get exposure to a breadth of technologies at scale. Want to know more about what we're building? Visit us at https://creditwise.capitalone.com , or install our free app on your iOS or Android device! We are seeking Data Engineers who can operate with a high degree of autonomy and work with product teams to create & enhance our software and data platform that enables differential capabilities and transformative customer experiences. On any given day you will : Write, review and debug code in Python, Scala or Java Develop and deploy distributed computing Big Data applications using Apache Spark, EMR, Microservices, Jenkins, Docker. Utilize Hadoop modules such as YARN, Hive and other Apache projects such as Kafka, Zookeeper, Airflow or Cassandra. We are an AWS environment so use tools like Lambda, Postgres, DynamoDB, S3, Step functions, Athena - and anything else that will help us. Plan and build data integrations between systems. Figure out the best way to share information and build the tech needed to execute- Think Data As A Service (DaaS). Leverage DevOps techniques and practices like Continuous Integration, Continuous Deployment, Test Automation, Build Automation and Test-Driven Development to enable the rapid delivery of working code. Utilize the CI/CD tools like SBT, Maven, Nexus, Artifactory, Git, Docker, Jenkins Pipelines etc. Help drive design, best practices and technical excellence in the team. Focus on the innovation and out of the box thinking. Implement cutting-edge solutions via teamwork and self-organization. Basic Qualifications Bachelor's Degree or military experience At least 8 years of experience in software development using Python, Scala or Java At least 8 years of experience with Unix/Linux systems with scripting experience in Shell, Ruby or Python At least 3 years of experience building big data solutions using Apache Spark or Hadoop ecosystem. At least 2 years of experience delivering analytical data warehouse solutions. Preferred Qualifications: 3+ years of experience with cloud-based technologies. 3+ years of experience building data pipelines and fit for purpose data stores. 2+ years of experience with Spring framework. 2+ years of experience with Machine Learning frameworks like H2O, SparkML. Familiarity with Agile engineering practices. At this time, Capital One will not sponsor a new applicant for employment authorization for this position.