Solution Architect - Lead Data Engineer (Senior Manager)

Capital One
Suburb Maryland Fac, MD
Dec 03, 2021
Dec 05, 2021
Full Time
Locations: VA - Richmond, United States of America, Richmond, VirginiaSolution Architect - Lead Data Engineer (Senior Manager)Senior Manager, Solutions ArchitectAs a Capital One Senior Manager, Solutions Architect, you'll be part of the Tech Automation and Optimization Team team dedicated to solving Enterprise scale problems in the space of IT Operations, Network monitoring, Cyber using automation, real time big data analytics and machine learning. You will partner with Senior Engineers, Data Scientists, Product Managers, and Delivery Leads from our Data Engineering, Software Engineering and Data science teams in the detailed technical design, development, and implementation of machine learning applications using existing and emerging technology platforms. Working within an Agile environment, you'll serve as a technical lead, guiding architectural design decisions, developing and reviewing application code, and ensuring high availability and performance of our machine learning applications. You'll have the opportunity to continuously learn and apply the latest innovations and best practices in Data Engineering. You'll mentor other engineers and develop your technical knowledge and skills to keep Capital One at the cutting edge of technology.What you'll do in the role:Architect solutions that solve real-world business problems, while working in collaboration with our Product, Engineering and Data Science teamsCollaborate as part of a cross-functional Agile team to create and enhance software that enables state-of-the-art, next generation big data and machine learning applicationsLeverage cloud-based architectures and technologies to deliver optimized Machine Learning models at scaleConstruct optimized data pipelines to feed Machine Learning modelsUse programming languages like Python, Scala, or JavaLeverage Continuous Integration and continuous deployment best practices, including test automation and monitoring, to ensure successful deployments of application code and ML models developed by our Data Science teamAdvocate for software and machine learning engineering best practicesFunction as the engineering tech lead for large-scale initiativesAs a Senior Manager Solutions Architect you will work with and apply technologies in categories such as:Cloud Computing Services (AWS)Data Management Solutions (Metadata, Lineage, Quality, etc.)Big Data Programming Frameworks (Data Pipeline, Spark, Glue etc.)Big Data Storage and Visualization SolutionsStreaming Technologies (Kafka, Kinesis etc.)Performance and Scaling TechniquesIntegration PatternsMicroservicesOpen Source SoftwareWho You Are:You are passionate about architecture, and applying it to cutting edge distributed systems.You love the comradery, debates, and leaning that comes from working with a team of fellow architectsCan see the impact of near term and long term choices, and are great at explaining itEnergized by challenges; incredible at technical analysis, and focus on doing the right thingExcel at building and leveraging trust with technical & people leaders across teams to gain alignmentYou are a life-long learner & mentorResponsibilities Include:Lead domain destination architecture design for AI based monitoring applications in the Monitoring, Incident management, Network and Cyber domainsProvide solutions or guidance to feature teams to not only increase speed to market but also lower long term maintenance cost while meeting all non-negotiable no-functional requirementsLeading Trade-off and impact analysis work for hard to change technical decisions, and manage technical conflictDevelop patterns, best practices, or reference implementations via POC or research and promote these in broader communities.Acting as a thought leader and strategist with our delivery and product partnersAdvocating for and representing Tech Automation and Optimization team in the Architecture Review Boards, and various product, platform and architecture discussionsPresenting work products and strategies to product managers, technology leadership across Capital OneDefining, executing and continuously improving our internal architecture processesEngage with other technology partners to further improve company common capabilities or to develop adoption strategies.Develop junior developers via mentoringBasic Qualifications:Bachelor's DegreeAt least 8 years of enterprise experience designing and building data-intensive solutions using distributed computingAt least 3 years of enterprise software engineering experience with Python, Scala, or JavaAt least 2 years of experience creating solutions architectures in a public cloud (AWS, Microsoft Azure, or Google Cloud)At least 2 years of enterprise experience with monitoring tools (Splunk, Elasticsearch or Cloudwatch)At least 3 years of enterprise experience building, scaling, and optimizing Machine Learning systemsAt least 2 years of people leadership experiencePreferred Qualifications:Master's degree10+ years of enterprise software engineering or data engineering with Python, Scala or Java6+ years of enterprise experience as a Solutions Architect4+ years of enterprise developing and deploying Machine Learning solutions in a Public Cloud environment (AWS, Azure, or Google Cloud)4+ years of enterprise experience with distributed systems, API, microservices, data processing, databases (relational, NoSQL, or time-series), streaming/messaging platforms, DevOps, resilience and stability2+ years of enterprise experience with Machine Learning frameworks (scikit-learn, PyTorch, Dask, Spark, or TensorFlow)2+ years of enterprise experience with gathering and preparing data for Machine Learning models2+ years of enterprise experience building production-ready Data Pipelines that feed Machine Learning models4+ years of people leadership experienceAWS CertificationCapital One will consider sponsoring a new qualified applicant for employment authorization for this position.No agencies please. Capital One is an Equal Opportunity Employer committed to diversity and inclusion in the workplace. All qualified applicants will receive consideration for employment without regard to sex, race, color, age, national origin, religion, physical and mental disability, genetic information, marital status, sexual orientation, gender identity/assignment, citizenship, pregnancy or maternity, protected veteran status, or any other status prohibited by applicable national, federal, state or local law. Capital One promotes a drug-free workplace. Capital One will consider for employment qualified applicants with a criminal history in a manner consistent with the requirements of applicable laws regarding criminal background inquiries, including, to the extent applicable, Article 23-A of the New York Correction Law; San Francisco, California Police Code Article 49, Sections 4901-4920; New York City's Fair Chance Act; Philadelphia's Fair Criminal Records Screening Act; and other applicable federal, state, and local laws and regulations regarding criminal background inquiries.If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation, please contact Capital One Recruiting at 1-800-304-9102 or via email at All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodations.For technical support or questions about Capital One's recruiting process, please send an email to Careers@capitalone.comCapital One does not provide, endorse nor guarantee and is not liable for third-party products, services, educational tools or other information available through this site.Capital One Financial is made up of several different entities. Please note that any position posted in Canada is for Capital One Canada, any position posted in the United Kingdom is for Capital One Europe and any position posted in the Philippines is for Capital One Philippines Service Corp. (COPSSC).