It takes powerful technology to connect our brands and partners with an audience of nearly 900 million. Whether you're looking to write mobile app code, engineer the servers behind our massive ad tech stacks, or develop algorithms to help us process trillions of data points a day, what you do here will have a huge impact on our business"A cents € and the world. Want in?The Data, Measurement and Insights team at Yahoo is responsible for building scalable and highly distributed systems to support mission critical continuously running ETL processes that collect and aggregate data from thousands of web servers and Ads servers. We are looking for a talented and motivated software engineer to work on the design and implementation of data pipeline platform infrastructure and application. Challenges include designing and building high-performance, massively distributed and fault-tolerant systems to handle peta-byte of data with minimal operational overhead, and meet the requirements of various Yahoo businesses. You must be a quick learner, have good communication skills, and be able to execute engineering projects through its lifecycle: architecture/design, implementation, testing, post-release maintenance and support.Responsibilities:Build and deploy data aggregation processes.Collaborate with cross-functional teams for data capture, data processing, data aggregation, and data validation.Develop infrastructure components and tools for the data pipeline that are extensible and reusable.Build highly distributed, scalable, reliable, 24/7 data processing pipeline.Build software to reduce operations cost.Minimum Job QualificationsStrong computer science fundamentals : data structures, algorithms, programming languages, distributed systems and information retrieval.Strong in object oriented programming. Familiar with Java language.Understanding of database internals and implementation techniques; working knowledge of SQL.Experience with Perl/Python Scripting.Familiar with fault tolerance system design and high performance engineering.Strong coding background; experience writing production code.Preferable Job QualificationsKnowledge of Hadoop, MapReduce, Spark, Hive, Druid and related ecosystem.Experience with data processing/ETL tools and exposure to large-scale systems development projects.Familiarity with information retrieval techniques, Experience with implementation and design of distributed systemsExposure to cloud based platforms such as AWS.Yahoo is proud to be an equal opportunity workplace. All qualified applicants will receive consideration for employment without regard to, and will not be discriminated against based on age, race, gender, color, religion, national origin, sexual orientation, gender identity, veteran status, disability or any other protected category. Yahoo is dedicated to providing an accessible environment for all candidates during the application process and for employees during their employment. If you need accessibility assistance and/or a reasonable accommodation due to a disability, please submit a request via the Accommodation Request Form ( /careers/contact-us.html ) or call 408-336-1409. Requests and calls received for non-disability related issues, such as following up on an application, will not receive a response.At Yahoo, we know that diversity makes us stronger. We are committed to a collaborative, inclusive environment that encourages authenticity and fosters a sense of belonging. We strive for everyone to feel valued, connected, and empowered to reach their potential and contribute their best. Check out our diversity and inclusion ( /diversity/ ) page to learn more.Currently work for Yahoo? Please apply on our internal career site.