Senior Data Engineer - Cyber Research (Cortex)
Company DescriptionOur MissionAt Palo Alto NetworksA' (R) everything starts and ends with our mission:Being the cybersecurity partner of choice, protecting our digital way of life.We have the vision of a world where each day is safer and more secure than the one before. These aren't easy goals to accomplish - but we're not here for easy. We're here for better. We are a company built on the foundation of challenging and disrupting the way things are done, and we're looking for innovators who are as committed to shaping the future of cybersecurity as we are.Disruption is at the core of our technology and on our way of work to meet the needs of our employees now and in the future through FLEXWORK, our approach to how we work. We're changing the nature of work from benefits to learning, location to leadership, we've rethought and recreated every aspect of the employee experience at Palo Alto Networks. And because it FLEXes around each individual employee based on their individual choices, employees are empowered to push boundaries and help us all evolve, together.Job DescriptionYour careerWe're looking for an experienced data engineer to join the Cyber Research Engineering team at Cortex.Cyber Research Engineering is a cross-functional team composed of people with backgrounds at the nexus of software engineering, data analysis, threat hunt, and national security. We're responsible for performing rapid prototyping and special projects using unique datasets to deliver cybersecurity insights for government, military, and commercial customers. We're responsible for several key Operations: We collect data, perform specialized scanning, and provide provides advanced vulnerability testing. Analytics: we analyze threat intelligence, performs APT Threat Hunting, and conduct research projects tailored to the special needs public sector customers. Software Development: we builds tools for technical users, create prototypes for unique public sector use cases, and maintain/add features to our established cyber intelligence products.The work of the Cyber Research Engineering team is varied, exciting, and meaningful. We leverage endpoint and boundary devices, network traffic, internet scanning, malware sandboxes and many other datasets ranging in size from terabytes to petabytes. We encourage engineers and researchers to use these datasets in unconventional ways to produce unparalleled cybersecurity products and insights about computer networks that allow customers to better hunt those individuals who try to abuse those networks.Your Impact Help bring a new threat intelligence product to market Design and implement methods to store, query, and analyze datasets ranging in size from gigabytes to petabytes in unconventional ways to produce unparalleled cybersecurity insights Develop novel techniques and approaches for understanding the Internet and characterizing data for insights relevant to cyber threat intelligence Empower threat intelligence analysts at Palo Alto and its customers to counter bad actors across the internet.QualificationsYour Experience 4+ years of experience as a professional software engineer or data engineer for a SaaS business Professional experience designing and implementing solutions for large-scale data storage and analysis, using tools such as Google BigQuery, ClickHouse, Google BigTable, Apache HBase, or ElasticSearch Experience developing and maintaining stream-processing pipelines using Apache Apache Beam or Apache Spark Familiarity with ETL management tools, such as Apache Airflow Familiarity with distributed message queues, such as Apache Kafka or RabbitMQ. Experience managing relational databases. Proficient in SQL and database operations Experience in software development, including some level of proficiency in Python Excited to work closely with analysts to build a toolkit for discovering and tracking APT campaigns across the internet High-level understanding of computer networks, protocols, and of how the Internet works. Able/willing to acquire a security clearanceAdditional InformationOur CommitmentWe're trailblazers that dream big, take risks, and challenge cybersecurity's status quo. It's simple: we can't accomplish our mission without diverse teams innovating, together.Palo Alto Networks is evolving and changing the nature of work to meet the needs of our employees now and in the future through FLEXWORK, our approach to how we work. From benefits to learning, location to leadership, we've rethought and recreated every aspect of the employee experience at Palo Alto Networks. And because it FLEXes around each individual employee based on their individual choices, employees are empowered to push boundaries and help us all evolve, together.We are committed to providing reasonable accommodations for all qualified individuals with a disability. If you require assistance or accommodation due to a disability or special need, please contact us at accommodations@.Palo Alto Networks is an equal opportunity employer. We celebrate diversity in our workplace, and all qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or other legally protected characteristics.All your information will be kept confidential according to EEO guidelines.Covid-19 Vaccination Information for Palo Alto Networks Jobs Vaccine requirements and disclosure obligations vary by country. Unless applicable law requires otherwise, you must be vaccinated for COVID or qualify for a reasonable accommodation if: The job requires accessing a company worksite The job requires in-person customer contact and the customer has implemented such requirements You choose to access a Palo Alto Networks worksite If you have questions about the vaccine requirements of this particular position based on your location or job requirements, please inquire with the recruiter.