Senior Data Engineer, Data Products - Ingestion, Processing and Curated Analytical Models
LTK is the largest influencer-driven platform used by millions of shoppers every month to find new styles and products curated by influencers all over the world. As a Senior Data Engineer II, you will be part of a growth-hungry, acceleration-minded team of problem-solvers and product-builders. This is an opportunity to grow with a fast-growing organization. We thrive in an extremely dynamic competitive environment. We focus relentlessly on the needs of our influencers, brands, and consumers. We seek thought-leaders who can collaborate effectively with product managers, designers, and engineers to identify actionable insights to help us grow.Title: Senior Data Engineer II - Data Products | Ingestion and CurationResponsibilitiesSenior data engineering leader responsible for building robust, reliable, and usable data pipelines and data sets that are used to fuel LTK's products, analytics, and data science solutionsBring modern technical strategies that optimize data engineering technical approach, workflows, and processesLead data engineering optimization projects and initiativesLead all aspects of data pipeline design activities (definition, analysis, architecture design, estimation)Participate in shaping, scoping, and setting technical direction for major projects and initiatives, working with product owners and engineering leadsLead analytical dimensional model design activities and support on-going improvement and useability of high value data setsIdentify high value opportunities for using our data to drive the business forwardSet robust, comprehensive design and development standards with clarityDevelop reusable data engineering approaches and patternsServe as a mentor to more junior data engineers; guide and facilitate work of other team membersLead out in an agile development environment, effectively planning, grooming, and delivering data engineering workProduce high quality technical documentation and artifacts that are easily consumable by data teams and other engineering teamsQualificationsExperience building production data pipelines, ELT/ETL solutions, data lakes, and data warehouses at a large scale7-8+ years in data engineering role on cloud data platform (min 4 years AWS)Programming proficiency in cloud data ecosystem using Python, R or Scala (min 5 years)5+ years utilizing large scale Analytic/MPP data warehouse platform (Redshift, Snowflake, Vertica, etc.)Highly proficient with complex SQLHighly proficient with modern analytical/dimensional modeling approaches, key management techniques, and understanding of how data sets can power a variety of analytic use cases (clustering, segmentation, regression, etc.)Highly proficient in engineering data pipelines using big data tooling (Spark, Hudi, Kafka)Highly proficient working in AWS cloud environment (S3, Cloud Formation, RDS, AWS Glue, Athena, EMR, Kinesis, Redshift)Strong understanding of cloud computing and optimization techniquesDemonstrated leadership and specialized expertise in at least three (3) of the following:Batch data ingestionBig data pipeline engineering and optimizationAnalytic/MPP data warehouse optimizationAnalytical data modelingEvent streaming data processingData pipeline metadata observabilityData Platform Cost OptimizationDataOpsSpecialized expertise designing and working with at least three (3) of the following data domains:Retail product dataEcommerce dataConsumer profile dataClickstream dataConsumer event dataMarketing channel/campaign dataAffiliate dataRetailer/Brand dataPreferred QualificationsAWS Certified Data Analytics - Specialty CertificationExposure and experience with multiple platform stacks and tooling (Databricks, Snowflake, DBT, Airflow Orchestration, etc.)What's in it for you as an employee of LTK?Interesting problems to solveCompetitive comp and benefits including medical, dental, and visionPaid Maternity and Paternity LeaveWellness benefits including workout from home with our live Virtual Fitness Classes! 401k retirement plan with LTK matching contributionFlexible work schedule plus Summer Fridays (Workday ends at 3pm)Virtual Company Happy Hours and Virtual Team Events! Disrupting the retail industry! What you have to look forward to when you work or visit for team huddles at a LTK Office: Fully stocked bars and kitchen (free snacks all day!) Catered meals weekly Monthly Chair massagesLaidback office environment Monthly themed Happy Hours! Free access to state of the art gym while working in or visiting our Dallas HQFree Covered Parking on-site while working in or visiting our Dallas HQAbout UsLTK is the largest global influencer marketing platform. Founded in 2011 by Amber Venz Box and Baxter Box, the company's mission is to empower the world's premium lifestyle creators to be as economically successful as possible.Now in its 10th year, LTK has grown to become a three-sided marketplace, serving creators, brands and shoppers. In November 2021, LTK announced a $300 million investment by SoftBank Vision Fund 2 that values the company at $2 billion.LTK is the most trusted and effective business-enablement platform for creators, powering their universal LTK Creator Shops (TM) . More than 5,000 retailers employ the LTK Brand Platform for performance-driven campaigns, paid collaborations and content licensing, and invested more than $1 billion in influencer marketing through the LTK platform by summer 2021.Shoppers purchase more than $3 billion in products annually on the LTK platform and app. LTK is headquartered in Dallas, TX with teams in the UK, Brazil, France, Germany, Australia, China and South Korea and clients in more than 100 countries.For US-Based Roles: We are not offering new sponsorships opportunities at this time for persons requiring employment visas, such as an H-1B; authorization to work in the US is a precondition of employment.Any unsolicited resumes/candidate profiles submitted through our website or to personal email accounts of employees of LTK are considered the property of LTK and are not subject to payment of agency fees.LTK is an Equal Opportunity Employer.