Senior Staff Software Engineer (Big Data Platform)

We’re looking for a senior staff software engineer to lead the next generation of data infrastructure at Pinterest which powers mission critical big data and AI applications

You’ll be working on some of the most exciting big data and AI open source technologies (Flink, Spark, Kubernetes, etc.), at the scale of exabytes of data to help Pinners discover and do what they love

Lead the strategy and technical direction of Pinterest’s data infrastructure for big data and AI applications

Build and scale data infra frameworks and infrastructure to process petabytes-scale datasets, including compute engines, job management, resource management, scheduling and remote shuffling

Work with internal customers on critical business use cases that rely on big data

Provide thought leadership to the entire company on how data should be processed and stored more reliably, quickly and efficiently at scale

Contribute to the team’s technical vision and long-term roadmap- Deep knowledge of big data / ML technologies (e.g. Flink, Spark, Presto, Kubernetes, Ray, PyTorch/TensorFlow)

Proficiency in one or more programming languages (Java, Go, Scala, Python)

Bachelor’s degree in Computer Science, a related technical field, or equivalent experience

Exceptional collaboration skills with cross-functional partners, with the ability to navigate ambiguity, make tradeoffs, and keep stakeholders aligned on priorities and progress

10+ years of industry experience with a proven track record of technical excellence

Experiences in Kubernetes and AWS technologies

5+ years of experience of building and support large scalable Kubernetes or big data platform