Machine Learning Infrastructure Engineer

New York, NY

Spotify logo
Spotify
Apply now Apply later

Posted 1 month ago

We are looking for a Software Engineer to help us define and build the next generation of ML infrastructure at Spotify. Our mission is to enable every team at Spotify to iterate quickly on hypotheses and scale their experiments to data sets with hundreds of billions of data points. In this role you will work closely with many of the ML teams at Spotify across missions including personalization, music recommendations, ads targeting, pricing and more. Above all, your work will impact the way the world experiences music!

What you'll do

  • Build infrastructure that best supports the needs of a broad community of machine learning engineers, active across all Spotify business units
  • Craft such infrastructure under the constraints that come with scale in regards to correctness, usability, interpretability, experimentation and maintainability
  • Become a specialist on demonstrating existing state-of-the-art tooling into the Spotify eco-system (TensorFlow, TFX, Kubeflow Pipelines, Cloud Bigtable)
  • We collaborate with multi-functional agile teams of software engineers, data engineers, ML specialists, and others in building new product features
  • Chip in to new and existing Spotify open source machine learning and data processing products (scio, zoltar)
  • Demonstrate your experience to drive best practices in ML and data engineering
  • Gain a deep understanding of various models used by our partners on both structured and unstructured content (text, audio, images, behavioral data etc)
  • Settle feasibility of projects through quick prototyping with respect to performance, quality, time and cost using Agile methodologies

Who you are

  • You have development experience with an object-oriented programming language such as C++ or Java and/or functional programming languages
  • You have previous confirmed experience with ML systems using frameworks such as Scikit-learn and Tensorflow
  • You have previously built APIs and libraries for Java, Scala or PythonYou care about agile software processes, data-driven development, reliability, and responsible experimentation
  • You routinely survey research publications in the machine learning and software engineering communities
  • You preferably have experience with data processing and storage frameworks like Google Cloud Dataflow, Hadoop, Scalding, Spark, Storm, Cassandra, Kafka, etc.
  • You preferably have open source contributions to share with us
  • Skilled communicator and have a consistent track record of leading work across subject areas
You are welcome at Spotify for who you are, no matter where you come from, what you look like, or what’s playing in your headphones. Our platform is for everyone, and so is our workplace. The more voices we have represented and amplified in our business, the more we will all thrive, contribute, and be forward-thinking! So bring us your personal experience, your perspectives, and your background. It’s in our differences that we will find the power to keep revolutionizing the way the world listens.
Spotify transformed music listening forever when we launched in 2008. Our mission is to unlock the potential of human creativity by giving a million creative artists the opportunity to live off their art and billions of fans the chance to enjoy and be passionate about these creators. Everything we do is driven by our love for music and podcasting. Today, we are the world’s most popular audio streaming subscription service with a community of more than 320 million users.
Job tags: C Hadoop Java Kafka Open source Scala Spark Streaming
Job region(s): North America
Share this job: