You are viewing content from a past/completed QCon

Presentation: The Evolution of Spotify Home Architecture

Track: Predictive Architectures in the Real World

Location: Cyril Magnin I

Duration: 3:20pm - 4:00pm

Day of week: Tuesday

Share this on:

This presentation is now available to view on InfoQ.com

Watch video with transcript

Abstract

This talk will take the audience through the evolution of Spotify's architecture that serves recommendations (playlist, albums, etc) on the home tab. We'll discuss the tradeoffs of the different architectural decisions we made and how we went from batch pipelines to services to a combination of services and streaming pipelines.

Speaker: Emily Samuels

Staff Engineer @Spotify

Emily Samuels is a Staff Engineer at Spotify. Her current focus is improving the recommendations on the Home Tab. In the past she has worked on Playlist Recommendations, the Discover Page, and Radio. She graduated from the University of Michigan with a BS in computer science. Emily has worked in the technology industry for ten years and was previously with FactSet Research Systems and Goldman Sachs. Her main interest is big data and she enjoys working on batch and streaming pipelines and distributed databases.

Find Emily Samuels at

Speaker: Anil Muppalla

Data Engineer @Spotify

Anil Muppalla is a Data Engineer at Spotify. His current focus building content recommendations on the Home Tab. In the past he has worked on real time data infrastructure for Spotify. He graduated from Georgia Tech with a MS in computer science. His main interest is in solving batch and streaming data problems and data infrastructure in general.

Find Anil Muppalla at

2019 Tracks

  • Predictive Data Pipelines & Architectures

    Case Study focused look at end to end predictive pipelines from places like Salesforce, Uber, Linkedin, & Netflix

  • Sequential Data: Natural Language, Time Series, and Sound

    Techniques, practices, and approaches around time series and sequential data. Expect topics including image recognition, NLP/NLU, preprocess, & crunching of related algorithms.

  • ML in Action

    Applied track demonstrating how to train, score, and handle common machine learning use cases, including heavy concentration in the space of security and fraud