SlideShare a Scribd company logo
1 of 74
Download to read offline
Obvious and Non-Obvious

Scalability Issues: Spotify Learnings

David Poblador i Garcia

@davidpoblador
!
!

BcnDevCon13
November 12, 2013
Spotify in numbers
2011
2011
2013
One order of
magnitude bigger
in some dimensions
1.000.000.000 playlists
400M two years ago
2M new playlists every day
6000+ servers
1300 two years ago
20 in 2008
Available in 32 markets
12 two years ago
Two years ago less than 10
people in OPSbigger now
+ Infra
more than 10 times
4



Data Centers
More than 20M songs
Adding 20K every day
More than 24M active users
6M paying subscribers
More than 50 teams

building products & features
Around 100

backend systems
Learning to Scale
Scaling

Data Centers
1

Scaling Data Centers

Admit that when you
are small, there is
someone better than
you at building
datacenters
2009?

Scaling Data Centers
2

Scaling Data Centers

Streamline

your procurement

process
2012

Scaling Data Centers
3

Scaling Data Centers

Have a

“unit of capacity”
!

We call it POD
2012

Scaling Data Centers
4

Scaling Data Centers

Data Centers are being
commoditized
!

Chances are that only a few
players will deploy DCs in the
future.
!

Keep an eye on that. Might
make sense for your needs
cloud

Scaling Operations
Scaling your backend
User

AP

AP

backend

service

AP

backend

service

User

…

User

Scaling your backend

AP
know your limits

Scaling your backend
examples
User

AP

60K users

5000 reqs/second

AP

backend

service node

AP

backend

service node

User

…

User

Scaling your backend

AP
Do not try to be

‘too smart’
DNS à la Spotify

Do not try to be ‘too smart’
Error Reporting
DHT ring lookup
Service Discovery
User Distribution
Do not try to be ‘too smart’
User

AP
DNS GeoIP
magic
AP

User

…

User

Do not try to be ‘too smart’

AP

AP
Do not try to be ‘too smart’
8.8.8.8
Do not try to be ‘too smart’
User

AP

AP
User

…

User

Do not try to be ‘too smart’

AP

AP

8.8.8.8
Storage Devices
RAM
AP
5000 reqs/second
AP

backend

service node

AP

backend

service node

AP

Storage Devices
Does not fit in RAM anymore
AP
? reqs/second
AP

big backend

service node

AP

big backend

service node

AP

Storage Devices
Hard Drives
200 IOPS
Storage Devices
AP
? reqs/second
AP

big backend

service node

AP

big backend

service node

AP

Storage Devices
SSD
10,000 IOPS
Storage Devices
Fusion IO
250,000 IOPS
Storage Devices
Page Cache
Example

AP
5000 reqs/second
AP

backend

service node

AP

backend

service node

!

RAM: 32 GB
OS RAM: 2 GB
!

AP

Page Cache

Songs: 10M
Index size: 10 GB
AP

AP

AP

AP

Page Cache

backend

service node
backend

service node

Increase in data (songs…)
!

Index: approx 13 GB
Page Cache
posix_fadvise(2)
orchestrate index deployment
mlock(2)
Page Cache
Retry (not much)
Back Off
Fail Fast
Degrade Gracefully
User

AP

AP

backend

service

AP

backend

service

User

…

User

AP

Retry (not much). Back Off. Fail Fast. Degrade Gracefully
DDoS’d by your clients
5000 conns/sec

User

Retry (not much). Back Off. Fail Fast. Degrade Gracefully

AP
Exponential Back Off Retry
5000 conns/sec

User

Retry (not much). Back Off. Fail Fast. Degrade Gracefully

AP
Fail Fast
User

AP

AP

backend

service

AP

backend

service

User

…

User

AP

Retry (not much). Back Off. Fail Fast. Degrade Gracefully
Degrade gracefully
User

Acceptable
Behaviour

AP

AP

backend

service

AP

backend

service

User

…

User

AP

Retry (not much). Back Off. Fail Fast. Degrade Gracefully
Test in real world
conditions
Use your most valuable asset
Start by sending X% of users to X% of your servers
Test in real world conditions
Automate
When necessary

Automate
Automate

http://xkcd.com/1205/
Take a self service
approach everywhere
Configuration Management
Databases and Storage
Provisioning of Servers
Service Discovery
Load Balancing
Monitoring
…
Take a self service approach everywhere
Scaling

Operations

(the team)
2011

Scaling Operations
1

Scaling Operations

Start having teams
carry operational
responsibility for their
own services,
including on-call
duties for the systems
they own
2012

Scaling Operations
2

Scaling Operations

Infrastructure and
Operations provide
expert guidance/help
on how to run
service(s) teams own
in production

(and everywhere else)
2013

Scaling Operations
3

Scaling Operations

Infrastructure and
Operations focus the
effort on building and
extending our
platform to create an
awesome place to run
services
devops

Scaling Operations
Incident

Management
Process
“Prevent an issue
from happening twice”

Incident Management Process
OPS-6000

Incident Management Process
Incident (severity)
Postmortem meeting with stakeholders
Remediations (urgency)
Incident Management Process
Moltes gràcies!
David Poblador i Garcia

@davidpoblador
!
!

BcnDevCon13
November 12, 2013

More Related Content

What's hot

Storm at Spotify
Storm at SpotifyStorm at Spotify
Storm at SpotifyNeville Li
 
Playlist Recommendations @ Spotify
Playlist Recommendations @ SpotifyPlaylist Recommendations @ Spotify
Playlist Recommendations @ SpotifyNikhil Tibrewal
 
Productive data engineer
Productive data engineerProductive data engineer
Productive data engineerRafał Wojdyła
 
Spotify: Horizontal Scalability for Great Success
Spotify: Horizontal Scalability for Great SuccessSpotify: Horizontal Scalability for Great Success
Spotify: Horizontal Scalability for Great SuccessNick Barkas
 
Machine Learning and Big Data for Music Discovery at Spotify
Machine Learning and Big Data for Music Discovery at SpotifyMachine Learning and Big Data for Music Discovery at Spotify
Machine Learning and Big Data for Music Discovery at SpotifyChing-Wei Chen
 
Hadoop User Group - Status Apache Drill
Hadoop User Group - Status Apache DrillHadoop User Group - Status Apache Drill
Hadoop User Group - Status Apache DrillMapR Technologies
 
Application architectures with Hadoop – Big Data TechCon 2014
Application architectures with Hadoop – Big Data TechCon 2014Application architectures with Hadoop – Big Data TechCon 2014
Application architectures with Hadoop – Big Data TechCon 2014hadooparchbook
 
Abuse of DNS wildcards in China - from passiveDNS perspective
Abuse of DNS wildcards in China - from passiveDNS perspectiveAbuse of DNS wildcards in China - from passiveDNS perspective
Abuse of DNS wildcards in China - from passiveDNS perspectiveAPNIC
 
Introduction to hadoop V2
Introduction to hadoop V2Introduction to hadoop V2
Introduction to hadoop V2TarjeiRomtveit
 
Hadoop Summit 2015: Hive at Yahoo: Letters from the Trenches
Hadoop Summit 2015: Hive at Yahoo: Letters from the TrenchesHadoop Summit 2015: Hive at Yahoo: Letters from the Trenches
Hadoop Summit 2015: Hive at Yahoo: Letters from the TrenchesMithun Radhakrishnan
 
Application Architectures with Hadoop - Big Data TechCon SF 2014
Application Architectures with Hadoop - Big Data TechCon SF 2014Application Architectures with Hadoop - Big Data TechCon SF 2014
Application Architectures with Hadoop - Big Data TechCon SF 2014hadooparchbook
 
Apache Hive Tutorial
Apache Hive TutorialApache Hive Tutorial
Apache Hive TutorialSandeep Patil
 
A Graph Service for Global Web Entities Traversal and Reputation Evaluation B...
A Graph Service for Global Web Entities Traversal and Reputation Evaluation B...A Graph Service for Global Web Entities Traversal and Reputation Evaluation B...
A Graph Service for Global Web Entities Traversal and Reputation Evaluation B...HBaseCon
 
Phoenix Secondary Indexing - LA HUG Sept 9th, 2013
Phoenix Secondary Indexing - LA HUG Sept 9th, 2013Phoenix Secondary Indexing - LA HUG Sept 9th, 2013
Phoenix Secondary Indexing - LA HUG Sept 9th, 2013Jesse Yates
 
Faster Faster Faster! Datamarts with Hive at Yahoo
Faster Faster Faster! Datamarts with Hive at YahooFaster Faster Faster! Datamarts with Hive at Yahoo
Faster Faster Faster! Datamarts with Hive at YahooMithun Radhakrishnan
 
Application Architectures with Hadoop - UK Hadoop User Group
Application Architectures with Hadoop - UK Hadoop User GroupApplication Architectures with Hadoop - UK Hadoop User Group
Application Architectures with Hadoop - UK Hadoop User Grouphadooparchbook
 

What's hot (20)

Storm at Spotify
Storm at SpotifyStorm at Spotify
Storm at Spotify
 
Playlist Recommendations @ Spotify
Playlist Recommendations @ SpotifyPlaylist Recommendations @ Spotify
Playlist Recommendations @ Spotify
 
Productive data engineer
Productive data engineerProductive data engineer
Productive data engineer
 
Spotify: Horizontal Scalability for Great Success
Spotify: Horizontal Scalability for Great SuccessSpotify: Horizontal Scalability for Great Success
Spotify: Horizontal Scalability for Great Success
 
Spotify services (SDC 2013)
Spotify services (SDC 2013)Spotify services (SDC 2013)
Spotify services (SDC 2013)
 
Modern Data Architecture
Modern Data ArchitectureModern Data Architecture
Modern Data Architecture
 
Machine Learning and Big Data for Music Discovery at Spotify
Machine Learning and Big Data for Music Discovery at SpotifyMachine Learning and Big Data for Music Discovery at Spotify
Machine Learning and Big Data for Music Discovery at Spotify
 
MPP vs Hadoop
MPP vs HadoopMPP vs Hadoop
MPP vs Hadoop
 
Hadoop User Group - Status Apache Drill
Hadoop User Group - Status Apache DrillHadoop User Group - Status Apache Drill
Hadoop User Group - Status Apache Drill
 
Application architectures with Hadoop – Big Data TechCon 2014
Application architectures with Hadoop – Big Data TechCon 2014Application architectures with Hadoop – Big Data TechCon 2014
Application architectures with Hadoop – Big Data TechCon 2014
 
Abuse of DNS wildcards in China - from passiveDNS perspective
Abuse of DNS wildcards in China - from passiveDNS perspectiveAbuse of DNS wildcards in China - from passiveDNS perspective
Abuse of DNS wildcards in China - from passiveDNS perspective
 
Introduction to hadoop V2
Introduction to hadoop V2Introduction to hadoop V2
Introduction to hadoop V2
 
Hadoop Summit 2015: Hive at Yahoo: Letters from the Trenches
Hadoop Summit 2015: Hive at Yahoo: Letters from the TrenchesHadoop Summit 2015: Hive at Yahoo: Letters from the Trenches
Hadoop Summit 2015: Hive at Yahoo: Letters from the Trenches
 
Application Architectures with Hadoop - Big Data TechCon SF 2014
Application Architectures with Hadoop - Big Data TechCon SF 2014Application Architectures with Hadoop - Big Data TechCon SF 2014
Application Architectures with Hadoop - Big Data TechCon SF 2014
 
Apache Hive Tutorial
Apache Hive TutorialApache Hive Tutorial
Apache Hive Tutorial
 
A Graph Service for Global Web Entities Traversal and Reputation Evaluation B...
A Graph Service for Global Web Entities Traversal and Reputation Evaluation B...A Graph Service for Global Web Entities Traversal and Reputation Evaluation B...
A Graph Service for Global Web Entities Traversal and Reputation Evaluation B...
 
Phoenix Secondary Indexing - LA HUG Sept 9th, 2013
Phoenix Secondary Indexing - LA HUG Sept 9th, 2013Phoenix Secondary Indexing - LA HUG Sept 9th, 2013
Phoenix Secondary Indexing - LA HUG Sept 9th, 2013
 
Faster Faster Faster! Datamarts with Hive at Yahoo
Faster Faster Faster! Datamarts with Hive at YahooFaster Faster Faster! Datamarts with Hive at Yahoo
Faster Faster Faster! Datamarts with Hive at Yahoo
 
R, Hadoop and Amazon Web Services
R, Hadoop and Amazon Web ServicesR, Hadoop and Amazon Web Services
R, Hadoop and Amazon Web Services
 
Application Architectures with Hadoop - UK Hadoop User Group
Application Architectures with Hadoop - UK Hadoop User GroupApplication Architectures with Hadoop - UK Hadoop User Group
Application Architectures with Hadoop - UK Hadoop User Group
 

Viewers also liked

Spotify Chords - Creating Music Moments
Spotify Chords - Creating Music MomentsSpotify Chords - Creating Music Moments
Spotify Chords - Creating Music MomentsRyan Cunningham
 
Spotify's business model and copyright infringement issue
Spotify's business model and copyright infringement issueSpotify's business model and copyright infringement issue
Spotify's business model and copyright infringement issueYeonKyung Lee
 
Forbes Middle East - February 2017 - Anghami Coverage
Forbes Middle East - February 2017 - Anghami CoverageForbes Middle East - February 2017 - Anghami Coverage
Forbes Middle East - February 2017 - Anghami CoverageAnghami
 
Analysis of Spotify & New Feature Ideas
Analysis of Spotify & New Feature IdeasAnalysis of Spotify & New Feature Ideas
Analysis of Spotify & New Feature IdeasSarah L. Miller
 
Making Better Mistakes Tomorrow
Making Better Mistakes TomorrowMaking Better Mistakes Tomorrow
Making Better Mistakes TomorrowDanielle Jabin
 
How to copy spotify in 30 minutes - Agile Israel 2016
How to copy spotify in 30 minutes - Agile Israel 2016How to copy spotify in 30 minutes - Agile Israel 2016
How to copy spotify in 30 minutes - Agile Israel 2016AgileSparks
 
Direct carrier billing could help operators to capture consumer spending on m...
Direct carrier billing could help operators to capture consumer spending on m...Direct carrier billing could help operators to capture consumer spending on m...
Direct carrier billing could help operators to capture consumer spending on m...AnalysysMasonResearch
 
Spotify. Strategy to remain the leader in the music industry.
Spotify. Strategy to remain the leader in the music industry.Spotify. Strategy to remain the leader in the music industry.
Spotify. Strategy to remain the leader in the music industry.Palina Supeyeva
 
Tone of Voice Analysis - Music Streaming Services - J-P Storrow
Tone of Voice Analysis  - Music Streaming Services - J-P StorrowTone of Voice Analysis  - Music Streaming Services - J-P Storrow
Tone of Voice Analysis - Music Streaming Services - J-P StorrowJean-Paul Storrow
 
Albert Gang Spotify
Albert Gang SpotifyAlbert Gang Spotify
Albert Gang SpotifyAlbert Gang
 
Spotify luis molina
Spotify   luis molinaSpotify   luis molina
Spotify luis molinaLuis Molina
 
Activation: From thinking to tweaking it, how we do it at Spotify
Activation: From thinking to tweaking it, how we do it at Spotify Activation: From thinking to tweaking it, how we do it at Spotify
Activation: From thinking to tweaking it, how we do it at Spotify TheFamily
 
Mobile Music Business Models in Asia's Emerging Markets
Mobile Music Business Models in Asia's Emerging MarketsMobile Music Business Models in Asia's Emerging Markets
Mobile Music Business Models in Asia's Emerging MarketsLaili Aidi
 
Qcon London 2017 - Architecture overhaul - Ad serving @ Spotify scale
Qcon London 2017 -  Architecture overhaul - Ad serving @ Spotify scaleQcon London 2017 -  Architecture overhaul - Ad serving @ Spotify scale
Qcon London 2017 - Architecture overhaul - Ad serving @ Spotify scaleKinshuk Mishra
 
Quality Built In @ Spotify
Quality Built In @ SpotifyQuality Built In @ Spotify
Quality Built In @ SpotifyAndrii Dzynia
 
Activate: What Matters
Activate: What MattersActivate: What Matters
Activate: What MattersActivate
 
Modi - Sharma - Is Spotify Sustainable in the Music Streaming Industry
Modi - Sharma - Is Spotify Sustainable in the Music Streaming IndustryModi - Sharma - Is Spotify Sustainable in the Music Streaming Industry
Modi - Sharma - Is Spotify Sustainable in the Music Streaming IndustryAbhinav Sharma
 

Viewers also liked (20)

Spotify presentation
Spotify presentationSpotify presentation
Spotify presentation
 
Spotify Chords - Creating Music Moments
Spotify Chords - Creating Music MomentsSpotify Chords - Creating Music Moments
Spotify Chords - Creating Music Moments
 
Spotify's business model and copyright infringement issue
Spotify's business model and copyright infringement issueSpotify's business model and copyright infringement issue
Spotify's business model and copyright infringement issue
 
Forbes Middle East - February 2017 - Anghami Coverage
Forbes Middle East - February 2017 - Anghami CoverageForbes Middle East - February 2017 - Anghami Coverage
Forbes Middle East - February 2017 - Anghami Coverage
 
Analysis of Spotify & New Feature Ideas
Analysis of Spotify & New Feature IdeasAnalysis of Spotify & New Feature Ideas
Analysis of Spotify & New Feature Ideas
 
Making Better Mistakes Tomorrow
Making Better Mistakes TomorrowMaking Better Mistakes Tomorrow
Making Better Mistakes Tomorrow
 
How to copy spotify in 30 minutes - Agile Israel 2016
How to copy spotify in 30 minutes - Agile Israel 2016How to copy spotify in 30 minutes - Agile Israel 2016
How to copy spotify in 30 minutes - Agile Israel 2016
 
Direct carrier billing could help operators to capture consumer spending on m...
Direct carrier billing could help operators to capture consumer spending on m...Direct carrier billing could help operators to capture consumer spending on m...
Direct carrier billing could help operators to capture consumer spending on m...
 
Spotify. Strategy to remain the leader in the music industry.
Spotify. Strategy to remain the leader in the music industry.Spotify. Strategy to remain the leader in the music industry.
Spotify. Strategy to remain the leader in the music industry.
 
Tone of Voice Analysis - Music Streaming Services - J-P Storrow
Tone of Voice Analysis  - Music Streaming Services - J-P StorrowTone of Voice Analysis  - Music Streaming Services - J-P Storrow
Tone of Voice Analysis - Music Streaming Services - J-P Storrow
 
Albert Gang Spotify
Albert Gang SpotifyAlbert Gang Spotify
Albert Gang Spotify
 
Spotify luis molina
Spotify   luis molinaSpotify   luis molina
Spotify luis molina
 
Activation: From thinking to tweaking it, how we do it at Spotify
Activation: From thinking to tweaking it, how we do it at Spotify Activation: From thinking to tweaking it, how we do it at Spotify
Activation: From thinking to tweaking it, how we do it at Spotify
 
Mobile Music Business Models in Asia's Emerging Markets
Mobile Music Business Models in Asia's Emerging MarketsMobile Music Business Models in Asia's Emerging Markets
Mobile Music Business Models in Asia's Emerging Markets
 
Scaling Operations At Spotify
Scaling Operations At SpotifyScaling Operations At Spotify
Scaling Operations At Spotify
 
The Spotify Playbook
The Spotify Playbook The Spotify Playbook
The Spotify Playbook
 
Qcon London 2017 - Architecture overhaul - Ad serving @ Spotify scale
Qcon London 2017 -  Architecture overhaul - Ad serving @ Spotify scaleQcon London 2017 -  Architecture overhaul - Ad serving @ Spotify scale
Qcon London 2017 - Architecture overhaul - Ad serving @ Spotify scale
 
Quality Built In @ Spotify
Quality Built In @ SpotifyQuality Built In @ Spotify
Quality Built In @ Spotify
 
Activate: What Matters
Activate: What MattersActivate: What Matters
Activate: What Matters
 
Modi - Sharma - Is Spotify Sustainable in the Music Streaming Industry
Modi - Sharma - Is Spotify Sustainable in the Music Streaming IndustryModi - Sharma - Is Spotify Sustainable in the Music Streaming Industry
Modi - Sharma - Is Spotify Sustainable in the Music Streaming Industry
 

Similar to Obvious and Non-Obvious Scalability Issues: Spotify Learnings

San presentation nov 2012 central pa
San presentation nov 2012 central paSan presentation nov 2012 central pa
San presentation nov 2012 central paJoseph D'Antoni
 
Big Data LDN 2018: THE FUTURE OF STREAMING: GLOBAL APPS, EVENT STORES AND SER...
Big Data LDN 2018: THE FUTURE OF STREAMING: GLOBAL APPS, EVENT STORES AND SER...Big Data LDN 2018: THE FUTURE OF STREAMING: GLOBAL APPS, EVENT STORES AND SER...
Big Data LDN 2018: THE FUTURE OF STREAMING: GLOBAL APPS, EVENT STORES AND SER...Matt Stubbs
 
Events and metrics the Lifeblood of Webops
Events and metrics the Lifeblood of WebopsEvents and metrics the Lifeblood of Webops
Events and metrics the Lifeblood of WebopsDatadog
 
The Future of Streaming: Global Apps, Event Stores and Serverless
The Future of Streaming: Global Apps, Event Stores and ServerlessThe Future of Streaming: Global Apps, Event Stores and Serverless
The Future of Streaming: Global Apps, Event Stores and ServerlessBen Stopford
 
Spotify cassandra london
Spotify cassandra londonSpotify cassandra london
Spotify cassandra londonNoa Resare
 
Optimizing Total Cost of Ownership for the AWS Cloud
Optimizing Total Cost of Ownership for the AWS CloudOptimizing Total Cost of Ownership for the AWS Cloud
Optimizing Total Cost of Ownership for the AWS CloudAmazon Web Services
 
Getting Started with Big Data and HPC in the Cloud - August 2015
Getting Started with Big Data and HPC in the Cloud - August 2015Getting Started with Big Data and HPC in the Cloud - August 2015
Getting Started with Big Data and HPC in the Cloud - August 2015Amazon Web Services
 
Linux and H/W optimizations for MySQL
Linux and H/W optimizations for MySQLLinux and H/W optimizations for MySQL
Linux and H/W optimizations for MySQLYoshinori Matsunobu
 
Ceph Day Berlin: Ceph on All Flash Storage - Breaking Performance Barriers
Ceph Day Berlin: Ceph on All Flash Storage - Breaking Performance BarriersCeph Day Berlin: Ceph on All Flash Storage - Breaking Performance Barriers
Ceph Day Berlin: Ceph on All Flash Storage - Breaking Performance BarriersCeph Community
 
Launching Your First Big Data Project on AWS
Launching Your First Big Data Project on AWSLaunching Your First Big Data Project on AWS
Launching Your First Big Data Project on AWSAmazon Web Services
 
The paradox of big data - dataiku / oxalide APEROTECH
The paradox of big data - dataiku / oxalide APEROTECHThe paradox of big data - dataiku / oxalide APEROTECH
The paradox of big data - dataiku / oxalide APEROTECHDataiku
 
Real-time “OLAP” for Big Data (+ use cases) - bigdata.ro 2013
Real-time “OLAP” for Big Data (+ use cases) - bigdata.ro 2013Real-time “OLAP” for Big Data (+ use cases) - bigdata.ro 2013
Real-time “OLAP” for Big Data (+ use cases) - bigdata.ro 2013Cosmin Lehene
 
Getting Started with Amazon DynamoDB
Getting Started with Amazon DynamoDBGetting Started with Amazon DynamoDB
Getting Started with Amazon DynamoDBAmazon Web Services
 
Tech Talk: Moneyball - Hitting real-time apps out of the park with Big Memory
Tech Talk: Moneyball - Hitting real-time apps out of the park with Big MemoryTech Talk: Moneyball - Hitting real-time apps out of the park with Big Memory
Tech Talk: Moneyball - Hitting real-time apps out of the park with Big MemoryMemVerge
 
Storage and performance, Whiptail
Storage and performance, Whiptail Storage and performance, Whiptail
Storage and performance, Whiptail Internet World
 
Sound cloud - User & Partner Conference - AT Internet
Sound cloud - User & Partner Conference - AT InternetSound cloud - User & Partner Conference - AT Internet
Sound cloud - User & Partner Conference - AT InternetAT Internet
 

Similar to Obvious and Non-Obvious Scalability Issues: Spotify Learnings (20)

San presentation nov 2012 central pa
San presentation nov 2012 central paSan presentation nov 2012 central pa
San presentation nov 2012 central pa
 
Big Data LDN 2018: THE FUTURE OF STREAMING: GLOBAL APPS, EVENT STORES AND SER...
Big Data LDN 2018: THE FUTURE OF STREAMING: GLOBAL APPS, EVENT STORES AND SER...Big Data LDN 2018: THE FUTURE OF STREAMING: GLOBAL APPS, EVENT STORES AND SER...
Big Data LDN 2018: THE FUTURE OF STREAMING: GLOBAL APPS, EVENT STORES AND SER...
 
Events and metrics the Lifeblood of Webops
Events and metrics the Lifeblood of WebopsEvents and metrics the Lifeblood of Webops
Events and metrics the Lifeblood of Webops
 
The Future of Streaming: Global Apps, Event Stores and Serverless
The Future of Streaming: Global Apps, Event Stores and ServerlessThe Future of Streaming: Global Apps, Event Stores and Serverless
The Future of Streaming: Global Apps, Event Stores and Serverless
 
Spotify cassandra london
Spotify cassandra londonSpotify cassandra london
Spotify cassandra london
 
Optimizing Total Cost of Ownership for the AWS Cloud
Optimizing Total Cost of Ownership for the AWS CloudOptimizing Total Cost of Ownership for the AWS Cloud
Optimizing Total Cost of Ownership for the AWS Cloud
 
Getting Started with Big Data and HPC in the Cloud - August 2015
Getting Started with Big Data and HPC in the Cloud - August 2015Getting Started with Big Data and HPC in the Cloud - August 2015
Getting Started with Big Data and HPC in the Cloud - August 2015
 
Linux and H/W optimizations for MySQL
Linux and H/W optimizations for MySQLLinux and H/W optimizations for MySQL
Linux and H/W optimizations for MySQL
 
Ceph Day Berlin: Ceph on All Flash Storage - Breaking Performance Barriers
Ceph Day Berlin: Ceph on All Flash Storage - Breaking Performance BarriersCeph Day Berlin: Ceph on All Flash Storage - Breaking Performance Barriers
Ceph Day Berlin: Ceph on All Flash Storage - Breaking Performance Barriers
 
Launching Your First Big Data Project on AWS
Launching Your First Big Data Project on AWSLaunching Your First Big Data Project on AWS
Launching Your First Big Data Project on AWS
 
Introducing Elastic MapReduce
Introducing Elastic MapReduceIntroducing Elastic MapReduce
Introducing Elastic MapReduce
 
CMP310_Deep Dive on Amazon EBS
CMP310_Deep Dive on Amazon EBSCMP310_Deep Dive on Amazon EBS
CMP310_Deep Dive on Amazon EBS
 
STG306_Deep Dive on Amazon EBS
STG306_Deep Dive on Amazon EBSSTG306_Deep Dive on Amazon EBS
STG306_Deep Dive on Amazon EBS
 
The paradox of big data - dataiku / oxalide APEROTECH
The paradox of big data - dataiku / oxalide APEROTECHThe paradox of big data - dataiku / oxalide APEROTECH
The paradox of big data - dataiku / oxalide APEROTECH
 
Real-time “OLAP” for Big Data (+ use cases) - bigdata.ro 2013
Real-time “OLAP” for Big Data (+ use cases) - bigdata.ro 2013Real-time “OLAP” for Big Data (+ use cases) - bigdata.ro 2013
Real-time “OLAP” for Big Data (+ use cases) - bigdata.ro 2013
 
Getting Started with Amazon DynamoDB
Getting Started with Amazon DynamoDBGetting Started with Amazon DynamoDB
Getting Started with Amazon DynamoDB
 
Tech Talk: Moneyball - Hitting real-time apps out of the park with Big Memory
Tech Talk: Moneyball - Hitting real-time apps out of the park with Big MemoryTech Talk: Moneyball - Hitting real-time apps out of the park with Big Memory
Tech Talk: Moneyball - Hitting real-time apps out of the park with Big Memory
 
Introducing DynamoDB
Introducing DynamoDBIntroducing DynamoDB
Introducing DynamoDB
 
Storage and performance, Whiptail
Storage and performance, Whiptail Storage and performance, Whiptail
Storage and performance, Whiptail
 
Sound cloud - User & Partner Conference - AT Internet
Sound cloud - User & Partner Conference - AT InternetSound cloud - User & Partner Conference - AT Internet
Sound cloud - User & Partner Conference - AT Internet
 

Recently uploaded

OpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability AdventureOpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability AdventureEric D. Schabell
 
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataCloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataSafe Software
 
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPAAnypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPAshyamraj55
 
UiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation DevelopersUiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation DevelopersUiPathCommunity
 
Designing A Time bound resource download URL
Designing A Time bound resource download URLDesigning A Time bound resource download URL
Designing A Time bound resource download URLRuncy Oommen
 
PicPay - GenAI Finance Assistant - ChatGPT for Customer Service
PicPay - GenAI Finance Assistant - ChatGPT for Customer ServicePicPay - GenAI Finance Assistant - ChatGPT for Customer Service
PicPay - GenAI Finance Assistant - ChatGPT for Customer ServiceRenan Moreira de Oliveira
 
Babel Compiler - Transforming JavaScript for All Browsers.pptx
Babel Compiler - Transforming JavaScript for All Browsers.pptxBabel Compiler - Transforming JavaScript for All Browsers.pptx
Babel Compiler - Transforming JavaScript for All Browsers.pptxYounusS2
 
UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8DianaGray10
 
9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding Team9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding TeamAdam Moalla
 
Things you didn't know you can use in your Salesforce
Things you didn't know you can use in your SalesforceThings you didn't know you can use in your Salesforce
Things you didn't know you can use in your SalesforceMartin Humpolec
 
Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024D Cloud Solutions
 
UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1DianaGray10
 
Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024SkyPlanner
 
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...UbiTrack UK
 
Introduction to Quantum Computing
Introduction to Quantum ComputingIntroduction to Quantum Computing
Introduction to Quantum ComputingGDSC PJATK
 
Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™Adtran
 
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesHow to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesThousandEyes
 
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdfIaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdfDaniel Santiago Silva Capera
 
Comparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioComparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioChristian Posta
 
RAG Patterns and Vector Search in Generative AI
RAG Patterns and Vector Search in Generative AIRAG Patterns and Vector Search in Generative AI
RAG Patterns and Vector Search in Generative AIUdaiappa Ramachandran
 

Recently uploaded (20)

OpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability AdventureOpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability Adventure
 
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataCloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
 
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPAAnypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPA
 
UiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation DevelopersUiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation Developers
 
Designing A Time bound resource download URL
Designing A Time bound resource download URLDesigning A Time bound resource download URL
Designing A Time bound resource download URL
 
PicPay - GenAI Finance Assistant - ChatGPT for Customer Service
PicPay - GenAI Finance Assistant - ChatGPT for Customer ServicePicPay - GenAI Finance Assistant - ChatGPT for Customer Service
PicPay - GenAI Finance Assistant - ChatGPT for Customer Service
 
Babel Compiler - Transforming JavaScript for All Browsers.pptx
Babel Compiler - Transforming JavaScript for All Browsers.pptxBabel Compiler - Transforming JavaScript for All Browsers.pptx
Babel Compiler - Transforming JavaScript for All Browsers.pptx
 
UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8
 
9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding Team9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding Team
 
Things you didn't know you can use in your Salesforce
Things you didn't know you can use in your SalesforceThings you didn't know you can use in your Salesforce
Things you didn't know you can use in your Salesforce
 
Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024
 
UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1
 
Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024
 
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
 
Introduction to Quantum Computing
Introduction to Quantum ComputingIntroduction to Quantum Computing
Introduction to Quantum Computing
 
Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™
 
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesHow to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
 
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdfIaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
 
Comparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioComparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and Istio
 
RAG Patterns and Vector Search in Generative AI
RAG Patterns and Vector Search in Generative AIRAG Patterns and Vector Search in Generative AI
RAG Patterns and Vector Search in Generative AI
 

Obvious and Non-Obvious Scalability Issues: Spotify Learnings