S: a Scripting Language for High-Performance RESTful Web Services

Università Faculty
della of Informatics
Svizzera
Italiana
S
A Scripting Language for
High-Performance
RESTful Web Services

Daniele Bonetta
Achille Peternier, Cesare Pautasso, Walter Binder
Faculty of Informatics
University of Lugano - USI
Switzerland
http://sosoa.inf.usi.ch/s
1
Monday, February 27, 12

Università Faculty

RESTful Web Services
Svizzera
Italiana

Services using the HTTP protocol

HTTP HTTP HTTP
Client Client Client
REST Architectural Style
Client-Server Architecture
Stateless Interaction
Resources (Stateful, URIs) RESTful service
Uniform Interface
(GET,PUT,DELETE,POST, ...) resource resource
resource resource

2

Università Faculty

Goal
Svizzera
Italiana

Develop and compose RESTful
services that scale

3

Università Faculty

Goal
Svizzera
Italiana

services that scale

#clients

3

Università Faculty

Goal
Svizzera
Italiana

services that scale

#clients #cores

3

Università Faculty

Goal
Svizzera
Italiana

services that scale

#clients #cores
using safe implicit parallelism

3

Università Faculty

Node.JS
Svizzera
Italiana

Asynchronous Event-loop based solution

4

Università Faculty

Node.JS
Svizzera
Italiana


on(‘request’, function(req,res) {
// ...
})

on(‘response’, function(req,res) {
// ...
})

4

Università Faculty

Node.JS
Svizzera
Italiana


// ...
})

// ...
})

Asynchronous nonblocking I/O ✔

4

Università Faculty

Node.JS
Svizzera
Italiana


// ...
})

// ...
})

No locks/synchronization ✔

4

Università Faculty

Node.JS
Svizzera
Italiana


// ...
})

// ...
})

Sequential composition: nested callbacks ✘

4

Università Faculty

Node.JS
Svizzera
Italiana


// ...
})

// ...
})

Callbacks need to be short: never block ✘

4

Università Faculty

Node.JS
Svizzera
Italiana


// ...
})

// ...
})

Callbacks need to be short: never block ✘
Master worker parallelism ✘
4

Università Faculty
Svizzera
Italiana

The S Scripting Language
A DSL for RESTful Web Services
Development and Composition

5

Università Faculty
Svizzera
Italiana

S erv ices
S tate ful

5

Università Faculty
Svizzera
Italiana

ab le
ca l
S erv ices
teful S
Sta

5

Università Faculty

S: Design Principles
Svizzera
Italiana

High-level architectural abstractions

Simple, clean programming model

6

Università Faculty

Svizzera
Italiana

Services compose resources
No threads/processes, no synchronization/locks
Stateful services


6

Università Faculty

Svizzera
Italiana

Services compose resources
No threads/processes, no synchronization/locks
Stateful services

Allow blocking function calls
Synchronous I/O + parallel constructs
Uniform interface and URIs

6

Università Faculty

S: Architecture
Svizzera
Italiana

S service

7

Università Faculty

S: Architecture
Svizzera
Italiana

S service

S resource S resource S resource

7

Università Faculty

S: Architecture
Svizzera
Italiana

S service


Node Node Node Node Node
.JS .JS .JS .JS .JS

7

Università Faculty

S: Architecture
Svizzera
Italiana

S service


.JS .JS .JS .JS .JS

S IPC Communication framework

7

Università Faculty

S: Architecture
Svizzera
Italiana

S service


.JS .JS .JS .JS .JS


Nonblocking I/O

7

Università Faculty

S: Architecture
Svizzera
Italiana

S service Synchronous
blocking
S resource S resource S resource S code

.JS .JS .JS .JS .JS


Nonblocking I/O

7

Università Faculty

S: Architecture
Svizzera
Italiana

S service Synchronous
blocking
S resource S resource S resource S code

.JS .JS .JS .JS .JS Asynchronous
nonblocking
Node.JS code
Nonblocking I/O

7

Università Faculty

S: Architecture
Svizzera
Italiana

S service No
processes/threads
S resource S resource S resource locks/sync

.JS .JS .JS .JS .JS Multiple Node.JS
processes
(IPC + shared state)
Nonblocking I/O

8

Università Faculty

Hello S
Svizzera
Italiana

res ‘/hello’ on GET {
respond ‘World!’
}

9

Università Faculty

Hello S
Svizzera
Italiana

Request
Handler
}

9

Università Faculty

Hello S
Svizzera
Italiana

URI
Request
Handler
}

9

Università Faculty

Hello S
Svizzera
Italiana

URI HTTP Verb
Request
Handler
}

9

Università Faculty

Hello S
Svizzera
Italiana

URI HTTP Verb
Request
Handler
}

Any valid JavaScript statement
+
S speciﬁc constructs
9

Università Faculty

Hello S
Svizzera
Italiana

}

HTTP S
Client Service

10

Università Faculty

Hello S
Svizzera
Italiana

}

HTTP S
Client Service

GET /hello HTTP/1.1
User-Agent: curl
Accept: */*
Host: your.host

10

Università Faculty

Hello S
Svizzera
Italiana

}

HTTP S
Client Service

HTTP/1.1 200 OK
Content-Type: text/plain

World!

11

Università Faculty

Compositions
Svizzera
Italiana

res ‘/hello1’ on GET {
respond get ‘http://www.a.b’
}

respond get ‘/hello1’
}

12

Università Faculty

Compositions
Svizzera
Italiana

}

}

Native HTTP support

12

Università Faculty

Compositions
Svizzera
Italiana

}

}

HTTP
Client

13

Università Faculty

Compositions
Svizzera
Italiana

}

}

HTTP
/hello2
Client

13

Università Faculty

Compositions
Svizzera
Italiana

}

}

HTTP
/hello2 /hello1
Client

13

Università Faculty

Compositions
Svizzera
Italiana

}

}

HTTP
/hello2 /hello1 www.a.b
Client

13

Università Faculty

Concurrency & Parallelism
Svizzera
Italiana

res ‘/res1‘ on GET {

// ...

// CPU/bound blocking call
var a = foo()
respond a
}

res ‘/res2’ on GET {

// ...
res r = ‘http://www.google.ch/search=@’

// I/O bound operation
boo = r.get(‘key’)
respond boo
}

14

Università Faculty

Svizzera
Italiana


// ... Atomically
// CPU/bound blocking call executed
var a = foo() blocks
respond a
}


// ...

respond boo
}

14

Università Faculty

Svizzera
Italiana


// ...

// CPU/bound blocking call Parallel
var a = foo() resources
respond a
}


// ...

respond boo
}

15

Università Faculty

Svizzera
Italiana


// ...

// CPU/bound blocking call Synchronous
var a = foo() operations
respond a
}


// ...

respond boo
}

16

Università Faculty

(1) CPU-bound Operations Svizzera
Italiana

Request Handler Processor

/res Worker #1

Router
Worker #n

17

Università Faculty

Italiana


/res Worker #1 To clients
(HTTP response)
Router
Worker #n

From clients
(HTTP requests)

17

Università Faculty

Italiana

(2) I/O-bound Operations


(HTTP response)
Router
Worker #n

From clients Parallelism degree
(HTTP requests) controller (PI)

17

Università Faculty

Italiana


To external resources
Request Handler Processor (through HTTP)
From other
workers
(HTTP response)
Router
Worker #n
To internal resources
(through IPC)
From clients Parallelism degree
(HTTP requests) controller (PI)

17

Università Faculty

Svizzera
Italiana

Event-based compilation output targeting Node.JS

18

Università Faculty

Svizzera
Italiana


• Synchronous I/O operations are desynchronized
by the compiler using multiple callbacks

18

Università Faculty

Svizzera
Italiana


• Synchronous I/O operations are desynchronized
by the compiler using multiple callbacks

• Callbacks are scheduled by the runtime using an
event-based approach.

18

Università Faculty

Sync to Async Compilation
Svizzera
Italiana

S vs. Node.JS

res ‘/example’ on GET {
var a = get ‘www.google.com’
var b = get ‘www.bing.com’
var c = get ‘www.yahoo.com’
respond a+b+c
}

19

Università Faculty

Svizzera
Italiana

S vs. Node.JS
res ‘/example’ on GET { http.createServer(function(creq,cres){
var a = get ‘www.google.com’ if(creq.method==‘GET’&&creq.url==‘/example’) {
var a,b,c = ‘’
var c = get ‘www.yahoo.com’
respond a+b+c startGet(‘www.google.com’,
} function(req,res) {
a = res.body
startGet(‘www.bing.com’,
function(req,res) {
b = res.body
startGet(‘www.yahoo.com’,
function(req,res) {
c = res.body
cres.end(a+b+c)
})
})
})
}
})

19

Università Faculty

Svizzera
Italiana

S vs. Node.JS
res ‘/example’ on GET {
par {
var c = put ‘www.a.b/?d=’+b
respond a+c
}}

20

Università Faculty

Svizzera
Italiana

S vs. Node.JS
res ‘/example’ on GET { http.createServer(function(req,res) {
par { if(creq.method==‘GET’&&creq.url==‘/example’) {
var G = {}
var c = put ‘www.a.b/?d=’+b on(‘done1’, function(result){
respond a+c G.a = result; emit(‘done3’)})
}} on(‘done2’, function(result){
G.b = result;
get get startPut(‘www.a.b/d?=‘+G.b, ‘done4’)
})
on(‘done4’, function(result) {
var b = ... G.c = result;
emit(‘done5’)
var a = ... })
put onAll([‘done3’,‘done5’], function() {
res.end(G.a+G.c)
var c = ... })
startGet(‘www.google.com’, ‘done1’)
startGet(‘www.bing.com’, ‘done2’)
respond }
})

20

Università Faculty

Svizzera
Italiana

http.createServer(function(req,res) {
if(creq.method==‘GET’&&creq.url==‘/example’) {
var G = {}
on(‘done1’, function(result){
get get G.a = result; emit(‘done3’)})
var b G.b = result;
startPut(‘www.a.b/d?=‘+G.b, ‘done4’)
var a })
put
G.c = result;
var c emit(‘done5’)
})
respond onAll([‘done3’,‘done5’], function() {
res.end(G.a+G.c)
})
}
})

21

Università Faculty

Svizzera
Italiana

Callbacks
registration http.createServer(function(req,res) {
var G = {}
var b G.b = result;
var a })
put
G.c = result;
})
res.end(G.a+G.c)
})
}
})

21

Università Faculty

Svizzera
Italiana

var G = {}
var b G.b = result;
var a })
put
G.c = result;
})
res.end(G.a+G.c)
})
}
})

22

Università Faculty

Svizzera
Italiana

var G = {}
var b G.b = result;
var a })
put
G.c = result;
})
res.end(G.a+G.c)
})
}
})

23

Università Faculty

Other Constructs
Svizzera
Italiana

pfor res creation
res ‘/pfor’ on GET { res ‘/example’ {
var L = [1,2,3] state s = 0
var a = ‘’ on POST {
res r = ‘www.a.b/val=@’ s++
pfor (var i in L) { res ‘/newResource’+s {
a += r.get(L[i]) on GET { respond s }
} on DELETE {}
respond a }
} }
} }

24

Università Faculty

Stateful Services
Svizzera
Italiana

res ‘/helloState’ {
state s = ‘world’
on GET {
respond ‘hello’ + s
}
on PUT {
s = req.name
}
}

25

Università Faculty

Stateful Services
Svizzera
Italiana

state s = ‘world’ Shared state
on GET {
respond ‘hello’ + s
}
on PUT {
s = req.name
}
}

25

Università Faculty

Stateful Services
Svizzera
Italiana

on GET {
respond ‘hello’ + s Read-only operations
}
on PUT {
s = req.name
}
}

25

Università Faculty

Stateful Services
Svizzera
Italiana

on GET {
respond ‘hello’ + s Read-only operations
}
on PUT {
s = req.name
} Write operation
}

25

Università Faculty

Uniform Interface and Parallelism
Svizzera
Italiana

HTTP’s Uniform Interface

HTTP Verb Properties Parallelism

HTTP GET Idempotent, safe, Yes
stateless
HTTP PUT Idempotent, Side- If stateless
effects
HTTP DELETE Idempotent, Side- If stateless
effects
HTTP POST Side-effects If stateless

26

Università Faculty

Versioned State Management
Svizzera
Italiana

res ‘/res’
state s Guarantees:
on GET {

}
// read s
• Eventual (C)onsistency
on PUT { • (A)vailability
}
// alter s • (P)artition Tolerance
}

S V. n
Worker #1

SLR
Worker #n
S
V. n S
V. n

27

Università Faculty

Svizzera
Italiana

res ‘/res’
state s Guarantees:
on GET {

}
// read s
}
}

S V. n
Worker #1
GET /res
SLR
Worker #n
S
V. n S
V. n

27

Università Faculty

Svizzera
Italiana

res ‘/res’
state s Guarantees:
on GET {

}
// read s
}
}

V. n-1
S
Worker #1

SLR
Worker #n
S
S
V. n V. n-1

28

Università Faculty

Svizzera
Italiana

res ‘/res’
state s Guarantees:
on GET {

}
// read s
}
}

V. n-1
S
Worker #1
PUT /res
SLR
Worker #n
S
S
V. n V. n-1

28

Università Faculty

Svizzera
Italiana

res ‘/res’
state s Guarantees:
on GET {

}
// read s
}
}

S V. n-1
Worker #1 V. n
GET /res
SLR
Worker #n
S
V. n S
V. n-1

29

Università Faculty

Example: // Crawler
Svizzera
Italiana

service crawl {
res ‘/crawl‘ on PUT {
var filter = require(‘HTMLparser.js’).filter
res store = ‘/store?value=@’
res crawl = ‘/crawl?list=@’

pfor(var i in req.list) {
var list = filter(get req.list[i])
par {
store.put(list)
crawl.put(list)
}
}
}

res ‘/store‘ {
state s = ‘’
on PUT {
s += req.value
}
on GET {
respond s
}
}
}

30

Università Faculty

Example: // Crawler
Svizzera
Italiana

service crawl {
JavaScript
res crawl = ‘/crawl?list=@’ import
par {
store.put(list)
crawl.put(list)
}
}
}

res ‘/store‘ {
state s = ‘’
on PUT {
s += req.value
}
on GET {
respond s
}
}
}

30

Università Faculty

Example: // Crawler
Svizzera
Italiana

service crawl {
JavaScript
par { External
store.put(list) resources
crawl.put(list)
} declaration
}
}

res ‘/store‘ {
state s = ‘’
on PUT {
s += req.value
}
on GET {
respond s
}
}
}

30

Università Faculty

Example: // Crawler
Svizzera
Italiana

service crawl {
JavaScript
par { External
crawl.put(list)
} declaration
}
}

res ‘/store‘ {
state s = ‘’ Parallel
on PUT {
s += req.value recursive
} crawling
on GET {
respond s
}
}
}

30

Università Faculty

Example: // Crawler
Svizzera
Italiana

service crawl {
JavaScript
par { External
crawl.put(list)
} declaration
}
}

res ‘/store‘ {
state s = ‘’ Parallel
on PUT {
s += req.value recursive
} crawling
on GET {
respond s
} Result
} accumulation
}

30

Università Faculty

Crawler Runtime
Svizzera
Italiana

res ‘/crawl’ on PUT { res ‘/store’ on PUT {
// ... // ...
} }

Worker #1

/store
/crawl
SLR
SLR S

31

Università Faculty

Crawler Runtime
Svizzera
Italiana

// ... // ...
} }

Worker #1

/store
/crawl
L = [...] SLR
SLR S

31

Università Faculty

Crawler Runtime
Svizzera
Italiana

// ... // ...
} }

/url1
/url2
...
Worker #1

/store
/crawl
L = [...] SLR
SLR S

31

Università Faculty

Crawler Runtime
Svizzera
Italiana

// ... // ...
} }

/url1
/url2
L = [...] ...
Worker #1

/store
/crawl
L = [...] SLR
SLR S

31

Università Faculty

Crawler Runtime
Svizzera
Italiana

// ... // ...
} }

/url1
/url2
L = [...] ...
Worker #1

/store
/crawl ...
L = [...] SLR
SLR S
Worker #n-1

31

Università Faculty

Crawler Runtime
Svizzera
Italiana

// ... // ...
} }

/url1
/url2
L = [...] ...
Worker #1

/store
/crawl ...
L = [...] SLR
SLR S
Worker #n-1

Worker #n
/url1
/url2
...
31

Università Faculty

Crawler Performance (24cores) Svizzera
Italiana

32

Università Faculty

Crawler Performance Svizzera
Italiana

33

Università Faculty

Conclusion
Svizzera
Italiana

What is S ?

34

Università Faculty

Conclusion
Svizzera
Italiana

What is S ?

Simple language for composing RESTful services
Scalable parallel runtime system
JavaScript compatible

34

Università Faculty

Conclusion
Svizzera
Italiana

What is S ?

Simple language for composing RESTful services
Scalable parallel runtime system
JavaScript compatible

Safe parallelism is possible for scripting stateful Web
services if they are RESTful

34

Università Faculty

Conclusion
Svizzera
Italiana

Future work

JVM (Rhino Engine)
REST + Streaming services
Distributed deployment (Cloud)

35

Università Faculty
Svizzera
Italiana

Thank You

http://sosoa.inf.usi.ch/S

daniele.bonetta@usi.ch

Daniele Bonetta
Achille Peternier, Cesare Pautasso, Walter Binder
Faculty of Informatics
University of Lugano - USI
Switzerland

36

S: a Scripting Language for High-Performance RESTful Web Services

Recomendados

Recomendados

Mais conteúdo relacionado

Destaque

Destaque (10)

Mais de Cesare Pautasso

Mais de Cesare Pautasso (20)

Último

Último (20)

S: a Scripting Language for High-Performance RESTful Web Services