2. The phone as a Remote Control eComm 2009, Amsterdam
Peter Kaptein
Valerie Ivangorodsky
the RoomWare project
2 Vivango | Instant Interfaces | The RoomWare project
3. The phone as a Remote Control eComm 2009, Amsterdam
The mobile phone can be used
to bridge the gap
between
a person and the reactive space
that person is in
3 Vivango | Instant Interfaces | The RoomWare project
4. The phone as a Remote Control eComm 2009, Amsterdam
Demo:
Using RoomWare, and the phone as a
remote control
4 Vivango | Instant Interfaces | The RoomWare project
5. The phone as a Remote Control eComm 2009, Amsterdam
RoomWare?
5 Vivango | Instant Interfaces | The RoomWare project
6. The phone as a Remote Control eComm 2009, Amsterdam
“There you stand inside the room, or on
a square. Maybe you can order a drink, or
food. Maybe you need assistance or a
service offered by the space. Or maybe
you are simpley new here.”
6 Vivango | Instant Interfaces | The RoomWare project
7. The phone as a Remote Control eComm 2009, Amsterdam
“So: how do you connect to what is
available when no one is there to help
you?”
7 Vivango | Instant Interfaces | The RoomWare project
8. The phone as a Remote Control eComm 2009, Amsterdam
People Places
Data
8 Vivango | Instant Interfaces | The RoomWare project
9. The phone as a Remote Control eComm 2009, Amsterdam
Action
People Places
Room
Ware
Action
Action
Data
9 Vivango | Instant Interfaces | The RoomWare project
10. The phone as a Remote Control eComm 2009, Amsterdam
Positioning:
10 Vivango | Instant Interfaces | The RoomWare project
11. The phone as a Remote Control eComm 2009, Amsterdam
- Things to web
- Online storage of sensor data
- Push of information from data
- Information about surroundings
- Interactions with surroundings
- Communication between objects
11 Vivango | Instant Interfaces | The RoomWare project
12. The phone as a Remote Control eComm 2009, Amsterdam
New platform for interactions in physical
space
- Games
- Applications
- Augmented reality
- Between people
- Between people and spaces
12 Vivango | Instant Interfaces | The RoomWare project
13. The phone as a Remote Control eComm 2009, Amsterdam
- “Web of things”
- Location Based Services
- Anything to anything
- Distributed applications
13 Vivango | Instant Interfaces | The RoomWare project
14. The phone as a Remote Control eComm 2009, Amsterdam
To interact with:
14 Vivango | Instant Interfaces | The RoomWare project
22. The phone as a Remote Control eComm 2009, Amsterdam
22 Vivango | Instant Interfaces | The RoomWare project
23. The phone as a Remote Control eComm 2009, Amsterdam
Why phones?
23 Vivango | Instant Interfaces | The RoomWare project
24. The phone as a Remote Control eComm 2009, Amsterdam
- Easy access to service
- (almost) Everyone has one
- Easy to connect
24 Vivango | Instant Interfaces | The RoomWare project
25. The phone as a Remote Control eComm 2009, Amsterdam
2 scenarios
25 Vivango | Instant Interfaces | The RoomWare project
26. The phone as a Remote Control eComm 2009, Amsterdam
Scenario1:
Dial in = remote
control
26 Vivango | Instant Interfaces | The RoomWare project
27. The phone as a Remote Control eComm 2009, Amsterdam
- Any phone
- Plus a VoIP mediator (in our case Voxeo)
- For games
- Or more serious use
27 Vivango | Instant Interfaces | The RoomWare project
28. The phone as a Remote Control eComm 2009, Amsterdam
“You are standing in front of a shopping
window. It is late in the evening. You like
to know more, but tomorrow you leave.
A slide show is presented. Underneath
the display is a toll-free phone number
you can dial. It will turn your phone into a
remote control for the slide show”
28 Vivango | Instant Interfaces | The RoomWare project
29. VoIP Box VoIP Mediator
Call Call
Push
RoomWare RoomWare Server
Applications
Push
Sockets
29
30. The phone as a Remote Control eComm 2009, Amsterdam
2-way communication possible
30 Vivango | Instant Interfaces | The RoomWare project
31. The phone as a Remote Control eComm 2009, Amsterdam
Demo today:
31 Vivango | Instant Interfaces | The RoomWare project
32. The phone as a Remote Control eComm 2009, Amsterdam
- Moving colored balls around the screen
- Via US number
- By the audience
32 Vivango | Instant Interfaces | The RoomWare project
33. The phone as a Remote Control eComm 2009, Amsterdam
041
345
892
33 Vivango | Instant Interfaces | The RoomWare project
34. The phone as a Remote Control eComm 2009, Amsterdam
Each ball is a player.
Using the keypad of the phone, you can
move the ball to the left, right, top or
bottom.
34 Vivango | Instant Interfaces | The RoomWare project
35. The phone as a Remote Control eComm 2009, Amsterdam
227
041
345
892
35 Vivango | Instant Interfaces | The RoomWare project
36. The phone as a Remote Control eComm 2009, Amsterdam
Scenario 2:
Sockets, beacons and
mobile apps
36 Vivango | Instant Interfaces | The RoomWare project
37. The phone as a Remote Control eComm 2009, Amsterdam
“You are standing in front the same
shopping window. It has a ‘powered by
RoomWare’ logo.You take your phone,
scan for bluetooth beacons and are
presented with a menu that turns your
phone into a smart Remote Control for
that slide show.”
37 Vivango | Instant Interfaces | The RoomWare project
39. The phone as a Remote Control eComm 2009, Amsterdam
Demo:
Remote control on
Android phone
39 Vivango | Instant Interfaces | The RoomWare project
40. The phone as a Remote Control eComm 2009, Amsterdam
Start: discovering
servicess via bluetooth
beacons
40 Vivango | Instant Interfaces | The RoomWare project
41. The phone as a Remote Control eComm 2009, Amsterdam
Discovered beacons:
“RoomWare demo”
- Is related to MAC
address of laptop
41 Vivango | Instant Interfaces | The RoomWare project
42. The phone as a Remote Control eComm 2009, Amsterdam
When you open the
Service “RoomWare
demo”, two remote
conrols are offered:
- “Shop demo”
- “Ball demo”
42 Vivango | Instant Interfaces | The RoomWare project
43. The phone as a Remote Control eComm 2009, Amsterdam
When you touch the
“Shop demo”, the remote
control is activated.
It shows clear options
like:
- “Presentatie”
- “Camera”
- “Next” (= next slide)
43 Vivango | Instant Interfaces | The RoomWare project
44. The phone as a Remote Control eComm 2009, Amsterdam
Pressing the options in the remote
control controls the slide-show
44 Vivango | Instant Interfaces | The RoomWare project
45. The phone as a Remote Control eComm 2009, Amsterdam
-Simulating shop window example for
clothing store with 3 new collections:
45 Vivango | Instant Interfaces | The RoomWare project
46. The phone as a Remote Control eComm 2009, Amsterdam
Pressing “Presentatie”
will show the main
presentation:
46 Vivango | Instant Interfaces | The RoomWare project
47. The phone as a Remote Control eComm 2009, Amsterdam
47 Vivango | Instant Interfaces | The RoomWare project
48. The phone as a Remote Control eComm 2009, Amsterdam
When you touch one of
the items, it is presented:
by sliding in the first page
48 Vivango | Instant Interfaces | The RoomWare project
50. The phone as a Remote Control eComm 2009, Amsterdam
When you touch the
“Next” button, the next
slide is presented
50 Vivango | Instant Interfaces | The RoomWare project
52. The phone as a Remote Control eComm 2009, Amsterdam
Our proximity
model
52 Vivango | Instant Interfaces | The RoomWare project
53. You Proximity levels
arms eye sight Around the block
reach
QR
Bluetooth
Phone #
53
54. The phone as a Remote Control eComm 2009, Amsterdam
The basic questions
54 Vivango | Instant Interfaces | The RoomWare project
55. The phone as a Remote Control eComm 2009, Amsterdam
Where are you?
How can we help you?
What can we offer?
With what means of access?
55 Vivango | Instant Interfaces | The RoomWare project
56. The phone as a Remote Control eComm 2009, Amsterdam
Simple everyday
tools
56 Vivango | Instant Interfaces | The RoomWare project
57. The phone as a Remote Control eComm 2009, Amsterdam
“Beacons”
57 Vivango | Instant Interfaces | The RoomWare project
58. The phone as a Remote Control eComm 2009, Amsterdam
58 Vivango | Instant Interfaces | The RoomWare project
59. The phone as a Remote Control eComm 2009, Amsterdam
“Markers”
59 Vivango | Instant Interfaces | The RoomWare project
60. The phone as a Remote Control eComm 2009, Amsterdam
60 Vivango | Instant Interfaces | The RoomWare project
61. The phone as a Remote Control eComm 2009, Amsterdam
“Numbers”
61 Vivango | Instant Interfaces | The RoomWare project
62. The phone as a Remote Control eComm 2009, Amsterdam
p: +31 (0)20 45 67 890
62 Vivango | Instant Interfaces | The RoomWare project
63. The phone as a Remote Control eComm 2009, Amsterdam
RoomWare Server
+ phones:
Basics
63 Vivango | Instant Interfaces | The RoomWare project
64. The phone as a Remote Control eComm 2009, Amsterdam
Socket connection
Device Device
64 Vivango | Instant Interfaces | The RoomWare project
65. The phone as a Remote Control eComm 2009, Amsterdam
Socket connection
Mobile ph. Application
65 Vivango | Instant Interfaces | The RoomWare project
66. The phone as a Remote Control eComm 2009, Amsterdam
Action!
Socket connection
Mobile ph. Application
66 Vivango | Instant Interfaces | The RoomWare project
67. The phone as a Remote Control eComm 2009, Amsterdam
Using RoomWare
to extend the phone
67 Vivango | Instant Interfaces | The RoomWare project
68. The phone as a Remote Control eComm 2009, Amsterdam
Device
Mobile ph. Application
68 Vivango | Instant Interfaces | The RoomWare project
69. The phone as a Remote Control eComm 2009, Amsterdam
Sensor Device
Mobile ph. Application
69 Vivango | Instant Interfaces | The RoomWare project
70. The phone as a Remote Control eComm 2009, Amsterdam
Sensor Device
Mobile ph. Application
Application Application
70 Vivango | Instant Interfaces | The RoomWare project
71. The phone as a Remote Control eComm 2009, Amsterdam
Sensor Device
Mobile ph. Application
Application Application
71 Sensor
Vivango | Instant Interfaces | The RoomWare project
72. The phone as a Remote Control eComm 2009, Amsterdam
Scalable and
extendable
72 Vivango | Instant Interfaces | The RoomWare project
73. The phone as a Remote Control eComm 2009, Amsterdam
RoomWare
Basis
73 Vivango | Instant Interfaces | The RoomWare project
74. The phone as a Remote Control eComm 2009, Amsterdam
- RoomWare Server
- Sockets
- Messages
- Distributed appliactions
74 Vivango | Instant Interfaces | The RoomWare project
75. The phone as a Remote Control eComm 2009, Amsterdam
Beacon,
Number and
Marker
Properties
75 Vivango | Instant Interfaces | The RoomWare project
76. The phone as a Remote Control eComm 2009, Amsterdam
p: +31 (0)20 45 67 890
76 Vivango | Instant Interfaces | The RoomWare project
77. The phone as a Remote Control eComm 2009, Amsterdam
Phone number
p: +31 Not entirely DIY
(0)20 45 Operator or VoIP
67 890 Cost per month
Phone can dial
77 Vivango | Instant Interfaces | The RoomWare project
78. The phone as a Remote Control eComm 2009, Amsterdam
QR-code
Do It Yourself
Printer and paper
Almost gratis
Phone has camera
78 Vivango | Instant Interfaces | The RoomWare project
79. The phone as a Remote Control eComm 2009, Amsterdam
RFID tags
Tags not DIY
Order online
Low cost / dirt cheap
Most phones: no reader
79 Vivango | Instant Interfaces | The RoomWare project
80. The phone as a Remote Control eComm 2009, Amsterdam
Bluetooth beacons
Not DIY
Buy in shop
Low cost
Phone has reader
80 Vivango | Instant Interfaces | The RoomWare project
81. The phone as a Remote Control eComm 2009, Amsterdam
p: +31 (0)20 45 67 890
81 Vivango | Instant Interfaces | The RoomWare project
82. The phone as a Remote Control eComm 2009, Amsterdam
82 Vivango | Instant Interfaces | The RoomWare project
83. The phone as a Remote Control eComm 2009, Amsterdam
Uses we see
83 Vivango | Instant Interfaces | The RoomWare project
84. The phone as a Remote Control eComm 2009, Amsterdam
Location Based
Services
84 Vivango | Instant Interfaces | The RoomWare project
85. The phone as a Remote Control eComm 2009, Amsterdam
Access to Local
Information
§
85 Vivango | Instant Interfaces | The RoomWare project
86. The phone as a Remote Control eComm 2009, Amsterdam
Narrow casting
86 Vivango | Instant Interfaces | The RoomWare project
87. The phone as a Remote Control eComm 2009, Amsterdam
Games
87 Vivango | Instant Interfaces | The RoomWare project
88. The phone as a Remote Control eComm 2009, Amsterdam
88 Vivango | Instant Interfaces | The RoomWare project
89. The phone as a Remote Control eComm 2009, Amsterdam
- Application will be available in
beginning of 2010
- Use is broader than shown here
- Open Source parts later in 2010
- Phone connects using bluetooth or QR
- Any kid can build this now
89 Vivango | Instant Interfaces | The RoomWare project
90. The phone as a Remote Control eComm 2009, Amsterdam
Thank you
90 Vivango | Instant Interfaces | The RoomWare project
91. The phone as a Remote Control eComm 2009, Amsterdam
Our data is on the
eComm site
91 Vivango | Instant Interfaces | The RoomWare project
92. The phone as a Remote Control eComm 2009, Amsterdam
92 Vivango | Instant Interfaces | The RoomWare project
93. The phone as a Remote Control eComm 2009, Amsterdam
Supporting slides
93 Vivango | Instant Interfaces | The RoomWare project
94. The phone as a Remote Control eComm 2009, Amsterdam
Locations
94 Vivango | Instant Interfaces | The RoomWare project
95. The phone as a Remote Control eComm 2009, Amsterdam
Musea
Showrooms
Galleries
95 Vivango | Instant Interfaces | The RoomWare project
96. The phone as a Remote Control eComm 2009, Amsterdam
Shops
96 Vivango | Instant Interfaces | The RoomWare project
97. The phone as a Remote Control eComm 2009, Amsterdam
Workplaces
Offices
97 Vivango | Instant Interfaces | The RoomWare project
98. The phone as a Remote Control eComm 2009, Amsterdam
Workplaces
Offices
98 Vivango | Instant Interfaces | The RoomWare project
99. The phone as a Remote Control eComm 2009, Amsterdam
Public spaces
Squares
(Bus) Stops
99 Vivango | Instant Interfaces | The RoomWare project
100. The phone as a Remote Control eComm 2009, Amsterdam
100 Vivango | Instant Interfaces | The RoomWare project
101. The phone as a Remote Control eComm 2009, Amsterdam
Developers and
users
101 Vivango | Instant Interfaces | The RoomWare project
102. The phone as a Remote Control eComm 2009, Amsterdam
Planned release of
system and code:
begin 2010
102 Vivango | Instant Interfaces | The RoomWare project
103. The phone as a Remote Control eComm 2009, Amsterdam
Mobile app: Android
103 Vivango | Instant Interfaces | The RoomWare project
104. The phone as a Remote Control eComm 2009, Amsterdam
Central system to
register your
beacons
104 Vivango | Instant Interfaces | The RoomWare project
105. The phone as a Remote Control eComm 2009, Amsterdam
One mobile app for
any Remote Control
you
create
105 Vivango | Instant Interfaces | The RoomWare project
106. The phone as a Remote Control eComm 2009, Amsterdam
Easy to add your
own local service
106 Vivango | Instant Interfaces | The RoomWare project
107. The phone as a Remote Control eComm 2009, Amsterdam
Future
107 Vivango | Instant Interfaces | The RoomWare project
108. The phone as a Remote Control eComm 2009, Amsterdam
More interaction
possibilities
108 Vivango | Instant Interfaces | The RoomWare project
109. The phone as a Remote Control eComm 2009, Amsterdam
Smart Surfaces
109 Vivango | Instant Interfaces | The RoomWare project
110. The phone as a Remote Control eComm 2009, Amsterdam
- Touch
110 Vivango | Instant Interfaces | The RoomWare project
111. The phone as a Remote Control eComm 2009, Amsterdam
- Image recognition
111 Vivango | Instant Interfaces | The RoomWare project
112. The phone as a Remote Control eComm 2009, Amsterdam
More ways to
connect
112 Vivango | Instant Interfaces | The RoomWare project
113. The phone as a Remote Control eComm 2009, Amsterdam
- RFID
113 Vivango | Instant Interfaces | The RoomWare project
114. The phone as a Remote Control eComm 2009, Amsterdam
- Bluetooth
114 Vivango | Instant Interfaces | The RoomWare project
115. The phone as a Remote Control eComm 2009, Amsterdam
- WiFi
115 Vivango | Instant Interfaces | The RoomWare project
116. The phone as a Remote Control eComm 2009, Amsterdam
- IMEI #
116 Vivango | Instant Interfaces | The RoomWare project
117. The phone as a Remote Control eComm 2009, Amsterdam
117 Vivango | Instant Interfaces | The RoomWare project
118. The phone as a Remote Control eComm 2009, Amsterdam
Awareness to
user
118 Vivango | Instant Interfaces | The RoomWare project
119. The phone as a Remote Control eComm 2009, Amsterdam
Broadcasting
identities
119 Vivango | Instant Interfaces | The RoomWare project
120. The phone as a Remote Control eComm 2009, Amsterdam
Mediating identities
120 Vivango | Instant Interfaces | The RoomWare project
121. The phone as a Remote Control eComm 2009, Amsterdam
You are already
tracable
121 Vivango | Instant Interfaces | The RoomWare project
122. The phone as a Remote Control eComm 2009, Amsterdam
- Bluetooth
122 Vivango | Instant Interfaces | The RoomWare project
123. The phone as a Remote Control eComm 2009, Amsterdam
- Phone WiFi MAC
123 Vivango | Instant Interfaces | The RoomWare project
124. The phone as a Remote Control eComm 2009, Amsterdam
- Phone IMEI #
124 Vivango | Instant Interfaces | The RoomWare project
125. The phone as a Remote Control eComm 2009, Amsterdam
We plan to give
feedback:
“you have been
detected”
125 Vivango | Instant Interfaces | The RoomWare project
126. The phone as a Remote Control eComm 2009, Amsterdam
126 Vivango | Instant Interfaces | The RoomWare project
127. The phone as a Remote Control eComm 2009, Amsterdam
Design goals
127 Vivango | Instant Interfaces | The RoomWare project
128. The phone as a Remote Control eComm 2009, Amsterdam
- Easy to build with
- Everyday means and tools
- Web cams
- Mobile phones
- Web applications
- 5 minutes: setup and go
128 Vivango | Instant Interfaces | The RoomWare project