SlideShare uma empresa Scribd logo
1 de 44
Baixar para ler offline
FOR THE INTERNET OF THINGS
Andrew Hinton / @inkblurt
WebVisions 2015 Chicago
UNDERSTANDING CONTEXT
2
@inkblurt
@contextbook
by
(me)
Hi, I’m Andrew, and I wrote a book about context. And while I was researching and writing this, I did a lot of thinking about what contextual experience
means in a world filled with things that think for themselves and chatter among one another on the internet.
THE INTERNET OF
THINGS
This is a very popular phrase of late … but when we say Things, what do we mean by that?
4
Rogue’s Gallery of IoT Gadgets!
Typically when people talk about the internet of things, they roll out a rogue’s gallery of IoT devices and gadgets….
But part of what I want to get across today is that we need to back up a bit and understand that we can’t really deal with the internet of things until we better understand things
that aren’t necessarily smart or networked.
5
Context is largely about what actions mean in our environment. And that’s getting more complicated. Trying to use a bathroom has become a contextual conundrum. What works and how? We grew up using bathrooms without these
sensors, but now we have to re-learn every bathroom we enter.
We need a label with picture and words on a faucet to understand how to use it. The soap has to be supplemented with store-bought back-up, because it isn’t working or it has run out.
In fact, auto soap dispensers make no sense if you think through the full context of how people behave in bathrooms — we don’t touch the soap again after we’ve washed, so why automate it? Instead, these auto-dispensers often
mistakenly squirt all the soap out as we wash under the faucet. This is a failure of understanding how a system of things and the system of human behavior meet to create context.
THE INTERNET OF THINGS
IS LESS ABOUT THINGS
& MORE ABOUT
ENVIRONMENTS
If I learned anything about the IoT as I was learning about how people understand and create context, it’s this … the internet of things is really about environments, not just the
objects in the environment. The objects make no sense without the context of the whole.
7
Affordance
James J Gibson
The potential the environment
offers for bodily action.
The guy who invented the concept of affordance — which we hear a lot about in design work — meant it as something a bit different than the way most folks mean it, and it was part of a
stunningly brilliant framework for understanding perception.
8
Invariants
That which does not change
in the midst of change.
James J Gibson
A central idea in Gibson’s framework is what he calls Invariants.
Invariants are the parts of our environment that don’t change, in the midst of change. Things that persist — they don’t vary. The ground under our feet is an invariant — generally it’s always solid
and supports our weight, for example. We evolved the bodies and brains we have in part because of the invariant nature of the ground under us, the air around us, the way stone is solid and the
way water is fluid.
Gibson mainly discusses invariants that exist for nearly all creatures, not just humans. But he also touches on human-made environmental stuff.
Invariants are at the core of how we understand context. Because context is about the relationships between the elements of our environment — and we need stable elements to bring coherence
to all the rest that isn’t stable.
ENVIRONMENT
wikimedia
Invariants
Something I now base my work on entirely is the idea that we have to understand how humans comprehend a context like this, because it’s the foundation for how we
understand everything else we’ve put into the world since the earliest civilizations could build stone walls and wooden fences.
ENVIRONMENT
wikimedia
Built
Invariants
We build things depending on the invariant qualities of the materials, and we depend on the invariant quality of the resulting buildings to be stable enough that we can have
civilization — stuff doesn’t change that fast or easily, so we rely on it for our context, for living, working, running businesses, and everything else.
But also notice all the language in this scene… turns out language is a sort of built invariant too, because we put it in the environment as structure. But the way language is
invariant is different from physical stuff.
http://commons.wikimedia.org/wiki/File:Taipei_City_Nanyang_Street_20130127.jpg
Invariants
(Convention)
Walking up to the elevator at Midway Airport on my way to WebVisions, on the way down to the train, there are these signs that are evidently required to help people understand
where the elevator button is… we’ve been using elevators and buttons for over a century, yet these things still require mediation and explanation, just so people understand
what their environment does. These are invariants based on social convention, not physics.
12
“elevator”
“button”
over a century of
cultural invariant
convention
context
There’s at least a century of cultural convention that we can take for granted when we put a sign saying ‘elevator button’ on something — and give people a button to push.
And the signs and the button aren’t usually going to change or disappear. I bring this up to emphasize how something as simple as a button on an elevator depends on tons of
context in order to make sense for a user.
13
Words
Pictures
Symbols …
Language as
environment.
We’ve gotten used to having lots of invariant semantic information in our environment — we depend on it to keep everything running right. Language acts
as a sort of environmental infrastructure in this way.
14
VARIANT!
But what happens when these things change? This is a speed limit sign in Atlanta, where they’ve installed digital signs that can change the speed limit at any time during the
day. What used to take physical effort, and even legislation to change the speed limit for an interstate highway, is now highly variant. This is a mundane ‘thing’ on the internet,
so to speak — it’s networked to a central office and changed either manually or by algorithm — actually, drivers have no idea what is behind the changes, other than assuming it
is altered based on traffic needs.
wikimedia
Not just variant,
but invisible.
Our landscapes are being saturated in these changing, variant parts of our infrastructure. And not only are they changing in visible ways, they’re mostly changing in invisible
ways.
APPROXIMATE INCREASE IN ENVIRONMENTAL COMPLEXITY OVER TIME*
Complexity
added to human
environment
No big whoop.
OMG PLEASE
MAKE IT STOP!!!!!!
What’s complexity?
We’re so modern!
Learn a new app? Uh. Ok.
I have no idea what my
phone is doing.
I have no idea what my
house is doing.
Time
Olden times Fin de siècle
* according to Andrew Hinton’s feelings on the subject.
Industrial
Revolution
“Information Age” 21st Century
According to my empirical measurement of my own personal feelings, complexity is hitting an extreme upward curve in our world. Humans are creating so many new parts of
our environment that do not behave the way everything has always behaved, that we are entering an unmapped territory.
The sort of territory that ancient mapmakers marked with pictures of sea monsters.
17
wikimedia
Interface
(Machine to Machine)
When the term “interface” came into usage in technology, it was about interfacing machines to machines. The humans who had to use the machines needed a way to “interface”
as well — and much to engineers’ annoyance, we don’t have a 25 pin standardized plug. We’re messier and more nuanced creatures.
18
Interface
(Machine to Human)
So we needed ways to let people tell things to computers. Some folks like to say that we’re getting away from having to have input mechanisms like this, and that we need to
make systems with “no UI” — but there’s no such thing as “no UI” — there will always need to be an interface.
THERE’S NO SUCH
THING AS “NO UI”
LANGUAGE IS THE
INTERFACE W/ IOT
We’re wanting our internet of things to understand the way we behave and talk “naturally” but that’s still language. And teaching them how to do this is very very difficult.
20
Understanding Context, Andrew Hinton, O’Reilly Media 2014
But we’re still not always very good about translating between the digital things in our lives and regular people. Even for simple everyday devices like a gas pump.
21
Remember back in the day when the Palm Pilot was a thing, and everyone who used one had to learn a new writing standard called Graffiti.
It was a well-designed alphabet for meeting the machine half way. The thing is, written language is already code — it’s encoded speech — so writing itself is very close to what
computers more easily comprehend, at least as input, but handwriting is too nuanced and “variant” for computers — even now — so standardizing how you make letters means
you’re making special marks that the computer can understand.
22
https://www.google.com/patents/US8558759
In the ensuing years, we’ve been trying to get even more sophisticated with the way we make signifiers to digital systems embedded in our environment. Like this “heart” gesture
that Google patented.
THE “THINGS” ARE
LISTENING
& EAGER TO ACT
We’re wanting our internet of things to understand the way we behave and talk “naturally” but that’s still language. And teaching them how to do this is very very difficult.
24
Captured from Twitter on September 22, 2015
The thing is, though, that we do things in our environment all the time that we assume will have only one meaning, because that’s the context we’ve always had. But digital
agents in our midst are now listening and reacting and making decisions based on those cues. You can search twitter at any point for “amazon echo commercial” and see people
complaining about their Echo reacting to Amazon commercials on TV.
25
But algorithms are getting more and more complex, to the point where they sort of have minds of their own. We want them to be “smart” but they’re not smart in the way that people are — and they may never be.
A friend of WebVisions, Dan Saffer, published this great piece in Wired about how we should tame our algorithms like dogs…and that makes a lot of sense. It’s actually bad for us and dogs to treat them like people…and we ought to not
assume that ‘smart things’ are like people either, even though they’re being designed and marketed to us to feel human.
26
No metaphor is more
misleading than “smart”.
- Mark Weiser, pioneer of ubiquitous computing
The late great Mark Weiser’s quote about “smart” things is more relevant now than ever.
27
James J Gibson
In fact, Saffer’s article came out just as I was finishing a part of my book about ‘smart things’ and context. In it, I explain how JJ Gibson’s ecological perception theory posits that creatures with autonomy in our environment are
objects with agency, animals, basically. They’re different from inert objects, because they act and move on their own, according to something other than predictable, invariant natural patterns.
I think that we need to not only do contextual research for users to understand how they perceive and act in the world, but for the IoT smart things with agency as well, so we can map and model the way they perceive and act.
Because it’s our job to translate between them.
28
We may never be able to rely on so-called intelligent systems to do things especially right always, because they make contextual mistakes all the time. Human
context is extremely nuanced and complex. For example, if Amazon should get anything right, it’s the authors of books, but for the longest time, it thought I had
a co-author.
29
Just another amusing example of how we make systems that we want to be smart and automated, but that don’t grok the nuances of real people — Facebook wants me to name this halloween decoration. Maybe it should be A. Horsley
Hinton?
30
“BMR”
height:weight:age:gender
“Calories!”
Arm
Movements
“Steps!”
[algorithm]
A tracker like the fitbit perceives us as a series of movements in space, and nothing more. It doesn’t actually understand the context of those movements. Like the other things we put into the
environment, this object makes our bodily movements mean something additional and new, and somewhat invisible to us, that movement didn’t mean before. Just like when we walk down our hall
and a smart thermostat reads it as activity that it considers when deciding to adjust temperature.
When we make smart, networked things, we have to create a language interface. But it’s challenging, because what the algorithms and sensors and little digital brains actually understand and
what they tell us might be really disconnected. The Fitbit and other trackers like it aren’t actually counting steps and calories, but making assumptions that are mostly “good enough” to
approximate those values, but not actually know them. These need more transparency and clarity about the complexity behind the information, rather than pretending that it’s “simple.”
31
Understanding Context, Andrew Hinton, O’Reilly Media 2014
Technology work tends to focus on the task — the action itself — without considering the context of need that brought it about, or the situation that spawned the need. But
contextual complexity demands now that we consider all these dimensions.
32
Understanding Context, Andrew Hinton, O’Reilly Media 2014
People need to understand digital “things” …
So, we need to understand digital things… and design needs to create careful layers of translation between the digital system’s artificial, binary conceptualization and the
organic, analog, messy human perception and understanding.
33
Understanding Context, Andrew Hinton, O’Reilly Media 2014
… but things also need to understand people.
But we need to work the other way around too — every thing in the IoT has its own situational context, a need that it’s programmed to meet, and actions it takes.
PLACES ARE MADE OF THINGS.
AN INTERNET OF THINGS
IS AN INTERNET OF
PLACES.
A final point to emphasize the environmental context of all this. Things are not just things, they’re part of places. When you add all these things together, what sort of places
result? Most of them are unaware of one another, especially if they come from different manufacturers.
35
We’ve been imagining for over a century, since the dawn of sophisticated industrial technology, what sort of amazing, automated, technologically intelligent environments we
might be able to make for ourselves. We’ve fantasized about these as utopias as well as dystopias, and often mixtures of both. But we’re long past the point of fiction on this.
(http://thecharnelhouse.org/2)
36
Creators of things like the Nest products want to grow their businesses and they want to make things that make people’s lives easier and better. This isn’t just about objects —
things — but entire places and ecosystems.
37
Mashable
XBox reading user’s skeleton & heartbeat
It still blows me away to think that a consumer device in our homes can sense our skeletal structure, and our heartbeats. Again, this is an extreme form of digital-agent
perception that doesn’t mean the same things to these objects that it means to us.
38
But how well
do you
understand
your iPhone??
With homekit and the new Apple TV, Apple is making a big play in this realm as well. But how well do you understand even your iphone? If I asked you to write down, right now,
all the streams of information your phone is saving to and pulling from cloud services, could you do it? Nobody ever says yes, by the way.
10 years ago, if I asked if you’d want a product on your person most of the day that tracked and saved externally all this information about you, you’d have said, no way — i
don’t bring this up to be alarmist, though, only to point out that we have a tendency to keep going forward with all this, without taking the time to map and understand it all, and
help users have a clear understanding of all the complexity that’s now invisible but meaningful to them. Context is radically changed in our phones — and already changing for
our homes and workplaces and cities. How do we help it be more clear?
ENVIRONMENT
PRODUCT
PRODUCT PRODUCT PRODUCT
PRODUCT
PRODUCT
PRODUCT
PRODUCT
PRODUCT
PRODUCT
PRODUCT
PRODUCT
PRODUCT
PRODUCT
PRODUCT
We tend to be focused on products, and we’re creating them incredibly fast.
In fact, the the way a lot of people are now defining design is essentially pushing product out into the world to see what happens. It’s great that we’re more product-focused
than project-focused, but that’s not enough.
>> But all of these are part of an environment. And they’re all connected. Every product needs to be created with clear awareness of how it will exist as part of a place.
40
Name & model the invisible contexts we make.
The place to start is to at least name and model the things inbetween — the invisible things — and their rules and what they see and sense. And then we
start to see that we’re wanting people to understand many different overlapping contexts at once.
1
MODEL & CREATE
INVARIANTS FOR
LEARNABLE CONTEXTS
CONTEXT / IoT
So to sum up, here are 3 points to walk away with.
2
LANGUAGE IS THE
HUMAN INTERFACE WITH
DIGITAL CREATURES
CONTEXT / IoT
context and strategy have a lot to do with each other because of the challenges of environments becoming more complex.
3
WE ARE ALL
ENVIRONMENTAL
DESIGNERS
CONTEXT / IoT
context and strategy have a lot to do with each other because of the challenges of environments becoming more complex.
44
THANK YOU
ANDREW HINTON | @INKBLURT
AH@ANDREWHINTON.COM
UNDERSTANDINGGROUP.COM

Mais conteúdo relacionado

Mais procurados

An Introduction to the Internet of Things
An Introduction to the Internet of ThingsAn Introduction to the Internet of Things
An Introduction to the Internet of ThingsMohammad Babaee
 
Internet of Things
Internet of ThingsInternet of Things
Internet of ThingsLaili Aidi
 
50 Connected Devices - How Mobile and the Internet of Things Will Affect You
50 Connected Devices - How Mobile and the Internet of Things Will Affect You50 Connected Devices - How Mobile and the Internet of Things Will Affect You
50 Connected Devices - How Mobile and the Internet of Things Will Affect YouApteligent
 
How the Internet of Things (IoT) Works for Business
How the Internet of Things (IoT) Works for BusinessHow the Internet of Things (IoT) Works for Business
How the Internet of Things (IoT) Works for Business10x Nation
 
Internet Of Things (IOT)
Internet Of Things (IOT)Internet Of Things (IOT)
Internet Of Things (IOT)Neha Bomble
 
The voice march
The voice march The voice march
The voice march Jade Mayer
 
The 21 Coolest Internet Of Things Gadgets
The 21 Coolest Internet Of Things GadgetsThe 21 Coolest Internet Of Things Gadgets
The 21 Coolest Internet Of Things GadgetsBernard Marr
 
Internet of Things (IoT) Past, Present, and Future
Internet of Things (IoT) Past, Present, and FutureInternet of Things (IoT) Past, Present, and Future
Internet of Things (IoT) Past, Present, and FutureLosant
 
Internet of Things B2B market study 2016
Internet of Things B2B market study 2016Internet of Things B2B market study 2016
Internet of Things B2B market study 2016Yoann Kolnik
 
Understanding the Internet of Things (IoT) | Sysfore
Understanding the Internet of Things (IoT) | SysforeUnderstanding the Internet of Things (IoT) | Sysfore
Understanding the Internet of Things (IoT) | SysforeSysfore Technologies
 
Internet of Things by innocent chukwunonyerem website solution developer afrihub
Internet of Things by innocent chukwunonyerem website solution developer afrihubInternet of Things by innocent chukwunonyerem website solution developer afrihub
Internet of Things by innocent chukwunonyerem website solution developer afrihubJOHN INNOCENT
 
What is the Internet of Things (IOT)
What is the Internet of Things (IOT)What is the Internet of Things (IOT)
What is the Internet of Things (IOT)Losant
 

Mais procurados (20)

An Introduction to the Internet of Things
An Introduction to the Internet of ThingsAn Introduction to the Internet of Things
An Introduction to the Internet of Things
 
L16 Internet of Things
L16 Internet of ThingsL16 Internet of Things
L16 Internet of Things
 
Internet of Things
Internet of ThingsInternet of Things
Internet of Things
 
15 Ways Mobile Will Change Our Lives (March 2012)
15 Ways Mobile Will Change Our Lives (March 2012)15 Ways Mobile Will Change Our Lives (March 2012)
15 Ways Mobile Will Change Our Lives (March 2012)
 
50 Connected Devices - How Mobile and the Internet of Things Will Affect You
50 Connected Devices - How Mobile and the Internet of Things Will Affect You50 Connected Devices - How Mobile and the Internet of Things Will Affect You
50 Connected Devices - How Mobile and the Internet of Things Will Affect You
 
How the Internet of Things (IoT) Works for Business
How the Internet of Things (IoT) Works for BusinessHow the Internet of Things (IoT) Works for Business
How the Internet of Things (IoT) Works for Business
 
J Social Interaction
J  Social InteractionJ  Social Interaction
J Social Interaction
 
Internet Of Things (IOT)
Internet Of Things (IOT)Internet Of Things (IOT)
Internet Of Things (IOT)
 
Solaris 29 03_2015_v1
Solaris 29 03_2015_v1Solaris 29 03_2015_v1
Solaris 29 03_2015_v1
 
IoT White Paper
IoT White PaperIoT White Paper
IoT White Paper
 
The voice march
The voice march The voice march
The voice march
 
A Strategist's Guide to the Internet of Things
A Strategist's Guide to the Internet of ThingsA Strategist's Guide to the Internet of Things
A Strategist's Guide to the Internet of Things
 
Internet of Things
Internet of ThingsInternet of Things
Internet of Things
 
The 21 Coolest Internet Of Things Gadgets
The 21 Coolest Internet Of Things GadgetsThe 21 Coolest Internet Of Things Gadgets
The 21 Coolest Internet Of Things Gadgets
 
Internet of Things (IoT) Past, Present, and Future
Internet of Things (IoT) Past, Present, and FutureInternet of Things (IoT) Past, Present, and Future
Internet of Things (IoT) Past, Present, and Future
 
Internet of things
Internet of thingsInternet of things
Internet of things
 
Internet of Things B2B market study 2016
Internet of Things B2B market study 2016Internet of Things B2B market study 2016
Internet of Things B2B market study 2016
 
Understanding the Internet of Things (IoT) | Sysfore
Understanding the Internet of Things (IoT) | SysforeUnderstanding the Internet of Things (IoT) | Sysfore
Understanding the Internet of Things (IoT) | Sysfore
 
Internet of Things by innocent chukwunonyerem website solution developer afrihub
Internet of Things by innocent chukwunonyerem website solution developer afrihubInternet of Things by innocent chukwunonyerem website solution developer afrihub
Internet of Things by innocent chukwunonyerem website solution developer afrihub
 
What is the Internet of Things (IOT)
What is the Internet of Things (IOT)What is the Internet of Things (IOT)
What is the Internet of Things (IOT)
 

Semelhante a Taming Context in the Internet of Things

Designing a Future We Want to Live In - UX STRAT USA 2017
Designing a Future We Want to Live In - UX STRAT USA 2017Designing a Future We Want to Live In - UX STRAT USA 2017
Designing a Future We Want to Live In - UX STRAT USA 2017Andrew Hinton
 
Understanding Context for UX Strategy UXSTRAT 2015
Understanding Context for UX Strategy UXSTRAT 2015 Understanding Context for UX Strategy UXSTRAT 2015
Understanding Context for UX Strategy UXSTRAT 2015 Andrew Hinton
 
The World Is The Screen
The World Is The ScreenThe World Is The Screen
The World Is The ScreenAndrew Hinton
 
What We Talk About When We Talk About Navigation (IA Conf 2019)
What We Talk About When We Talk About Navigation (IA Conf 2019)What We Talk About When We Talk About Navigation (IA Conf 2019)
What We Talk About When We Talk About Navigation (IA Conf 2019)Andrew Hinton
 
The digital revolution 2013
The digital revolution 2013The digital revolution 2013
The digital revolution 2013Bex Lewis
 
Context Design (beta2) World IA Day 2013
Context Design (beta2) World IA Day 2013Context Design (beta2) World IA Day 2013
Context Design (beta2) World IA Day 2013Andrew Hinton
 
The World is the Screen - Convey UX 2014
The World is the Screen - Convey UX 2014The World is the Screen - Convey UX 2014
The World is the Screen - Convey UX 2014Andrew Hinton
 
A Design Journey /// Naba 2014
A Design Journey /// Naba 2014 A Design Journey /// Naba 2014
A Design Journey /// Naba 2014 Leandro Agro'
 
We're All Cyborgs Now
We're All Cyborgs Now We're All Cyborgs Now
We're All Cyborgs Now Sami Niemelä
 
Domesticating intelligence @ Interaction17
Domesticating intelligence @ Interaction17Domesticating intelligence @ Interaction17
Domesticating intelligence @ Interaction17Simone Rebaudengo
 
Inverge 08 From Telephone To Tweetup
Inverge 08 From Telephone To TweetupInverge 08 From Telephone To Tweetup
Inverge 08 From Telephone To TweetupAmber Case
 
Change - A World In Flux
Change - A World In FluxChange - A World In Flux
Change - A World In FluxWill Francis
 

Semelhante a Taming Context in the Internet of Things (20)

Designing a Future We Want to Live In - UX STRAT USA 2017
Designing a Future We Want to Live In - UX STRAT USA 2017Designing a Future We Want to Live In - UX STRAT USA 2017
Designing a Future We Want to Live In - UX STRAT USA 2017
 
Understanding Context for UX Strategy UXSTRAT 2015
Understanding Context for UX Strategy UXSTRAT 2015 Understanding Context for UX Strategy UXSTRAT 2015
Understanding Context for UX Strategy UXSTRAT 2015
 
The World Is The Screen
The World Is The ScreenThe World Is The Screen
The World Is The Screen
 
What We Talk About When We Talk About Navigation (IA Conf 2019)
What We Talk About When We Talk About Navigation (IA Conf 2019)What We Talk About When We Talk About Navigation (IA Conf 2019)
What We Talk About When We Talk About Navigation (IA Conf 2019)
 
Verum Factum: making the world with language | Andrew Hinton #IIAS15
Verum Factum: making the world with language | Andrew Hinton #IIAS15Verum Factum: making the world with language | Andrew Hinton #IIAS15
Verum Factum: making the world with language | Andrew Hinton #IIAS15
 
The digital revolution 2013
The digital revolution 2013The digital revolution 2013
The digital revolution 2013
 
Context Design (beta2) World IA Day 2013
Context Design (beta2) World IA Day 2013Context Design (beta2) World IA Day 2013
Context Design (beta2) World IA Day 2013
 
Essay Invention
Essay InventionEssay Invention
Essay Invention
 
Live Streaming
Live StreamingLive Streaming
Live Streaming
 
The World is the Screen - Convey UX 2014
The World is the Screen - Convey UX 2014The World is the Screen - Convey UX 2014
The World is the Screen - Convey UX 2014
 
A Design Journey /// Naba 2014
A Design Journey /// Naba 2014 A Design Journey /// Naba 2014
A Design Journey /// Naba 2014
 
We're All Cyborgs Now
We're All Cyborgs Now We're All Cyborgs Now
We're All Cyborgs Now
 
The Invention Of An Invention
The Invention Of An InventionThe Invention Of An Invention
The Invention Of An Invention
 
Domesticating intelligence @ Interaction17
Domesticating intelligence @ Interaction17Domesticating intelligence @ Interaction17
Domesticating intelligence @ Interaction17
 
Essay On INNOVATION
Essay On INNOVATIONEssay On INNOVATION
Essay On INNOVATION
 
Renaissance Inventions
Renaissance InventionsRenaissance Inventions
Renaissance Inventions
 
Inverge 08 From Telephone To Tweetup
Inverge 08 From Telephone To TweetupInverge 08 From Telephone To Tweetup
Inverge 08 From Telephone To Tweetup
 
Writing With Technology Essay
Writing With Technology EssayWriting With Technology Essay
Writing With Technology Essay
 
Change - A World In Flux
Change - A World In FluxChange - A World In Flux
Change - A World In Flux
 
Orienteering Objects
Orienteering ObjectsOrienteering Objects
Orienteering Objects
 

Mais de WebVisions

Christian Titze, "Hello From the Other Side: Adapting the Agile Agency to Cli...
Christian Titze, "Hello From the Other Side: Adapting the Agile Agency to Cli...Christian Titze, "Hello From the Other Side: Adapting the Agile Agency to Cli...
Christian Titze, "Hello From the Other Side: Adapting the Agile Agency to Cli...WebVisions
 
Amélie Lamont, "Design Anthropology 101"
Amélie Lamont, "Design Anthropology 101"Amélie Lamont, "Design Anthropology 101"
Amélie Lamont, "Design Anthropology 101"WebVisions
 
Nate Clinton, "Conversations with Machines"
Nate Clinton, "Conversations with Machines"Nate Clinton, "Conversations with Machines"
Nate Clinton, "Conversations with Machines"WebVisions
 
Thomas Phinney, “Fonts. Everything is Changing. Again.”
Thomas Phinney, “Fonts. Everything is Changing. Again.”Thomas Phinney, “Fonts. Everything is Changing. Again.”
Thomas Phinney, “Fonts. Everything is Changing. Again.”WebVisions
 
The Importance of Side Projects
The Importance of Side ProjectsThe Importance of Side Projects
The Importance of Side ProjectsWebVisions
 
Commit to the Crazy
Commit to the CrazyCommit to the Crazy
Commit to the CrazyWebVisions
 
Intuition and Reason in Design
Intuition and Reason in DesignIntuition and Reason in Design
Intuition and Reason in DesignWebVisions
 
Data and Algorithmic Bias in the Web
Data and Algorithmic Bias in the WebData and Algorithmic Bias in the Web
Data and Algorithmic Bias in the WebWebVisions
 
Activism x Technology
Activism x TechnologyActivism x Technology
Activism x TechnologyWebVisions
 
Mike Monteiro, "This is the Golden Age of Design...and We're Screwed"
Mike Monteiro, "This is the Golden Age of Design...and We're Screwed"Mike Monteiro, "This is the Golden Age of Design...and We're Screwed"
Mike Monteiro, "This is the Golden Age of Design...and We're Screwed"WebVisions
 
Mark Wyner, "A New Dawn of the Human Experience"
Mark Wyner, "A New Dawn of the Human Experience"Mark Wyner, "A New Dawn of the Human Experience"
Mark Wyner, "A New Dawn of the Human Experience"WebVisions
 
Kevin Hoyt, "On the Verge of Genius: Smart Cities Workshop"
Kevin Hoyt, "On the Verge of Genius: Smart Cities Workshop"Kevin Hoyt, "On the Verge of Genius: Smart Cities Workshop"
Kevin Hoyt, "On the Verge of Genius: Smart Cities Workshop"WebVisions
 
Art + Commerce
Art + CommerceArt + Commerce
Art + CommerceWebVisions
 
Users are People Too
Users are People TooUsers are People Too
Users are People TooWebVisions
 
Happily Ever After: Pain-Free Prioritization
Happily Ever After: Pain-Free PrioritizationHappily Ever After: Pain-Free Prioritization
Happily Ever After: Pain-Free PrioritizationWebVisions
 
Mind Melds and BattleBots: Creating the Right Kind of Designer/Developer Dynamic
Mind Melds and BattleBots: Creating the Right Kind of Designer/Developer DynamicMind Melds and BattleBots: Creating the Right Kind of Designer/Developer Dynamic
Mind Melds and BattleBots: Creating the Right Kind of Designer/Developer DynamicWebVisions
 
Poetry for Robots: A Digital Humanities Experiment
Poetry for Robots: A Digital Humanities ExperimentPoetry for Robots: A Digital Humanities Experiment
Poetry for Robots: A Digital Humanities ExperimentWebVisions
 
Kent Nichols, "Downshifting Your Life to Rev Up Your Creativity"
Kent Nichols, "Downshifting Your Life to Rev Up Your Creativity"Kent Nichols, "Downshifting Your Life to Rev Up Your Creativity"
Kent Nichols, "Downshifting Your Life to Rev Up Your Creativity"WebVisions
 
Robert Stulle, "Stories From the Agile Agency"
Robert Stulle, "Stories From the Agile Agency"Robert Stulle, "Stories From the Agile Agency"
Robert Stulle, "Stories From the Agile Agency"WebVisions
 
Mona Patel, "Excuses, Excuses, Excuse Personas"
Mona Patel, "Excuses, Excuses, Excuse Personas"Mona Patel, "Excuses, Excuses, Excuse Personas"
Mona Patel, "Excuses, Excuses, Excuse Personas"WebVisions
 

Mais de WebVisions (20)

Christian Titze, "Hello From the Other Side: Adapting the Agile Agency to Cli...
Christian Titze, "Hello From the Other Side: Adapting the Agile Agency to Cli...Christian Titze, "Hello From the Other Side: Adapting the Agile Agency to Cli...
Christian Titze, "Hello From the Other Side: Adapting the Agile Agency to Cli...
 
Amélie Lamont, "Design Anthropology 101"
Amélie Lamont, "Design Anthropology 101"Amélie Lamont, "Design Anthropology 101"
Amélie Lamont, "Design Anthropology 101"
 
Nate Clinton, "Conversations with Machines"
Nate Clinton, "Conversations with Machines"Nate Clinton, "Conversations with Machines"
Nate Clinton, "Conversations with Machines"
 
Thomas Phinney, “Fonts. Everything is Changing. Again.”
Thomas Phinney, “Fonts. Everything is Changing. Again.”Thomas Phinney, “Fonts. Everything is Changing. Again.”
Thomas Phinney, “Fonts. Everything is Changing. Again.”
 
The Importance of Side Projects
The Importance of Side ProjectsThe Importance of Side Projects
The Importance of Side Projects
 
Commit to the Crazy
Commit to the CrazyCommit to the Crazy
Commit to the Crazy
 
Intuition and Reason in Design
Intuition and Reason in DesignIntuition and Reason in Design
Intuition and Reason in Design
 
Data and Algorithmic Bias in the Web
Data and Algorithmic Bias in the WebData and Algorithmic Bias in the Web
Data and Algorithmic Bias in the Web
 
Activism x Technology
Activism x TechnologyActivism x Technology
Activism x Technology
 
Mike Monteiro, "This is the Golden Age of Design...and We're Screwed"
Mike Monteiro, "This is the Golden Age of Design...and We're Screwed"Mike Monteiro, "This is the Golden Age of Design...and We're Screwed"
Mike Monteiro, "This is the Golden Age of Design...and We're Screwed"
 
Mark Wyner, "A New Dawn of the Human Experience"
Mark Wyner, "A New Dawn of the Human Experience"Mark Wyner, "A New Dawn of the Human Experience"
Mark Wyner, "A New Dawn of the Human Experience"
 
Kevin Hoyt, "On the Verge of Genius: Smart Cities Workshop"
Kevin Hoyt, "On the Verge of Genius: Smart Cities Workshop"Kevin Hoyt, "On the Verge of Genius: Smart Cities Workshop"
Kevin Hoyt, "On the Verge of Genius: Smart Cities Workshop"
 
Art + Commerce
Art + CommerceArt + Commerce
Art + Commerce
 
Users are People Too
Users are People TooUsers are People Too
Users are People Too
 
Happily Ever After: Pain-Free Prioritization
Happily Ever After: Pain-Free PrioritizationHappily Ever After: Pain-Free Prioritization
Happily Ever After: Pain-Free Prioritization
 
Mind Melds and BattleBots: Creating the Right Kind of Designer/Developer Dynamic
Mind Melds and BattleBots: Creating the Right Kind of Designer/Developer DynamicMind Melds and BattleBots: Creating the Right Kind of Designer/Developer Dynamic
Mind Melds and BattleBots: Creating the Right Kind of Designer/Developer Dynamic
 
Poetry for Robots: A Digital Humanities Experiment
Poetry for Robots: A Digital Humanities ExperimentPoetry for Robots: A Digital Humanities Experiment
Poetry for Robots: A Digital Humanities Experiment
 
Kent Nichols, "Downshifting Your Life to Rev Up Your Creativity"
Kent Nichols, "Downshifting Your Life to Rev Up Your Creativity"Kent Nichols, "Downshifting Your Life to Rev Up Your Creativity"
Kent Nichols, "Downshifting Your Life to Rev Up Your Creativity"
 
Robert Stulle, "Stories From the Agile Agency"
Robert Stulle, "Stories From the Agile Agency"Robert Stulle, "Stories From the Agile Agency"
Robert Stulle, "Stories From the Agile Agency"
 
Mona Patel, "Excuses, Excuses, Excuse Personas"
Mona Patel, "Excuses, Excuses, Excuse Personas"Mona Patel, "Excuses, Excuses, Excuse Personas"
Mona Patel, "Excuses, Excuses, Excuse Personas"
 

Último

UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...UbiTrack UK
 
Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024SkyPlanner
 
How Accurate are Carbon Emissions Projections?
How Accurate are Carbon Emissions Projections?How Accurate are Carbon Emissions Projections?
How Accurate are Carbon Emissions Projections?IES VE
 
Building AI-Driven Apps Using Semantic Kernel.pptx
Building AI-Driven Apps Using Semantic Kernel.pptxBuilding AI-Driven Apps Using Semantic Kernel.pptx
Building AI-Driven Apps Using Semantic Kernel.pptxUdaiappa Ramachandran
 
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve DecarbonizationUsing IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve DecarbonizationIES VE
 
Videogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdfVideogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdfinfogdgmi
 
Linked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond OntologiesLinked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond OntologiesDavid Newbury
 
Empowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintEmpowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintMahmoud Rabie
 
Cybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxCybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxGDSC PJATK
 
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostKubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostMatt Ray
 
UiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation DevelopersUiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation DevelopersUiPathCommunity
 
Basic Building Blocks of Internet of Things.
Basic Building Blocks of Internet of Things.Basic Building Blocks of Internet of Things.
Basic Building Blocks of Internet of Things.YounusS2
 
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019IES VE
 
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsIgniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsSafe Software
 
UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6DianaGray10
 
Comparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioComparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioChristian Posta
 
NIST Cybersecurity Framework (CSF) 2.0 Workshop
NIST Cybersecurity Framework (CSF) 2.0 WorkshopNIST Cybersecurity Framework (CSF) 2.0 Workshop
NIST Cybersecurity Framework (CSF) 2.0 WorkshopBachir Benyammi
 
Introduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptxIntroduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptxMatsuo Lab
 
Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1DianaGray10
 

Último (20)

UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
 
Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024
 
How Accurate are Carbon Emissions Projections?
How Accurate are Carbon Emissions Projections?How Accurate are Carbon Emissions Projections?
How Accurate are Carbon Emissions Projections?
 
Building AI-Driven Apps Using Semantic Kernel.pptx
Building AI-Driven Apps Using Semantic Kernel.pptxBuilding AI-Driven Apps Using Semantic Kernel.pptx
Building AI-Driven Apps Using Semantic Kernel.pptx
 
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve DecarbonizationUsing IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
 
Videogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdfVideogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdf
 
Linked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond OntologiesLinked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond Ontologies
 
Empowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintEmpowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership Blueprint
 
Cybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxCybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptx
 
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostKubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
 
UiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation DevelopersUiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation Developers
 
Basic Building Blocks of Internet of Things.
Basic Building Blocks of Internet of Things.Basic Building Blocks of Internet of Things.
Basic Building Blocks of Internet of Things.
 
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
 
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsIgniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
 
UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6
 
201610817 - edge part1
201610817 - edge part1201610817 - edge part1
201610817 - edge part1
 
Comparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioComparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and Istio
 
NIST Cybersecurity Framework (CSF) 2.0 Workshop
NIST Cybersecurity Framework (CSF) 2.0 WorkshopNIST Cybersecurity Framework (CSF) 2.0 Workshop
NIST Cybersecurity Framework (CSF) 2.0 Workshop
 
Introduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptxIntroduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptx
 
Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1
 

Taming Context in the Internet of Things

  • 1. FOR THE INTERNET OF THINGS Andrew Hinton / @inkblurt WebVisions 2015 Chicago UNDERSTANDING CONTEXT
  • 2. 2 @inkblurt @contextbook by (me) Hi, I’m Andrew, and I wrote a book about context. And while I was researching and writing this, I did a lot of thinking about what contextual experience means in a world filled with things that think for themselves and chatter among one another on the internet.
  • 3. THE INTERNET OF THINGS This is a very popular phrase of late … but when we say Things, what do we mean by that?
  • 4. 4 Rogue’s Gallery of IoT Gadgets! Typically when people talk about the internet of things, they roll out a rogue’s gallery of IoT devices and gadgets…. But part of what I want to get across today is that we need to back up a bit and understand that we can’t really deal with the internet of things until we better understand things that aren’t necessarily smart or networked.
  • 5. 5 Context is largely about what actions mean in our environment. And that’s getting more complicated. Trying to use a bathroom has become a contextual conundrum. What works and how? We grew up using bathrooms without these sensors, but now we have to re-learn every bathroom we enter. We need a label with picture and words on a faucet to understand how to use it. The soap has to be supplemented with store-bought back-up, because it isn’t working or it has run out. In fact, auto soap dispensers make no sense if you think through the full context of how people behave in bathrooms — we don’t touch the soap again after we’ve washed, so why automate it? Instead, these auto-dispensers often mistakenly squirt all the soap out as we wash under the faucet. This is a failure of understanding how a system of things and the system of human behavior meet to create context.
  • 6. THE INTERNET OF THINGS IS LESS ABOUT THINGS & MORE ABOUT ENVIRONMENTS If I learned anything about the IoT as I was learning about how people understand and create context, it’s this … the internet of things is really about environments, not just the objects in the environment. The objects make no sense without the context of the whole.
  • 7. 7 Affordance James J Gibson The potential the environment offers for bodily action. The guy who invented the concept of affordance — which we hear a lot about in design work — meant it as something a bit different than the way most folks mean it, and it was part of a stunningly brilliant framework for understanding perception.
  • 8. 8 Invariants That which does not change in the midst of change. James J Gibson A central idea in Gibson’s framework is what he calls Invariants. Invariants are the parts of our environment that don’t change, in the midst of change. Things that persist — they don’t vary. The ground under our feet is an invariant — generally it’s always solid and supports our weight, for example. We evolved the bodies and brains we have in part because of the invariant nature of the ground under us, the air around us, the way stone is solid and the way water is fluid. Gibson mainly discusses invariants that exist for nearly all creatures, not just humans. But he also touches on human-made environmental stuff. Invariants are at the core of how we understand context. Because context is about the relationships between the elements of our environment — and we need stable elements to bring coherence to all the rest that isn’t stable.
  • 9. ENVIRONMENT wikimedia Invariants Something I now base my work on entirely is the idea that we have to understand how humans comprehend a context like this, because it’s the foundation for how we understand everything else we’ve put into the world since the earliest civilizations could build stone walls and wooden fences.
  • 10. ENVIRONMENT wikimedia Built Invariants We build things depending on the invariant qualities of the materials, and we depend on the invariant quality of the resulting buildings to be stable enough that we can have civilization — stuff doesn’t change that fast or easily, so we rely on it for our context, for living, working, running businesses, and everything else. But also notice all the language in this scene… turns out language is a sort of built invariant too, because we put it in the environment as structure. But the way language is invariant is different from physical stuff. http://commons.wikimedia.org/wiki/File:Taipei_City_Nanyang_Street_20130127.jpg
  • 11. Invariants (Convention) Walking up to the elevator at Midway Airport on my way to WebVisions, on the way down to the train, there are these signs that are evidently required to help people understand where the elevator button is… we’ve been using elevators and buttons for over a century, yet these things still require mediation and explanation, just so people understand what their environment does. These are invariants based on social convention, not physics.
  • 12. 12 “elevator” “button” over a century of cultural invariant convention context There’s at least a century of cultural convention that we can take for granted when we put a sign saying ‘elevator button’ on something — and give people a button to push. And the signs and the button aren’t usually going to change or disappear. I bring this up to emphasize how something as simple as a button on an elevator depends on tons of context in order to make sense for a user.
  • 13. 13 Words Pictures Symbols … Language as environment. We’ve gotten used to having lots of invariant semantic information in our environment — we depend on it to keep everything running right. Language acts as a sort of environmental infrastructure in this way.
  • 14. 14 VARIANT! But what happens when these things change? This is a speed limit sign in Atlanta, where they’ve installed digital signs that can change the speed limit at any time during the day. What used to take physical effort, and even legislation to change the speed limit for an interstate highway, is now highly variant. This is a mundane ‘thing’ on the internet, so to speak — it’s networked to a central office and changed either manually or by algorithm — actually, drivers have no idea what is behind the changes, other than assuming it is altered based on traffic needs.
  • 15. wikimedia Not just variant, but invisible. Our landscapes are being saturated in these changing, variant parts of our infrastructure. And not only are they changing in visible ways, they’re mostly changing in invisible ways.
  • 16. APPROXIMATE INCREASE IN ENVIRONMENTAL COMPLEXITY OVER TIME* Complexity added to human environment No big whoop. OMG PLEASE MAKE IT STOP!!!!!! What’s complexity? We’re so modern! Learn a new app? Uh. Ok. I have no idea what my phone is doing. I have no idea what my house is doing. Time Olden times Fin de siècle * according to Andrew Hinton’s feelings on the subject. Industrial Revolution “Information Age” 21st Century According to my empirical measurement of my own personal feelings, complexity is hitting an extreme upward curve in our world. Humans are creating so many new parts of our environment that do not behave the way everything has always behaved, that we are entering an unmapped territory. The sort of territory that ancient mapmakers marked with pictures of sea monsters.
  • 17. 17 wikimedia Interface (Machine to Machine) When the term “interface” came into usage in technology, it was about interfacing machines to machines. The humans who had to use the machines needed a way to “interface” as well — and much to engineers’ annoyance, we don’t have a 25 pin standardized plug. We’re messier and more nuanced creatures.
  • 18. 18 Interface (Machine to Human) So we needed ways to let people tell things to computers. Some folks like to say that we’re getting away from having to have input mechanisms like this, and that we need to make systems with “no UI” — but there’s no such thing as “no UI” — there will always need to be an interface.
  • 19. THERE’S NO SUCH THING AS “NO UI” LANGUAGE IS THE INTERFACE W/ IOT We’re wanting our internet of things to understand the way we behave and talk “naturally” but that’s still language. And teaching them how to do this is very very difficult.
  • 20. 20 Understanding Context, Andrew Hinton, O’Reilly Media 2014 But we’re still not always very good about translating between the digital things in our lives and regular people. Even for simple everyday devices like a gas pump.
  • 21. 21 Remember back in the day when the Palm Pilot was a thing, and everyone who used one had to learn a new writing standard called Graffiti. It was a well-designed alphabet for meeting the machine half way. The thing is, written language is already code — it’s encoded speech — so writing itself is very close to what computers more easily comprehend, at least as input, but handwriting is too nuanced and “variant” for computers — even now — so standardizing how you make letters means you’re making special marks that the computer can understand.
  • 22. 22 https://www.google.com/patents/US8558759 In the ensuing years, we’ve been trying to get even more sophisticated with the way we make signifiers to digital systems embedded in our environment. Like this “heart” gesture that Google patented.
  • 23. THE “THINGS” ARE LISTENING & EAGER TO ACT We’re wanting our internet of things to understand the way we behave and talk “naturally” but that’s still language. And teaching them how to do this is very very difficult.
  • 24. 24 Captured from Twitter on September 22, 2015 The thing is, though, that we do things in our environment all the time that we assume will have only one meaning, because that’s the context we’ve always had. But digital agents in our midst are now listening and reacting and making decisions based on those cues. You can search twitter at any point for “amazon echo commercial” and see people complaining about their Echo reacting to Amazon commercials on TV.
  • 25. 25 But algorithms are getting more and more complex, to the point where they sort of have minds of their own. We want them to be “smart” but they’re not smart in the way that people are — and they may never be. A friend of WebVisions, Dan Saffer, published this great piece in Wired about how we should tame our algorithms like dogs…and that makes a lot of sense. It’s actually bad for us and dogs to treat them like people…and we ought to not assume that ‘smart things’ are like people either, even though they’re being designed and marketed to us to feel human.
  • 26. 26 No metaphor is more misleading than “smart”. - Mark Weiser, pioneer of ubiquitous computing The late great Mark Weiser’s quote about “smart” things is more relevant now than ever.
  • 27. 27 James J Gibson In fact, Saffer’s article came out just as I was finishing a part of my book about ‘smart things’ and context. In it, I explain how JJ Gibson’s ecological perception theory posits that creatures with autonomy in our environment are objects with agency, animals, basically. They’re different from inert objects, because they act and move on their own, according to something other than predictable, invariant natural patterns. I think that we need to not only do contextual research for users to understand how they perceive and act in the world, but for the IoT smart things with agency as well, so we can map and model the way they perceive and act. Because it’s our job to translate between them.
  • 28. 28 We may never be able to rely on so-called intelligent systems to do things especially right always, because they make contextual mistakes all the time. Human context is extremely nuanced and complex. For example, if Amazon should get anything right, it’s the authors of books, but for the longest time, it thought I had a co-author.
  • 29. 29 Just another amusing example of how we make systems that we want to be smart and automated, but that don’t grok the nuances of real people — Facebook wants me to name this halloween decoration. Maybe it should be A. Horsley Hinton?
  • 30. 30 “BMR” height:weight:age:gender “Calories!” Arm Movements “Steps!” [algorithm] A tracker like the fitbit perceives us as a series of movements in space, and nothing more. It doesn’t actually understand the context of those movements. Like the other things we put into the environment, this object makes our bodily movements mean something additional and new, and somewhat invisible to us, that movement didn’t mean before. Just like when we walk down our hall and a smart thermostat reads it as activity that it considers when deciding to adjust temperature. When we make smart, networked things, we have to create a language interface. But it’s challenging, because what the algorithms and sensors and little digital brains actually understand and what they tell us might be really disconnected. The Fitbit and other trackers like it aren’t actually counting steps and calories, but making assumptions that are mostly “good enough” to approximate those values, but not actually know them. These need more transparency and clarity about the complexity behind the information, rather than pretending that it’s “simple.”
  • 31. 31 Understanding Context, Andrew Hinton, O’Reilly Media 2014 Technology work tends to focus on the task — the action itself — without considering the context of need that brought it about, or the situation that spawned the need. But contextual complexity demands now that we consider all these dimensions.
  • 32. 32 Understanding Context, Andrew Hinton, O’Reilly Media 2014 People need to understand digital “things” … So, we need to understand digital things… and design needs to create careful layers of translation between the digital system’s artificial, binary conceptualization and the organic, analog, messy human perception and understanding.
  • 33. 33 Understanding Context, Andrew Hinton, O’Reilly Media 2014 … but things also need to understand people. But we need to work the other way around too — every thing in the IoT has its own situational context, a need that it’s programmed to meet, and actions it takes.
  • 34. PLACES ARE MADE OF THINGS. AN INTERNET OF THINGS IS AN INTERNET OF PLACES. A final point to emphasize the environmental context of all this. Things are not just things, they’re part of places. When you add all these things together, what sort of places result? Most of them are unaware of one another, especially if they come from different manufacturers.
  • 35. 35 We’ve been imagining for over a century, since the dawn of sophisticated industrial technology, what sort of amazing, automated, technologically intelligent environments we might be able to make for ourselves. We’ve fantasized about these as utopias as well as dystopias, and often mixtures of both. But we’re long past the point of fiction on this. (http://thecharnelhouse.org/2)
  • 36. 36 Creators of things like the Nest products want to grow their businesses and they want to make things that make people’s lives easier and better. This isn’t just about objects — things — but entire places and ecosystems.
  • 37. 37 Mashable XBox reading user’s skeleton & heartbeat It still blows me away to think that a consumer device in our homes can sense our skeletal structure, and our heartbeats. Again, this is an extreme form of digital-agent perception that doesn’t mean the same things to these objects that it means to us.
  • 38. 38 But how well do you understand your iPhone?? With homekit and the new Apple TV, Apple is making a big play in this realm as well. But how well do you understand even your iphone? If I asked you to write down, right now, all the streams of information your phone is saving to and pulling from cloud services, could you do it? Nobody ever says yes, by the way. 10 years ago, if I asked if you’d want a product on your person most of the day that tracked and saved externally all this information about you, you’d have said, no way — i don’t bring this up to be alarmist, though, only to point out that we have a tendency to keep going forward with all this, without taking the time to map and understand it all, and help users have a clear understanding of all the complexity that’s now invisible but meaningful to them. Context is radically changed in our phones — and already changing for our homes and workplaces and cities. How do we help it be more clear?
  • 39. ENVIRONMENT PRODUCT PRODUCT PRODUCT PRODUCT PRODUCT PRODUCT PRODUCT PRODUCT PRODUCT PRODUCT PRODUCT PRODUCT PRODUCT PRODUCT PRODUCT We tend to be focused on products, and we’re creating them incredibly fast. In fact, the the way a lot of people are now defining design is essentially pushing product out into the world to see what happens. It’s great that we’re more product-focused than project-focused, but that’s not enough. >> But all of these are part of an environment. And they’re all connected. Every product needs to be created with clear awareness of how it will exist as part of a place.
  • 40. 40 Name & model the invisible contexts we make. The place to start is to at least name and model the things inbetween — the invisible things — and their rules and what they see and sense. And then we start to see that we’re wanting people to understand many different overlapping contexts at once.
  • 41. 1 MODEL & CREATE INVARIANTS FOR LEARNABLE CONTEXTS CONTEXT / IoT So to sum up, here are 3 points to walk away with.
  • 42. 2 LANGUAGE IS THE HUMAN INTERFACE WITH DIGITAL CREATURES CONTEXT / IoT context and strategy have a lot to do with each other because of the challenges of environments becoming more complex.
  • 43. 3 WE ARE ALL ENVIRONMENTAL DESIGNERS CONTEXT / IoT context and strategy have a lot to do with each other because of the challenges of environments becoming more complex.
  • 44. 44 THANK YOU ANDREW HINTON | @INKBLURT AH@ANDREWHINTON.COM UNDERSTANDINGGROUP.COM