SlideShare a Scribd company logo
1 of 27
Mobile AR SDK Tutorial
Augmented World Expo, NY, March 25, 2014
Patrick
O’Shaughnessey
@patchedreality
patrick@patchedreality.com
http://patchedreality.com
Patched Reality
Custom Augmented Reality
and Digital Eyewear Apps
http://patchedreality.com
Patched Reality
Using Best-in-Breed Technologies
http://patchedreality.com
Video and Slides from AWE 2013
http://bit.ly/SDKTutorialAWE2013
Notable Features Since June
Some Highlights:
• Extended tracking
• CAD model-based training
• Text recognition and tracking
• Digital eyewear support
What’s the purpose of an AR SDK?
Simplifies one or more of:
• Recognition – What to track
• Tracking – Where it is (3D pose)
• Content rendering – Your Interesting Stuff
Tracking Types
• GPS + Compass + Gyro + Accelerometer
• Marker (Fiduciary, frame, etc)
• NFT (2D images)
• Pre-trained
• Cloud recognized
• User-defined
• 3D (Pre-trained point cloud)
• Live 3D (SLAM)
• Face, Fingers, Body
• Robot
Mobile AR SDKs Short List
SDK Purpose Tracking Platform Graphics Cloud GP
S
License
Qualcomm
Vuforia
2D Images,
Cylinders,
Markers,
Text
NFT+Ext,
Cylinder,
Marker,
Text
iOS, Android Unity3D &
Alt.
yes no Free
$99-
499/mo
Cloud
Metaio
SDK
2D Images,
3D, GEO,
QR
NFT+Ext,
GPS,
3D, SLAM
iOS, Android,
Eyewear
Unity3D &
Proprietary
yes yes $0-5,500
$235-
680/mo
Cloud
Total Imm.
D’fusion
2D Images,
Faces
NFT, Face iOS, Android
Dev: MS
only
Proprietary no no $0-7,800
Wikitude
SDK
2D Images,
GEO
GPS, NFT iOS, Android,
Blackberry,
Eyewear
HTML,
Proprietary
yes yes $0-2,300
Layar SDK 2D images,
Geo
NFT, QR iOS, Android Proprietary yes no $3,250/ap
p/yr +
$60/page
Mobile AR SDKs Short List
SDK Purpose Tracking Platform Graphics Cloud GP
S
License
13th Lab
Point Cloud
2D Images,
3D,
Anywhere
NFT, 3D,
SLAM
iOS, Android Unity3D &
Alt.
no no 0-$5,000
HP
Aurasma
SDK
VFX, Videos
on 2D
Images
NFT iOS, Android Proprietary yes yes Per click
Obvious
Engine
2D images,
Cylinders
NFT,
Cyl.
iOS, Android Unity3D &
Alt.
no no $8000/ap
p/plaform
String Framed 2D
images
Framed
Image
iOS Unity3D &
Alt.
no no $499
-
$8000/ap
p/year
Orbotix Robotic AR Sphero iOS, Android Unity3D no no Free
catchoom 2D Images NFT iOS Proprietary yes no $0-2000
+$135-
835/mo
SDK Development On Ramp
1) Set up Dev Environment
• Xcode (iOS)
• Eclipse (Android)
• Android SDK
• Android NDK
• Unity 3D
2) Download SDK
3) Install and run samples
SDK Development with Unity
1) Create Project
2) Wire up SDK - camera setup, licensing, etc
3) Set up recognition and tracking configuration
4) Add scene content and interactions
5) Build, Run, Test
6) Repeat 3-5
7) Ship
NFT Setup - Vuforia
1) Import Unity package
2) Create target using “Target Manager” at
developer.vuforia.com
3) Download and Import target package
4) Replace MainCamera with ARCamera prefab
5) Add ImageTarget prefab
6) Add content to ImageTarget
7) Enable Data Set load on ARCamera
8) Select Data Set and Image Target on ImageTarget
9) Build and Run
NFT Setup - Vuforia
Extended Tracking
Extended Tracking
SLAM Setup - metaio
1) Import metaioSDK.unitypackage
2) Add metaioSDK prefab to scene
3) Delete Main Camera
4) Generate app signature
(mobiledeveloperportal.ar-live.de)
5) Add app signature to metaioSDK
6) Add metaioTracker prefab to scene
7) Add scene root to metaioTracker object
SLAM Setup - metaio
1) Add GUI and script that calls
metaio.MetaioSDKUnity
.startInstantTracking
("INSTANT_3D", "");
2) Add metaioCallback subclass
(InstantTrackingCallback from
TutorialInstantTracking) and replace the one
on metaioSDK GameObject
3) Build and run
4) Add missing libraries to Xcode project
SLAM Setup - metaio
Missing Libraries:
metaiosdk
libxml2.dylib
AVFoundation
Security
SLAM Setup - metaio
https://mobiledeveloperportal.ar-live.de/index.php
SLAM Setup - metaio
Tools for Non-Programmers
www.metaio.com/products/creator/
Tools for Non-Programmers
www.layar.com/creator
Tools for Non-Programmers
studio.wikitude.com
Tools for Non-Programmers
studio.aurasma.com
Tools for Non-Programmers
http://catchoom.com
Tools for Non-Programmers
www.ar-code.it
Cloud Campaign Editor
Thank You!
Patrick
O’Shaughnessey
@patchedreality
patrick@patchedreality.com
http://patchedreality.com

More Related Content

What's hot

Review and Overview on Computational Visualization in Augmented Reality
Review and Overview on Computational Visualization in Augmented RealityReview and Overview on Computational Visualization in Augmented Reality
Review and Overview on Computational Visualization in Augmented RealityMarco Losurdo
 
Wally Young (DAQRI) The Path to ARToolKit 6
Wally Young (DAQRI) The Path to ARToolKit 6Wally Young (DAQRI) The Path to ARToolKit 6
Wally Young (DAQRI) The Path to ARToolKit 6AugmentedWorldExpo
 
Philipp Nagele (Wikitude): Context Is for Kings: Putting Context in the Hands...
Philipp Nagele (Wikitude): Context Is for Kings: Putting Context in the Hands...Philipp Nagele (Wikitude): Context Is for Kings: Putting Context in the Hands...
Philipp Nagele (Wikitude): Context Is for Kings: Putting Context in the Hands...AugmentedWorldExpo
 
Simulating Lidar Sensors for Computer Vision
Simulating Lidar Sensors for Computer VisionSimulating Lidar Sensors for Computer Vision
Simulating Lidar Sensors for Computer VisionUnity Technologies
 
Augmented Reality-now and future
Augmented Reality-now and futureAugmented Reality-now and future
Augmented Reality-now and futureAnand .
 
Getting started with Unity and AR/VR for the .NET developer... Reloaded!
Getting started with Unity and AR/VR for the .NET developer... Reloaded!Getting started with Unity and AR/VR for the .NET developer... Reloaded!
Getting started with Unity and AR/VR for the .NET developer... Reloaded!Davide Zordan
 
Getting started with Unity and AR/VR for the .NET developer
Getting started with Unity and AR/VR for the .NET developerGetting started with Unity and AR/VR for the .NET developer
Getting started with Unity and AR/VR for the .NET developerDavide Zordan
 
Augmented Reality Application - Final Year Project
Augmented Reality Application - Final Year ProjectAugmented Reality Application - Final Year Project
Augmented Reality Application - Final Year ProjectYash Kaushik
 
Getting started with Unity and AR/VR for the .NET developer - October 2020
Getting started with Unity and AR/VR for the .NET developer - October 2020Getting started with Unity and AR/VR for the .NET developer - October 2020
Getting started with Unity and AR/VR for the .NET developer - October 2020Davide Zordan
 
Augmented Reality Tutorial dedicated to Computational Fluid Dynamics
Augmented Reality Tutorial dedicated to Computational Fluid DynamicsAugmented Reality Tutorial dedicated to Computational Fluid Dynamics
Augmented Reality Tutorial dedicated to Computational Fluid DynamicsMarco Losurdo
 
Magic Leap Developers Presentation by Cliff Baldridge 2018
Magic Leap Developers Presentation by Cliff Baldridge 2018Magic Leap Developers Presentation by Cliff Baldridge 2018
Magic Leap Developers Presentation by Cliff Baldridge 2018Cliff Baldridge
 
Getting started with unity and AR/VR for the .net developer - DDD North 2020
Getting started with unity and AR/VR for the .net developer - DDD North 2020Getting started with unity and AR/VR for the .net developer - DDD North 2020
Getting started with unity and AR/VR for the .net developer - DDD North 2020Davide Zordan
 
Breaking Glass: Glass development without Glass
Breaking Glass: Glass development without GlassBreaking Glass: Glass development without Glass
Breaking Glass: Glass development without GlassOstap Andrusiv
 

What's hot (17)

Review and Overview on Computational Visualization in Augmented Reality
Review and Overview on Computational Visualization in Augmented RealityReview and Overview on Computational Visualization in Augmented Reality
Review and Overview on Computational Visualization in Augmented Reality
 
Wally Young (DAQRI) The Path to ARToolKit 6
Wally Young (DAQRI) The Path to ARToolKit 6Wally Young (DAQRI) The Path to ARToolKit 6
Wally Young (DAQRI) The Path to ARToolKit 6
 
Philipp Nagele (Wikitude): Context Is for Kings: Putting Context in the Hands...
Philipp Nagele (Wikitude): Context Is for Kings: Putting Context in the Hands...Philipp Nagele (Wikitude): Context Is for Kings: Putting Context in the Hands...
Philipp Nagele (Wikitude): Context Is for Kings: Putting Context in the Hands...
 
3D in Android
3D in Android3D in Android
3D in Android
 
Simulating Lidar Sensors for Computer Vision
Simulating Lidar Sensors for Computer VisionSimulating Lidar Sensors for Computer Vision
Simulating Lidar Sensors for Computer Vision
 
Augmented Reality-now and future
Augmented Reality-now and futureAugmented Reality-now and future
Augmented Reality-now and future
 
Getting started with Unity and AR/VR for the .NET developer... Reloaded!
Getting started with Unity and AR/VR for the .NET developer... Reloaded!Getting started with Unity and AR/VR for the .NET developer... Reloaded!
Getting started with Unity and AR/VR for the .NET developer... Reloaded!
 
Getting started with Unity and AR/VR for the .NET developer
Getting started with Unity and AR/VR for the .NET developerGetting started with Unity and AR/VR for the .NET developer
Getting started with Unity and AR/VR for the .NET developer
 
Augmented Reality Application - Final Year Project
Augmented Reality Application - Final Year ProjectAugmented Reality Application - Final Year Project
Augmented Reality Application - Final Year Project
 
Augmented Reality Games
Augmented Reality GamesAugmented Reality Games
Augmented Reality Games
 
Getting started with Unity and AR/VR for the .NET developer - October 2020
Getting started with Unity and AR/VR for the .NET developer - October 2020Getting started with Unity and AR/VR for the .NET developer - October 2020
Getting started with Unity and AR/VR for the .NET developer - October 2020
 
Augmented Reality Tutorial dedicated to Computational Fluid Dynamics
Augmented Reality Tutorial dedicated to Computational Fluid DynamicsAugmented Reality Tutorial dedicated to Computational Fluid Dynamics
Augmented Reality Tutorial dedicated to Computational Fluid Dynamics
 
Magic Leap Developers Presentation by Cliff Baldridge 2018
Magic Leap Developers Presentation by Cliff Baldridge 2018Magic Leap Developers Presentation by Cliff Baldridge 2018
Magic Leap Developers Presentation by Cliff Baldridge 2018
 
Getting started with unity and AR/VR for the .net developer - DDD North 2020
Getting started with unity and AR/VR for the .net developer - DDD North 2020Getting started with unity and AR/VR for the .net developer - DDD North 2020
Getting started with unity and AR/VR for the .net developer - DDD North 2020
 
Breaking Glass: Glass development without Glass
Breaking Glass: Glass development without GlassBreaking Glass: Glass development without Glass
Breaking Glass: Glass development without Glass
 
Ppt
PptPpt
Ppt
 
virtual_chess
virtual_chessvirtual_chess
virtual_chess
 

Similar to Mobile AR SDK Tutorial - Augmented World Expo New York 2014

Philipp Nagele (Wikitude) Wikitude SDK Tutorial
Philipp Nagele (Wikitude) Wikitude SDK Tutorial Philipp Nagele (Wikitude) Wikitude SDK Tutorial
Philipp Nagele (Wikitude) Wikitude SDK Tutorial AugmentedWorldExpo
 
Mobile AR Lecture 7 - Introduction to Vuforia
Mobile AR Lecture 7 - Introduction to VuforiaMobile AR Lecture 7 - Introduction to Vuforia
Mobile AR Lecture 7 - Introduction to VuforiaMark Billinghurst
 
Philipp Nagele (Wikitude): What's Next with Wikitude
Philipp Nagele (Wikitude): What's Next with WikitudePhilipp Nagele (Wikitude): What's Next with Wikitude
Philipp Nagele (Wikitude): What's Next with WikitudeAugmentedWorldExpo
 
Augmenting reality: Bring digital objects into the real world
Augmenting reality: Bring digital objects into the real worldAugmenting reality: Bring digital objects into the real world
Augmenting reality: Bring digital objects into the real worldUnity Technologies
 
Cardboard VR: Building Low Cost VR Experiences
Cardboard VR: Building Low Cost VR ExperiencesCardboard VR: Building Low Cost VR Experiences
Cardboard VR: Building Low Cost VR ExperiencesMark Billinghurst
 
Developing AR and VR Experiences with Unity
Developing AR and VR Experiences with UnityDeveloping AR and VR Experiences with Unity
Developing AR and VR Experiences with UnityMark Billinghurst
 
Philipp Nagele (CTO, Wikitude) An Insider Deep-Dive into the Wikitude SDK
Philipp Nagele (CTO, Wikitude) An Insider Deep-Dive into the Wikitude SDK Philipp Nagele (CTO, Wikitude) An Insider Deep-Dive into the Wikitude SDK
Philipp Nagele (CTO, Wikitude) An Insider Deep-Dive into the Wikitude SDK AugmentedWorldExpo
 
Building VR Applications For Google Cardboard
Building VR Applications For Google CardboardBuilding VR Applications For Google Cardboard
Building VR Applications For Google CardboardMark Billinghurst
 
Android app developers in bangalore- thorsignia
Android app developers in bangalore- thorsigniaAndroid app developers in bangalore- thorsignia
Android app developers in bangalore- thorsigniacharan Teja
 
The Wikitude SDK and the Wikitude Studio
The Wikitude SDK and the Wikitude StudioThe Wikitude SDK and the Wikitude Studio
The Wikitude SDK and the Wikitude StudioMartin Lechner
 
ARmedia SDK: new Features and Capabilities
ARmedia SDK: new Features and CapabilitiesARmedia SDK: new Features and Capabilities
ARmedia SDK: new Features and CapabilitiesGraziano Terenzi
 
Breizhcamp Rennes 2011
Breizhcamp Rennes 2011Breizhcamp Rennes 2011
Breizhcamp Rennes 2011sekond0
 
RICOH THETA x IoT Developers Contest : Cloud API Seminar
 RICOH THETA x IoT Developers Contest : Cloud API Seminar RICOH THETA x IoT Developers Contest : Cloud API Seminar
RICOH THETA x IoT Developers Contest : Cloud API Seminarcontest-theta360
 
Advanced map feature - marker cluster
Advanced map feature -  marker clusterAdvanced map feature -  marker cluster
Advanced map feature - marker clusterMickey Chiang
 
Create Your Own VR Experience
Create Your Own VR ExperienceCreate Your Own VR Experience
Create Your Own VR ExperienceMark Billinghurst
 
Unity and Microsoft Azure Cognitive Services - DIGITREK21 Workshop
Unity and Microsoft Azure Cognitive Services - DIGITREK21 WorkshopUnity and Microsoft Azure Cognitive Services - DIGITREK21 Workshop
Unity and Microsoft Azure Cognitive Services - DIGITREK21 WorkshopPablo Farías Navarro
 
Developing AIR for Mobile with Flash Professional CS5.5
Developing AIR for Mobile with Flash Professional CS5.5Developing AIR for Mobile with Flash Professional CS5.5
Developing AIR for Mobile with Flash Professional CS5.5Chris Griffith
 

Similar to Mobile AR SDK Tutorial - Augmented World Expo New York 2014 (20)

Philipp Nagele (Wikitude) Wikitude SDK Tutorial
Philipp Nagele (Wikitude) Wikitude SDK Tutorial Philipp Nagele (Wikitude) Wikitude SDK Tutorial
Philipp Nagele (Wikitude) Wikitude SDK Tutorial
 
Mobile AR Lecture 7 - Introduction to Vuforia
Mobile AR Lecture 7 - Introduction to VuforiaMobile AR Lecture 7 - Introduction to Vuforia
Mobile AR Lecture 7 - Introduction to Vuforia
 
Philipp Nagele (Wikitude): What's Next with Wikitude
Philipp Nagele (Wikitude): What's Next with WikitudePhilipp Nagele (Wikitude): What's Next with Wikitude
Philipp Nagele (Wikitude): What's Next with Wikitude
 
Augmenting reality: Bring digital objects into the real world
Augmenting reality: Bring digital objects into the real worldAugmenting reality: Bring digital objects into the real world
Augmenting reality: Bring digital objects into the real world
 
Mobile AR Tutorial
Mobile AR TutorialMobile AR Tutorial
Mobile AR Tutorial
 
Cardboard VR: Building Low Cost VR Experiences
Cardboard VR: Building Low Cost VR ExperiencesCardboard VR: Building Low Cost VR Experiences
Cardboard VR: Building Low Cost VR Experiences
 
Developing AR and VR Experiences with Unity
Developing AR and VR Experiences with UnityDeveloping AR and VR Experiences with Unity
Developing AR and VR Experiences with Unity
 
Philipp Nagele (CTO, Wikitude) An Insider Deep-Dive into the Wikitude SDK
Philipp Nagele (CTO, Wikitude) An Insider Deep-Dive into the Wikitude SDK Philipp Nagele (CTO, Wikitude) An Insider Deep-Dive into the Wikitude SDK
Philipp Nagele (CTO, Wikitude) An Insider Deep-Dive into the Wikitude SDK
 
Building VR Applications For Google Cardboard
Building VR Applications For Google CardboardBuilding VR Applications For Google Cardboard
Building VR Applications For Google Cardboard
 
Android app developers in bangalore- thorsignia
Android app developers in bangalore- thorsigniaAndroid app developers in bangalore- thorsignia
Android app developers in bangalore- thorsignia
 
The Wikitude SDK and the Wikitude Studio
The Wikitude SDK and the Wikitude StudioThe Wikitude SDK and the Wikitude Studio
The Wikitude SDK and the Wikitude Studio
 
ARmedia SDK: new Features and Capabilities
ARmedia SDK: new Features and CapabilitiesARmedia SDK: new Features and Capabilities
ARmedia SDK: new Features and Capabilities
 
Breizhcamp Rennes 2011
Breizhcamp Rennes 2011Breizhcamp Rennes 2011
Breizhcamp Rennes 2011
 
RICOH THETA x IoT Developers Contest : Cloud API Seminar
 RICOH THETA x IoT Developers Contest : Cloud API Seminar RICOH THETA x IoT Developers Contest : Cloud API Seminar
RICOH THETA x IoT Developers Contest : Cloud API Seminar
 
Getting Started With Android
Getting Started With AndroidGetting Started With Android
Getting Started With Android
 
Advanced map feature - marker cluster
Advanced map feature -  marker clusterAdvanced map feature -  marker cluster
Advanced map feature - marker cluster
 
Create Your Own VR Experience
Create Your Own VR ExperienceCreate Your Own VR Experience
Create Your Own VR Experience
 
Unity and Microsoft Azure Cognitive Services - DIGITREK21 Workshop
Unity and Microsoft Azure Cognitive Services - DIGITREK21 WorkshopUnity and Microsoft Azure Cognitive Services - DIGITREK21 Workshop
Unity and Microsoft Azure Cognitive Services - DIGITREK21 Workshop
 
AR with vuforia
AR with vuforiaAR with vuforia
AR with vuforia
 
Developing AIR for Mobile with Flash Professional CS5.5
Developing AIR for Mobile with Flash Professional CS5.5Developing AIR for Mobile with Flash Professional CS5.5
Developing AIR for Mobile with Flash Professional CS5.5
 

Recently uploaded

The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxThe Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxLoriGlavin3
 
Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...Rick Flair
 
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxPasskey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxLoriGlavin3
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfAlex Barbosa Coqueiro
 
Training state-of-the-art general text embedding
Training state-of-the-art general text embeddingTraining state-of-the-art general text embedding
Training state-of-the-art general text embeddingZilliz
 
Generative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersGenerative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersRaghuram Pandurangan
 
What is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfWhat is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfMounikaPolabathina
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 3652toLead Limited
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebUiPathCommunity
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxLoriGlavin3
 
SALESFORCE EDUCATION CLOUD | FEXLE SERVICES
SALESFORCE EDUCATION CLOUD | FEXLE SERVICESSALESFORCE EDUCATION CLOUD | FEXLE SERVICES
SALESFORCE EDUCATION CLOUD | FEXLE SERVICESmohitsingh558521
 
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc
 
The State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxThe State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxLoriGlavin3
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxDigital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxLoriGlavin3
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsSergiu Bodiu
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek SchlawackFwdays
 
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningLars Bell
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024Stephanie Beckett
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.Curtis Poe
 

Recently uploaded (20)

The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxThe Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
 
Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...
 
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxPasskey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdf
 
Training state-of-the-art general text embedding
Training state-of-the-art general text embeddingTraining state-of-the-art general text embedding
Training state-of-the-art general text embedding
 
Generative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersGenerative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information Developers
 
What is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfWhat is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdf
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio Web
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
 
SALESFORCE EDUCATION CLOUD | FEXLE SERVICES
SALESFORCE EDUCATION CLOUD | FEXLE SERVICESSALESFORCE EDUCATION CLOUD | FEXLE SERVICES
SALESFORCE EDUCATION CLOUD | FEXLE SERVICES
 
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
 
The State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxThe State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptx
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxDigital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platforms
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
 
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine Tuning
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.
 

Mobile AR SDK Tutorial - Augmented World Expo New York 2014

  • 1. Mobile AR SDK Tutorial Augmented World Expo, NY, March 25, 2014 Patrick O’Shaughnessey @patchedreality patrick@patchedreality.com http://patchedreality.com
  • 2. Patched Reality Custom Augmented Reality and Digital Eyewear Apps http://patchedreality.com
  • 3. Patched Reality Using Best-in-Breed Technologies http://patchedreality.com
  • 4. Video and Slides from AWE 2013 http://bit.ly/SDKTutorialAWE2013
  • 5. Notable Features Since June Some Highlights: • Extended tracking • CAD model-based training • Text recognition and tracking • Digital eyewear support
  • 6. What’s the purpose of an AR SDK? Simplifies one or more of: • Recognition – What to track • Tracking – Where it is (3D pose) • Content rendering – Your Interesting Stuff
  • 7. Tracking Types • GPS + Compass + Gyro + Accelerometer • Marker (Fiduciary, frame, etc) • NFT (2D images) • Pre-trained • Cloud recognized • User-defined • 3D (Pre-trained point cloud) • Live 3D (SLAM) • Face, Fingers, Body • Robot
  • 8. Mobile AR SDKs Short List SDK Purpose Tracking Platform Graphics Cloud GP S License Qualcomm Vuforia 2D Images, Cylinders, Markers, Text NFT+Ext, Cylinder, Marker, Text iOS, Android Unity3D & Alt. yes no Free $99- 499/mo Cloud Metaio SDK 2D Images, 3D, GEO, QR NFT+Ext, GPS, 3D, SLAM iOS, Android, Eyewear Unity3D & Proprietary yes yes $0-5,500 $235- 680/mo Cloud Total Imm. D’fusion 2D Images, Faces NFT, Face iOS, Android Dev: MS only Proprietary no no $0-7,800 Wikitude SDK 2D Images, GEO GPS, NFT iOS, Android, Blackberry, Eyewear HTML, Proprietary yes yes $0-2,300 Layar SDK 2D images, Geo NFT, QR iOS, Android Proprietary yes no $3,250/ap p/yr + $60/page
  • 9. Mobile AR SDKs Short List SDK Purpose Tracking Platform Graphics Cloud GP S License 13th Lab Point Cloud 2D Images, 3D, Anywhere NFT, 3D, SLAM iOS, Android Unity3D & Alt. no no 0-$5,000 HP Aurasma SDK VFX, Videos on 2D Images NFT iOS, Android Proprietary yes yes Per click Obvious Engine 2D images, Cylinders NFT, Cyl. iOS, Android Unity3D & Alt. no no $8000/ap p/plaform String Framed 2D images Framed Image iOS Unity3D & Alt. no no $499 - $8000/ap p/year Orbotix Robotic AR Sphero iOS, Android Unity3D no no Free catchoom 2D Images NFT iOS Proprietary yes no $0-2000 +$135- 835/mo
  • 10. SDK Development On Ramp 1) Set up Dev Environment • Xcode (iOS) • Eclipse (Android) • Android SDK • Android NDK • Unity 3D 2) Download SDK 3) Install and run samples
  • 11. SDK Development with Unity 1) Create Project 2) Wire up SDK - camera setup, licensing, etc 3) Set up recognition and tracking configuration 4) Add scene content and interactions 5) Build, Run, Test 6) Repeat 3-5 7) Ship
  • 12. NFT Setup - Vuforia 1) Import Unity package 2) Create target using “Target Manager” at developer.vuforia.com 3) Download and Import target package 4) Replace MainCamera with ARCamera prefab 5) Add ImageTarget prefab 6) Add content to ImageTarget 7) Enable Data Set load on ARCamera 8) Select Data Set and Image Target on ImageTarget 9) Build and Run
  • 13. NFT Setup - Vuforia
  • 16. SLAM Setup - metaio 1) Import metaioSDK.unitypackage 2) Add metaioSDK prefab to scene 3) Delete Main Camera 4) Generate app signature (mobiledeveloperportal.ar-live.de) 5) Add app signature to metaioSDK 6) Add metaioTracker prefab to scene 7) Add scene root to metaioTracker object
  • 17. SLAM Setup - metaio 1) Add GUI and script that calls metaio.MetaioSDKUnity .startInstantTracking ("INSTANT_3D", ""); 2) Add metaioCallback subclass (InstantTrackingCallback from TutorialInstantTracking) and replace the one on metaioSDK GameObject 3) Build and run 4) Add missing libraries to Xcode project
  • 18. SLAM Setup - metaio Missing Libraries: metaiosdk libxml2.dylib AVFoundation Security
  • 19. SLAM Setup - metaio https://mobiledeveloperportal.ar-live.de/index.php
  • 20. SLAM Setup - metaio