Currently there are a lot of testautomation frameworks that can help you automate your native app, but how do you pick the right one?
In the talk I gave at AppiumConf2018 in London I showed how my journey for selecting the best tool for testing Tele2's new React Native app for iOS and Android went. We take a look at the selected teststrategy and walked down the bumpy road I needed to take to get the automation on the quality level it is now.
4. About me
âȘ The blue guy
âȘ Fatherof 2 kids and happily married formore than12,5years
âȘ Manual testing since 2007
âȘ Testautomation since 2012 (QTP/UFT,Protractor,Appium,webdriver.io)
âȘ Automation geek
âȘ Ownerof some widelyused (testing)modules
âȘ Working fordeTesters and hired bydifferentcustomers
5. About me
âȘ The blue guy
âȘ Fatherof 2 kids and happily married formore than12,5years
âȘ Manual testing since 2007
âȘ Testautomation since 2012 (QTP/UFT,Protractor,Appium,webdriver.io)
âȘ Automation geek
âȘ Ownerof some widelyused (testing)modules
âȘ Working fordeTesters and hired bydifferentcustomers
10. (Test automation) Requirements
Hard:
âȘ The tool should be cross-platform
âȘ Write testcode in1language
âȘ UserE2E flow (app/browser/native)
âȘ Teston âš
emulators/simulators/real devices
âȘ CI-support
âȘ Reporting with screenshots on error
Soft:
11. (Test automation) Requirements
Hard:
âȘ The tool should be cross-platform
âȘ Write testcode in1language
âȘ UserE2E flow (app/browser/native)
âȘ Teston âš
emulators/simulators/real devices
âȘ CI-support
âȘ Reporting with screenshots on error
Soft:
âȘ Automation should be a team effort
âȘ TestBDD style (Given,When,Then)
20. How did I compare?
âȘ Navigation:
âȘ Tabbar and swipe
21. How did I compare?
âȘ Navigation:
âȘ Tabbar and swipe
22. How did I compare?
âȘ Navigation:
âȘ Tabbar and swipe
âȘ Webview:
âȘ Native / Hybrid Swipe
âȘ Act in the webview context
23. How did I compare?
âȘ Navigation:
âȘ Tabbar and swipe
âȘ Webview:
âȘ Native / Hybrid Swipe
âȘ Act in the webview context
âȘ Chats:
âȘ Interact and get result
25. Detox
Proâs
â Interacts nicelywith the app and
syncs with it
â Fast
â Easyto debug
â Possibilityto use the native keyboard
â You see interaction on the screen
â (Alreadya) Big community
Cons
26. Detox
Proâs
â Interacts nicelywith the app and
syncs with it
â Fast
â Easyto debug
â Possibilityto use the native keyboard
â You see interaction on the screen
â (Alreadya) Big community
Cons
â Onlynative app support
â No interaction with a webview
â Currentlyno supportforcoordinates
â Currentlyno screenshots
â No .getText()
â Hard to getproperlogging/reporting
â Hard toverifycertain actions
28. Appium
Proâs
â The de facto standard
â Stable solution & large community
â Supports native / hybrid / browser
â Well supported forprivate/cloud
device lab
â Integrate with multiple frameworks
â There is always a wayin 99% of the
(test) cases
Cons
29. Appium
Proâs
â The de facto standard
â Stable solution & large community
â Supports native / hybrid / browser
â Well supported forprivate/cloud
device lab
â Integrate with multiple frameworks
â There is always a wayin 99% of the
(test) cases
Cons
â Hard to setup (?)
â Slow
â Unstable / inconsistentresults (?)
â Sometimes hard to debug
31. Is Appium the best tool for React Native apps?
âȘ Itâs not the holy grail!
32. Is Appium the best tool for React Native apps?
âȘ Itâs not the holy grail!
âȘ What are your requirements?
33. Is Appium the best tool for React Native apps?
âȘ Itâs not the holy grail!
âȘ What are your requirements?
âȘ What should your app do (now/future)?
34. Is Appium the best tool for React Native apps?
âȘ Itâs not the holy grail!
âȘ What are your requirements?
âȘ What should your app do (now/future)?
âȘ Which tool supports your needs/expectations?
35. Is Appium the best tool for React Native apps?
âȘ Itâs not the holy grail!
âȘ What are your requirements?
âȘ What should your app do (now/future)?
âȘ Which tool supports your needs/expectations?
âȘ Proof Of Concept!