What framework are you using for mobile automation?

Someone recently asked on Slack what are the most popular mobile automation frameworks at the moment. I thought it would be interesting to poll people here on The Club to see what frameworks you’re using.

What mobile automation framework are you using?
  • Appium
  • XCUITest
  • Cypress
  • Espresso
  • UI Automator
  • WebdriverIO
  • Perfecto
  • Robo test
  • Other (please explain below)

0 voters

I wanted to vote for 2 options (because iOS & Android) but couldn’t.

I couldn’t vote for 2 - wanted to vote for Espresso and XCUITest

Hmm try now @maaike.brinkhof & @deament, you should be able to choose more than one now that I’ve edited it

Interesting results so far :grin:

How does ROI look for these tools? My experience is that mobile tools are behind web testing in terms of maturity.

2 Likes

That could be a great standalone/new questions @danuk :grin: I don’t personally have much experience with anything except WebdriverIO I’m afraid.

I am trying to look at tool options for testing our websites and how we will be able have automation across all platforms, including devices (our biggest percentage of customer traffic). I am interested in peoples experiences of the available tools so we can review the results, but we are not focusing on the App side as it is a different team.

The Dev’s seem to be really keen for us to use a specific tool, but that seem to have limitations around devices and only seem to really work on browsers/desktop.

Any advice would be great :slight_smile:

2 Likes

Hi Sarah, if you’d like to go all in on mobile, I’d recommend trying out Espresso for Android and xcui for iOS. This would allow you to run your tests on a wide range of devices.

Although those are predominantly used for testing the mobile app, you can leverage the framework to test websites. There are a lot of tutorials to do this, but I’m happy to help if you couldn’t find a good one.

This way you can also add some native testing frameworks to your skillset/toolset.

Good luck!

1 Like

Been testing for on and off over my career, the mobile work started when I used was a “robot-based” framework, possibly an early fork reworked to do mobile testing before mobile testing was even a thing. Lately I am using a totally rewritten pytest in-house framework again, which pulls in Appium and pulls in selenium/webdriverIO, trying to merge them a bit.

1 Like

Interesting to see Appium out on top so far!

Appium is probably only that far up, because it’s used under the covers in many subscription based tools, which is a misnomer perhaps. I just don’t see the brilliant community support that webdriver for example gets.

We use Xcui for iOS and Espresso for Android, having good buy in from developers.
Then running them daily on CircleCI.

2 Likes

Side question on that point, at what stage do you notarize the app in your CI line, and how often does notarize just randomly fail?