Case studies / How we test mobile apps
EcommerceHow we approach it

Mobile app testing on the phones your users actually own

Crashes often live on devices the team does not have. We build the device matrix from real usage and test on real hardware and real networks.

Device matrixbuilt from real user data
Real devicesnot only emulators
Appiumautomation in CI
Networksslow, unstable and interrupted
In 60 seconds

The whole story, short

The problem

Crashes appear on budget and older phones nobody on the team owns.

What we did

  • Set a device matrix strategy
  • Test on real devices
  • Automate with Appium
  • Review crash analytics
  • Test network conditions

The outcome

Real devices chosen from your usage data

The problem

What goes wrong

  • Crashes appear on budget and older phones nobody on the team owns.
  • Memory issues surface only on low-RAM devices.
  • Payments fail or duplicate when the connection drops.
  • Store ratings fall before the team can reproduce the issue.

Why the usual fix falls short

Emulators miss hardware, manufacturer and memory issues. Testing on the team’s own phones covers only a small slice of real users.

What we did

How we tested it

  1. Set a device matrix strategy

    Use analytics to choose the device and OS combinations real users have, including budget models.

  2. Test on real devices

    Run on a real-device cloud to reproduce hardware and manufacturer-specific problems.

  3. Automate with Appium

    Automate the main flows and connect them to CI, so each release candidate is tested.

  4. Review crash analytics

    Rank crash reports by affected users and business impact.

  5. Test network conditions

    Test payments and cart recovery on slow, unstable and interrupted connections.

FAQ

Questions buyers ask

How many devices should a mobile app be tested on?

There is no fixed number. Use your analytics to find the devices, OS versions, and screen sizes your users actually have, then cover the combinations representing most of them. Add older or low-end devices where they matter, and revisit the list regularly because usage changes.

Are real devices better than emulators?

Each has a role. Emulators and simulators are fast and affordable for early development checks. Real devices are needed to find hardware, manufacturer, performance, battery, and network issues. Most teams use emulators during development, then confirm important flows on real devices before each release reaches customers.

What is Appium used for?

Appium is an open-source framework for automating native, hybrid, and mobile web apps on iOS and Android. Teams often use it to run one test approach across both platforms. Platform-specific tools such as Espresso and XCUITest can be faster, so the right choice depends on the app and team.

Want this level of testing on your product?