17 Testing Tools for Mobile UX

Source http://feedproxy.google.com/~r/KISSmetrics/~3/GP4PtXr1Yvc/

Below, you will find 17 tools that will help you test various features of your app and obtain real-time feedback.

The tools will help you discover where your users are struggling and, thus, how to improve your app.

Let’s get started!

1. Userlytics

Best feature – Recruiting couldn’t be any simpler. You can send an invitation through your database, post it on social media sites, or use any 3rd party for this. There’s also a participant panel at Userlytics that you can use.

Features

Userlytics’s Mobile App User Experience Testing lets you observe usability of apps on iOS. The tool just provides you with the raw session video file. It has no data on the items clicked, movements, or gestures. Akin to UserTesting.com, it has an ever-growing panel of users who are already equipped with a PC, microphone, and webcam.

The participation segmentation feature runs deep. You can choose the Residence, Gender, Age, Education, Employment, etc.

When setting up tests, you can set the tasks you want the users to complete and also set the time duration for the test.

Another option is to include a survey at the end of the test that the test takers have to answer.

Works on – iOS / iPhone / iPad.

Pricing – Userlytics works on a Freemium model. When you create a free account, you get 7 credits each month to perform tests. When you sign up, you get a one-time bonus of 33 credits, along with 7 credits; i.e., 40 credits in total.

A mobile usability test would cost 18 credits. Each participant would cost 18 credits; so if there are 10 participants for a test, the total would be 180 credits.

2. Applause

Best feature – The targeted group of survey participants who are handpicked to test your app. What separates Applause from other such services is that you can have a consultation with an expert at Applause, who then chooses the ideal participants based on the consultation.

Features

Applause offers lots of cool features, ranging from expert usability surveys and audits to narrated captures.

With Applause’s team of usability experts, your app will receive the right feedback to develop high usability for your apps. Detailed reports, consultations, and even mock survey questions are all in the pack.

There are over 100,000 professional testers to assist you in the quest.

Works on – iOS / iPhone / iPad / Android.

Pricing – The pricing is not shown on their website, but they do have a pricing estimator through which you can calculate your costs.

3. Appsee

Best feature – The ability to see exactly what users are doing on your app. With session recordings, touch heatmaps, and analytics, you have a window into the mind of the user. This can quickly reveal usability problems with the app.

Features

Appsee’s in-app mobile analytics platform tracks each and every interaction of the user with your app.

What makes it different from Userlytics is its ability to let you see what your actual app users are doing. Unlike Userlytics’s test panel (where people are paid to test your app), at Appsee, a few lines of code gets you into the shoes of your customers.

With a paid panel of testers, you need to specify what they have to do. Seeing what a user does with the app is an entirely different experience because each person can use it differently, even in ways you wouldn’t think of.

Here are the features of Appsee:

  1. User Recordings: The User Recordings feature captures every screen, tap, swipe, and action in a session. You can decide how many user interactions you want to record and segment by demographic and even specific screens (e.g., checkout screens to see what causes cart abandonment).
  2. Touch Heatmaps: All touch gestures – swipe, tap, and pinch – are aggregated into one whole called the touch heatmap. They help you find out which parts of the screen users spend most of their time on. Knowing that, you can place CTAs in the most optimal manner.

  1. Real-time In-app Analytics: In-app analytics show you how users interact with an app’s screens. This feature can help you discover which screens have a higher quit rate, which screens are causing confusion, and the top actions by users.

In addition, Appsee can send you crash reports and reports on unresponsive gestures, and it can help you set up a proper conversion funnel.

Works on – iOS / iPhone / iPad.

Pricing – Appsee offers a fully functional free trial. However, the pricing plans aren’t disclosed on the website. For pricing, you need to contact them.

4. Swrve

Best feature – In-app campaigns. With these, you can run extremely targeted campaigns – campaigns that can be targeted right down to an individual user and that are customizable and testable. It’s marketing automation at its best. Segmentation goes along with this feature, letting you build both small and large segments of users with specific traits.

Features

Swrve calls itself a complete app marketing solution, but its most powerful and unique feature is its A/B testing tool. Swerve was initially developed for game developers, but there’s no reason you can’t use it, too. As a marketing tool, it offers many features; but for our purposes, we’ll focus on three of its powerful features:

  1. A/B Testing: Swrve can handle any number of variants while conducting an A/B test. The control group can be limited to any size you want. If you want 10% of your users to see the variation, that can be done in a few clicks.

  1. Segmentation: It lets you build target groups based on several criteria. User demographics, age group, paying user, device used, gender, and users playing a particular level are just a few examples of those you can choose from. A/B testing can be combined with user segmentation, too.
  2. Analytics: It offers easy-to-understand charts about all Key Performance Indicators (KPIs), such as Revenue, Conversions, Daily Average Users (DAU), Monthly Average Users (MAU), and retention rates.

Works on – iOS / iPhone / iPad / Android.

Pricing – Swrve offers a fully functional free trial which supports up to 10,000 monthly active users (MAU). The Flex plan supports 20,000 MAU and is priced at $200 per month. The professional edition supports 250,000 MAU and starts at $2,500 per month. If your app’s appetite is even bigger, they have custom plans, too.

5. Loop 11

Features

You can create a remote usability test (e.g., tasks and questions) to determine how users use an app. You can invite participants via social media to perform the tasks. You will get a report with task completion rate, the time spent per task, most common success page, most common fail page, most common first click, and common navigation paths.

Works on – Web based / iPad.

Pricing – The pricing is on a per project basis, and each project would cost $350. You also can buy a license for $1,900 to $9,000, depending on your needs.

6. Arise

Best feature – Its A/B testing platform that lets you show different variants to different users to discover which variant performs the best.

Features

Much like other A/B testing platforms for mobile, Arise offers a native iOS and Android A/B testing platform. It integrates easily with your app’s SDK, and it lets you test an unlimited number of features and variations. The dashboard shows how conversions have changed, for the better or worse, over time.

It helps you track goals, like in-app purchases, new account creations, and improved CTR on ads.

You decide what user ratio sees the variation and at which stage.

Works on – iOS / iPhone / iPad / Android.

Pricing – Arise operates on a Freemium model with the basic version starting at $0. You can run A/B tests on one app with up to 100 monthly active users (MAU).

The professional plan is €299/month and supports one app and MAU up to 10,000.

The business plan is priced at €649/month and supports 2 apps and MAU of 100,000.

For even bigger requirements, you need to contact them.

7. SimpleUsability’s beMobile

Best feature – This is one of the very few companies that offers usability testing as a service. As a result, rest assured that you will get a fully customized service that is in tune with your needs.

Features

They will identify problems associated with your mobile app by taking into account and testing identified journeys that users have on the app. Also, you can use the tool to analyze cross-platform behavior of the app and loading times on various networks.

Mobile usability is a service that SimpleUsability offers and includes the following:

  • Helps identify common user tasks
  • Assesses what customers use the app for
  • Helps in evaluation of general usability
  • Is cross-platform
  • Can study connectivity and loading times with ease

Here’s a case study on using beMobile that you will find useful.

Pricing – Since this is being offered as a service, the prices will vary from app to app, and you will have to contact them for more information.

8. Keynote

Best feature – Keynote’s cloud-based platform called Device Anywhere is a one-of-a-kind testing environment for mobile apps.

Below, you can see a small preview of the number of devices, their versions, and the quantities available for conducting tests.

With 500+ mobile devices, Keynote features one of the most exhaustive lists of devices ever for testing apps.

Features

With Keynote, you have two options for app testing. The first is a cloud-based platform, Device Anywhere, and the second is a mobile testing environment, Keynote MI.

Keynote’s testing facility consists of a network of over 2,000 interconnected mobile phones and tablets called Device Anywhere. Unlike simulated platforms that offer only limited functionality, live phones on different carriers worldwide is the ultimate solution for testing apps. Screenshots of all the tests are captured and backed up so that you can review them whenever you want to.

The second option called Keynote MI supports device emulation on a WebKit browser. You can record a script on one device and run it on any other device. The library has over 2,200 scripts for testing.

They have a library of tests for your mobile apps.

Works on – iOS / iPhone / iPad / Android.

Pricing – Keynote offers a trial that supports a dozen devices. Prices for the PRO plan and Enterprise Plan are not shown on the website, but the former has a fully functional trial and the latter comes with a demo.

9. UserZoom

Best feature – UserZoom’s greatest feature could be that it provides you with people who test apps in their natural environment. You can see the facial expressions of the users while using each feature, the time taken on tasks, and a lot of other things. With no cue cards or artificial environment, this could be one of the best tools for usability testing.

Features

UserZoom provides a remote unmoderated testing environment for testing mobile apps. Unlike artificial environments created using a panel of people in a lab, UserZoom provides a natural testing environment similar to Userlytics (discussed earlier) where participants test the mobile apps in their own homes with their own devices.

After building the study design via UserZoom, you can invite participants via social media, email, or from a panel provider. Tasks are given to them and their feedback is recorded. You can see real-time data, including success ratios, time on task, clickstreams, heatmaps, video, audio, facial expressions, mouse movements, responses to the questionnaires, etc., which can be accessed via the Analytics dashboard and exported to PowerPoint, Word, Excel, or SPSS.

Works on – iOS / iPhone / iPad / Android.

Pricing – There doesn’t seem to be a free trial available. UserZoom’s annual software subscription fees start at $25,000/year, which gives access to an on-demand, web-based research software platform and an in-built, user-friendly Manager to design your studies, recruit participants, collect data, conduct analysis, and generate your reports.

10. Apperian

Best feature – Apperian’s app distribution lets users be an active part of the feedback system by letting them provide feedback through app ratings and comments. This kind of crowdsourcing helps users propose improvements to existing apps or ideas for new apps and drives down the costs for collecting feedback.

Features

Apperian can be used for mobile app testing. Apperian’s app distribution takes care of sending the app’s link via SMS, email, and chat to a wide audience. This testing community consists of testers outside the company circle like consumers, contractors, etc., allowing you to quickly test out variations of the same app to see which one is popular.

Works on – iOS / iPhone / iPad / Android.

Pricing – Apperian offers a 30-day free trial to their mobile management platform AppEase. The pricing details aren’t shown on the website.

11. Mr. Tappy

Best feature – One of the very few physical usability testing kits for testing apps. You can set up your own panel of participants with Mr. Tappy.

Features

Mr. Tappy provides insight into what users are doing with your app. It was originally designed as a filming rig for testing usability on the iPad. Now, it can be used for recording user interactions with mobile by serving as a recording kit from the user’s point of view.

It’s a hardware tool made of aluminum, and the entire thing can be set up by twisting the nuts. No tools are required.

Works on – iPhone / iPad / Android.

Pricing – Mr. Tappy kit would cost you $295, which includes worldwide shipping.

12. Lookback

Best feature – It captures user app interactions in their natural environment. The video playback at 60 frames per second is very detailed and clear.

Features

Lookback will record the voice and gestures of users. It also will record the screen and collect experiences. Lookback’s essence is in capturing pure customer experiences while they use the app. They are not in a laboratory constrained with tools and wires. The video of the user comes from the corresponding front camera along with a screen recording. You can see the reactions on their faces and understand if they are struggling with the app.

What sets Lookback apart is that not only does it capture pure experiences, it does that in style. At 60 frames per second, Lookback is much better than its competitors at 1 frame per second.

Works on – iOS 8.

Pricing – Their website says that they are absolutely free while in beta.

13. Watchsend

Best feature – What sets Watchsend apart is that you can run usability tests even while your app is in beta or is testing out beta features.

Features

It records what your users do with the app.

The part that interested me is that it offers deeper insights into app beta tests. With Watchsend, you get to know if the new features released are hitting home.

The data consumption is pretty low at 1 Mb per minute of recorded video.

With apps, unlike with PCs where you can see mouse clicks, you virtually are left with nothing. But Watchsend shows you where your users are tapping.

Works on – iPhone.

Pricing – They work on a Freemium model, and the prices are shown below:

14. Apptimize

Features

Apptimize provides a reliable A/B testing platform for testing apps. You can add a few lines of code to your app and voilà there is an interface where you can run changes.

Multiple experiments can be run with Apptimize.

Works on – iOS / iPhone / iPad / Android.

Pricing – It works on a Freemium model. The basic version that can support up to 25,000 monthly users is free. The standard version costs $300 per month, and the Professional plan is priced at $1,000 per month, both of which come with a free trial. If you have more than a million customers, then the price is $5,000 per month (free trial available).

15. Leanplum

Features

Leanplum provides flexible A/B testing for mobile apps. There is no coding whatsoever required to use it. What makes Leanplum stand out is that you can test and push those changes without approval from the Appstore.

Leanplum also offers powerful segmentation, and users can be segmented based on demographics, behavior, and device type. You can set custom parameters to segment users.

It comes with cohort analysis, retroactive funnels, comparison graphs, stack graphs, etc.

Works on – iOS / iPhone / iPad / Android.

Pricing – It works on a freemium model with the free plan called Seed for apps with 500 daily active users. It supports one app.

The Blossom plan supports apps with up to 1.5K daily active users, and it handles 2 apps in total. It costs $79/month.

The Prune plan supports apps with up to 10K daily active users, and it handles 3 apps in total. It costs $399/month.

If you need something even higher, then you need to contact them for the custom plan.

16. Amazon A/B Testing

Features

Amazon’s tool is completely free since it’s in beta. It’s an easy way to run in-app tests.

The segmentation seems much more advanced, with the ability to limit the sample size, set complex criteria, etc.

Works on – iOS / iPhone / iPad / Android.

Pricing – It’s 100% free.

17. Vessel

Features

Vessel is an A/B testing tool that helps product managers run deep-layered A/B tests on their mobile apps. You can monitor how the variations perform even while the tests are running. It results in zero downtime and the ability to send out winning versions to users with app-store releases. The session times are monitored, and you can see how much time users spend on your app.

You can import all the data and analyze it with SQL or CRM. The larger analytics package allows in-browser editing, too.

Works on – iOS / iPhone / iPad / Android.

Pricing – The basic version is billed at $150/month and comes with a 30-day free trial, supports up to 100k monthly active users (MAU), and includes unlimited testing and multivariate testing.

The optimal version is billed at $650/month and comes with a 30-day free trial, supports up to 500k MAU, and includes unlimited testing, multivariate testing, segmentation, and 90-day retention.

The enterprise version also has a free trial, but you need to contact them with your requirements first.

There you have it!

Did we miss anything? If so, please let us know in the comments!

About the Author: This article was written by George Mathew.

Some of the links in the post above are “affiliate links.” This means if you click on the link and purchase the item, we will receive an affiliate commission. Regardless, we only recommend products or services we believe will add value to our readers.

Share and Enjoy

  • Facebook
  • Twitter
  • Delicious
  • LinkedIn
  • StumbleUpon
  • Add to favorites
  • Email
  • RSS

Leave a Reply

Your email address will not be published. Required fields are marked *

CommentLuv badge