Evaluation: Huawei's latest mobile application/APP testing tool MobileTest

1. Current testing pain points and optional solutions of mobile applications/Apps

The mobile Internet market has entered the second half, with fierce homogenization competition and an increase in the average customer acquisition cost. Compatibility issues such as screen incompatibility, flashback, non-response, and UI abnormality seriously affect user experience and affect user conversion rate and user stickiness. How to solve these problems?

Method 1: Android emulator or USB connection to real machine test

Disadvantages: Compatibility issues and performance issues caused by hardware differences such as screens cannot be found.

Method 2: Purchasing the main compatible models for compatibility testing

Disadvantages: There are many Android custom systems, large differences in hardware parameters such as screen size and resolution, fast model update, and high procurement and maintenance costs.

There are other disadvantages to both approaches:

1. Compatibility testing is highly professional, requires Android development and testing experience, and has high learning costs

2. Manual testing is inefficient and repetitive, making it difficult to locate and diagnose problems

3. The development cost of automated test is high, and the multi-model automated test also needs to build a software and hardware test platform

2. Key features and solutions of Huawei MobileTest

Huawei MobileTest provides Android APK compatibility automated traversal testing, based on automated real-device testing, to help developers find defects and locate problems.

ü Cover the 5 steps of installation, startup, login, traversal and uninstallation

ü Diagnose up to 11 types of Android app compatibility issues

ü Take a screenshot of the test steps, click on the problem to quickly locate the step and take a screenshot

üCPU and memory usage, battery temperature curve

ü Performance details provide 3 categories of 16 items and 4 performance grades

üLogCat log level display, one-click log download

ü 2 steps to quickly submit test tasks

ü The fastest 6 minutes (including task queuing time) output test report

ü The overview report is clear at a glance, and the detailed report is detailed

ü One-click download of detailed test report in Excel format

ü Card graphics to manage test tasks

ü A variety of models are available for public testing, and new models are continuously added

3. Introduction to Huawei MobileTest usage and related features

1. Create a mobile compatibility test task

a. Browse test item description: traversal test, performance collection

b. Select Android application: upload from local by default, you can also reuse the uploaded application APK or select the compiled and built APK from the release repository

c. Select mobile phone: filter models according to brand and Android version, one task can select multiple models

d. Submit test tasks

[Related Features] Card-based management of test tasks

n Quick preview of test status and test results

nCreate, query and delete test tasks

[Related features] A variety of public beta models, and new models continue to be added

2. Manage mobile compatibility testing tasks

a. Search query test task

b. View the test progress according to the status of the task icon

c. View overall pass rate and distribution

d. Delete test tasks (only task creator and item management roles can delete)

3. View the Mobile Compatibility Test Task Report

a. View APK summary information, test pass rate and problem distribution

b. View the distribution of test results: View the test results of 11 types of problems by status and model

c. View the test details of a certain model

d. View the test results according to the brand, system and resolution statistics

e. Browse the same AKP related test

f. One-click download of test report in Excel format

[Related features] Diagnose 11 types of Android application compatibility issues

n Installation failed: The application cannot be installed normally due to platform compatibility and other issues

n Startup failed: No response after startup, unable to enter the home page of the application

nApp crashes: "App has stopped running" pop-up window appears during operation

n Flashback: An operation during operation causes an abnormal exit to the desktop

n No response: The "Application is not responding" pop-up window appears during operation

nRunning error: An operation produces unexpected results during the running process. It may be that the application interface or background logic does not meet expectations.

nUI exception: page controls are not fully displayed

n Black and white borders: There are undesigned black borders and white borders on the page

n account exception: the correct account cannot log in

n Unable to go back: After the application enters a certain page, the page cannot be exited and the application cannot be exited (you can only forcefully kill the application)

Uninstallation failed: The application cannot be uninstalled or there is residue after uninstallation

[Related features] Detailed test report content, one-click download

n Pass rate: Test model pass rate

n problem distribution statistics: 11 types of problem distribution statistics

nTest result distribution: Display the test results of each model, and count the pass rate in three dimensions: brand, system, and resolution

n related tests: related test tasks for the same application

nReport download: Excel format report, including test results and statistical charts

4. View the details of the mobile compatibility test task report

a. View the problems found in the test and click to locate the problem step

b.查看测试步骤截图，点击和输入操作使用红框突出显示

c.查看性能曲线：分时显示CPU占用率、内存占用率、电池温度

d.查看资源消耗、应用设计、响应速率的性能等级评定

e.查看LogCat日志，分Error、Warning、Info、Debug类别过滤日志

f.一键下载LogCat日志

【相关特性】

n问题提示：提示检测发现的问题，点击定位到步骤截图

n测试截屏：记录主要操作步骤截屏、问题步骤红色高亮突出显示

n性能详情：资源消耗、应用设计、响应速率3类16项，4个性能等级

n性能曲线：记录CPU占用率、内存占用率、电池温度随时间变化曲线

nLogCat日志：记录LogCat日志，按照Error、Warning、Info、Debug分级展示，支持一键下载日志

四、免费公测入口

https://www.hwclouds.com/product/mobiletest.html

目前开通的是华北区，注册并登陆控制台以后，需选择华北区

选择后将在左侧导航栏中看到