Smart practice of mobile testing

Abstract:  Monkey, traversal, and functional testing must be familiar to everyone. Monkey has strong randomness and can find hidden problems, but it is random, uncontrollable, and inefficient. The traversal process is controllable, but often requires a high time cost to write and maintain related script. MQC has been working in the field of automated testing for many years, and has created a new testing tool Ripper for compatibility testing while fully absorbing the advantages of various testing methods.

1. Application Quality & Development Speed

Most companies tend to consider three aspects when developing apps: time cost, development cost, and failure cost.

• Race against time
• Development cost
• Failure cost

2. Testing Status & Pain Points

Manual testing

• A lot of repetitive work, slow testing speed
• A lot of points to pay attention to, high QA cost

Automated functional testing

•Fast changes, requiring frequent revisions, high maintenance costs
•Duplicated processes, hard to find crashes
•Use case failures are often caused by scripting or setting problems

three. Compatibility Test Tool

Compatibility Test Monkey

• Uncontrollable actions and low coverage
• Time-consuming testing
• Difficulty in locating problems during development

Compatibility Test Traversal

• Improve detection coverage
• Lack of specific business scenarios
• Lack of problem location

Compatibility test ripper

•More actions: multi-finger operation (zoom), combo, Chinese input
•Precise control, high concurrency, high test efficiency
•Perftool
•Scenario

4. Compatibility test capability comparison

In order to compare the test effect of Ripper and monkey, we wrote a property page structure App that contains various controls (viewpager, listview, fragment, imageview, etc.).

image

image

image

5. Features of Compatibility Test

image

image
•Anr
   KeyDispatchTimeout
•IllegalStateException
   Fragment already added
  50 ~ 200ms

六、兼容性测试弱场景

image

•控件(语义、类型)
•弹窗

七、兼容性测试 功能场景

•为数十万app提供测试服务
•数百万页面
•缩放,连击
•视频切换,方向切换
•登录,注册,反馈
•快速遍历

image

八、兼容性测试 问题复现与定位

无法复现的bug是没有价值的。相信大家常常会因为无法定位问题、复现问题而无法有效修复bug,MQC在测试App质量的同时提供了Crash定位、Crash解决方案来辅助开发修复bug。

image

九、兼容性测试 解决方案

image

十、兼容性测试 畅想

  • 业务场景测试(金融、社交、购物),定制化的测试工具
  • 测试环境模拟(弱网、低电量、gps)
  • Ui 问题自动化检测
原文链接:https://yq.aliyun.com/articles/155831?spm=5176.8091938.0.0.Zz5zDk

Guess you like

Origin http://43.154.161.224:23101/article/api/json?id=326374946&siteId=291194637