Classification and trade-offs of
UTest compatibility testing UTest’s compatibility testing services are mainly divided into three categories: model adaptation testing, ROM adaptation testing, and automated testing. The model adaptation test can be understood as a compatibility test of the product function logic. In practice, the entire excellent testing technical team will analyze the function points that the product needs to adapt, and intelligently select the test model that needs to be adapted through the model , Cooperate with test experts to test the test plan formulated for product function points to achieve the effect of comprehensive coverage of functions and in-depth exploration of bugs.
ROM adaptation test is to test the functions that may affect the product due to the different characteristics of the mobile phone manufacturer or the Google system. There will be special development and research on the change characteristics of the system, analysis of the scope of the function, and the test experts output the test plan to test the relevant functions. Find problems and ensure product experience.
The purpose of automated testing is to convert human-driven manual testing into a way to automatically execute tests by machines, which are used to quickly verify the basic functions of the product, including installation, startup, uninstallation, control traversal, etc., to find whether the product has serious crash problems .
When it comes to automated testing, some manufacturers use robots to simulate human operations to achieve automated compatibility testing. According to the test pyramid model, although the cost of passing the UI test is higher and the feedback is slower, the confidence of the test result is also higher. So how does Youtest achieve automated testing?
How does Youtest deal with it?
Youtest technical experts said that in general, the simulation of real operations through the outer layer of robots is used to do some targeted tests, such as repeated operations with uniform rules and some violent tests. The advantage is that it can be cross-platform. As long as the recording rules and clicking on the coordinates can be adapted to a series of devices; however, this approach also has its disadvantages, such as the coordinate offset caused by the robot's own judgment error.
Utest currently uses simulation operations based on the software interface level. At present, this method has fully met the existing automation requirements. The cost of UI automated testing is indeed not small, but considering that it can fully reflect the real operation, UI testing is still indispensable in trade-offs. Youtest improves ROI through a series of operations such as case management, case hierarchical grading, effective case encapsulation, and intelligent traversal and AI access. In addition, for companies, they can carry out as many tests as possible, such as unit tests and interface tests, that require little environmental factors to improve the quality of their apps.
The pain points and usage scenarios
solved by the model adaptation test The main pain points solved by the model adaptation test are:
• Andriod is severely fragmented and lacks related equipment;
• Insufficient staffing within the enterprise and lack of testing resources;
• High product quality requirements, Lack of relevant talents.
There are mainly two types of usage scenarios:
• The start-up team is
specifically manifested as: lack of relevant test models; lack of professional test teams; product quality has certain requirements; cost savings and insufficient expenses.
• The product team with tens of millions of users is
specifically manifested as: lack of relevant test models; need for a professional team to respond quickly to improve efficiency; high product quality requirements; lack of professional compatibility testing talents.
The technical highlights of Youce in the model adaptation test
- Professional local testing team, team members have many years of experience in testing Tencent's billion-level user products (such as QQ, butler, sync assistant, app treasure, space, etc.), covering multiple product areas.
- Deeply cultivated in the field of compatibility testing for 10 years, has accumulated a lot of compatibility testing experience, and can quickly output customized testing solutions based on product functions.
- Youce has a stable Tencent supplier channel, short model procurement cycle, fast update, comprehensive model coverage, greatly shortening the bug life cycle.
- Strictly abide by Tencent's product quality standards and strictly control product quality.
How does UTest do customized ROM adaptation tests?
The ROM test mainly solves the following pain points:
• The compatibility of product functions with the vertical system version;
• The compatibility of product functions with the horizontal manufacturer version;
• After the problem is discovered, no suitable solution can be found.
In response to these pain points, the ROM test plan given by YouTest is as follows:
• Analyze the differences between the major versions of Android and the ROMs of major manufacturers (Huawei, Xiaomi, OPPO, vivo, etc.), and integrate them into ROM function points for APP Specific functions, analyze the scope of influence of ROM on functions;
• Test experts formulate relevant test solutions according to the scope of influence;
• Testers feedback problems, terminal development and troubleshooting, and output solutions;
• Testers’ problem regression, synchronization of the main code and completion Service closed loop.
Classification of automated testing and common technical difficulties
Automated testing is mainly divided into three types:
• Shallow automated testing: simple startup, installation, uninstallation, and light traversal testing, providing screenshots and log logs;
• In-depth automated testing: traversing through specific algorithms App has 70% or more controls, and provides screenshots and log logs;
• Customized script testing: supports UI2's automated testing framework and provides the ability to write automated scripts.
Common technical difficulties and solutions for automated testing:
• The test framework has model adaptation problems: by adapting to a large number of models, we have accumulated a lot of technical experience to achieve high framework compatibility and high stability;
• APK installation process system The pop-up window cannot be processed: A separate auxiliary click service is integrated during the framework test process, so that the pop-up window of the mobile phone system can be automatically clicked;
• The APK control cannot be obtained without information: the control xpath attribute and image recognition are integrated to obtain the attributeless control.