As the scope of APP applications becomes wider and wider, the user group becomes larger and larger, and there are more and more models of terminal devices. The fragmentation of mobile terminals intensifies, making APP compatibility testing a must-considered link in test quality assurance.
APP compatibility testing usually considers: operating system, manufacturer ROM, screen resolution, network, etc. However, it is difficult to cover all compatibility testing dimensions with limited testing manpower, material resources and time resources. Therefore, the Top X principle is usually adopted, that is, the top ranking.
How to obtain Top If there is no data on the product itself, you can refer to the Top ranking data compiled by the industry.
1 Compatibility test dimension analysis
2-1 Operating system version
The operating system version mainly considers Android and iOS systems. The specific version distribution and market share of the Android system are as follows (the data in this article comes from Tencent Big Data Research Center):
The specific version distribution and market share of the iOS system are as follows:
From the above data, it can be concluded that the market share of android4.x, 5.x, and 6.x versions is less than 7%. You can negotiate with product developers. If the current software development does not support compatibility with older versions, you can choose to test Discard compatibility testing for older versions.
For Android, we mainly consider 7.x, 8.x, 9.x, and 10.x. For iOS, we mainly consider 12.x, 13.x, and 14.x.
For the minor versions under each major version of the operating system, due to the large workload, unless there is a clear impact on the app, there is generally no need to consider covering the minor versions one by one.
2-2 Different manufacturers
Both Android and iOS have different phone models, and Apple has currently updated to iPhone 12 Pro.
For Android models, because the Android system source code is open source, different Android mobile phone manufacturers will make customized modifications based on the Android native system and then release it to the outside world.
The endless release of systems will aggravate the fragmentation problem of Android, leading to increasing differences between Android devices. An Android APP application may show completely different behaviors on different devices. For example, calling the mobile phone camera may cause incompatibility on some mobile phones.
Regarding the compatibility of ROMs from different Android manufacturers, many test teams do not have a large number of device models. The usual approach is to be compatible with models from some mainstream manufacturers.
Android platform brand and model ranking (data comes from Baidu Statistical Traffic Research Institute):
Model ranking of iOS platform (data comes from Baidu Statistical Traffic Research Institute):
2-3 Screen resolution
On devices with different resolutions and sizes, if the code is not adapted, problems such as misalignment, stretching, and style anomalies will occur.
As of now, the mainstream resolutions of andoid are: 1920*1080, 1280*720, 2340*1080, etc., and the mainstream sizes are 5.x, 6.x inches.
The mainstream resolutions of iOS are: 2208*1242, 1334*750, 2436*1125, etc., and the mainstream size is 5.5~6.5 inches.
2-4 Network type
To ensure coverage in different network environments, currently, the functions of Wifi, 2G, 3G, and 4G of different operators are mainly considered.
2 How to conduct compatibility testing
The essence of compatibility testing is functional testing. For the above compatibility testing dimensions, it is impossible to cover all test cases one by one in every model, every system version, every resolution, etc. The testing workload is too huge.
Therefore, in addition to APPs with hundreds of millions of users, such as WeChat and Douyin, which will build test platforms to cover all models, for other compatibility test dimension coverage, mainstream models are generally given priority, and Simultaneously consider whether the model covers different manufacturers, system versions, resolutions, sizes, etc.; if it is not fully covered, it will be supplemented based on the top-ranked devices of the brand, and cross-combination with operating systems, resolutions, sizes, etc.
For example, part of the table below (for reference only)
After confirming the models and devices that need to be covered, it will be time-consuming and labor-intensive to execute a full set of functional test cases on each device one by one, and the testing efficiency will not be high.
Considering the need to ensure both quality and testing efficiency, the usual approach is:
-
Choose to perform full use cases on a few mainstream models, and use cases that cover major functions on other devices within the compatibility range.
-
Test cases can be tailored according to the characteristics of the software to be tested, scenario implementation, etc. For page functions similar to obtaining data from local cache, which do not involve network requests, network compatibility test cases can be tailored.
In addition, for network type compatibility testing, you can choose a real machine to test the main functions of the APP for different network bandwidths, delays and stability in Wifi, 2G, 3G, 4G and other environments. In particular, functions that are strongly related to the network, such as live video broadcast, file transfer, etc., need to be verified carefully.
3 瀻 结
When the APP compatibility test is completed manually or automatically and the product is launched, users will receive feedback on compatibility issues. Based on the feedback, use cases for this compatibility test scenario need to be added for subsequent version testing.
In addition, we also need to keep an eye on mainstream mobile phone updates and new versions released by manufacturers, and consider whether APP compatibility and adaptation testing is needed.
All in all, the quality assurance and compatibility testing of an APP must be taken seriously, otherwise it will lead to the loss of users and affect the long-term development of the product.
Take action, it is better to be on the road than to wait and see. In the future, you will definitely thank yourself for working hard now! If you want to learn and improve but can't find the information and there is no one to answer your questions, please join the group in time: 786229024, which contains various testing and development materials and technologies. You can communicate together.
Finally: The complete software testing video tutorial below has been compiled and uploaded. Friends who need it can get it by themselvesSoftware testing interview document We must study to find a high-paying job. The following interview questions are the latest interview materials from first-tier Internet companies such as Alibaba, Tencent, Byte, etc., and are given by Byte bosses. Authoritative answers. I believe everyone can find a satisfactory job after reviewing this set of interview materials. 【保证100%免费】
