How to do a good test? (7) Compatibility Testing (CT)

1. Introduction to compatibility testing

Compatibility Testing (CT) is a software testing method designed to verify the correct operation and consistency of applications under different operating systems, browsers, devices and network environments. For online shopping systems, compatibility testing is very important because users may use a variety of different devices and browsers to access the system and expect a consistent experience.

Compatibility testing mainly focuses on the following aspects:

Operating system compatibility : Test the compatibility of the system on different operating systems (such as Windows, Mac, Linux), including operating systems of different versions and configurations.
Browser compatibility : Test the compatibility of the system on various commonly used browsers (such as Chrome, Firefox, Safari, Internet Explorer), including different versions and different configurations of browsers.
Device compatibility : Test the compatibility of the system on different devices, including desktop computers, laptops, tablets, and smartphones.
Resolution and screen size compatibility : Test system compatibility at different resolutions and screen sizes to ensure page layout and content display correctly on a variety of devices.
Network compatibility : Test the compatibility of the system in different network environments, including low-speed networks, unstable networks, and high-latency networks.

2. Usage scenarios

Usage scenarios of compatibility testing in online shopping systems include but are not limited to:

Users use different operating systems and browsers to access the website to shop and place orders.
Users access the shopping system through mobile applications using different devices (e.g. tablets, smartphones).
Users use the shopping system to shop online under different network environments (such as 3G, 4G, Wi-Fi).
Users browse the website and perform shopping operations on devices with different resolutions and screen sizes.

3. Common technologies and tools

When conducting compatibility testing, commonly used techniques and tools include:

Cross-browser testing tools : used to automatically execute test cases in different browsers, such as Selenium, BrowserStack, CrossBrowserTesting, etc.
Device testing platform : Provides cloud testing platforms for various real devices, such as TestObject, AWS Device Farm, etc., to test the compatibility of applications on different devices.
Browser developer tools : Modern browsers provide developer tools that can simulate different devices, adjust resolutions and network conditions for manual testing and debugging.
Virtual machines and containers : Use virtual machine software (such as VirtualBox) or container technology (such as Docker) to test in different operating system and browser environments.
Mobile device emulators and simulators : Software tools for simulating mobile devices, such as the Android emulator provided by Android Studio and the iOS simulator provided by Xcode.

4. Specific implementation methods

The following is the specific implementation method of compatibility testing in online shopping systems:

Develop a test plan : Identify the compatibility aspects to be tested (operating systems, browsers, devices, resolutions, etc.) and develop a testing strategy and test cases.
Choose testing tools and platforms : Choose appropriate cross-browser testing tools, device testing platforms, or other tools and technologies based on the needs in your testing plan.
Execute automated tests : Use your choice of cross-browser testing tools, write test scripts or record test cases, and run automated tests across different browsers and operating systems.
Perform manual testing : Use browser developer tools or device emulators/simulators to manually test your website's compatibility across different browsers, operating systems, and devices.
Test resolutions and screen sizes : Resize your browser window or use browser developer tools to simulate different resolutions and screen sizes to verify how your site's layout and content display under a variety of circumstances.
Test network compatibility : Use network simulation tools or test under different network environments to verify the performance and stability of the system under low-speed, unstable or high-latency network conditions.
Record and report defects : During testing, record compatibility issues and defects found and generate detailed reports including problem descriptions, reproduction steps, and environment information.
Fix and retest : Assign reported issues to development teams and track fix progress. After the fix is complete, re-run the compatibility test to make sure the issue is resolved.
Continuously monitor compatibility : Since browsers, operating systems, and devices are constantly being updated and evolved, conduct regular compatibility testing and continuously monitor the system's compatibility in new environments.

The above is the specific implementation method of compatibility testing in online shopping systems. Through the comprehensive use of automated testing tools, manual testing and other related technologies, the good compatibility and user experience of the shopping system can be ensured in various environments.

The following are specific test cases for compatibility testing of online shopping systems (web and mobile). Each test case is designed according to a standard template and examples are provided. Here is an example of at least 10 test cases:

5. Test cases designed for compatibility testing

5.1. Operating system compatibility test cases

Test case 1

Test Case Name: Operating System Compatibility - Windows 10

Test goal: Verify the compatibility of the online shopping system on the Windows 10 operating system.

Test prerequisite: Install and run the latest version of the online shopping system.

Test steps:

Open the Windows 10 operating system.
Launch any compatible browser.
Enter the URL of the online shopping system and access the homepage.
Browse the product list, select products, and add to cart.
Go through the checkout process, including filling in shipping information, making payment, and more.
Check whether the page layout and functions are normal.

Expected results: The online shopping system runs normally on Windows 10, the page layout is correct, and the functions are available.

Actual results: The online shopping system runs normally on Windows 10, the page layout is correct, and the functions are available.

Conclusion: The online shopping system passed the compatibility test on Windows 10.

Note: None

Test case 2

Test Case Name: Operating System Compatibility - Windows 11

Test goal: Verify the compatibility of the shopping system on the Windows 11 operating system.

Test prerequisites: Install and run the latest version of the shopping system.

Test steps:

Open the Windows 11 operating system.
Launch any compatible browser.
Enter the URL of the shopping system and visit the home page.
Browse the product list, select products, and add to cart.
Go through the checkout process, including filling in shipping information, making payment, and more.
Check whether the page layout and functions are normal.

Expected results: The shopping system runs normally on Windows 11, the page layout is correct, and the functions are available.

Actual results: The shopping system runs normally on Windows 11, the page layout is correct, and the functions are available.

Conclusion: The shopping system passed the compatibility test on Windows 11.

Note: None

Test case 3

Test case name: Operating system compatibility - Safari browser on macOS

Test goal: Verify the compatibility of the shopping system in the Safari browser on macOS.

Test prerequisites: Use the macOS operating system and install the latest version of the Safari browser.

Test steps:

Open the macOS device.
Launch the Safari browser.
Enter the URL of the shopping system and visit the home page.
Browse the product list, select products, and add to cart.
Go through the checkout process, including filling in shipping information, making payment, and more.
Check whether the page layout and functions are normal.

Expected results: The shopping system runs normally in the Safari browser on macOS, the page layout is correct, and functions are available.

Actual results: The shopping system runs normally in Safari on macOS, with correct page layout and usable functionality.

Conclusion: The shopping system passed compatibility testing in the Safari browser on macOS.

Note: None

Test case 4

Test Case Name: Operating System Compatibility - iOS 14

Test goal: Verify the compatibility of the shopping app with the iOS 14 operating system.

Test prerequisites: Use the iOS 14 operating system and install the latest version of the shopping app.

Test steps:

Open your iOS device.
Start the shopping app.
Browse the product list, select products, and add to cart.
Go through the checkout process, including filling in shipping information, making payment, and more.
Check whether the page layout and functions are normal.

Expected results: The shopping app runs normally on the iOS 14 operating system, the page layout is correct, and the functions are available.

Actual results: The shopping app runs normally on the iOS 14 operating system, the page layout is correct, and the functions are available.

Conclusion: The shopping app passed the compatibility test on the iOS 14 operating system.

Note: None

Test case 5

Test Case Name: OS Compatibility - Android 10

Test goal: Verify the compatibility of the shopping app with the Android 10 operating system.

Test prerequisites: Use Android 10 operating system and install the latest version of the shopping app.

Test steps:

Turn on your Android device.
Start the shopping app.
Browse the product list, select products, and add to cart.
Go through the checkout process, including filling in shipping information, making payment, and more.
Check whether the page layout and functions are normal.

Expected results: The shopping app runs normally on the Android 10 operating system, the page layout is correct, and the functions are available.

Actual results: The shopping app runs normally on the Android 10 operating system, the page layout is correct, and the functions are available.

Conclusion: The shopping app passed the compatibility test on the Android 10 operating system.

Note: None

5.2. Browser compatibility test cases

Test case 1

Test case name: Browser Compatibility - Google Chrome latest version

Test goal: Verify the compatibility of the shopping system on the latest version of Google Chrome.

Test prerequisites: Install and run the latest version of the shopping system.

Test steps:

Open the Google Chrome browser.
Enter the URL of the shopping system and visit the home page.
Browse the product list, select products, and add to cart.
Go through the checkout process, including filling in shipping information, making payment, and more.
Check whether the page layout and functions are normal.

Expected results: The shopping system runs normally in the latest version of Google Chrome, the page layout is correct, and the functions are available.

Actual results: The shopping system runs normally in the latest version of Google Chrome, the page layout is correct, and the functions are available.

Conclusion: The shopping system passed the compatibility test in the latest version of Google Chrome.

Note: None

Test case 2

Test case name: Browser Compatibility - Firefox latest version

Test goal: Verify the compatibility of the shopping system on the latest version of Firefox.

Test prerequisites: Install and run the latest version of the shopping system.

Test steps:

Open the Firefox browser.
Enter the URL of the shopping system and visit the home page.
Browse the product list, select products, and add to cart.
Go through the checkout process, including filling in shipping information, making payment, and more.
Check whether the page layout and functions are normal.

Expected results: The shopping system runs normally in the latest version of Firefox, the page layout is correct, and the functions are available.

Actual results: The shopping system runs normally in the latest version of Firefox, the page layout is correct, and the functions are available.

Conclusion: The shopping system passed the compatibility test in the latest version of Firefox.

Note: None

5.3. Mobile compatibility test cases

Test case 1

Test case name: Mobile compatibility - Safari browser on iOS

Test goal: Verify the compatibility of the shopping system in the Safari browser on iOS.

Test prerequisites: Use an iOS device and install the latest version of Safari browser.

Test steps:

Turn on your iOS device.
Launch the Safari browser.
Enter the URL of the shopping system and visit the home page.
Browse the product list, select products, and add to cart.
Go through the checkout process, including filling in shipping information, making payment, and more.
Check whether the page layout and functions are normal.

Expected results: The shopping system runs normally in the Safari browser on iOS, the page layout is correct, and the functions are available.

Actual results: The shopping system runs normally in the Safari browser on iOS, with correct page layout and usable functionality.

Conclusion: The shopping system passed the compatibility test in the Safari browser on iOS.

Note: None

Test case 2

Test case name: Mobile compatibility - Chrome browser on iOS

Test goal: Verify the compatibility of the online shopping system in the Chrome browser on iOS.

Test prerequisites: Use an iOS device and install the latest version of the Chrome browser.

Test steps:

Turn on your iOS device.
Launch the Chrome browser.
Enter the URL of the online shopping system and access the homepage.
Browse the product list, select products, and add to cart.
Go through the checkout process, including filling in shipping information, making payment, and more.
Check whether the page layout and functions are normal.

Expected results: The online shopping system runs normally in the Chrome browser on iOS, the page layout is correct, and the functions are available.

Actual results: The online shopping system runs normally in the Chrome browser on iOS, with correct page layout and usable functionality.

Conclusion: The online shopping system passed the compatibility test in the Chrome browser on iOS.

Note: None

Test case 3

Test case name: Mobile compatibility - Firefox browser on Android

Test goal: Verify the compatibility of the shopping system in the Firefox browser on Android.

Test prerequisites: Use an Android device and install the latest version of Firefox browser.

Test steps:

Turn on your Android device.
Start the Firefox browser.
Enter the URL of the shopping system and visit the home page.
Browse the product list, select products, and add to cart.
Go through the checkout process, including filling in shipping information, making payment, and more.
Check whether the page layout and functions are normal.

Expected results: The shopping system runs normally in the Firefox browser on Android, the page layout is correct, and the functions are available.

Actual results: The shopping system runs normally in the Firefox browser on Android, with correct page layout and usable functionality.

Conclusion: The shopping system passed the compatibility test in the Firefox browser on Android.

Note: None

Test case 4

Test case name: Mobile compatibility - Safari browser on iPad

Test goal: Verify the compatibility of the shopping system in the Safari browser on iPad.

Test prerequisites: Use an iPad device and install the latest version of the Safari browser.

Test steps:

Turn on the iPad device.
Launch the Safari browser.
Enter the URL of the shopping system and visit the home page.
Browse the product list, select products, and add to cart.
Go through the checkout process, including filling in shipping information, making payment, and more.
Check whether the page layout and functions are normal.

Expected results: The shopping system runs normally in the Safari browser on the iPad, the page layout is correct, and the functionality is available.

Actual results: The shopping system runs normally in Safari on the iPad, with correct page layout and functional functionality.

Conclusion: The shopping system passed the compatibility test in the Safari browser on iPad.

Note: None

Test case 5

Test case name: Mobile device compatibility - Shopping App on iPhone

Test goal: Verify the compatibility of the shopping app on iPhone devices.

Test prerequisites: Install the latest version of the shopping app and use an iPhone device.

Test steps:

Turn on your iPhone device.
Start the shopping app.
Browse the product list, select products, and add to cart.
Go through the checkout process, including filling in shipping information, making payment, and more.
Check whether the page layout and functions are normal.

Expected results: The shopping app runs normally on the iPhone device, the page layout is correct, and the functions are available.

Actual results: The shopping app runs normally on the iPhone device, the page layout is correct, and the functions are available.

Conclusion: The shopping app passed the compatibility test on iPhone devices.

Note: None

Test case 6

Test Case Name: Mobile Device Compatibility - Shopping App on Android

Test goal: Verify the compatibility of the shopping app on Android devices.

Test prerequisites: Install the latest version of the shopping app and use an Android device.

Test steps:

Turn on your Android device.
Start the shopping app.
Browse the product list, select products, and add to cart.
Go through the checkout process, including filling in shipping information, making payment, and more.
Check whether the page layout and functions are normal.

Expected results: The shopping app runs normally on the Android device, the page layout is correct, and the functions are available.

Actual results: The shopping app runs normally on Android devices, the page layout is correct, and the functions are available.

Conclusion: The shopping app passed the compatibility test on Android devices.

Note: None

5.4.Screen resolution compatibility

Test case 1

Test case name: Screen resolution compatibility - 1366x768 resolution

Test goal: Verify the compatibility of the shopping system on a 1366x768 resolution screen.

Test prerequisite: Use a device that supports 1366x768 resolution.

Test steps:

Turn on the device and set the resolution to 1366x768.
Launch any compatible browser.
Enter the URL of the shopping system and visit the home page.
Browse the product list, select products, and add to cart.
Go through the checkout process, including filling in shipping information, making payment, and more.
Check whether the page layout and functions are normal.

Expected results: The shopping system runs normally on a 1366x768 resolution screen, the page layout is correct, and the functions are available.

Actual results: The shopping system runs normally on a 1366x768 resolution screen, the page layout is correct, and the functions are available.

Conclusion: The shopping system passed the compatibility test on a 1366x768 resolution screen.

Note: None

Test case 2

Test case name: Screen resolution compatibility - 1920x1080 resolution

Test goal: Verify the compatibility of the shopping system on a 1920x1080 resolution screen.

Test prerequisite: Use a device that supports 1920x1080 resolution.

Test steps:

Turn on the device and set the resolution to 1920x1080.
Launch any compatible browser.
Enter the URL of the shopping system and visit the home page.
Browse the product list, select products, and add to cart.
Go through the checkout process, including filling in shipping information, making payment, and more.
Check whether the page layout and functions are normal.

Expected results: The shopping system runs normally on a 1920x1080 resolution screen, the page layout is correct, and the functions are available.

Actual results: The shopping system runs normally on a 1920x1080 resolution screen, the page layout is correct, and the functions are available.

Conclusion: The shopping system passed the compatibility test on a 1920x1080 resolution screen.

Note: None

Test case 3

Test case name: Different screen size compatibility - iPhone X

Test goal: Verify the compatibility of the shopping app on different screen sizes of iPhone X.

Test prerequisites: Use an iPhone X device and install the latest version of the shopping app.

Test steps:

Turn on your iPhone X device.
Start the shopping app.
Browse the product list, select products, and add to cart.
Go through the checkout process, including filling in shipping information, making payment, and more.
Check whether the page layout and functions are normal.

Expected results: The shopping app runs normally on different screen sizes of iPhone X, the page layout is correct, and the functions are available.

Actual results: The shopping app runs normally on different screen sizes of iPhone X, the page layout is correct, and the functions are usable.

Conclusion: The shopping app passed the compatibility test on iPhone X’s different screen sizes.

Note: None

5.4. Database compatibility test cases

Test case 1

Test case name: Database Compatibility - MySQL 8.0

Test goal: Verify the compatibility of the shopping system with the MySQL 8.0 database.

Test prerequisites: Configure the shopping system to connect to the MySQL 8.0 database, and ensure that the database is set up correctly.

Test steps:

Start the shopping system.
Browse the product list, select products, and add to cart.
Go through the checkout process, including filling in shipping information, making payment, and more.
Check whether the data interaction between the shopping system and the MySQL 8.0 database is normal.

Expected results: The data interaction between the shopping system and the MySQL 8.0 database is normal and data can be read and written.

Actual results: The data interaction between the shopping system and the MySQL 8.0 database is normal and data can be read and written.

Conclusion: The shopping system and the MySQL 8.0 database passed the compatibility test.

Note: None

5.5. Network compatibility test cases

Test case 1

**Test Case Name:**Network Compatibility - Low Speed Network

Test goal: Verify the compatibility of the system in a low-speed network environment.

Test prerequisites:

The phone is connected to a low-speed network, such as a 2G network.
The online shopping system App has been installed and opened on the mobile phone.

Test steps:

Open the online shopping system App.
Browse product listings or search for products.
Click to open the product details page.
Add items to cart.
Go through the settlement process, including filling in the shipping address, selecting the payment method, etc.

expected outcome:

The app opens normally and displays the product list or search results.
The product details page can load and display normally.
The item can be successfully added to the shopping cart.
The checkout process can proceed normally, including filling in the shipping address and selecting the payment method.

actual results:

The app opens normally and displays product lists or search results, but loads slowly.
The product details page loaded slowly, but eventually showed up successfully.
The item can be successfully added to the shopping cart.
The checkout process was slow but ultimately completed successfully.

Conclusion: The system passed the compatibility test in a low-speed network environment. Although the loading speed is slow, the functions can run normally.

Note: None

Test case 2

**Test case name:**Network Compatibility-Unstable Network

Test goal: Verify the compatibility of the system in an unstable network environment.

Test prerequisites:

The phone is connected to an unstable network, such as network disconnection or network fluctuations.
The online shopping system App has been installed and opened on the mobile phone.

Test steps:

Open the online shopping system App.
Browse product listings or search for products.
Click to open the product details page.
Add items to cart.
Go through the settlement process, including filling in the shipping address, selecting the payment method, etc.

expected outcome:

The app opens normally and displays the product list or search results.
The product details page can load and display normally.
The item can be successfully added to the shopping cart.
The checkout process can proceed normally, including filling in the shipping address and selecting the payment method.

actual results:

Apps may fail to open or load slowly in unstable network environments.
The product details page may fail to load or be displayed delayed.
The item can be successfully added to the shopping cart.
The checkout process may be affected by network fluctuations, causing delays or errors when filling in your shipping address or selecting a payment method.

Conclusion: The system partially passed the compatibility test in an unstable network environment, but some problems may occur due to network fluctuations.

Note: None

Test case 3

**Test Case Name:**Network Compatibility - High Latency Network

Test goal: Verify the compatibility of the system in a high-latency network environment.

Test prerequisites:

The phone is connected to a high-latency network, such as a high-latency mobile network.
The online shopping system App has been installed and opened on the mobile phone.

Test steps:

Open the online shopping system App.
Browse product listings or search for products.
Click to open the product details page.
Add items to cart.
Go through the settlement process, including filling in the shipping address, selecting the payment method, etc.

expected outcome:

The app opens normally and displays the product list or search results.
The product details page can load and display normally.
The item can be successfully added to the shopping cart.
The checkout process can proceed normally, including filling in the shipping address and selecting the payment method.

actual results:

The app opens normally and displays product lists or search results, but there is a high delay.
The product details page loaded slowly, but eventually showed up successfully.
The item can be successfully added to the shopping cart.
The checkout process was slow, including delays in filling in your shipping address and selecting your payment method.

Conclusion: The system passed the compatibility test in a high-latency network environment. Although there is a delay, the function can run normally.

Note: None