How to do report test? Software testing practice, ultra-detailed test point analysis (full coverage)

Contents: Guide

foreword

Report test is an important test content, because the user group faced is generally the company's senior management or an important group of users. Problems have a greater impact, so they must be treated carefully and cautiously.
So how to test it?

1. Improve familiarity with the business
Like functional testing and other tests, report testing also needs to be familiar with the business, including business processes, business rules, and data storage. The difference is that report testing needs to understand the algorithm, data source, and requirements of each indicator. Understand the relationship between specific business actions and indicators.

2. Data preparation
Raw data:
①Understand the database table structure\data classification of the original database
②Understand the boundary rules displayed in this report, and prepare the corresponding test data
③Generate data and fix the test data by certain means

Display data:
①The data covers all categories
②The amount of data needs to be large enough
③It needs to contain all boundary values (combined with the query conditions when displaying)
④The data needs to contain a small amount of illegal data to verify the fault tolerance of the system

Data generation methods:
① Stored process
② Third-party tools (DataFactary, etc.)
③ Generate data through business (not recommended)
④ Generate data through related business interfaces

3. Data correctness verification
For customers, the use of reports means that they can quickly and easily find the data they need through the platform of the report system, so the most important content of the test report is to verify the correctness of the data.

The summary method is as follows:
to find out the source of the data, which table and which field it comes from;

Time condition: The statistical interval should be in the card at what time in the business, and consider whether the demand includes the boundary value of the statistical interval;

To clarify the specific conditions of the measured table and the measured indicators, for example, to count all the agency business in this month from 2023-06-01 to 2023-06-31, the specific condition is to limit the business source of the policy to the agency business middle;

Sql preparation, this process is to summarize the above three processes, and it is also the basis for subsequent data analysis with developers, so improve your ability to write sql.
In addition, when the test time is not sufficient, for some simple reports, such as lists and other reports, you can directly select lists of various business types for separate analysis without writing SQL statements by yourself;

For data checking and analysis, the data queried by sql should be checked with the developer’s. Since some data are large in volume, it is best to use a comparison tool (recommended: BCompare software), and analyze the data that cannot be checked separately , the process of analysis is often the main link to discover problems. In this process, if you really can't analyze it yourself, you can ask developers to assist;

Data display format: whether the decimal place, thousandth sign, percent sign, etc. are consistent with those set in the report, whether the unit, exchange rate, etc. are converted, and whether some codes are converted into text;

Consistency between detail and total, whether the sum of the detail values of each part is consistent with the total, etc.;

To cover all query statistics methods, under the condition of sufficient time, it is necessary to set various condition combinations through equivalence class division and permutation and combination according to the conditions (filter items, dimensions). the custom shall prevail;

4. Display of report format
After data verification, the focus should be on whether the display format of the output report meets the customer's requirements.
There are two main types of report formats

The reports stipulated in the insurance industry standards use a fixed format, such as some reports submitted by the China Insurance Regulatory Commission.
Reports customized according to the needs of enterprises or users.

Therefore, these two types of reports need to be tested from the following aspects:
whether the overall display format of the report conforms to the sample provided by the customer;
whether the title or table name of the report is correct;
whether the time period of the report page is the time selected by the user paragraph;
when the output content is too much, whether the pagination method is correct; when turning the page, whether it has the same style as the previous page (such as the table header); whether the output of the second page is correct; data that needs special reminder (some abnormal data
) Whether it is highlighted, whether the calculation method of some indicators is particularly complicated or if there are several indicators that are easy to confuse, whether to add notes on the page;

5. Comparability between reports
After the vertical test is completed, we need to connect the tested reports horizontally, because some reports have different names, but some indicators are the same, so we need to compare the two reports Where to compare, see if the statistical results are the same in the same time period.

In addition, different indicators in different reports are also related.
For example: the list of premiums receivable in business and the balance of premiums receivable in finance, when the statistical standards of the two are consistent, the total of premiums receivable in the list is equal to the balance of financial receivables, as well as premium income, Total premium income in the same statistical interval of premiums received and premiums receivable = premiums received + premiums receivable (not actually received)

Therefore, during the testing process, it is necessary to clarify the levels and sequences between them, which requires strengthening the understanding of the business and the accumulation of knowledge.

6. Other
report output and printing:
After the report is generated in the system, the report is not finished. Generally, it needs to be printed out for customer use, such as meeting or submitting for approval, so the printing function of the report is also very important.

Before printing, users generally need to export the report for further analysis or for comparison with other reports, so the export function of the report must also be verified. Generally, the main formats that can be exported are Excel and pdf formats, and then the exported content must be verified Whether it is correct or not is consistent with the generated report.

Report performance: Try to require developers to use the optimal query statement to avoid customers waiting too long during use

Report authority: For a system with authority control, the report should of course be consistent with the authority of the user, and authority control needs to be verified from two aspects.
Report condition definition: In the condition selection area, some drop-down boxes should not be able to display data outside the scope of user permissions.

The following is the most complete software test engineer learning knowledge architecture system diagram in 2023 that I compiled