Deadline：
2018-5-9 10:00PM, subject to the time of submission to the class blog.
According to the following requirements, complete the testing and release of the team's project.
test
Please write the software test process and test results according to the software requirements document, function description, system design and test plan in the team project, and answer the following questions.
- How many bugs were found in total during testing? How many bugs are there in each category?
- a. Bug fixes;
- b. Bugs that cannot be reproduced
- c. This product is designed like this, not a bug;
- d. It has no ability to repair, and does not plan to repair it in the future;
- e. This bug should indeed be fixed, but there is no time to fix it in this version, and it will be delayed until the next version.
- Scenario testing, including the following:
- How do you expect different users to use your software?
- What are their needs and goals?
- How does the functionality provided by your software fit together to meet their needs?
- What platforms, hardware configurations, browser types, etc. do you test your software on? - test matrix
- non-functional testing
- Performance indicators (response time and throughput, need to give screenshots and test instances and results)
- System resource monitoring (CPU, memory usage, screenshots and test instances and results need to be given)
- Stress test (different number of concurrent users, screenshots, test instances and results need to be given)
- Fatigue test (to test the ability of the server to run continuously, screenshots and test examples and results need to be given)
- Security testing (from three perspectives, namely confidentiality, availability, integrity. Screenshots and test examples and results need to be given)
serial number completed tests Expected performance metrics of the system actual test results Difference analysis Performance issues and suggestions for improvement 001 002
- Additional questions: The following additional questions are based on the requirements of the 4 standards and further refine the requirements
| Test items | basic requirements | Refinement requirements | Score |
| Performance | Response time and throughput | In addition to the test of the total response time, it is also necessary to analyze the performance bottleneck. It is necessary to point out which module of the software has a serious impact on the response time. It can be considered from the calculation of the response time and the I/O response time. The smaller the granularity of the module, the better The better the concentration, the need to give screenshots and test examples and analysis | 5 |
| System resource monitoring | CPU and memory usage | Similar to the response time, it is necessary to give which module occupies the most CPU time and memory. The smaller the granularity of the module, the better the concentration. Screenshots, test examples and analysis should be given. | 5 |
| pressure test | Different concurrent users | The corresponding test script needs to be given | 5 |
| fatigue test | Test the server's ability to run continuously | To calculate the longest running time started from the service, you need to give the corresponding screenshot, which can be viewed from the system log | 3 |
| Safety test | From three perspectives, namely confidentiality, availability, integrity | Confidentiality needs to be viewed from the perspective of data confidentiality and the confidentiality of the user's use process. Ensure that the software has certain defense capabilities and can resist confidentiality attacks. Availability refers to a certain resistance to malicious attacks to ensure that the service is available and robust. Integrity requires that user data is not tampered with, operations do not interfere with each other, and data consistency can be guaranteed to a certain extent. | 5 |
- Under what conditions do you think your team's software is considered good enough to release an alpha version? -Exit criteria
refer to
- Test planning and execution:
- Test report example:
- WeChat Mini Program/APP
- Test tool: XTest
- Install: https://github.com/TencentXTest/XTest/releases
- Tutorial:
- Reference: WeChat Mini Program Automation Practice
- Mobile App https://www.cnblogs.com/dsyy/p/7488845.html
- Android automated testing tool Appium: http://www.uml.org.cn/mobiledev/201804231.asp?artid=20658
- Siege is an open source web stress testing and evaluation tool.
- DBMonster is a stress testing tool that generates random data to test SQL databases, see http://dbmonster.kernelpanic.pl/ for details .
- For more performance testing tools, visit http://www.opensourcetesting.org/performance.php
release
- When the software is released, write a release note on the team blog
- List the features of this version (list new features developed on the basis of the original project)
- Developed on the basis of the original project, listing the bugs fixed in this version
- Requirements for the operating environment
- installation method
- Describe known issues and limitations of the system
- Explain how and where the software is released
- In addition to text, the description of functions can be supplemented by pictures, videos, etc.
refer to
Example of release notes: http://www.cnblogs.com/buaase/p/4954977.html
Grading
- On-time delivery - with points (see the table below for detailed grading rules)
- Late submission - 0 points
- More than two weeks late - the score for this assignment will be deducted
- Plagiarism - the score of this assignment will be deducted
- If you have an opinion on the score, you will only be given one chance to appeal to the teaching assistant
| project | Score | Remark |
| How many bugs were found in total during testing? How many bugs are there in each category? | 10 | ae 2 points per item |
| How do you expect different users to use your software? | 2 | |
| What are their needs and goals? | 2 | |
| How does the functionality provided by your software fit together to meet their needs? | 2 | |
| What platforms, hardware configurations, browser types, etc. do you test your software on? | 10 | test matrix, which requires a detailed listing of test entries |
| Performance | 4 | |
| System resource monitoring | 4 | |
| pressure test | 4 | |
| fatigue test | 4 | |
| Safety test | 4 | |
| Additional questions | <=15 | If the score exceeds 15 points, it will be counted as 15 points, but not every item can get full points as long as it is done. |
| export conditions | 5 | |
| List the features of this version | 5 | If it is an original project that needs to develop new functions on the basis of the original project, it is required to have pictures and texts. |
| Requirements for the operating environment | 3 | If the teaching assistant cannot install the software correctly according to the given operating environment information or use the software, no marks will be given to this part. |
| installation method | 3 | 助教按照所给的安装方法无法正确安装或这使用该软件则该部分不给分 |
| 描述系统已知的问题和限制 | 5 | |
| 说明软件的发布方式以及发布地址 | 5 |