Difference between revisions of "QA/Build Verification Test(BVT)"

From Apache OpenOffice Wiki
< QA
Jump to: navigation, search
(BVTFileType)
m
 
(10 intermediate revisions by 4 users not shown)
Line 1: Line 1:
 
== Introduction ==
 
== Introduction ==
Build Verification Testing, BVT for short, is a set of tests that run on new build to verify that whether the build is testable or not. It is done prior to its release to test team for further testing. This testing is done for Build Validation and Build Acceptance.<br />
+
Build Verification Testing, BVT for short, is a set of tests that run on new build to verify that whether the build is testable or not. It is done prior to its release to test team for further testing. This testing is done for Build Validation and Build Acceptance.
  
'''Why do we need BVT?'''<br />
+
{{Tip|'''Why do we need BVT?'''
BVT is a type of regression test and only take short time, like 30 - 60 minutes, to verify that whether the build is stable and can be tested thoroughly. BVT can save the efforts of testers to setup and test a build when major functionalities are having defects.  If any of the tests fails, BVT will report to developers immediately to remind relevant developers to review source codes.<br />
+
BVT is a type of regression test and only take short time, to verify that whether the build is stable and can be tested thoroughly. BVT can save the efforts of testers to setup and test a build when major functions are having defects.  If any of the tests fails, BVT will report to developers immediately to remind relevant developers to review source codes.
 +
}}
  
'''What's the difference between vclauto BVT and smoketestoo_native?'''<br />
+
All tests in BVT are automated, included in package bvt. Smoke test is included in BVT. It takes about 20 minutes to finish the test. Please refer to [[QA/test_automation_guide|Getting Started with Test Automation]] for further information. You can view daily BVT result on our [https://people.apache.org/~liuzhe/testdashboard/#bvt test dashboard].
Currently, there are two modules in AOO can do build verification test.<br />
+
* smoketestdoc<br />
+
It's used to generate the test documents required by smoke test.<br />
+
* smoketestoo_native<br />
+
A small test suite to verify if the basic functions of OpenOffice.org work.<br />
+
  
Smoketestoo_native uses UNO API/Macro to perform testing. It is based on basic language. It is hard to extend functionalities because of its drawbacks. <br />
+
[[Category:Quality Assurance]]
* The poor IDE.
+
* Hard to debug.
+
* Hard to analyze the testing result.
+
* Basic language is not popular.
+
 
+
Vclauto BVT is based on vclauto framework. It is GUI testing. Sometimes UNO API tests have no problem, but UI can not display correctly. Vclauto BVT can effectively avoid such mistakes. It performs testing like a real user. It generates keyboard/mouse events, does GUI actions and gets information from the GUI to validate the function.<br />
+
Further more, vclauto BVT already integrated  smoketestoo_native test into it.<br />
+
 
+
== Framework ==
+
Currently, vclauto BVT include 4 classes, a total of 48 test cases. These test cases are based on VCLAuto, and verify main functionalities.<br />
+
1. Integrating smoke test from AOO.<br />
+
2. Test cases cover 5 products: word processor, spreadsheet, presentation, drawing, and equation editor.<br />
+
3. Testing main operations about each products: new, save, load, reopen.<br />
+
4. Objects operations: picture, chart, table, function.<br />
+
5. Other test points: export as pdf, print, about dialog, slide show.<br />
+
 
+
Below is the detailed introduction of each case.<br />
+
=== SmokeTest ===
+
The original smoke test contains two test sample files, smoketestdoc.sxw and TestExtension.oxt. How to use them you can refer to http://wiki.services.openoffice.org/wiki/SmokeTest.<br />
+
In vclauto BVT, smoke test is implemented in SmokeTest.java. Keeping two sample file, using UNO API to trigger the test instead of control event. Test points are following.<br />
+
1. Create documents: word processor, spreadsheet, presentation, drawing, and equation editor.<br />
+
2. Save above documents to supported types. e.g. Save word processor as .odt, .sxw files.<br />
+
3. Close above documents.<br />
+
4. Open a database, insert/delete/seek data in the database, close the database.<br />
+
5. Install and uninstall an extension.<br />
+
6. Write test results in log files.<br />
+
 
+
=== BVTFileType ===
+
Test cases in BVTFileType.java are used to test main operations of supported file types. Test points are below.<br />
+
{| class="wikitable"
+
|-
+
!Test Case
+
!Function Description
+
|-
+
|
+
testSaveNewODT
+
testSaveNewOTT
+
testSaveNewSXW
+
testSaveNewSTW
+
testSaveNewDOC
+
testSaveNewTXT
+
|
+
*Create a new text document.
+
*Input some texts by keyboard.
+
*Set the texts style.
+
*Save the document. One case  is  corresponding to one file type.
+
*Close the document.
+
*Reopen the saved file.
+
*Verify if the text still exists in the file.
+
|-
+
| row 2, cell 1
+
| row 2, cell 2
+
|-
+
| row 2, cell 1
+
| row 2, cell 2
+
|-
+
| row 2, cell 1
+
| row 2, cell 2
+
|-
+
| row 2, cell 1
+
| row 2, cell 2
+
|-
+
| row 2, cell 1
+
| row 2, cell 2
+
|}
+

Latest revision as of 12:37, 27 October 2021

Introduction

Build Verification Testing, BVT for short, is a set of tests that run on new build to verify that whether the build is testable or not. It is done prior to its release to test team for further testing. This testing is done for Build Validation and Build Acceptance.

Tip.png Why do we need BVT?

BVT is a type of regression test and only take short time, to verify that whether the build is stable and can be tested thoroughly. BVT can save the efforts of testers to setup and test a build when major functions are having defects. If any of the tests fails, BVT will report to developers immediately to remind relevant developers to review source codes.


All tests in BVT are automated, included in package bvt. Smoke test is included in BVT. It takes about 20 minutes to finish the test. Please refer to Getting Started with Test Automation for further information. You can view daily BVT result on our test dashboard.

Personal tools