Difference between revisions of "QA/BVT"
Phoenixwang (Talk | contribs) |
Phoenixwang (Talk | contribs) |
||
| Line 5: | Line 5: | ||
BVT is a type of regression test and only take short time, to verify that whether the build is stable and can be tested thoroughly. BVT can save the efforts of testers to setup and test a build when major functions are having defects. If any of the tests fails, BVT will report to developers immediately to remind relevant developers to review source codes. | BVT is a type of regression test and only take short time, to verify that whether the build is stable and can be tested thoroughly. BVT can save the efforts of testers to setup and test a build when major functions are having defects. If any of the tests fails, BVT will report to developers immediately to remind relevant developers to review source codes. | ||
}} | }} | ||
| − | |||
= Prerequisites = | = Prerequisites = | ||
==Platform== | ==Platform== | ||
| Line 19: | Line 18: | ||
==Soft Skills== | ==Soft Skills== | ||
Basic skills about Windows Command line, Linux/Mac Terminal | Basic skills about Windows Command line, Linux/Mac Terminal | ||
| − | |||
| − | |||
=How to run BVT= | =How to run BVT= | ||
== Getting the source code == | == Getting the source code == | ||
| Line 45: | Line 42: | ||
screenshot/: Screenshot pictures when test assert is failed. | screenshot/: Screenshot pictures when test assert is failed. | ||
==Process== | ==Process== | ||
| − | Create task on Bugzilla to track BVT execution task. [[https://issues.apache.org/ooo/ Bugzilla]]<br/> | + | #Create task on Bugzilla to track BVT execution task. [[https://issues.apache.org/ooo/ Bugzilla]]<br/> |
| − | Track your execution task on [[http://wiki.openoffice.org/w/index.php?title=QA/BVT_Report BVT Report ]]<br/> | + | #Track your execution task on [[http://wiki.openoffice.org/w/index.php?title=QA/BVT_Report BVT Report ]]<br/> |
| − | + | ||
* Platform: Platform which you can run BVT.<br/> | * Platform: Platform which you can run BVT.<br/> | ||
* Volunteer: Volunteer's name to take this execution task.<br/> | * Volunteer: Volunteer's name to take this execution task.<br/> | ||
* Revision: build version of AOO4.0<br/> | * Revision: build version of AOO4.0<br/> | ||
| − | * Status: Pass/Fail | + | * Status: Pass/Fail<br/> |
* Task ID:Task ID in Bugzilla.<br/> | * Task ID:Task ID in Bugzilla.<br/> | ||
| − | |||
{| class="wikitable" border="1" | {| class="wikitable" border="1" | ||
|- | |- | ||
| Line 105: | Line 100: | ||
| | | | ||
| | | | ||
| − | |||
|} | |} | ||
| + | #Update your execution result on "Status" column, and add detail HTML result in new link(Record link on [[http://wiki.openoffice.org/w/index.php?title=QA/BVT_Report BVT Report ]] ). | ||
==FAQ== | ==FAQ== | ||
Revision as of 09:07, 28 March 2013
Contents
Introduction
Build Verification Testing, BVT for short, is a set of tests that run on new build to verify that whether the build is testable or not. It is done prior to its release to test team for further testing. This testing is done for Build Validation and Build Acceptance.
Prerequisites
Platform
Test machine with OS in below list: WindowsXP, Windows7 32bit, Windows7 64bit,Ubuntu, Suse, Redhat,Mac
Environment tools
- SVN Client:
On Windows: Download and Install TortoiseSVN as SVN Client to checkout sourcecode.
http://tortoisesvn.net/downloads.html
- JDK: JDK 1.5, JDK 1.6 or above.
- Ant: Apache Ant 1.8.2 or above.
- JUnit: JUnit 4.10 or above. For lazy people, if internet is available, it can be automatically installed during testing.
Soft Skills
Basic skills about Windows Command line, Linux/Mac Terminal
How to run BVT
Getting the source code
Anyone can checkout source code from our Subversion repository. Run the following command.
svn co https://svn.apache.org/repos/asf/openoffice/trunk/test/ test
Run testing
As a normal user, how to run testing against an installed OpenOffice?
Firstly compile the project with the command under test module.
ant -Dopenoffice.home="OpenOffice installation directory" compile
Then start testing with the command "run". e.g. Run all test classes under package bvt
run -Dopenoffice.home="/Applications/OpenOffice.org.app/Contents" -tp bvt
e.g. Run the given test classes
run -Dopenoffice.home="/Applications/OpenOffice.org.app/Contents" -tc bvt.gui.BasicFunctionTest
Where to get the testing result?
By default, the testing output is stored in "test/testspace/output***". Open "test/testspace/output/result.html" in your browser to see the testing report.
Special stuff in the output directory.
result.xml: Test result in XML. Every case's detail result, may include case error stack. result.html: Test result in HTML. Collect all case's result, to report as HTML. screenshot/: Screenshot pictures when test assert is failed.
Process
- Create task on Bugzilla to track BVT execution task. [Bugzilla]
- Track your execution task on [BVT Report ]
- Platform: Platform which you can run BVT.
- Volunteer: Volunteer's name to take this execution task.
- Revision: build version of AOO4.0
- Status: Pass/Fail
- Task ID:Task ID in Bugzilla.
| Revision | Platform | Volunteer | Status | Task ID |
|---|---|---|---|---|
| WindowsXP | ||||
| Windows7 32bit | ||||
| Windows7 64bit | ||||
| Ubuntu | ||||
| Suse | ||||
| Redhat | ||||
| Mac |
- Update your execution result on "Status" column, and add detail HTML result in new link(Record link on [BVT Report ] ).
FAQ
