Difference between revisions of "QA/BVT"

From Apache OpenOffice Wiki
< QA
Jump to: navigation, search
Line 44: Line 44:
 
  result.html: Test result in HTML. Collect all case's result, to report as HTML.
 
  result.html: Test result in HTML. Collect all case's result, to report as HTML.
 
  screenshot/: Screenshot pictures when test assert is failed.
 
  screenshot/: Screenshot pictures when test assert is failed.
 +
==Process==
 +
Create task on Bugzilla to track BVT execution task. [[https://issues.apache.org/ooo/ Bugzilla]]<br/>
 +
Track your execution task on [[http://wiki.openoffice.org/w/index.php?title=QA/BVT_Report BVT Report ]]<br/>
 +
 +
* Platform: Platform which you can run BVT.<br/>
 +
* Volunteer: Volunteer's name to take this execution task.<br/>
 +
* Revision: build version of AOO4.0<br/>
 +
* Status: Pass/Fail with detail link.<br/>
 +
* Task ID:Task ID in Bugzilla.<br/>
 +
 +
{| class="wikitable" border="1"
 +
|-
 +
! Revision
 +
! Platform
 +
! Volunteer
 +
! Status
 +
! Task ID
 +
|-
 +
|
 +
| WindowsXP
 +
|
 +
|
 +
|
 +
|-
 +
|
 +
| Windows7 32bit
 +
|
 +
|
 +
|
 +
|-
 +
|
 +
|Windows7 64bit
 +
|
 +
|
 +
|
 +
|-
 +
|
 +
|Ubuntu
 +
|
 +
|
 +
|
 +
|-
 +
|
 +
|Suse
 +
|
 +
|
 +
|
 +
 +
|-
 +
|
 +
|Redhat
 +
|
 +
|
 +
|
 +
 +
|-
 +
|
 +
|Mac
 +
|
 +
|
 +
|
 +
 +
|}
  
 
==FAQ==
 
==FAQ==

Revision as of 08:39, 28 March 2013

Introduction

Build Verification Testing, BVT for short, is a set of tests that run on new build to verify that whether the build is testable or not. It is done prior to its release to test team for further testing. This testing is done for Build Validation and Build Acceptance.

Template:Documentation/Tip

Prerequisites

Platform

Test machine with OS in below list: WindowsXP, Windows7 32bit, Windows7 64bit,Ubuntu, Suse, Redhat,Mac

Environment tools

  • SVN Client:

On Windows: Download and Install TortoiseSVN as SVN Client to checkout sourcecode.
http://tortoisesvn.net/downloads.html

Soft Skills

Basic skills about Windows Command line, Linux/Mac Terminal


How to run BVT

Getting the source code

Anyone can checkout source code from our Subversion repository. Run the following command.

svn co https://svn.apache.org/repos/asf/openoffice/trunk/test/ test

Run testing

As a normal user, how to run testing against an installed OpenOffice?
Firstly compile the project with the command under test module.

ant -Dopenoffice.home="OpenOffice installation directory" compile

Then start testing with the command "run". e.g. Run all test classes under package bvt

run -Dopenoffice.home="/Applications/OpenOffice.org.app/Contents" -tp bvt

e.g. Run the given test classes

run -Dopenoffice.home="/Applications/OpenOffice.org.app/Contents" -tc bvt.gui.BasicFunctionTest


Where to get the testing result?

By default, the testing output is stored in "test/testspace/output***". Open "test/testspace/output/result.html" in your browser to see the testing report.

Special stuff in the output directory.

result.xml: Test result in XML. Every case's detail result, may include case error stack.
result.html: Test result in HTML. Collect all case's result, to report as HTML.
screenshot/: Screenshot pictures when test assert is failed.

Process

Create task on Bugzilla to track BVT execution task. [Bugzilla]
Track your execution task on [BVT Report ]

  • Platform: Platform which you can run BVT.
  • Volunteer: Volunteer's name to take this execution task.
  • Revision: build version of AOO4.0
  • Status: Pass/Fail with detail link.
  • Task ID:Task ID in Bugzilla.
Revision Platform Volunteer Status Task ID
WindowsXP
Windows7 32bit
Windows7 64bit
Ubuntu
Suse
Redhat
Mac

FAQ

Template:Documentation/Note


Reference

Test Automation Guide
BVT Report
Personal tools