QAAutomation

From Apache OpenOffice Wiki
Revision as of 08:43, 13 October 2008 by Hde (Talk | contribs)

Jump to: navigation, search

The OOo QA Automation Team has the main responsibility to assure stability and quality of the whole OOo/SUN Staroffice. The automated GUI testing provides a test framework with test scripts and an application (VCL TestTool) to test almost the whole office application automatically. The VCL TestTool scripts are written in BASIC with some additional functions especially for the office. The VCL TestTool communicates via TCP/IP with the office application. To start the GUI testing it is recommended to download the scripts (TestTool Environment) and the VCL TestTool application for the platform where you want to run the tests. home of automation team for further details


QA Automation Alert Levels

On this page you'll find an explanation of 'VTTDI'-Values (VCLTesttool defect index) generated by automated tests running on every master workspace. VTTDI is to assure a simple understanding of quality status. The VTTDI-Index is calculated by the following formula:
'(warnings * 1 + errors * 3) / number of tests'

Automation Quality status: green
  • Alert level: 1 ( VTTDI <= 0.3 )
  • release and category tests have been finished
  • No critical issues have been found during automated tests
Automation Quality status: lookout
  • Alert level: 2 ( VTTDI >=0.3 and <= 0.5 )
  • release and category tests have been finished
  • Some errors and warnings have been found during automated testing
  • Testresults must be evaluated by QA
  • release might be at risk
Automation Quality status: mild
  • Alert level: 3 ( VTTDI > 0.5 and <= 1 )
  • release and category tests have been finished
  • Some more errors and warnings have been found during automated testing
  • Testresults must be evaluated by QA
  • release is at risk
Automation Quality status: moderate
  • Alert level: 4 ( VTTDI > 1 )
  • release and category tests have been finished
  • Loads of errors and warnings have been found during automated testing
  • Testresults must be evaluated by QA
  • release is not possible
Automation Quality status: severe
  • Alert level: 5 ( VTTDI of any size )
  • release tests have not been finished
  • Testresults must be evaluated by QA
  • release is not possible
Personal tools