Difference between revisions of "QAAutomation"

From Apache OpenOffice Wiki
Jump to: navigation, search
(Test cycles (category's))
 
(4 intermediate revisions by 3 users not shown)
Line 1: Line 1:
The OOo QA Automation Team has the main responsibility to assure stability and quality of the whole OOo/SUN Staroffice. The automated GUI testing provides a test framework with test scripts and an application ([http://wiki.services.openoffice.org/wiki/Testtool VCL TestTool]) to test almost the whole office application automatically. The VCL TestTool scripts are written in BASIC with some additional functions especially for the office. The VCL TestTool communicates via TCP/IP with the office application. To start the GUI testing it is recommended to download the scripts (TestTool Environment) and the VCL TestTool application for the platform where you want to run the tests. [http://qa.openoffice.org/ooQAReloaded/AutomationTeamsite/ooQA-TeamAutomation.html home of automation team] for further details
+
[[ru:RU/qaautomation]]
 +
[[sl:SL/QAAutomation]]
 +
The OOo QA Automation Team has the main responsibility to assure stability and quality of the whole OOo/SUN Staroffice. The automated GUI testing provides a test framework with test scripts and an application ([[Testtool|VCL TestTool]]) to test almost the whole office application automatically. The VCL TestTool scripts are written in BASIC with some additional functions especially for the office. The VCL TestTool communicates via TCP/IP with the office application. To start the GUI testing it is recommended to download the scripts (TestTool Environment) and the VCL TestTool application for the platform where you want to run the tests. [http://qa.openoffice.org/ooQAReloaded/AutomationTeamsite/ooQA-TeamAutomation.html home of automation team] for further details
  
  
  
 
= QA Automation Alert Levels =
 
= QA Automation Alert Levels =
On this page you'll find an explanation of 'Master-Quality-Meter' (not yet released on OOo) generated by automated tests running on every master workspace. This will be achieved by the VTTDI-Index defined by the QA Automation Team to make a simple understanding of quality status.
+
On this page you'll find an explanation of 'VTTDI'-Values (VCLTesttool defect index) generated by automated tests running on every master workspace. VTTDI is used on 'Quality Assurance Statuspage' ([[QUASTe]]) to assure a simple understanding of quality status.
 
The VTTDI-Index is calculated by the following formula: <br>''''(warnings * 1 + errors * 3) / number of tests''''
 
The VTTDI-Index is calculated by the following formula: <br>''''(warnings * 1 + errors * 3) / number of tests''''
  

Latest revision as of 21:27, 9 April 2010

The OOo QA Automation Team has the main responsibility to assure stability and quality of the whole OOo/SUN Staroffice. The automated GUI testing provides a test framework with test scripts and an application (VCL TestTool) to test almost the whole office application automatically. The VCL TestTool scripts are written in BASIC with some additional functions especially for the office. The VCL TestTool communicates via TCP/IP with the office application. To start the GUI testing it is recommended to download the scripts (TestTool Environment) and the VCL TestTool application for the platform where you want to run the tests. home of automation team for further details


QA Automation Alert Levels

On this page you'll find an explanation of 'VTTDI'-Values (VCLTesttool defect index) generated by automated tests running on every master workspace. VTTDI is used on 'Quality Assurance Statuspage' (QUASTe) to assure a simple understanding of quality status. The VTTDI-Index is calculated by the following formula:
'(warnings * 1 + errors * 3) / number of tests'

Automation Quality status: green
  • Alert level: 1 ( VTTDI <= 0.3 )
  • release and category tests have been finished
  • No critical issues have been found during automated tests
Automation Quality status: lookout
  • Alert level: 2 ( VTTDI >=0.3 and <= 0.5 )
  • release and category tests have been finished
  • Some errors and warnings have been found during automated testing
  • Testresults must be evaluated by QA
  • release might be at risk
Automation Quality status: mild
  • Alert level: 3 ( VTTDI > 0.5 and <= 1 )
  • release and category tests have been finished
  • Some more errors and warnings have been found during automated testing
  • Testresults must be evaluated by QA
  • release is at risk
Automation Quality status: moderate
  • Alert level: 4 ( VTTDI > 1 )
  • release and category tests have been finished
  • Loads of errors and warnings have been found during automated testing
  • Testresults must be evaluated by QA
  • release is not possible
Automation Quality status: severe
  • Alert level: 5 ( VTTDI of any size )
  • release tests have not been finished
  • Testresults must be evaluated by QA
  • release is not possible
Personal tools
In other languages