Difference between revisions of "VCLTesttool 2.4"

From Apache OpenOffice Wiki
Jump to: navigation, search
m (Beta testing)
m (Beta testing)
Line 26: Line 26:
 
! Platform / Download !! Master Tester !! [http://qa.openoffice.org/ooQAReloaded/AutomationTeamsite/ooQA-TeamAutomationTestlist.html Category] !! Status
 
! Platform / Download !! Master Tester !! [http://qa.openoffice.org/ooQAReloaded/AutomationTeamsite/ooQA-TeamAutomationTestlist.html Category] !! Status
 
|-
 
|-
|http://qa.openoffice.org/qatesttool/src680m226/VCLTestTool_Solaris_Intel_src680m226.tar.gz Solaris Intel || MSC || || style="background:yellow" | beta test
+
|[http://qa.openoffice.org/qatesttool/src680m226/VCLTestTool_Solaris_Intel_src680m226.tar.gz Solaris Intel] || MSC || || style="background:yellow" | beta test
 
|-
 
|-
 
|[http://qa.openoffice.org/qatesttool/src680m226/VCLTestTool_Solaris_Sparc_src680m226.tar.gz Solaris Sparc] || JSI || || style="background:yellow" | beta test
 
|[http://qa.openoffice.org/qatesttool/src680m226/VCLTestTool_Solaris_Sparc_src680m226.tar.gz Solaris Sparc] || JSI || || style="background:yellow" | beta test

Revision as of 13:54, 6 September 2007

Introduction

Since the time got too short to introduce a new VCL TestTool for testing OOo 2.3 new VCL TestTool for testing OOo 2.3 we will go on now at the beginning of the OOo 2.4 tree to get a new testtool.


We tested the CWS gh13 with all available test scripts. Now we want to use the VCL TestTool based on SRC680m226 as the new default testtool for OOo 2.4. It is currently declared as beta version.

Beta testing

Since we found almost all regressions by testing the CWS gh13 we will reduce testing for this version. In the beta testing phase Hamburg StarOffice qa automation team will run the next master category test on the platforms for SRC680. It will take some time to start and evaluate the results, since OOo 2.3 is currently tested for release. Everybody else may also test the testtool version and report errors regarding the VCL TestTool application.

Test plan is to make sure the beta TestTool behaves like the current TestTool based on SRC680m50.

The testing is coordinated by TBO.

The beta test binaries succeeded the first.bas and topten.bas tests.

The testing should be done with a current OOo version from src680.(Current as of 04.09.2007 is src680m227).

The master tester will set the category he tests.

Currently existing downloadable VCL testtool binaries (SRC680m226). These are Standalone VCL_TestTool binaries.

Platform / Download Master Tester Category Status
Solaris Intel MSC beta test
Solaris Sparc JSI beta test
Linux FHA beta test
Windows HDE beta test
MacOS X PPC Aqua Tester needed beta test
MacOS X Intel Aqua Tester needed not yet available
MacOS X PPC X11 same binary as PPC Aqua

Binaries are taken from Sun StarOffice builds, exept:

MacOS X: they are based on Nakata Maho's builds

Final version

After the testtool is declared as final, this version will be used by Hamburg StarOffice qa team, and it is the reference for everybody else; If you find a bug or issue with an testtool other than the final testtool version you have to verify if it also comes up with the reference testtool.

We provide these references as reduced binaries from an OOo installation as VCL TestTool; 20MB compressed and 60MB deflated; These are meant for keeping a VCL TestTool on the computer. We strongly not recommend on using the TestTool version from the OOo package that comes with every build. We want to test OOo and not the TestTool - and thus you have to keep some things constant to be sure the found errors are in the OOo application and not in the TestTool! It sometimes happen, that changes to OOo break the TestTool - some are obvious, some not.

Currently known errors

http://wiki.services.openoffice.org/wiki/VCLTestToolIssues

Errors found during beta testing

Please insert the issues here.

Finished testing

Insert finishing date here and announce in qa-dev

Check list

  • create standalone binaries (TBO started 03.09.2007)
  • run topten.bas and first.bas (TBO started 03.09.2007)
  • checkin changes to standalone version
  • verify testtoolrc and insert timeout of 4 minutes (TBO done)
  • write Standalone VCL_TestTool wiki entry (TBO done)
  • upload binaries (TBO started 03.09.2007)
  • announce beta in qa-dev (TBO done)
  • Wait for feedback of testers
  • ...
  • Announce final VCL TestTool Application for 2.4
  • Insert information into static pages at qa.openoffice.org/qatesttool
Personal tools