Difference between revisions of "VCLTesttool 2.4"

From Apache OpenOffice Wiki
Jump to: navigation, search
(Check list)
(Check list)
 
(4 intermediate revisions by the same user not shown)
Line 27: Line 27:
 
! Platform / Download !! Master Tester !! [http://qa.openoffice.org/ooQAReloaded/AutomationTeamsite/ooQA-TeamAutomationTestlist.html Category] !! Status
 
! Platform / Download !! Master Tester !! [http://qa.openoffice.org/ooQAReloaded/AutomationTeamsite/ooQA-TeamAutomationTestlist.html Category] !! Status
 
|-
 
|-
|[http://qa.openoffice.org/qatesttool/src680m226/VCLTestTool_Solaris_Intel_src680m226.tar.gz Solaris Intel] || MSC || || style="background:yellow" | beta test
+
|[http://qa.openoffice.org/qatesttool/src680m226/VCLTestTool_Solaris_Intel_src680m226.tar.gz Solaris Intel] || MSC || || style="background:green" | final
 
|-
 
|-
|[http://qa.openoffice.org/qatesttool/src680m226/VCLTestTool_Solaris_Sparc_src680m226.tar.gz Solaris Sparc] || JSI || || style="background:yellow" | beta test
+
|[http://qa.openoffice.org/qatesttool/src680m226/VCLTestTool_Solaris_Sparc_src680m226.tar.gz Solaris Sparc] || JSI || || style="background:green" | final
 
|-
 
|-
|[http://qa.openoffice.org/qatesttool/src680m226/VCLTestTool_Linux_src680m226.tar.gz Linux] || FHA || || style="background:yellow" | beta test
+
|[http://qa.openoffice.org/qatesttool/src680m226/VCLTestTool_Linux_src680m226.tar.gz Linux] || FHA || || style="background:green" | final
 
|-
 
|-
|[http://qa.openoffice.org/qatesttool/src680m226/VCLTestTool_Win_src680m226.zip Windows] || HDE || || style="background:yellow" | beta test
+
|[http://qa.openoffice.org/qatesttool/src680m226/VCLTestTool_Win_src680m226.zip Windows] || HDE || || style="background:green" | final
 
|-
 
|-
|[http://qa.openoffice.org/qatesttool/src680m226/VCLTestTool_Mac_X11_src680m226.tar.gz MacOS X PPC X11] || Tester needed || || style="background:yellow" | beta test
+
|[http://qa.openoffice.org/qatesttool/src680m226/VCLTestTool_Mac_X11_src680m226.tar.gz MacOS X PPC X11] || || || style="background:white" | Canceled
 
|-
 
|-
|[http://qa.openoffice.org/qatesttool/src680m226/VCLTestTool_Mac_X11_Intel_src680m226.tar.gz MacOS X Intel X11]  || Tester needed || || style="background:yellow" | beta test
+
|[http://qa.openoffice.org/qatesttool/src680m226/VCLTestTool_Mac_X11_Intel_src680m226.tar.gz MacOS X Intel X11]  || || || style="background:white" | Canceled
 
|-
 
|-
|[http://qa.openoffice.org/qatesttool/src680m226/VCLTestTool.app.zip MacOS X PPC Aqua] || Tester needed || || style="background:orange" | [http://wiki.services.openoffice.org/wiki/VCLTesttool_2.4#Errors_found_during_beta_testing issues open]
+
|[http://qa.openoffice.org/qatesttool/src680m226/VCLTestTool.app.zip MacOS X PPC Aqua] || based on SRC680m243 || || style="background:green" | final - untested
 
|-
 
|-
|[http://qa.openoffice.org/qatesttool/src680m226/VCLTestTool-Intel.app.zip MacOS X Intel Aqua]|| Tester needed || || style="background:orange" | [http://wiki.services.openoffice.org/wiki/VCLTesttool_2.4#Errors_found_during_beta_testing issues open]
+
|[http://qa.openoffice.org/qatesttool/src680m226/VCLTestTool-Intel.app.zip MacOS X Intel Aqua]|| based on SRC680m243 || || style="background:green" | final - untested
 
|}
 
|}
  
 
Binaries are taken from Sun StarOffice builds, exept:
 
Binaries are taken from Sun StarOffice builds, exept:
: MacOS X: they are based on [ftp://ooopackages.good-day.net/pub/OpenOffice.org/MacOSX/SRC680_m226 Nakata Maho's builds]
+
: MacOS X PPC: this is based on [ftp://ooopackages.good-day.net/pub/OpenOffice.org/MacOSX/SRC680_m243 Nakata Maho's builds]
  
 
==Final version==
 
==Final version==
Line 58: Line 58:
  
 
==Errors found during beta testing==
 
==Errors found during beta testing==
 +
 +
These Errors on Mac OS X Intel are fixed in SRC680m243
 +
 
Please insert the issues here.
 
Please insert the issues here.
  
Line 67: Line 70:
  
 
==Finished testing==
 
==Finished testing==
Insert finishing date here and announce in qa-dev
+
22.01.2008
  
 
==Check list==
 
==Check list==
Line 77: Line 80:
 
* upload binaries (TBO done)
 
* upload binaries (TBO done)
 
* announce beta in qa-dev (TBO done)
 
* announce beta in qa-dev (TBO done)
* All binaries available, testing ist started: 20.09.2007
+
* All binaries available, testing ist started: done: 20.09.2007
 
* Wait for feedback of testers
 
* Wait for feedback of testers
* Announce final VCL TestTool Application for 2.4: 22.01.2008
+
* Announce final VCL TestTool Application for 2.4: done: 22.01.2008
* Insert information into static pages at qa.openoffice.org/qatesttool: 22.01.2008
+
* Insert information into static pages at qa.openoffice.org/qatesttool: done: 22.01.2008
* Provide standalone binary for Mac OS X Intel:  
+
* Provide standalone binary for Mac OS X Intel: done: 28.02.2008
  
 
<noinclude>[[Category:Porting]] [[Category:Aqua]] [[Category:MacOSX]][[Category:Quality_Assurance]]</noinclude>
 
<noinclude>[[Category:Porting]] [[Category:Aqua]] [[Category:MacOSX]][[Category:Quality_Assurance]]</noinclude>

Latest revision as of 14:10, 28 January 2008

Introduction

Since the time got too short to introduce a new VCL TestTool for testing OOo 2.3 new VCL TestTool for testing OOo 2.3 we will go on now at the beginning of the OOo 2.4 tree to get a new testtool.


We tested the CWS gh13 with all available test scripts. Now we want to use the VCL TestTool based on SRC680m226 as the new default testtool for OOo 2.4. It is currently declared as beta version.

Beta testing

Since we found almost all regressions by testing the CWS gh13 we will reduce testing for this version. In the beta testing phase Hamburg StarOffice qa automation team will run the next master category test on the platforms for SRC680. It will take some time to start and evaluate the results, since OOo 2.3 is currently tested for release. Everybody else may also test the testtool version and report errors regarding the VCL TestTool application.

Test plan is to make sure the beta TestTool behaves like the current TestTool based on SRC680m50.

The testing is coordinated by TBO.

The beta test binaries succeeded the first.bas and topten.bas tests.

The testing should be done with a current OOo version from src680.(Current as of 04.09.2007 is src680m227).

The master tester will set the category he tests.

Currently existing downloadable VCL testtool binaries (SRC680m226). These are Standalone VCL_TestTool binaries.

Download size is 20MB each and about 60MB deflated on disk.
Platform / Download Master Tester Category Status
Solaris Intel MSC final
Solaris Sparc JSI final
Linux FHA final
Windows HDE final
MacOS X PPC X11 Canceled
MacOS X Intel X11 Canceled
MacOS X PPC Aqua based on SRC680m243 final - untested
MacOS X Intel Aqua based on SRC680m243 final - untested

Binaries are taken from Sun StarOffice builds, exept:

MacOS X PPC: this is based on Nakata Maho's builds

Final version

After the testtool is declared as final, this version will be used by Hamburg StarOffice qa team, and it is the reference for everybody else; If you find a bug or issue with an testtool other than the final testtool version you have to verify if it also comes up with the reference testtool.

We provide these references as reduced binaries from an OOo installation as VCL TestTool; 20MB compressed and 60MB deflated; These are meant for keeping a VCL TestTool on the computer. We strongly not recommend on using the TestTool version from the OOo package that comes with every build. We want to test OOo and not the TestTool - and thus you have to keep some things constant to be sure the found errors are in the OOo application and not in the TestTool! It sometimes happen, that changes to OOo break the TestTool - some are obvious, some not.

Currently known errors

http://wiki.services.openoffice.org/wiki/VCLTestToolIssues

Errors found during beta testing

These Errors on Mac OS X Intel are fixed in SRC680m243

Please insert the issues here.

MacOS Aqua: 81559 testtool: AQUA: -run parameter is being ignored (batch mode)

workaround
export AQUA_NATIVE_MENUS=false
before you start the
testtool.app/Contents/MacOS/testtool.bin

MacOS Aqua: 81645 testtool: AQUA: declare.bas is not useable

Workaround is to use X11 verison of OOo

Finished testing

22.01.2008

Check list

  • create standalone binaries (TBO done)
  • run topten.bas and first.bas (TBO done)
  • checkin changes to standalone version (TBO done)
  • verify testtoolrc and insert timeout of 4 minutes (TBO done)
  • write Standalone VCL_TestTool wiki entry (TBO done)
  • upload binaries (TBO done)
  • announce beta in qa-dev (TBO done)
  • All binaries available, testing ist started: done: 20.09.2007
  • Wait for feedback of testers
  • Announce final VCL TestTool Application for 2.4: done: 22.01.2008
  • Insert information into static pages at qa.openoffice.org/qatesttool: done: 22.01.2008
  • Provide standalone binary for Mac OS X Intel: done: 28.02.2008
Personal tools