Difference between revisions of "QA status Chart2"

From Apache OpenOffice Wiki
Jump to: navigation, search
m (7 load save tests missing; wording)
Line 34: Line 34:
  
 
7th of March '07 :
 
7th of March '07 :
*in 3 turns the CWS get in state 'ready for QA' the first time
+
*the CWS get in state 'ready for QA' the first time
 
*294 issues are attached at the CWS chart2mst3
 
*294 issues are attached at the CWS chart2mst3
 +
*until end of March the major critical issues (19 issues) were fixed in 3 turns
  
 
12th of April '07 :
 
12th of April '07 :
Line 41: Line 42:
 
*260 issues are verified in CWS chart2mst3 => 56 issues are open - 6 feature and 7 enhancements
 
*260 issues are verified in CWS chart2mst3 => 56 issues are open - 6 feature and 7 enhancements
 
*3 test case specifications are written => 9 are open
 
*3 test case specifications are written => 9 are open
 +
*integration tests were done for Writer and Impress (2 days per application by Wolfram Garten and Michael Ruess)
 
*2 automated UI tests have been written (it hast to be checked if they are checked full functionality of 2 specifications)
 
*2 automated UI tests have been written (it hast to be checked if they are checked full functionality of 2 specifications)
 
*7 load/save tests have been written which should help the manual tester to get as soon as possible documents for verification
 
*7 load/save tests have been written which should help the manual tester to get as soon as possible documents for verification
 
*316 issues are attached at CWS chart2mst3
 
*316 issues are attached at CWS chart2mst3
 +
  
 
<H2>Number of submitted issues</H2>
 
<H2>Number of submitted issues</H2>
(all issues for new chart have 'New chart' in summary and can be queried)
+
(all issues for new chart have 'new chart' in summary and the key work 'new_implementation' and can be [http://qa.openoffice.org/issues/query.cgi queried in IssueTracker])
  
 
<B>Current state (12th of April) :</B>
 
<B>Current state (12th of April) :</B>
Line 68: Line 71:
 
**only issues with priority 3 and 4
 
**only issues with priority 3 and 4
 
**all these issues are regressions against the old chart module
 
**all these issues are regressions against the old chart module
**list of prioritization can be found at http://www.openoffice.org/files/documents/4/3962/Chart2_RegressionReview.ods
+
**list of prioritization (made by development) can be found at http://www.openoffice.org/files/documents/4/3962/Chart2_RegressionReview.ods
  
 
*[http://eis.services.openoffice.org/EIS2/cws.ShowCWS?Path=SRC680%2Fchart04 chart04] :
 
*[http://eis.services.openoffice.org/EIS2/cws.ShowCWS?Path=SRC680%2Fchart04 chart04] :

Revision as of 10:47, 12 April 2007

The status by the Quality Assurance for the Chart 2 project is tracked on this page. The Chart 2 project should replace the old Chart module which is integrated in OOo 2.x (currently 2.2). The new module is included in one CWS (chart2mst3).


Effort

The estimated effort in QA for the CWS chart2mst3 is planned with 3 months until the CWS get in state 'ready for QA' for the first time.

In this time frame the following parts are included :

  • testing and verifying of all issue which are included in CWS chart2mst3
  • write automated test scripts to check general functionality of new Chart module
  • testing the new chart module in all applications of OOo (integration tests for Writer, Impress and Calc)
  • approve all specifications
  • writing test case specifications for all new features with specifications (documentation what is tested, for further testing cycles and for reproducible test scenarios)
  • full function tests of all new features with test case specifications
  • general testing of the Chart module

The following parts are not required for approving the CWS, but should be done as much as possible :

  • adopt older test case specifications to the new functionality of Chart 2
  • write automated test scripts for all new features


The effort is planned for one complete test cycle. If it will be needed to check all issues in the CWS more than once, the time frame has to be extended.


Time frame for testing and quality assurance

Beside the development of the new chart module Thomas Klarhoefer is full-time the responsible engineer for the Quality Assurance. Jogi Sievers is responsible script writer for automated testing and support Thomas. The QA is done in parallel since more than a year. So the testing didn't start with setting the CWS in state 'ready for QA', it started much earlier and was continues work beside the development process.

The final approval process for the CWS nearly started with the setting it in state 'ready for QA'. This was done for the first time at 7th of March 2007. So currently the estimated due date for setting the CWS to 7th of June 2007.


Current status

14th of February '07 :

  • started verification of all issues from type 'task'
  • 252 issues are attached at the CWS chart2mst3

7th of March '07 :

  • the CWS get in state 'ready for QA' the first time
  • 294 issues are attached at the CWS chart2mst3
  • until end of March the major critical issues (19 issues) were fixed in 3 turns

12th of April '07 :

  • 8 specifications are approved by iTeam => 4 are open
  • 260 issues are verified in CWS chart2mst3 => 56 issues are open - 6 feature and 7 enhancements
  • 3 test case specifications are written => 9 are open
  • integration tests were done for Writer and Impress (2 days per application by Wolfram Garten and Michael Ruess)
  • 2 automated UI tests have been written (it hast to be checked if they are checked full functionality of 2 specifications)
  • 7 load/save tests have been written which should help the manual tester to get as soon as possible documents for verification
  • 316 issues are attached at CWS chart2mst3


Number of submitted issues

(all issues for new chart have 'new chart' in summary and the key work 'new_implementation' and can be queried in IssueTracker)

Current state (12th of April) :

  • all opened issues which are set for new chart : 80

Submitted issues since starting verification of the issues in chart2mst3 (17th of February '07)

  • submitted issues for new chart module : 82
  • added issues to chart2mst3 (are older than 17th of Feb.) : 64
  • issues are added to other CWS than chart2mst3 : 23
  • open issues are not registered at a CWS : 5


Other opened CWS for new chart

Beside CWS chart2mst3 other CWS exists for the new chart module. They includes regressions and issues which should be fixed after integration of the new chart module. But it is difficult to say, if all of these issues can be shifted after the final release of Chart 2 or if they are a Must for the final release.

Here are the CWS :

  • chart03 :
    • currently added issue : 49
    • issues which are submitted since 14th of February : 26
    • issues which are submitted since 17th of March  : 19
    • all issues are targeted with 'OOo 2.3' and 'OOo 2.x'
    • only issues with priority 3 and 4
    • all these issues are regressions against the old chart module
    • list of prioritization (made by development) can be found at http://www.openoffice.org/files/documents/4/3962/Chart2_RegressionReview.ods
  • chart04 :
    • currently added issue : 17
    • issues which are submitted since 14th of February : 4
    • issues which are submitted since 17th of March  : 2
    • all issues are targeted with 'OOo 2.3' and 'OOo 2.x'
    • only issues with priority 3 and 4
Personal tools