Difference between revisions of "QA/QA Tasks"

From Apache OpenOffice Wiki
< QA
Jump to: navigation, search
(Automation Script Task)
 
(74 intermediate revisions by 9 users not shown)
Line 1: Line 1:
'''Don't know how to contribute to QA? Read the page to get a clue.''' <br />
+
{{DISPLAYTITLE: QA Tasks}}
 +
'''Welcome'''
  
The following table records the short-term tasks which you can help currently. The tasks are easy and make you get involved quickly. If you are interested in some ones, please add your name and due date in the table, then create a task in [https://issues.apache.org/ooo/ bugzilla]. When you finish the task, please fill the completion date and make the row strikethrough.  Besides these tasks, there are a lot of long-term QA task to do. Talk in the mailing list ooo-qa@incubator.apache.org when you are confused.
+
Welcome to Apache OpenOffice(aka AOO) community. As QA we are helping improve AOO product quality. In generally, we are working on defect handling, manual test, and automation test. If you are interest in QA and willing to make AOO better, don’t hesitate to work with us and contribute your idea and your effort.
  
== Release Testing Task==
+
QA volunteers please find tasks here:
Task list here are test activity before product release
+
 
{| class="prettytable" border="1" width="100%"
+
{| width="50%" class="wikitable"
 +
|+ '''QA Task List'''
 
|-
 
|-
| Task
+
! Task Type
| Brief description
+
! Task Link
| Complexity
+
! Update Date
| BZ ID
+
| Owner
+
| Due Day
+
| Completion Date
+
 
|-
 
|-
| AOO 3.4.1 RC1 build installation testing
+
| Defect Task
| Test RC1 build installer
+
| [[QA/Tasks/DefectTask]]
| Middle
+
| Last Update 2012/11/19
| {{Bug|120354}}
+
| Lou Qing Le
+
| 2012/07/30
+
|
+
 
|-
 
|-
| AOO 3.4.1 RC1 build general testing
+
| Test Case Task
| RC1 build general testing
+
| [[QA/Tasks/TestcaseTask]]
| Middle
+
| Last Update 2012/11/20
| {{Bug|120355 }}
+
|  
+
| 2012/07/30
+
|
+
 
|-
 
|-
| AOO 3.4.1 RC1 build Release Blocker Defects Verification
+
| Automation Scripts Task
| RC1 build Blocker defects verification
+
| *placeholder*
| Middle
+
| {{Bug|120357 }}
+
| Wang Li Feng
+
| 2012/07/30
+
 
|  
 
|  
|-
 
| Run Performance Test on new RC build
 
|
 
| Middle
 
|
 
| Liu Yi Xuan
 
| 2012/07/27
 
|
 
|-
 
|
 
|
 
|
 
|
 
|
 
|
 
|
 
|-
 
 
|}
 
|}
  
==Test case Task==
 
Task list here are test case related work
 
{| class="prettytable" border="1" width="100%"
 
|-
 
| Task
 
| Brief description
 
| Complexity
 
| BZ ID
 
| Owner
 
| Due Day
 
| Completion Date
 
|-
 
|
 
|
 
|
 
|
 
|
 
|
 
|
 
|-
 
|
 
|
 
|
 
|
 
|
 
|
 
|
 
|-
 
|}
 
  
==Test Execution Task==
+
'''Following reference for QA tasks'''
Tasks list here are test case execution related
+
{| class="prettytable" border="1" width="100%"
+
|-
+
| Task
+
| Brief description
+
| Complexity
+
| BZ ID
+
| Owner
+
| Due Day
+
| Completion Date
+
|-
+
|
+
|
+
|
+
|
+
|
+
|
+
|
+
|-
+
|
+
|
+
|
+
|
+
|
+
|
+
|
+
|-
+
|}
+
  
==Automation Script Task==
+
=Working with defect=
Tasks list here are automation script related work
+
{| class="prettytable" border="1" width="100%"
+
|-
+
| Task
+
| style="width:400px" | Brief description
+
| Complexity
+
| BZ ID
+
| Owner
+
| Due Day
+
| Completion Date
+
|-
+
| <s>Let LongRun.java to output csv </s>
+
| Get a clear trend using csv
+
| Middle
+
| {{Bug|120351}}
+
| Liu Zhe
+
| 2012/07/24
+
| 2012/07/24
+
|-
+
| <s>Rename GUI test package name into testcase.gui</s>
+
| Avoid to conflict with uno test
+
| Middle
+
| {{Bug|120352}}
+
| Liu Zhe
+
| 2012/07/25
+
|
+
|-
+
| Silent install/uninstall
+
| Need update "test/testoo/build.xml" <br>
+
|High
+
| {{Bug|120322}}
+
| Lou Qing Le
+
|
+
|
+
|-
+
| Refactor the test code under testcase.sc.*
+
| Make sure the classes can run against AOO. Merge related classes into one class
+
| High
+
| {{Bug|120321}}
+
| Li Lin Yi
+
| 2012/07/20
+
| 2012/07/20
+
|-
+
| Make test code under testcase.sc/sw/sd.* language-neutral
+
| Make sure the classes can run against AOO en-US/zh-CN/zh-TW build.
+
| High
+
| {{Bug|120323}}
+
| Li Lin Yi
+
| 2012/07/25
+
|
+
|-
+
| Convert the complex test in sw/qa to testuno project
+
|
+
| High
+
|
+
|
+
|
+
|
+
|-
+
| Convert the complex test in sc/qa to testuno project
+
|
+
| High
+
|
+
|
+
|
+
|
+
|-
+
| Convert the complex test in sd/qa to testuno project
+
|
+
| High
+
|
+
|
+
|
+
|
+
|-
+
| Make performance testing support Linux and Mac OS
+
| testcase.performance.benchmark only supports Windows now
+
| High
+
|
+
|
+
|
+
|
+
|-
+
| Create new UNO API test project
+
|
+
| High
+
| {{Bug|120320}}
+
| Liu Zhe
+
| 2012/07/20
+
| 2012/07/20
+
|-
+
| Create VclTreeListBox for WINDOW_TREELISTBOX controls
+
| Add testcommon/source/org/openoffice/test/vcl/widget/VclTreeListBox
+
| High
+
|
+
| Li Lin Yi
+
| 2012/07/27
+
|
+
|-
+
| Remove testtool component from installation package
+
| Currently testtool is included in the installation package. It should be removed. [http://comments.gmane.org/gmane.comp.apache.incubator.ooo.devel/21458 Discussion in Mailing list]
+
| High
+
|
+
|
+
|
+
|
+
|-
+
| Write the performance test script of launch cases
+
| Compare the launch performance of normal start and quick start
+
| High
+
|
+
| Liu Yi Xuan
+
| 2012/07/25
+
|
+
|-
+
| Write basic database cases via UNO API
+
|
+
| High
+
|
+
| Wang Li Feng
+
|
+
|
+
|-
+
| Create new UNO API cases for Spreadsheet
+
|
+
| High
+
|
+
| Guo Bin
+
|
+
|
+
|-
+
| write text general case in word processor via UNO API
+
|
+
| High
+
|
+
| Du Jing
+
|
+
|
+
|-
+
|
+
|
+
|
+
|
+
|
+
|
+
|
+
|-
+
|}
+
  
==Documentation Task==
+
==Confirm “UNCONFIRMED" defect==
Task list here are documentation work related
+
{| class="prettytable" border="1" width="100%"
+
|-
+
| Task
+
| Brief description
+
| Complexity
+
| BZ ID
+
| Owner
+
| Due Day
+
| Completion Date
+
|-
+
| <s> Wiki Writing: How to report a bug </s>
+
| A guide for filling bug in Bugzilla
+
| High
+
|
+
| Yan Ji
+
|
+
| 2012/07/19
+
|-
+
| Wiki Writing: How to write test case
+
| A guide for writing test case
+
| High
+
|
+
| Yan Ji
+
| 2012/07/27
+
|
+
|-
+
| Wiki Writing: GUI test cases writing checklist
+
| dd to [[QA/vclauto]]
+
| High
+
| {{Bug|120324}}
+
| Li Lin Yi
+
| 2012/07/27
+
|
+
|-
+
| <s>Wiki Writing: Installer test cases </s>
+
| Add to [[QA/AOO341_TestCase/Installation]]
+
| Middle
+
|
+
| Lou Qing Le
+
|
+
| 2012/07/20
+
|-
+
| Wiki Writing: Performance Test Introduction
+
|
+
| Middle
+
|
+
| Liu Yi Xuan
+
| 2012/07/25
+
|
+
|-
+
|
+
|
+
|
+
|
+
|
+
|
+
|
+
|-
+
|}
+
  
== Intermediate ==
+
# Reading defect description carefully to get understand essential of the problem.
{| class="prettytable" border="1" width="100%"
+
# Based on the information provided verify whether the issue can be reproduced against latest build on all supported OS( the purpose of doing that is make sure  whether the problem is OS independent).
|-
+
# Identify regression. Try the defect against some old builds, e.g. released milestone build, to verify if the problem can also be reproduced too. If no, that means the issue is introduced after that build. This will help developer to locate how the defect is introduced.
! Task
+
# Do problem determination (PD). After reproduce defect, analysis defect symptom and function implementation try to give suggestion from QA/end user perspective.
! Comments
+
# If the problem can be reproduced, change defect status to “CONFIRMED”, otherwise communicate with reporter to figure out the reproduce steps.
! Contributor
+
! Due Date
+
! Completion Date
+
|-
+
| <s>Wiki Writing: How to report a bug</s>
+
| Done! The page is [[QA/HowToFileIssue]]
+
| Yan Ji
+
|
+
|
+
|-
+
| Wiki Writing: How to write test case
+
|
+
|
+
|
+
|
+
|-
+
| Wiki Writing: GUI test cases writing checklist
+
| Add to [[QA/vclauto]]<br />[https://issues.apache.org/ooo/show_bug.cgi?id=120324 Bug 120324]
+
| Li Lin Yi
+
| 20120727
+
|
+
|-
+
| Wiki Writing: Installer test cases
+
| Done. Add to [[QA/AOO341_TestCase/Installation]]
+
| Lou Qing Le
+
|
+
|
+
|-
+
| AOO 3.4.1 RC build installation testing
+
| clean install and upgrade from Aoo 3.4. On Win7, Win8, Ubuntu, Suse, Redhat and some 64-bit platforms.
+
  
Install language packages and check the language switching.
+
==Verify “RESOLVED” defect==
  
| Lou Qing Le
+
# Get latest build which include the fix.
|2012/07/31
+
# Follow the reproduce steps on the OS which issue has been reported on, verify if the defect is able to be reproduced or not.
|
+
# If the defect cannot be reproduce, then update your verification result to defect’s comments.
|-
+
# Based on your knowledge to identify which function area may be impacted by this bug fix to do impact testing.
| AOO 3.4.1 RC build general testing
+
# If no problem found in impact testing, update your test result to defect’s comments. Otherwise reject the defect or accept this fix and open another new defect for the issue just found.
|
+
# With all verify/test is passed, change defect status to “VERIFIED” and then change it to “CLOSED”
|
+
|2012/07/31
+
|
+
|-
+
| AOO 3.4.1 RC build release blocker defects verification
+
|
+
| Wang Li Feng
+
|2012/07/31
+
|
+
|-
+
| Automated Test: Let LongRun.java to output csv
+
| Get a clear trend using csv. [https://issues.apache.org/ooo/show_bug.cgi?id=120351 Bug 120351]
+
| Liu Zhe
+
| 2012/07/24
+
| 2012/07/24
+
|-
+
| Automated Test:Rename GUI test package name into testcase.gui
+
| Avoid to conflict with uno test. [https://issues.apache.org/ooo/show_bug.cgi?id=120352 Bug 120352]
+
| Liu Zhe
+
| 2012/07/25
+
|
+
|-
+
| Wiki Writing: Performance Test Introduction
+
|
+
| Liu Yi Xuan
+
| 2012/07/25
+
|
+
|-
+
| Automated Test: Run perfromance test. Compare load/preload result
+
|
+
| Li Lin Yi
+
|
+
|
+
|}
+
  
== Advanced ==
+
==Open new defect==
{| class="prettytable" border="1" width="100%"
+
 
|-
+
# When encounter problem while testing product functionality, e.g. running test case, or verifying defect, following this guide to fire bug [[QA/HowToFileIssue]]
! Task
+
 
! Comments
+
=Working with manual testing=
! Contributor
+
! Due Date
+
! Completion Date
+
|-
+
| Automated Test: install/uninstall silently OpenOffice installation package (Not the archive package).
+
| Need update "test/testoo/build.xml"
+
  
[https://issues.apache.org/ooo/show_bug.cgi?id=120322 Bug 120322]
+
In AOO project, all manual testing assets, e.g. test case, test execution are store in Testlink system(http://aootesting.adfinis-sygroup.org/index.php) , with this system we can
| Lou Qing Le
+
 
|
+
# Perform test case manually.
|
+
# Write functionality test case
|-
+
 
| Automated Test: Refactor the test code under testcase.sc.*
+
For Testlink system usage guide, please refer to [[QA/Testlink]]
| Make sure the classes can run against AOO. Merge related classes into one class.<br />[https://issues.apache.org/ooo/show_bug.cgi?id=120321 Bug 120321]
+
 
| Li Lin Yi
+
For how to write test case, please refer to [[QA/Testcase/How_to_write_test_case]] and sample test case [[QA/Testcase/Sample]]
| 2012-07-20
+
 
| 2012-07-20
+
 
|-
+
=Automation section=
| Automated Test: Make test code under testcase.sc/sw/sd.* language-neutral
+
'''Under Construction'''
| Make sure the classes can run against AOO en-US/zh-CN/zh-TW build.<br />[https://issues.apache.org/ooo/show_bug.cgi?id=120323 Bug 120323]
+
[[Category: Quality Assurance]]
| Li Lin Yi
+
| 2012-07-25
+
|
+
|-
+
| Automated Test: Convert the complex test in sw/qa to testuno project
+
|
+
|
+
|
+
|
+
|-
+
| Automated Test: Convert the complex test in sc/qa to testuno project
+
|
+
|
+
|
+
|
+
|-
+
| Automated Test: Convert the complex test in sd/qa to testuno project
+
|
+
|
+
|
+
|
+
|-
+
| Automated Test: Make performance testing support Linux and Mac OS
+
| testcase.performance.benchmark only supports Windows now.
+
|
+
|
+
|
+
|-
+
| Automated Test: Create new UNO API test project
+
| [https://issues.apache.org/ooo/show_bug.cgi?id=120320 Bug 120320]
+
| Liu Zhe
+
| 2012-7-20
+
| 2012-7-20
+
|-
+
| Automated Test: Create VclTreeListBox for WINDOW_TREELISTBOX controls
+
| Add testcommon/source/org/openoffice/test/vcl/widget/VclTreeListBox
+
| Li Lin Yi
+
| 2012-7-27
+
|
+
|-
+
| Automated Test: Remove testtool component from installation package
+
| Currently testtool is included in the installation package. It should be removed. [http://comments.gmane.org/gmane.comp.apache.incubator.ooo.devel/21458 Discussion in Mailing list]
+
|
+
|
+
|
+
|-
+
| Performance Test: Write the performance test script of launch cases
+
| Compare the launch performance of normal start and quick start
+
| Liu Yi Xuan
+
| 2012-7-25
+
|
+
|-
+
| Performance Test: Run Performance Test on new RC build
+
|
+
| Liu Yi Xuan
+
| 2012-7-27
+
|
+
|-
+
| Automated Test: Write basic database cases via UNO API
+
|
+
| Wang Li Feng
+
|
+
|
+
|-
+
| Automated Test: Create new UNO API cases for Spreadsheet
+
|
+
| Guo Bin
+
|
+
|
+
|-
+
|Automated Test:write text general case in word processor  via UNO API
+
|
+
|Du Jing
+
|
+
|
+
|}
+

Latest revision as of 09:49, 20 November 2012

Welcome

Welcome to Apache OpenOffice(aka AOO) community. As QA we are helping improve AOO product quality. In generally, we are working on defect handling, manual test, and automation test. If you are interest in QA and willing to make AOO better, don’t hesitate to work with us and contribute your idea and your effort.

QA volunteers please find tasks here:

QA Task List
Task Type Task Link Update Date
Defect Task QA/Tasks/DefectTask Last Update 2012/11/19
Test Case Task QA/Tasks/TestcaseTask Last Update 2012/11/20
Automation Scripts Task *placeholder*


Following reference for QA tasks

Working with defect

Confirm “UNCONFIRMED" defect

  1. Reading defect description carefully to get understand essential of the problem.
  2. Based on the information provided verify whether the issue can be reproduced against latest build on all supported OS( the purpose of doing that is make sure whether the problem is OS independent).
  3. Identify regression. Try the defect against some old builds, e.g. released milestone build, to verify if the problem can also be reproduced too. If no, that means the issue is introduced after that build. This will help developer to locate how the defect is introduced.
  4. Do problem determination (PD). After reproduce defect, analysis defect symptom and function implementation try to give suggestion from QA/end user perspective.
  5. If the problem can be reproduced, change defect status to “CONFIRMED”, otherwise communicate with reporter to figure out the reproduce steps.

Verify “RESOLVED” defect

  1. Get latest build which include the fix.
  2. Follow the reproduce steps on the OS which issue has been reported on, verify if the defect is able to be reproduced or not.
  3. If the defect cannot be reproduce, then update your verification result to defect’s comments.
  4. Based on your knowledge to identify which function area may be impacted by this bug fix to do impact testing.
  5. If no problem found in impact testing, update your test result to defect’s comments. Otherwise reject the defect or accept this fix and open another new defect for the issue just found.
  6. With all verify/test is passed, change defect status to “VERIFIED” and then change it to “CLOSED”

Open new defect

  1. When encounter problem while testing product functionality, e.g. running test case, or verifying defect, following this guide to fire bug QA/HowToFileIssue

Working with manual testing

In AOO project, all manual testing assets, e.g. test case, test execution are store in Testlink system(http://aootesting.adfinis-sygroup.org/index.php) , with this system we can

  1. Perform test case manually.
  2. Write functionality test case

For Testlink system usage guide, please refer to QA/Testlink

For how to write test case, please refer to QA/Testcase/How_to_write_test_case and sample test case QA/Testcase/Sample


Automation section

Under Construction

Personal tools