Difference between revisions of "QA/QA Tasks"

From Apache OpenOffice Wiki
< QA
Jump to: navigation, search
(Documentation Task)
 
(62 intermediate revisions by 9 users not shown)
Line 1: Line 1:
'''Don't know how to contribute to QA? Read the page to get a clue.''' <br />
+
{{DISPLAYTITLE: QA Tasks}}
 +
'''Welcome'''
  
The following table records the short-term tasks which you can help currently. The tasks are easy and make you get involved quickly. If you are interested in some ones, please add your name and due date in the table, then create a task in [https://issues.apache.org/ooo/ bugzilla]. When you finish the task, please fill the completion date and make the row strikethrough.  Besides these tasks, there are a lot of long-term QA task to do. Talk in the mailing list ooo-qa@incubator.apache.org when you are confused.
+
Welcome to Apache OpenOffice(aka AOO) community. As QA we are helping improve AOO product quality. In generally, we are working on defect handling, manual test, and automation test. If you are interest in QA and willing to make AOO better, don’t hesitate to work with us and contribute your idea and your effort.
  
== Release Testing Task==
+
QA volunteers please find tasks here:
Task list here are test activity before product release
+
{| class="prettytable" border="1" width="100%"
+
|-
+
| Task
+
| Brief description
+
| Complexity
+
| BZ ID
+
| Owner
+
| Due Day
+
| Completion Date
+
|-
+
| AOO 3.4.1 RC1 Testing
+
| Test RC1 rev 1364591
+
| Middle
+
| {{Bug|120363}}
+
| Yan Ji
+
| 2012/07/30
+
|
+
|-
+
|
+
|
+
|
+
|
+
|
+
|
+
|
+
|-
+
|
+
|
+
|
+
|
+
|
+
|
+
|
+
|-
+
  
|  
+
{| width="50%" class="wikitable"
|  
+
|+ '''QA Task List'''
|
+
|
+
|
+
|
+
|
+
 
|-
 
|-
|}
+
! Task Type
 
+
! Task Link
==Test case Task==
+
! Update Date
Task list here are test case related work
+
{| class="prettytable" border="1" width="100%"
+
 
|-
 
|-
| Task
+
| Defect Task
| Brief description
+
| [[QA/Tasks/DefectTask]]
| Complexity
+
| Last Update 2012/11/19
| BZ ID
+
| Owner
+
| Due Day
+
| Completion Date
+
 
|-
 
|-
|  
+
| Test Case Task
|  
+
| [[QA/Tasks/TestcaseTask]]
|  
+
| Last Update 2012/11/20
|
+
|
+
|
+
|
+
 
|-
 
|-
 +
| Automation Scripts Task
 +
| *placeholder*
 
|  
 
|  
|
 
|
 
|
 
|
 
|
 
|
 
|-
 
 
|}
 
|}
  
==Test Execution Task==
 
Tasks list here are test case execution related
 
{| class="prettytable" border="1" width="100%"
 
|-
 
| Task
 
| Brief description
 
| Complexity
 
| BZ ID
 
| Owner
 
| Due Day
 
| Completion Date
 
|-
 
| Run Build Verification Test on AOO r1364591
 
| Add report to [[QA/Report/BVT]]
 
|
 
|
 
| Li Lin Yi
 
| 2012-07-27
 
|
 
|-
 
| Run PVT on AOO r1364591
 
| Add report to [[QA/AOO341_PVTResult]]
 
|
 
| 120364
 
| Liu Yi Xuan
 
| 2012-07-27
 
| 2012-07-26
 
|-
 
|}
 
  
==Automation Script Task==
+
'''Following reference for QA tasks'''
Tasks list here are automation script related work
+
{| class="prettytable" border="1" width="100%"
+
|-
+
| Task
+
| style="width:400px" | Brief description
+
| Complexity
+
| BZ ID
+
| Owner
+
| Due Day
+
| Completion Date
+
|-
+
| <s>Let LongRun.java to output csv </s>
+
| Get a clear trend using csv
+
| Middle
+
| {{Bug|120351}}
+
| Liu Zhe
+
| 2012/07/24
+
| 2012/07/24
+
|-
+
| <s>Rename GUI test package name into testcase.gui</s>
+
| Avoid to conflict with uno test
+
| Middle
+
| {{Bug|120352}}
+
| Liu Zhe
+
| 2012/07/25
+
| 2012/07/25
+
|-
+
| Silent install/uninstall
+
| Need update "test/testoo/build.xml" <br>
+
|High
+
| {{Bug|120322}}
+
| Lou Qing Le
+
| 2012/08/01
+
|
+
|-
+
| Refactor the test code under testcase.sc.*
+
| Make sure the classes can run against AOO. Merge related classes into one class
+
| High
+
| {{Bug|120321}}
+
| Li Lin Yi
+
| 2012/07/20
+
| 2012/07/20
+
|-
+
| Make test code under testcase.sc/sw/sd.* language-neutral
+
| Make sure the classes can run against AOO en-US/zh-CN/zh-TW build.
+
| High
+
| {{Bug|120323}}
+
| Li Lin Yi
+
| 2012/07/25
+
|
+
|-
+
| Convert the complex test in sw/qa to testuno project
+
|
+
| High
+
|
+
|
+
|
+
|
+
|-
+
| Convert the complex test in sc/qa to testuno project
+
|
+
| High
+
|
+
|
+
|
+
|
+
|-
+
| Convert the complex test in sd/qa to testuno project
+
|
+
| High
+
|
+
|
+
|
+
|
+
|-
+
| Make performance testing support Linux and Mac OS
+
| testcase.performance.benchmark only supports Windows now
+
| High
+
|
+
|
+
|
+
|
+
|-
+
| Create new UNO API test project
+
|
+
| High
+
| {{Bug|120320}}
+
| Liu Zhe
+
| 2012/07/20
+
| 2012/07/20
+
|-
+
| Create VclTreeListBox for WINDOW_TREELISTBOX controls
+
| Add testcommon/source/org/openoffice/test/vcl/widget/VclTreeListBox
+
| High
+
|
+
| Li Lin Yi
+
| 2012/07/27
+
|
+
|-
+
| Remove testtool component from installation package
+
| Currently testtool is included in the installation package. It should be removed. [http://comments.gmane.org/gmane.comp.apache.incubator.ooo.devel/21458 Discussion in Mailing list]
+
| High
+
|
+
| Liu Zhe
+
| 2012/08/03
+
|
+
|-
+
| Write the performance test script of launch cases
+
| Compare the launch performance of normal start and quick start
+
| High
+
|
+
| Liu Yi Xuan
+
| 2012/07/25
+
|
+
|-
+
| Write Presentation cases via UNO API
+
|
+
| High
+
|
+
| Wang Li Feng
+
|
+
|
+
|-
+
| Create new UNO API cases for Spreadsheet
+
|
+
| High
+
|
+
| Guo Bin
+
|
+
|
+
|-
+
| write text general case in word processor via UNO API
+
|
+
| High
+
|
+
| Du Jing
+
|
+
|
+
|-
+
|
+
|
+
|
+
|
+
|
+
|
+
|
+
|-
+
|}
+
  
==Documentation Task==
+
=Working with defect=
Task list here are documentation work related
+
{| class="prettytable" border="1" width="100%"
+
|-
+
| Task
+
| Brief description
+
| Complexity
+
| BZ ID
+
| Owner
+
| Due Day
+
| Completion Date
+
|-
+
| <s> Wiki Writing: How to report a bug </s>
+
| A guide for filling bug in Bugzilla
+
| High
+
|
+
| Yan Ji
+
|
+
| 2012/07/19
+
|-
+
|<s> Wiki Writing: How to write test case </s>
+
| A guide for writing test case
+
| High
+
|
+
| Yan Ji
+
| 2012/07/27
+
|
+
|-
+
| Wiki Writing: GUI test cases writing checklist
+
| Add to [[QA/vclauto]]
+
| High
+
| {{Bug|120324}}
+
| Li Lin Yi
+
| 2012/07/27
+
|
+
|-
+
| <s>Wiki Writing: Installer test cases </s>
+
| Add to [[QA/AOO341_TestCase/Installation]]
+
| Middle
+
|
+
| Lou Qing Le
+
|
+
| 2012/07/20
+
|-
+
| Wiki Writing: Performance Test Introduction
+
|
+
| Middle
+
|
+
| Liu Yi Xuan
+
| 2012/07/25
+
|
+
|-
+
|
+
|
+
|
+
|
+
|
+
|
+
|
+
|-
+
|}
+
  
== Intermediate ==
+
==Confirm “UNCONFIRMED" defect==
{| class="prettytable" border="1" width="100%"
+
|-
+
! Task
+
! Comments
+
! Contributor
+
! Due Date
+
! Completion Date
+
|-
+
| <s>Wiki Writing: How to report a bug</s>
+
| Done! The page is [[QA/HowToFileIssue]]
+
| Yan Ji
+
|
+
|
+
|-
+
| Wiki Writing: How to write test case
+
|
+
|
+
|
+
|
+
|-
+
| Wiki Writing: GUI test cases writing checklist
+
| Add to [[QA/vclauto]]<br />[https://issues.apache.org/ooo/show_bug.cgi?id=120324 Bug 120324]
+
| Li Lin Yi
+
| 20120727
+
|
+
|-
+
| Wiki Writing: Installer test cases
+
| Done. Add to [[QA/AOO341_TestCase/Installation]]
+
| Lou Qing Le
+
|
+
|
+
|-
+
| AOO 3.4.1 RC build installation testing
+
| clean install and upgrade from Aoo 3.4. On Win7, Win8, Ubuntu, Suse, Redhat and some 64-bit platforms.
+
  
Install language packages and check the language switching.
+
# Reading defect description carefully to get understand essential of the problem.
 +
# Based on the information provided verify whether the issue can be reproduced against latest build on all supported OS( the purpose of doing that is make sure  whether the problem is OS independent).
 +
# Identify regression. Try the defect against some old builds, e.g. released milestone build, to verify if the problem can also be reproduced too. If no, that means the issue is introduced after that build. This will help developer to locate how the defect is introduced.
 +
# Do problem determination (PD). After reproduce defect, analysis defect symptom and function implementation try to give suggestion from QA/end user perspective.
 +
# If the problem can be reproduced, change defect status to “CONFIRMED”, otherwise communicate with reporter to figure out the reproduce steps.
  
| Lou Qing Le
+
==Verify “RESOLVED” defect==
|2012/07/31
+
 
|
+
# Get latest build which include the fix.
|-
+
# Follow the reproduce steps on the OS which issue has been reported on, verify if the defect is able to be reproduced or not.
| AOO 3.4.1 RC build general testing
+
# If the defect cannot be reproduce, then update your verification result to defect’s comments.
|
+
# Based on your knowledge to identify which function area may be impacted by this bug fix to do impact testing.
|
+
# If no problem found in impact testing, update your test result to defect’s comments. Otherwise reject the defect or accept this fix and open another new defect for the issue just found.
|2012/07/31
+
# With all verify/test is passed, change defect status to “VERIFIED” and then change it to “CLOSED”
|
+
 
|-
+
==Open new defect==
| AOO 3.4.1 RC build release blocker defects verification
+
 
|
+
# When encounter problem while testing product functionality, e.g. running test case, or verifying defect, following this guide to fire bug [[QA/HowToFileIssue]]
| Wang Li Feng
+
 
|2012/07/31
+
=Working with manual testing=
|
+
 
|-
+
In AOO project, all manual testing assets, e.g. test case, test execution are store in Testlink system(http://aootesting.adfinis-sygroup.org/index.php) , with this system we can
| Automated Test: Let LongRun.java to output csv
+
 
| Get a clear trend using csv. [https://issues.apache.org/ooo/show_bug.cgi?id=120351 Bug 120351]
+
# Perform test case manually.
| Liu Zhe
+
# Write functionality test case
| 2012/07/24
+
 
| 2012/07/24
+
For Testlink system usage guide, please refer to [[QA/Testlink]]
|-
+
 
| Automated Test:Rename GUI test package name into testcase.gui
+
For how to write test case, please refer to [[QA/Testcase/How_to_write_test_case]] and sample test case [[QA/Testcase/Sample]]
| Avoid to conflict with uno test. [https://issues.apache.org/ooo/show_bug.cgi?id=120352 Bug 120352]
+
 
| Liu Zhe
+
 
| 2012/07/25
+
=Automation section=
|
+
'''Under Construction'''
|-
+
[[Category: Quality Assurance]]
| Wiki Writing: Performance Test Introduction
+
|
+
| Liu Yi Xuan
+
| 2012/07/25
+
|
+
|-
+
| Automated Test: Run perfromance test. Compare load/preload result
+
|
+
| Li Lin Yi
+
|
+
|
+
|}
+

Latest revision as of 09:49, 20 November 2012

Welcome

Welcome to Apache OpenOffice(aka AOO) community. As QA we are helping improve AOO product quality. In generally, we are working on defect handling, manual test, and automation test. If you are interest in QA and willing to make AOO better, don’t hesitate to work with us and contribute your idea and your effort.

QA volunteers please find tasks here:

QA Task List
Task Type Task Link Update Date
Defect Task QA/Tasks/DefectTask Last Update 2012/11/19
Test Case Task QA/Tasks/TestcaseTask Last Update 2012/11/20
Automation Scripts Task *placeholder*


Following reference for QA tasks

Working with defect

Confirm “UNCONFIRMED" defect

  1. Reading defect description carefully to get understand essential of the problem.
  2. Based on the information provided verify whether the issue can be reproduced against latest build on all supported OS( the purpose of doing that is make sure whether the problem is OS independent).
  3. Identify regression. Try the defect against some old builds, e.g. released milestone build, to verify if the problem can also be reproduced too. If no, that means the issue is introduced after that build. This will help developer to locate how the defect is introduced.
  4. Do problem determination (PD). After reproduce defect, analysis defect symptom and function implementation try to give suggestion from QA/end user perspective.
  5. If the problem can be reproduced, change defect status to “CONFIRMED”, otherwise communicate with reporter to figure out the reproduce steps.

Verify “RESOLVED” defect

  1. Get latest build which include the fix.
  2. Follow the reproduce steps on the OS which issue has been reported on, verify if the defect is able to be reproduced or not.
  3. If the defect cannot be reproduce, then update your verification result to defect’s comments.
  4. Based on your knowledge to identify which function area may be impacted by this bug fix to do impact testing.
  5. If no problem found in impact testing, update your test result to defect’s comments. Otherwise reject the defect or accept this fix and open another new defect for the issue just found.
  6. With all verify/test is passed, change defect status to “VERIFIED” and then change it to “CLOSED”

Open new defect

  1. When encounter problem while testing product functionality, e.g. running test case, or verifying defect, following this guide to fire bug QA/HowToFileIssue

Working with manual testing

In AOO project, all manual testing assets, e.g. test case, test execution are store in Testlink system(http://aootesting.adfinis-sygroup.org/index.php) , with this system we can

  1. Perform test case manually.
  2. Write functionality test case

For Testlink system usage guide, please refer to QA/Testlink

For how to write test case, please refer to QA/Testcase/How_to_write_test_case and sample test case QA/Testcase/Sample


Automation section

Under Construction

Personal tools