Difference between revisions of "QA/QA Tasks"

From Apache OpenOffice Wiki
< QA
Jump to: navigation, search
(Beginner)
 
(86 intermediate revisions by 9 users not shown)
Line 1: Line 1:
'''Don't know how to contribute to QA? Read the page to get a clue.''' <br />
+
{{DISPLAYTITLE: QA Tasks}}
 +
'''Welcome'''
  
The following table records the short-term tasks which you can help currently. The tasks are easy and make you get involved quickly. If you are interested in some ones, please add your name and due date in the table, then create a task in [https://issues.apache.org/ooo/ bugzilla]. When you finish the task, please fill the completion date and make the row strikethrough.  Besides these tasks, there are a lot of long-term QA task to do. Talk in the mailing list ooo-qa@incubator.apache.org when you are confused.
+
Welcome to Apache OpenOffice(aka AOO) community. As QA we are helping improve AOO product quality. In generally, we are working on defect handling, manual test, and automation test. If you are interest in QA and willing to make AOO better, don’t hesitate to work with us and contribute your idea and your effort.
  
== Release Testing ==
+
QA volunteers please find tasks here:
{| class="prettytable" border="1" width="100%"
+
 
 +
{| width="50%" class="wikitable"
 +
|+ '''QA Task List'''
 
|-
 
|-
! Task
+
! Task Type
! Brief description
+
! Task Link
! Complexity
+
! Update Date
! BZ ID
+
! Owner
+
! Due Day
+
! Completion Date
+
 
|-
 
|-
! AOO 3.4.1 RC1 build installation testing
+
| Defect Task
! Test RC1 build installer
+
| [[QA/Tasks/DefectTask]]
! Middle
+
| Last Update 2012/11/19
! {{Bug|120354}}
+
!
+
! 2012/07/30
+
!
+
 
|-
 
|-
 +
| Test Case Task
 +
| [[QA/Tasks/TestcaseTask]]
 +
| Last Update 2012/11/20
 
|-
 
|-
! AOO 3.4.1 RC1 build general testing
+
| Automation Scripts Task
! RC1 build general testing
+
| *placeholder*
! Middle
+
|  
! {{Bug|120355 }}
+
!
+
! 2012/07/30
+
!
+
 
|}
 
|}
  
== Intermediate ==
 
{| class="prettytable" border="1" width="100%"
 
|-
 
! Task
 
! Comments
 
! Contributor
 
! Due Date
 
! Completion Date
 
|-
 
| <s>Wiki Writing: How to report a bug</s>
 
| Done! The page is [[QA/HowToFileIssue]]
 
| Yan Ji
 
|
 
|
 
|-
 
| Wiki Writing: How to write test case
 
|
 
|
 
|
 
|
 
|-
 
| Wiki Writing: GUI test cases writing checklist
 
| Add to [[QA/vclauto]]<br />[https://issues.apache.org/ooo/show_bug.cgi?id=120324 Bug 120324]
 
| Li Lin Yi
 
| 20120727
 
|
 
|-
 
| Wiki Writing: Installer test cases
 
| Done. Add to [[QA/AOO341_TestCase/Installation]]
 
| Lou Qing Le
 
|
 
|
 
|-
 
| AOO 3.4.1 RC build installation testing
 
| clean install and upgrade from Aoo 3.4. On Win7, Win8, Ubuntu, Suse, Redhat and some 64-bit platforms.
 
  
Install language packages and check the language switching.
+
'''Following reference for QA tasks'''
  
| Lou Qing Le
+
=Working with defect=
|2012/07/31
+
|
+
|-
+
| AOO 3.4.1 RC build general testing
+
|
+
|
+
|2012/07/31
+
|
+
|-
+
| AOO 3.4.1 RC build release blocker defects verification
+
|
+
| Wang Li Feng
+
|2012/07/31
+
|
+
|-
+
| Automated Test: Let LongRun.java to output csv
+
| Get a clear trend using csv. [https://issues.apache.org/ooo/show_bug.cgi?id=120351 Bug 120351]
+
| Liu Zhe
+
| 2012/07/24
+
| 2012/07/24
+
|-
+
| Automated Test:Rename GUI test package name into testcase.gui
+
| Avoid to conflict with uno test. [https://issues.apache.org/ooo/show_bug.cgi?id=120352 Bug 120352]
+
| Liu Zhe
+
| 2012/07/25
+
|
+
|-
+
| Wiki Writing: Performance Test Introduction
+
|
+
| Liu Yi Xuan
+
| 2012/07/25
+
|
+
|-
+
| Wiki Writing: Database Usage
+
|
+
| Wang Li Feng
+
|
+
|
+
|-
+
| Wiki Writing: Main data model of Presentation.
+
|
+
| Wang Li Feng
+
|
+
|
+
|-
+
| Automated Test: Run perfromance test. Compare load/preload result
+
|
+
| Li Lin Yi
+
|
+
|
+
|}
+
  
== Advanced ==
+
==Confirm “UNCONFIRMED" defect==
{| class="prettytable" border="1" width="100%"
+
|-
+
! Task
+
! Comments
+
! Contributor
+
! Due Date
+
! Completion Date
+
|-
+
| Automated Test: install/uninstall silently OpenOffice installation package (Not the archive package).
+
| Need update "test/testoo/build.xml"
+
  
[https://issues.apache.org/ooo/show_bug.cgi?id=120322 Bug 120322]
+
# Reading defect description carefully to get understand essential of the problem.
 +
# Based on the information provided verify whether the issue can be reproduced against latest build on all supported OS( the purpose of doing that is make sure  whether the problem is OS independent).
 +
# Identify regression. Try the defect against some old builds, e.g. released milestone build, to verify if the problem can also be reproduced too. If no, that means the issue is introduced after that build. This will help developer to locate how the defect is introduced.
 +
# Do problem determination (PD). After reproduce defect, analysis defect symptom and function implementation try to give suggestion from QA/end user perspective.
 +
# If the problem can be reproduced, change defect status to “CONFIRMED”, otherwise communicate with reporter to figure out the reproduce steps.
  
1. write a .bat for silent install on windows -- Done
+
==Verify “RESOLVED” defect==
  
2. write script for silent uninstall on windows -- Done
+
# Get latest build which include the fix.
 +
# Follow the reproduce steps on the OS which issue has been reported on, verify if the defect is able to be reproduced or not.
 +
# If the defect cannot be reproduce, then update your verification result to defect’s comments.
 +
# Based on your knowledge to identify which function area may be impacted by this bug fix to do impact testing.
 +
# If no problem found in impact testing, update your test result to defect’s comments. Otherwise reject the defect or accept this fix and open another new defect for the issue just found.
 +
# With all verify/test is passed, change defect status to “VERIFIED” and then change it to “CLOSED”
  
3. update build.xml to run the scripts on windows
+
==Open new defect==
4. write script file for silent install for DEB
+
 
5. investigate the command of uninstall openoffice DEB package
+
# When encounter problem while testing product functionality, e.g. running test case, or verifying defect, following this guide to fire bug [[QA/HowToFileIssue]]
6. update build.xml to run the script on Ubuntu
+
 
7. write script file for silent install for RPM
+
=Working with manual testing=
8. investigate the command of uninstall openoffice RPM package
+
 
9. update build.xml to run the script on suse/redhat
+
In AOO project, all manual testing assets, e.g. test case, test execution are store in Testlink system(http://aootesting.adfinis-sygroup.org/index.php) , with this system we can
| Lou Qing Le
+
 
|
+
# Perform test case manually.
|
+
# Write functionality test case
|-
+
 
| Automated Test: Refactor the test code under testcase.sc.*
+
For Testlink system usage guide, please refer to [[QA/Testlink]]
| Make sure the classes can run against AOO. Merge related classes into one class.<br />[https://issues.apache.org/ooo/show_bug.cgi?id=120321 Bug 120321]
+
 
| Li Lin Yi
+
For how to write test case, please refer to [[QA/Testcase/How_to_write_test_case]] and sample test case [[QA/Testcase/Sample]]
| 2012-07-20
+
 
| 2012-07-20
+
 
|-
+
=Automation section=
| Automated Test: Make test code under testcase.sc/sw/sd.* language-neutral
+
'''Under Construction'''
| Make sure the classes can run against AOO en-US/zh-CN/zh-TW build.<br />[https://issues.apache.org/ooo/show_bug.cgi?id=120323 Bug 120323]
+
[[Category: Quality Assurance]]
| Li Lin Yi
+
| 2012-07-25
+
|
+
|-
+
| Automated Test: Convert the complex test in sw/qa to testuno project
+
|
+
|
+
|
+
|
+
|-
+
| Automated Test: Convert the complex test in sc/qa to testuno project
+
|
+
|
+
|
+
|
+
|-
+
| Automated Test: Convert the complex test in sd/qa to testuno project
+
|
+
|
+
|
+
|
+
|-
+
| Automated Test: Make performance testing support Linux and Mac OS
+
| testcase.performance.benchmark only supports Windows now.
+
|
+
|
+
|
+
|-
+
| Automated Test: Create new UNO API test project
+
| [https://issues.apache.org/ooo/show_bug.cgi?id=120320 Bug 120320]
+
| Liu Zhe
+
| 2012-7-20
+
| 2012-7-20
+
|-
+
| Automated Test: Create VclTreeListBox for WINDOW_TREELISTBOX controls
+
| Add testcommon/source/org/openoffice/test/vcl/widget/VclTreeListBox
+
| Li Lin Yi
+
| 2012-7-27
+
|
+
|-
+
| Automated Test: Remove testtool component from installation package
+
| Currently testtool is included in the installation package. It should be removed. [http://comments.gmane.org/gmane.comp.apache.incubator.ooo.devel/21458 Discussion in Mailing list]
+
|
+
|
+
|
+
|-
+
| Performance Test: Write the performance test script of launch cases
+
| Compare the launch performance of normal start and quick start
+
| Liu Yi Xuan
+
| 2012-7-25
+
|
+
|-
+
| Performance Test: Run Performance Test on new RC build
+
|
+
| Liu Yi Xuan
+
| 2012-7-27
+
|
+
|-
+
| Automated Test: Write basic database cases via UNO API
+
|
+
| Wang Li Feng
+
|
+
|
+
|-
+
| Automated Test: Create new UNO API cases for Spreadsheet
+
|
+
| Guo Bin
+
|
+
|
+
|-
+
|Automated Test:write text general case in word processor  via UNO API
+
|
+
|Du Jing
+
|
+
|
+
|}
+

Latest revision as of 09:49, 20 November 2012

Welcome

Welcome to Apache OpenOffice(aka AOO) community. As QA we are helping improve AOO product quality. In generally, we are working on defect handling, manual test, and automation test. If you are interest in QA and willing to make AOO better, don’t hesitate to work with us and contribute your idea and your effort.

QA volunteers please find tasks here:

QA Task List
Task Type Task Link Update Date
Defect Task QA/Tasks/DefectTask Last Update 2012/11/19
Test Case Task QA/Tasks/TestcaseTask Last Update 2012/11/20
Automation Scripts Task *placeholder*


Following reference for QA tasks

Working with defect

Confirm “UNCONFIRMED" defect

  1. Reading defect description carefully to get understand essential of the problem.
  2. Based on the information provided verify whether the issue can be reproduced against latest build on all supported OS( the purpose of doing that is make sure whether the problem is OS independent).
  3. Identify regression. Try the defect against some old builds, e.g. released milestone build, to verify if the problem can also be reproduced too. If no, that means the issue is introduced after that build. This will help developer to locate how the defect is introduced.
  4. Do problem determination (PD). After reproduce defect, analysis defect symptom and function implementation try to give suggestion from QA/end user perspective.
  5. If the problem can be reproduced, change defect status to “CONFIRMED”, otherwise communicate with reporter to figure out the reproduce steps.

Verify “RESOLVED” defect

  1. Get latest build which include the fix.
  2. Follow the reproduce steps on the OS which issue has been reported on, verify if the defect is able to be reproduced or not.
  3. If the defect cannot be reproduce, then update your verification result to defect’s comments.
  4. Based on your knowledge to identify which function area may be impacted by this bug fix to do impact testing.
  5. If no problem found in impact testing, update your test result to defect’s comments. Otherwise reject the defect or accept this fix and open another new defect for the issue just found.
  6. With all verify/test is passed, change defect status to “VERIFIED” and then change it to “CLOSED”

Open new defect

  1. When encounter problem while testing product functionality, e.g. running test case, or verifying defect, following this guide to fire bug QA/HowToFileIssue

Working with manual testing

In AOO project, all manual testing assets, e.g. test case, test execution are store in Testlink system(http://aootesting.adfinis-sygroup.org/index.php) , with this system we can

  1. Perform test case manually.
  2. Write functionality test case

For Testlink system usage guide, please refer to QA/Testlink

For how to write test case, please refer to QA/Testcase/How_to_write_test_case and sample test case QA/Testcase/Sample


Automation section

Under Construction

Personal tools