Difference between revisions of "QA/QA Tasks"

From Apache OpenOffice Wiki
< QA
Jump to: navigation, search
m (moved QA/Tasks to QA/QA Tasks)
Line 1: Line 1:
'''Don't know how to contribute to QA? Read the page to get a clue.''' <br />
+
{{DISPLAYTITLE: QA Tasks}}
 +
Welcome to Apache OpenOffice(aka AOO) community. As QA we are helping improve AOO product quality. In generally, we are working on defect handling, manual test, and automation test. If you are interest in QA and willing to make AOO better, don’t hesitate to work with us and contribute your idea and your effort.
  
The following table records the short-term tasks which you can help currently. The tasks are easy and make you get involved quickly. If you are interested in some ones, please add your name and due date in the table, then create a task in [https://issues.apache.org/ooo/ bugzilla]. When you finish the task, please fill the completion date and make the row strikethrough.  Besides these tasks, there are a lot of long-term QA task to do. Talk in the mailing list ooo-qa@incubator.apache.org when you are confused.
+
=Working with defect=
  
== Release Testing Task==
+
==Confirm defect which its status is “UNCONFIRMED”==
Task list here are test activity before product release
+
{| class="prettytable" border="1" width="100%"
+
|-
+
| Task
+
| Brief description
+
| Complexity
+
| BZ ID
+
| Owner
+
| Due Day
+
| Completion Date
+
|-
+
|<s> AOO 3.4.1 RC1 Testing</s>
+
| Test RC1 rev 1364591
+
| Middle
+
| {{Bug|120363}}
+
| Yan Ji
+
| 2012/07/30
+
|
+
|-
+
| <s>AOO 3.4.1 RC Testing</s>
+
| Test RC rev 1369843
+
| Middle
+
| {{Bug|120532}}
+
| Yan Ji
+
| 2012/08/12
+
| 2012/08/10
+
|-
+
| AOO 3.4.1 RC Testing
+
| Test RC rev 1371686
+
| Middle
+
| {{Bug|120543}}
+
| Yan Ji
+
| 2012/08/17
+
|
+
|-
+
  
|
+
# Reading defect description carefully to get understand essential of the problem.
|
+
# Based on the information provided verify whether the issue can be reproduced against latest build on all supported OS( the purpose of doing that is make sure  whether the problem is OS independent).
|
+
# Identify regression. Try the defect against some old builds, e.g. released milestone build, to verify if the problem can also be reproduced too. If no, that means the issue is introduced after that build. This will help developer to locate how the defect is introduced.
|
+
# Do problem determination (PD). After reproduce defect, analysis defect symptom and function implementation try to give suggestion from QA/end user perspective.
|
+
# If the problem can be reproduced, change defect status to “CONFIRMED”, otherwise communicate with reporter to figure out the reproduce steps.
|
+
|
+
|-
+
|}
+
  
==Test case Task==
+
==Verify defect which its status is “RESOLVED”==
Task list here are test case related work
+
{| class="prettytable" border="1" width="100%"
+
|-
+
| Task
+
| Brief description
+
| Complexity
+
| BZ ID
+
| Owner
+
| Due Day
+
| Completion Date
+
|-
+
|
+
|
+
|
+
|
+
|
+
|
+
|
+
|-
+
|
+
|
+
|
+
|
+
|
+
|
+
|
+
|-
+
|}
+
  
==Test Execution Task==
+
# Get latest build which include the fix.
Tasks list here are test case execution related
+
# Follow the reproduce steps on the OS which issue has been reported on, verify if the defect is able to be reproduced or not.
{| class="prettytable" border="1" width="100%"
+
# If the defect cannot be reproduce, then update your verification result to defect’s comments.
|-
+
# Based on your knowledge to identify which function area may be impacted by this bug fix to do impact testing.
| Task
+
# If no problem found in impact testing, update your test result to defect’s comments. Otherwise reject the defect or accept this fix and open another new defect for the issue just found.
| Brief description
+
# With all verify/test is passed, change defect status to “VERIFIED” and then change it to “CLOSED”
| Complexity
+
| BZ ID
+
| Owner
+
| Due Day
+
| Completion Date
+
|-
+
| <s>Run Build Verification Test on AOO r1364591</s>
+
| Add report to [[QA/Report/BVT]]
+
|
+
|
+
| Li Lin Yi
+
| 2012-07-27
+
| Build canceled.
+
|-
+
| Run PVT on AOO r1364591
+
| Add report to [[QA/AOO341_PVTResult]]
+
|
+
| 120364
+
| Liu Yi Xuan
+
| 2012-07-27
+
| 2012-07-26
+
|-
+
| <s>Run Build Verification Test on AOO r1366353</s>
+
| Add report to [[QA/Report/BVT]]
+
|
+
| {{Bug|120407}}
+
| Li Lin Yi
+
| 2012-08-01
+
| 2012-08-01
+
|-
+
| <s>Run Build Verification Test on AOO r1367911</s>
+
| Add report to [[QA/Report/BVT]]
+
|
+
|
+
| Li Lin Yi
+
| 2012-08-03
+
| 2012-08-03<br />No linux report, because no linux build.
+
|-
+
| <s>Run Automation Test on AOO r1367911</s>
+
| Add report to [[QA/Report/FVT]]
+
|
+
|
+
| Li Lin Yi
+
| 2012-08-03
+
| 2012-08-03<br />Only winodws report. Because Mac has problem, will fix next week. No linux build.
+
|-
+
| Run PVT on AOO 1371686
+
| Add report to [[QA/AOO341_PVTResult]]
+
|
+
| {{Bug|120407}}
+
| Liu Yi Xuan
+
| 2012-08-17
+
| 2012-08-17
+
|}
+
  
==Automation Script Task==
+
==Open new defect==
Tasks list here are automation script related work
+
{| class="prettytable" border="1" width="100%"
+
|-
+
| Task
+
| style="width:400px" | Brief description
+
| Complexity
+
| BZ ID
+
| Owner
+
| Due Day
+
| Completion Date
+
|-
+
| <s>Let LongRun.java to output csv </s>
+
| Get a clear trend using csv
+
| Middle
+
| {{Bug|120351}}
+
| Liu Zhe
+
| 2012/07/24
+
| 2012/07/24
+
|-
+
| <s>Rename GUI test package name into testcase.gui</s>
+
| Avoid to conflict with uno test
+
| Middle
+
| {{Bug|120352}}
+
| Liu Zhe
+
| 2012/07/25
+
| 2012/07/25
+
|-
+
| Silent install/uninstall
+
| Need update "test/testoo/build.xml" <br>
+
|High
+
| {{Bug|120322}}
+
| Lou Qing Le
+
| 2012/08/01
+
|
+
|-
+
| <s>[Automation][uno]Check Character style in SD</s>
+
+
|High
+
| {{Bug|120562}}
+
| Lou Qing Le
+
| 2012/08/15
+
| 2012/08/15
+
|-
+
| <s>[testuno]Check the Build-In Bullet</s>
+
+
|High
+
| {{Bug|120631}}
+
| Lou Qing Le
+
| 2012/08/21
+
| 2012/08/21
+
|-
+
|<s> [testuno]Check Bullet Style in SD</s>
+
|
+
|High
+
|{{Bug|120632}}
+
|Lou Qing Le
+
|2012/8/23
+
|2012/8/23
+
|-
+
| [testuno]Check the Build-In graphic bullet(gallery-bullets)
+
+
|High
+
| {{Bug|120687}}
+
| Lou Qing Le
+
| 2012/08/28
+
|
+
|-
+
| [testuno]Select a graphic from file as graphic bullet in SD
+
+
|High
+
| {{Bug|120731}}
+
| Lou Qing Le
+
| 2012/08/28
+
|
+
|-
+
| [testuno]Check the numbering bullet types and properties
+
+
|High
+
| {{Bug|120754}}
+
| Lou Qing Le
+
| 2012/08/28
+
|
+
|-
+
| [testuno]Check File Properties
+
+
|High
+
| {{Bug|120840}}
+
| Lou Qing Le
+
| 2012/09/07
+
|
+
|-
+
| [testuno]Check Graphic position and size
+
+
|High
+
| {{Bug|120968}}
+
| Lou Qing Le
+
| 2012/09/14
+
|
+
|-
+
| [testuno]check graphic border: line color and line style
+
+
|High
+
| {{Bug|120989}}
+
| Lou Qing Le
+
| 2012/09/17
+
|
+
|-
+
| <s>Refactor the test code under testcase.sc.*</s>
+
| Make sure the classes can run against AOO. Merge related classes into one class
+
| High
+
| {{Bug|120321}}
+
| Li Lin Yi
+
| 2012/07/20
+
| 2012/07/20
+
|-
+
| <s>Make test code under testcase.sc/sw/sd.* language-neutral</s>
+
| Make sure the classes can run against AOO en-US/zh-CN/zh-TW build.
+
| High
+
| {{Bug|120323}}
+
| Li Lin Yi
+
| 2012/07/25
+
| 2012/07/25
+
|-
+
| Convert the complex test in sw/qa to testuno project
+
|
+
| High
+
|
+
|
+
|
+
|
+
|-
+
| Convert the complex test in sc/qa to testuno project
+
|
+
| High
+
|
+
|
+
|
+
|
+
|-
+
| Convert the complex test in sd/qa to testuno project
+
|
+
| High
+
|
+
|
+
|
+
|
+
|-
+
| Move ant scripts from testgui to test module root
+
|
+
| High
+
| {{Bug|120510}}
+
| Liu Zhe
+
| 2012/08/10
+
|
+
|-
+
| <s>Create new UNO API test project</s>
+
|
+
| High
+
| {{Bug|120320}}
+
| Liu Zhe
+
| 2012/07/20
+
| 2012/07/20
+
|-
+
| Create VclTreeListBox for WINDOW_TREELISTBOX controls
+
| Add testcommon/source/org/openoffice/test/vcl/widget/VclTreeListBox
+
| High
+
| {{Bug|120384}}
+
| Li Lin Yi
+
| 2012/07/27
+
|
+
|-
+
| Remove testtool component from installation package
+
| Currently testtool is included in the installation package. It should be removed. [http://comments.gmane.org/gmane.comp.apache.incubator.ooo.devel/21458 Discussion in Mailing list]
+
| High
+
| {{Bug|120399}}
+
| Liu Zhe
+
| 2012/08/03
+
|
+
|-
+
| Write the performance test script of launch cases
+
| Compare the launch performance of normal start and quick start
+
| High
+
|
+
| Liu Yi Xuan
+
| 2012/07/25
+
|
+
|-
+
| <s>Write Database cases via UNO API </s>
+
| Write sample database cases via UNO API
+
| High
+
| {{Bug|120525}}
+
| Wang Li Feng
+
| 2012/08/10
+
| 2012/08/10
+
|-
+
| <s>Write Presentation Shape cases via UNO API </s>
+
| Write Presentation Shape cases via UNO API
+
| High
+
| {{Bug|120527}}
+
| Wang Li Feng
+
| 2012/08/20
+
| 2012/08/20
+
|-
+
| Create new UNO API cases for Spreadsheet
+
|
+
| High
+
|
+
| Guo Bin
+
|
+
|
+
|-
+
| write text general case in word processor via UNO API
+
|
+
| High
+
|
+
| Du Jing
+
|
+
|
+
|-
+
| Modify PVT script to support on Linux and Mac Platform
+
| With this modification, PVT could run on Windows and Linux platforms and could track memory info
+
| High
+
|{{Bug|120394}}
+
| Liu Yi Xuan
+
| 2012/07/27
+
|
+
|-
+
| Spreadsheet VclAuto test script development.
+
| Fix the issue that can not get menu item for VclAuto script.
+
Create insert sheet(s) test script.
+
| High
+
|{{Bug|120218}}
+
| Zhu Shan
+
| 2012/07/09
+
| 2012/07/09
+
|-
+
| Spreadsheet UNO API test script development.
+
| Parameterized test case sample created for formula checking.
+
| High
+
|{{Bug|120558}}
+
| Zhu Shan
+
| 2012/08/13
+
| 2012/08/13
+
|-
+
| Spreadsheet UNO API test script development.
+
| Spreadsheet UNO API utility methods development in package testuon.testlib.uno
+
| High
+
|
+
| Zhu Shan
+
|
+
|
+
|-
+
| <s>Presentation Shape Properties test script development via UNO API</s>
+
| Presentation Shape Properties test script development via UNO API
+
| High
+
|{{Bug|120645}}
+
| Wang LiFeng
+
| 2012/08/24
+
| 2012/08/24
+
|-
+
|<s> Presentation Shape type test script development via UNO API</s>
+
| Presentation Shape type test script development via UNO API
+
| High
+
|{{Bug|120733}}
+
| Wang LiFeng
+
| 2012/08/28
+
| 2012/08/28
+
|-
+
| <s>Presentation Chart type test script development via UNO API</s>
+
| Presentation Chart type test script development via UNO API
+
| High
+
|{{Bug|120734}}
+
| Wang LiFeng
+
| 2012/08/31
+
| 2012/08/29
+
|-
+
| <s>Presentation Chart properties test script development via UNO API</s>
+
| Presentation Chart properties test script development via UNO API
+
| High
+
|{{Bug|120794}}
+
| Wang LiFeng
+
| 2012/09/07
+
| 2012/09/06
+
|-
+
| <s>Presentation Text box test script development via UNO API</s>
+
| Presentation Text box test script development via UNO API
+
| High
+
|{{Bug|120955}}
+
| Wang LiFeng
+
| 2012/09/14
+
| 2012/09/14
+
|-
+
|}
+
  
==Documentation Task==
+
# When encounter problem while testing product functionality, e.g. running test case, or verifying defect, following this guide to fire bug [[QA/HowToFileIssue]]
Task list here are documentation work related
+
{| class="prettytable" border="1" width="100%"
+
|-
+
| Task
+
| Brief description
+
| Complexity
+
| BZ ID
+
| Owner
+
| Due Day
+
| Completion Date
+
|-
+
| <s> Wiki Writing: How to report a bug </s>
+
| A guide for filling bug in Bugzilla
+
| High
+
|
+
| Yan Ji
+
|
+
| 2012/07/19
+
|-
+
|<s> Wiki Writing: How to write test case </s>
+
| A guide for writing test case
+
| High
+
|
+
| Yan Ji
+
| 2012/07/27
+
|
+
|-
+
| <s>Wiki Writing: GUI test cases writing checklist</s>
+
| Add to [[QA/vclauto]]
+
| High
+
| {{Bug|120324}}
+
| Li Lin Yi
+
| 2012/07/27
+
| 2012/07/26
+
|-
+
| <s>Wiki Writing: Installer test cases </s>
+
| Add to [[QA/AOO341_TestCase/Installation]]
+
| Middle
+
|
+
| Lou Qing Le
+
|
+
| 2012/07/20
+
|-
+
| Wiki Writing: Performance Test Introduction
+
|
+
| Middle
+
|
+
| Liu Yi Xuan
+
| 2012/07/25
+
|
+
|-
+
|<s>Wiki Writing: Database Usage</s>
+
| Done! [[QA/Database]]
+
[[How_Tos|Document/How_Tos/Database]]
+
| Middle
+
|
+
| Wang Li Feng
+
| 2012/08/01
+
| 2012/08/01
+
|-
+
|-
+
|<s>Wiki Writing: TestLink Usage</s>
+
| (Done!)Mainly usage of Testlink [[QA/TestLink]]
+
| High
+
|
+
| Wang Li Feng
+
| 2012/08/15
+
| 2012/08/15
+
|-
+
|Wiki Writing: SVT memory leak report
+
| [[QA/SVT]]  
+
| Middle
+
|
+
| Wang Li Feng
+
|
+
|
+
|-
+
|}
+
  
[[Category:Quality Assurance]]
+
''Defect confirmation task goes here:''
 +
 
 +
''xxxxx''
 +
 
 +
 
 +
 
 +
''Defect verification task goes here:''
 +
 
 +
''xxxxx''
 +
 
 +
 
 +
 
 +
=Working with manual testing=
 +
 
 +
In AOO project, all manual testing assets, e.g. test case, test execution are store in Testlink system(http://aootesting.adfinis-sygroup.org/index.php) , with this system we can
 +
 
 +
# Perform test case manually.
 +
# Write functionality test case
 +
 
 +
For Testlink system usage guide, please refer to [[QA/Testlink]]
 +
 
 +
 
 +
 
 +
Manual test execution task goes here:
 +
 
 +
xxxx
 +
 
 +
 
 +
 
 +
Test case writing task goes here:
 +
 
 +
xxxx
 +
 
 +
 
 +
 
 +
=Automation section=

Revision as of 15:56, 19 November 2012

Welcome to Apache OpenOffice(aka AOO) community. As QA we are helping improve AOO product quality. In generally, we are working on defect handling, manual test, and automation test. If you are interest in QA and willing to make AOO better, don’t hesitate to work with us and contribute your idea and your effort.

Working with defect

Confirm defect which its status is “UNCONFIRMED”

  1. Reading defect description carefully to get understand essential of the problem.
  2. Based on the information provided verify whether the issue can be reproduced against latest build on all supported OS( the purpose of doing that is make sure whether the problem is OS independent).
  3. Identify regression. Try the defect against some old builds, e.g. released milestone build, to verify if the problem can also be reproduced too. If no, that means the issue is introduced after that build. This will help developer to locate how the defect is introduced.
  4. Do problem determination (PD). After reproduce defect, analysis defect symptom and function implementation try to give suggestion from QA/end user perspective.
  5. If the problem can be reproduced, change defect status to “CONFIRMED”, otherwise communicate with reporter to figure out the reproduce steps.

Verify defect which its status is “RESOLVED”

  1. Get latest build which include the fix.
  2. Follow the reproduce steps on the OS which issue has been reported on, verify if the defect is able to be reproduced or not.
  3. If the defect cannot be reproduce, then update your verification result to defect’s comments.
  4. Based on your knowledge to identify which function area may be impacted by this bug fix to do impact testing.
  5. If no problem found in impact testing, update your test result to defect’s comments. Otherwise reject the defect or accept this fix and open another new defect for the issue just found.
  6. With all verify/test is passed, change defect status to “VERIFIED” and then change it to “CLOSED”

Open new defect

  1. When encounter problem while testing product functionality, e.g. running test case, or verifying defect, following this guide to fire bug QA/HowToFileIssue

Defect confirmation task goes here:

xxxxx


Defect verification task goes here:

xxxxx


Working with manual testing

In AOO project, all manual testing assets, e.g. test case, test execution are store in Testlink system(http://aootesting.adfinis-sygroup.org/index.php) , with this system we can

  1. Perform test case manually.
  2. Write functionality test case

For Testlink system usage guide, please refer to QA/Testlink


Manual test execution task goes here:

xxxx


Test case writing task goes here:

xxxx


Automation section

Personal tools