Test Case Management

The Test Case Management Portal (or in short TCM) is a web based portal for test case management (as the name states). This includes definition and translation of testcases as well as assigning test cases to specific testers and collecting the results.

General Information about TCM

TCM is developed and hosted by the Sun localization testing team. So, the initial focus of TCM is localization testing - not only for OOo. We are trying to extend the capabilities of TCM, so that it can be used for general testing tasks within the OOo project.

At the moment the OOo project is using the same TCM installation as the OpenSolaris project. This means, we use the same "program" but the data are distinct.

For a short introduction to TCM see about TCM. (The introduction is written for a successor of the current TCM. So the screens may differ from what you see in current TCM.

Roles in TCM

There are three (or four) roles in TCM:

• SQA (Software Quality Assurance)

Can view test cases, update results (pass/fail) per test case

• SQE (Software QA Engineer)

can modify (add, remove, translate) test cases

• MGR (Manager)

Has SQE access + can grant user access, assign tests to testers, enter new test cases / scenarios and create new test reports and report templates

All these roles are based on localizations. That means, every SQA / SQE / MGR belongs to one (ore more) localizations. SQA's will see test cases translated to their language, SQE's will be able to translate the cases to a given language. MGR can only assign tests to tester of the same localization.

The Manager of the en localization has some more rights. He is some kind of "Super Manager" (the fourth role).

Bugs in TCM

If you find bugs in TCM (the tool itself), you can use the OOo Issue Tracker to report them. Use category qa, subcategory tcm.

If you find bugs that apply to a test case (bug in OpenOffice.org) you need to file it for the appropiate Issue Tracker component. Don't use qa / tcm in this case.

You may ask at the dev@qa.openoffice.org mailinglist if something is unclear with TCM.

Doing your daily work

SQA tasks

Doing your tests

Before you can do any tests, you need to have assigned some tests to you. You should ask your manager to assign tests to you. (Ask at dev@qa.openoffice.org if you do not know, who "your manager" is).

• Login to TCM

Login to TCM with your username and password

• Go to "Test Result Update"

after login, you will see some menu items (depending on your role). You need to go to "Test Result Update" (Item #2, if you have SQA role only)

• Select the Build number

in the next screen you will see a list of build numbers you have tests assigned for. In most cases you should only see one or two builds. Follow the link in column "Build Number" for the build you are going to test.

• Select the assigned test scenario

you will now see all of your assigned tests for the selected build. Do not click on the assignment id (although this seems obvious, it is wrong). Follow the link in column "Assign by" instead.

If you have already done some of your tests, you may follow the link in column U (click on the number). You will see only untested cases in the next screen.

• enter your results

you will no see all test cases of the scenario. Each test case has a short description (what to do) and the information, what results are expected.

At the top of each test case you will see option buttons. Select "pass" if the test meets the expected result. Select "fail" if not. You may also "skip" a test if you are not sure if you understand the description (or if it is not important for the current test). If you do not have the time to complete a test, leave it "untested".

In case, the test fails, you should file an issue and put the issue id to the input box "bug".

You may also leave a comment about the test. Your manager will be able to read the comments and may have better information about the quality of the build.

• update your results

navigate to the bottom of the page and "update" the results. You should do this from time to time, even if you entered only some of your results.

Hint: There is an option to download the test case descriptions in step 4. You will see a "download" link in the right most column. You may download a plain text file here. (In case your browser is going to save the file as .cgi, simply rename it to .txt). You may open the file with any text editor. The File header has some information about the file format. So you should be able to enter your test results offline. Once, your test has been completed and all results have been entered to the file, you can upload it again. You can do this again in step 4. Enter the file name (full file path and name) in the input box on top of the table. Then press "upload".

Report Issues for failed tests

If a test failes, you should file an issue at the OpenOffice.org Issue Tracker. For such an issue, the issue writing guidelines apply.

As not every developer or member of the qa project has access to TCM, repeat the steps that lead to the problem in the issue.

It is planned to be able to see test case descriptions in TCM without being logged in. Once this has been implemented, you may enter a link to the test case description in Issue Tracker.