Difference between revisions of "SL/Test Case Management"

From Apache OpenOffice Wiki
Jump to: navigation, search
(Created page with 'Category:Quality AssuranceCategory:Sl.openoffice.org Portal TCM (angl. Test Case Management ali upravljanje s preizkusi) je spletni portal za upravljanje s preizkusnimi …')
 
(Doing your daily work)
Line 36: Line 36:
 
You may ask at the dev@qa.openoffice.org mailinglist if something is unclear with TCM.
 
You may ask at the dev@qa.openoffice.org mailinglist if something is unclear with TCM.
  
= Doing your daily work =
+
= Opravljanje dnevnega dela =
  
 
== Naloge SQA ==
 
== Naloge SQA ==
  
=== Doing your tests ===
+
=== Izvajanje preizkusov ===
  
Before you can do any tests, you need to have assigned some tests to you. You should ask your manager to assign tests to you. (Ask at dev@qa.openoffice.org if you do not know, who "your manager" is).
+
Preden lahko izvedete preizkuse, vam morajo biti preizkusi dodeljeni. You should ask your manager to assign tests to you. (Ask at dev@qa.openoffice.org if you do not know, who "your manager" is).
  
 
* Prijavite se v TCM
 
* Prijavite se v TCM
Line 57: Line 57:
 
: If you have already done some of your tests, you may follow the link in column U (click on the number). You will see only untested cases in the next screen.
 
: If you have already done some of your tests, you may follow the link in column U (click on the number). You will see only untested cases in the next screen.
  
* Enter your results
+
* Vnesite rezultate
 
: you will no see all test cases of the scenario. Each test case has a short description (what to do) and the information, what results are expected.
 
: you will no see all test cases of the scenario. Each test case has a short description (what to do) and the information, what results are expected.
 
:  At the top of each test case you will see option buttons. Select "pass" if the test meets the expected result. Select "fail" if not. You may also "skip" a test if you are not sure if you understand the description (or if it is not important for the current test). If you do not have the time to complete a test, leave it "untested".
 
:  At the top of each test case you will see option buttons. Select "pass" if the test meets the expected result. Select "fail" if not. You may also "skip" a test if you are not sure if you understand the description (or if it is not important for the current test). If you do not have the time to complete a test, leave it "untested".
Line 63: Line 63:
 
: You may also leave a comment about the test. Your manager will be able to read the comments and may have better information about the quality of the build.
 
: You may also leave a comment about the test. Your manager will be able to read the comments and may have better information about the quality of the build.
  
* Update your results
+
* Posodobite rezultate
 
: navigate to the bottom of the page and "update" the results. You should do this from time to time, even if you entered only some of your results.
 
: navigate to the bottom of the page and "update" the results. You should do this from time to time, even if you entered only some of your results.
  
Line 70: Line 70:
 
There is an option to download the test case descriptions in step 4. You will see a "download" link in the right most column. You may download a plain text file here. (In case your browser is going to save the file as .cgi, simply rename it to .txt).
 
There is an option to download the test case descriptions in step 4. You will see a "download" link in the right most column. You may download a plain text file here. (In case your browser is going to save the file as .cgi, simply rename it to .txt).
 
You may open the file with any text editor. The File header has some information about the file format. So you should be able to enter your test results offline.
 
You may open the file with any text editor. The File header has some information about the file format. So you should be able to enter your test results offline.
Once, your test has been completed and all results have been entered to the file, you can upload it again. You can do this again in step 4. Enter the file name (full file path and name) in the input box on top of the table. Then press "upload".
+
Once, your test has been completed and all results have been entered to the file, you can upload it again. You can do this again in step 4. Enter the file name (full file path and name) in the input box on top of the table. Nato pritisnite "upload".
  
=== Report Issues for failed tests ===
+
=== Poročajte o težavah pri neuspelih preizkusih ===
  
 
If a test failes, you should file an issue at the OpenOffice.org  [[Issue Tracker]]. For such an issue, the [http://qa.openoffice.org/issue_handling/bug_writing_guidelines.html issue writing guidelines] apply.
 
If a test failes, you should file an issue at the OpenOffice.org  [[Issue Tracker]]. For such an issue, the [http://qa.openoffice.org/issue_handling/bug_writing_guidelines.html issue writing guidelines] apply.
Line 90: Line 90:
 
: After logging in, you will see the menu items appropriate to your rôle. Go to "Test Case Maintenance" (Item #1, if you have the SQE rôle).
 
: After logging in, you will see the menu items appropriate to your rôle. Go to "Test Case Maintenance" (Item #1, if you have the SQE rôle).
  
* Select the product "OpenOffice.org - Office Suites(2.0)"
+
* Izberite izdelek (product) "OpenOffice.org - Office Suites(2.0)"
 
: "OpenOffice.org" is the only accessible product - click on the product-name link.
 
: "OpenOffice.org" is the only accessible product - click on the product-name link.
  
* Choose a Category
+
* Izberite kategorijo (Category)
 
: Follow the link to the appropriate Category for the Test Case to be translated. You will now see all the Test Case Descriptions in this Category. The translation, if any, will also be displayed for each description.
 
: Follow the link to the appropriate Category for the Test Case to be translated. You will now see all the Test Case Descriptions in this Category. The translation, if any, will also be displayed for each description.
  
Line 100: Line 100:
 
: ''Hint'': you can also use HTML tags to format your translation text.
 
: ''Hint'': you can also use HTML tags to format your translation text.
  
* Update the description
+
* Posodobite opis
 
: Enter your translation, and press the "Update" button at the bottom of the page.
 
: Enter your translation, and press the "Update" button at the bottom of the page.
  
''Hint'': You will see "download" links shown in several places. You can use these links to download all the test cases in one text file, translate them offline and upload the resulting file when you're finished. The file includes a description of the file format.
+
''Namig'': You will see "download" links shown in several places. You can use these links to download all the test cases in one text file, translate them offline and upload the resulting file when you're finished. The file includes a description of the file format.
  
== MGR tasks ==
+
== Opravila MGR ==
  
=== grant access to new testers ===
+
=== omogočite dostop novim preizkuševalcem ===
  
* Login to TCM
+
* Prijavite se v TCM
: [http://www.sunvirtuallab.com:8001/tcm2/opensource/tcm_login.cgi?tcm_config=newooo Login to TCM] with your username and password
+
: [http://www.sunvirtuallab.com:8001/tcm2/opensource/tcm_login.cgi?tcm_config=newooo Prijavite se v TCM] s svojim uporabniškim imenom in geslom
  
* Go to "Property Maintenance"  
+
* Pojdite na "Property Maintenance"  
 
: after login, you will see some menu items (depending on your role). You need to go to "Property Maintenance" (Item #7, if you have MGR role)
 
: after login, you will see some menu items (depending on your role). You need to go to "Property Maintenance" (Item #7, if you have MGR role)
  
* Go To "People"
+
* Pojdite na "People"
 
: The only property you are able to edit as normal MGR is "People" - follow the link
 
: The only property you are able to edit as normal MGR is "People" - follow the link
  
* Add new People
+
* Dodajte nove ljudi
 
: you can add new people by following the link on the upper right
 
: you can add new people by following the link on the upper right
  
* Enter user details
+
* Vnesite uporabniške podrobnosti
: You need to enter
+
: Vnesti morate
:; Login : thats the login name of the user (it's a good idea to use the OOo-account name as login name for TCM)
+
:; Login (prijava): to je prijavno ime uporabnika (it's a good idea to use the OOo-account name as login name for TCM)
:; Name : the full name of the tester
+
:; Name (ime): polno ime preizkuševalca
:; Language : you may choose one or more languages you are responsible for
+
:; Language (jezik): izberete lahko enega ali več jezikov, za katere ste odgovorni
 
:; Location : free text, just a notice, where the tester is based
 
:; Location : free text, just a notice, where the tester is based
:; Email : an e-Mail adress, in case you need to contact the tester. (the openoffice.org mail address would work here)
+
:; Email (E-poštni naslov): an e-Mail adress, in case you need to contact the tester. (the openoffice.org mail address would work here)
:; Role : choose the [[#Roles in TCM|role]] of the tester. Make sure, you include the SQA role, even if you grant SQE or MGR role.
+
:; Role (vloga): choose the [[#Roles in TCM|role]] of the tester. Make sure, you include the SQA role, even if you grant SQE or MGR role.
  
* Add the tester
+
* Dodajte preizkuševalca
: press the "Add"-button at the bottom of the screen
+
: pritisnite gumb "Add" na dnu zaslona
  
''Hint'': you can change user details or reset the password for existing testers at this screen. You just need to click on the login name.
+
''Namig'': you can change user details or reset the password for existing testers at this screen. You just need to click on the login name.
  
=== assign tests ===
+
=== dodelite preizkuse ===
  
* Login to TCM
+
* Prijavite se v TCM
: [http://www.sunvirtuallab.com:8001/tcm2/opensource/tcm_login.cgi?tcm_config=newooo Login to TCM] with your username and password
+
: [http://www.sunvirtuallab.com:8001/tcm2/opensource/tcm_login.cgi?tcm_config=newooo Prijavite se v TCM] s svojim uporabniškim imenom in geslom
  
* Go to "Test Assignment Maintenance"  
+
* Pojdite na "Test Assignment Maintenance"  
 
: after login, you will see some menu items (depending on your role). You need to go to "Test Assignment Maintenance" (Item #5, if you have MGR role)
 
: after login, you will see some menu items (depending on your role). You need to go to "Test Assignment Maintenance" (Item #5, if you have MGR role)
  
* Choose the Project "OpenOffice.org"
+
* Izberite projekt (Project) "OpenOffice.org"
 
: you will see a list of Projects that are managed in this TCM instance. Follow the link to OpenOffice.org
 
: you will see a list of Projects that are managed in this TCM instance. Follow the link to OpenOffice.org
  
* Select build number
+
* Izberite številko gradnje (build number)
 
: the next screen will show a list of builds that are ready for testing (e.g. localisationXX for localisation tests or 2.XRC for release tests)
 
: the next screen will show a list of builds that are ready for testing (e.g. localisationXX for localisation tests or 2.XRC for release tests)
 
: select "Scenario" in column "Assignemnt by" for the build that should be tested (don't follow the link to the build name, this will show a list of all testassignments for this build)  
 
: select "Scenario" in column "Assignemnt by" for the build that should be tested (don't follow the link to the build name, this will show a list of all testassignments for this build)  
  
* Select the scenario
+
* Izberite scenarij
 
: choose a scenario, you like to assign. (Application scenarios are used for localization testing, the "OOo release sanity" scenario is used for release approval)
 
: choose a scenario, you like to assign. (Application scenarios are used for localization testing, the "OOo release sanity" scenario is used for release approval)
 
: follow the link in column "Test Cases" (click on the number of test cases in this scenario)
 
: follow the link in column "Test Cases" (click on the number of test cases in this scenario)
Line 158: Line 158:
 
: you can assign multiple platforms to one tester and a plattform to more than one tester  
 
: you can assign multiple platforms to one tester and a plattform to more than one tester  
  
''Hint'': to go back to the Scenario selection screen simply use the Back button of your browser.
+
''Namig'': to go back to the Scenario selection screen simply use the Back button of your browser.
  
=== review test results ===
+
=== preglejte rezultate preizkusov ===
  
=== create a test report ===
+
=== ustvarite poročilo preizkusov ===

Revision as of 15:09, 28 December 2009


Portal TCM (angl. Test Case Management ali upravljanje s preizkusi) je spletni portal za upravljanje s preizkusnimi primeri (kot pove samo ime). To vključuje definicijo in prevod preizkusov, kot tudi dodeljevanje preizkusov posameznim preizkuševalcem in zbiranje rezultatov.

Splošne informacije o TCM

TCM je razvil in ga gosti ekipa preizkušanja lokalizacij podjetja Sun. So, the initial focus of TCM is localization testing - not only for OOo. We are trying to extend the capabilities of TCM, so that it can be used for general testing tasks within the OOo project.

At the moment the OOo project is using the same TCM installation as the OpenSolaris project. This means, we use the same "program" but the data are distinct.

For a short introduction to TCM see about TCM. The introduction is written for a successor of the current TCM. So the screens may differ from what you see in current TCM.

Vloge v TCM

Obstajajo tri (ali štiri) vloge v TCM:

  • SQA (Software Quality Assurance)
Lahko si ogleduje preizkusne primere, posodablja rezultata (prestalo/neuspelo oz. pass/fail) za posamezen preizkusni primer
  • SQE (Software QA Engineer)
lahko spreminja (doda, odstrani, prevede) preizkusne primere
  • MGR (Manager)
Ima dostop SQE + lahko dodeli dostop uporabnikom, dodeli preizkuse preizkuševalcem, vnese nove preizkusne primere / scenarije in ustvari nova poročila preizkusov ali predloge poročil

All these roles are based on localizations. That means, every SQA / SQE / MGR belongs to one (ore more) localizations. SQA's will see test cases translated to their language, SQE's will be able to translate the cases to a given language. MGR can only assign tests to tester of the same localization.

The Manager of the en localization has some more rights. He is some kind of "Super Manager" (the fourth role).


Hrošči v TCM

Če najdete hrošče v TCM (v orodju samem), lahko uporabite OOo Issue Tracker, da o njih poročate. Uporabite kategorijo (category) qa, podkategorijo (subcategory) tcm.

If you find bugs that apply to a test case (bug in OpenOffice.org) you need to file it for the appropiate Issue Tracker component. Don't use qa / tcm in this case. See Report Issues for failed tests.

You may ask at the dev@qa.openoffice.org mailinglist if something is unclear with TCM.

Opravljanje dnevnega dela

Naloge SQA

Izvajanje preizkusov

Preden lahko izvedete preizkuse, vam morajo biti preizkusi dodeljeni. You should ask your manager to assign tests to you. (Ask at dev@qa.openoffice.org if you do not know, who "your manager" is).

  • Prijavite se v TCM
Prijavite se v TCM s svojim uporabniškim imenom in geslom
  • Pojdite na "Test Result Update"
po prijavi boste videli nekaj menijskih ukazov (odvisno od vaše vloge). You need to go to "Test Result Update" (Item #2, if you have SQA role only)
  • Izberite številko gradnje (Build number)
in the next screen you will see a list of build numbers you have tests assigned for. In most cases you should only see one or two builds. Follow the link in column "Build Number" for the build you are going to test.
  • Select the assigned test scenario
you will now see all of your assigned tests for the selected build. Do not click on the assignment id (although this seems obvious, it is wrong). Follow the link in column "Assign by" instead.
If you have already done some of your tests, you may follow the link in column U (click on the number). You will see only untested cases in the next screen.
  • Vnesite rezultate
you will no see all test cases of the scenario. Each test case has a short description (what to do) and the information, what results are expected.
At the top of each test case you will see option buttons. Select "pass" if the test meets the expected result. Select "fail" if not. You may also "skip" a test if you are not sure if you understand the description (or if it is not important for the current test). If you do not have the time to complete a test, leave it "untested".
In case, the test fails, you should file an issue and put the issue id to the input box "bug".
You may also leave a comment about the test. Your manager will be able to read the comments and may have better information about the quality of the build.
  • Posodobite rezultate
navigate to the bottom of the page and "update" the results. You should do this from time to time, even if you entered only some of your results.


Namig: There is an option to download the test case descriptions in step 4. You will see a "download" link in the right most column. You may download a plain text file here. (In case your browser is going to save the file as .cgi, simply rename it to .txt). You may open the file with any text editor. The File header has some information about the file format. So you should be able to enter your test results offline. Once, your test has been completed and all results have been entered to the file, you can upload it again. You can do this again in step 4. Enter the file name (full file path and name) in the input box on top of the table. Nato pritisnite "upload".

Poročajte o težavah pri neuspelih preizkusih

If a test failes, you should file an issue at the OpenOffice.org Issue Tracker. For such an issue, the issue writing guidelines apply.

As not every developer or member of the qa project has access to TCM, repeat the steps that lead to the problem in the issue.

It is planned to be able to see test case descriptions in TCM without being logged in. Once this has been implemented, you may enter a link to the test case description in Issue Tracker.

Naloge SQE

prevajanje preizkusnih primerov

  • Prijavite se v TCM
Prijavite se v TCM s svojim uporabniškim imenom in geslom
  • Pojdite na "Test Case Maintenance"
After logging in, you will see the menu items appropriate to your rôle. Go to "Test Case Maintenance" (Item #1, if you have the SQE rôle).
  • Izberite izdelek (product) "OpenOffice.org - Office Suites(2.0)"
"OpenOffice.org" is the only accessible product - click on the product-name link.
  • Izberite kategorijo (Category)
Follow the link to the appropriate Category for the Test Case to be translated. You will now see all the Test Case Descriptions in this Category. The translation, if any, will also be displayed for each description.
  • Open a single Test Case Description to translate
Click on the Test Case ID. You'll see the English (original) text and input fields for translation.
Hint: you can also use HTML tags to format your translation text.
  • Posodobite opis
Enter your translation, and press the "Update" button at the bottom of the page.

Namig: You will see "download" links shown in several places. You can use these links to download all the test cases in one text file, translate them offline and upload the resulting file when you're finished. The file includes a description of the file format.

Opravila MGR

omogočite dostop novim preizkuševalcem

  • Prijavite se v TCM
Prijavite se v TCM s svojim uporabniškim imenom in geslom
  • Pojdite na "Property Maintenance"
after login, you will see some menu items (depending on your role). You need to go to "Property Maintenance" (Item #7, if you have MGR role)
  • Pojdite na "People"
The only property you are able to edit as normal MGR is "People" - follow the link
  • Dodajte nove ljudi
you can add new people by following the link on the upper right
  • Vnesite uporabniške podrobnosti
Vnesti morate
Login (prijava)
to je prijavno ime uporabnika (it's a good idea to use the OOo-account name as login name for TCM)
Name (ime)
polno ime preizkuševalca
Language (jezik)
izberete lahko enega ali več jezikov, za katere ste odgovorni
Location 
free text, just a notice, where the tester is based
Email (E-poštni naslov)
an e-Mail adress, in case you need to contact the tester. (the openoffice.org mail address would work here)
Role (vloga)
choose the role of the tester. Make sure, you include the SQA role, even if you grant SQE or MGR role.
  • Dodajte preizkuševalca
pritisnite gumb "Add" na dnu zaslona

Namig: you can change user details or reset the password for existing testers at this screen. You just need to click on the login name.

dodelite preizkuse

  • Prijavite se v TCM
Prijavite se v TCM s svojim uporabniškim imenom in geslom
  • Pojdite na "Test Assignment Maintenance"
after login, you will see some menu items (depending on your role). You need to go to "Test Assignment Maintenance" (Item #5, if you have MGR role)
  • Izberite projekt (Project) "OpenOffice.org"
you will see a list of Projects that are managed in this TCM instance. Follow the link to OpenOffice.org
  • Izberite številko gradnje (build number)
the next screen will show a list of builds that are ready for testing (e.g. localisationXX for localisation tests or 2.XRC for release tests)
select "Scenario" in column "Assignemnt by" for the build that should be tested (don't follow the link to the build name, this will show a list of all testassignments for this build)
  • Izberite scenarij
choose a scenario, you like to assign. (Application scenarios are used for localization testing, the "OOo release sanity" scenario is used for release approval)
follow the link in column "Test Cases" (click on the number of test cases in this scenario)
  • Assign test scenarios per platform
now you can assign the scenario to a tester. Simply select a tester for any platform and click on Update.
you can assign multiple platforms to one tester and a plattform to more than one tester

Namig: to go back to the Scenario selection screen simply use the Back button of your browser.

preglejte rezultate preizkusov

ustvarite poročilo preizkusov

Personal tools