Difference between revisions of "QA/TestResults"

From Apache OpenOffice Wiki
< QA
Jump to: navigation, search
(General Testing Test Results)
(+cat)
 
(29 intermediate revisions by 5 users not shown)
Line 9: Line 9:
 
*Feature you conduct testing
 
*Feature you conduct testing
 
*General testing result as:
 
*General testing result as:
  *How many bugs you reported
+
**How many bugs you reported
  *What they are
+
**What they are (use the template <nowiki>{{Bug|nnn}}</nowiki> to link to the issue)
  *Other issues you want to highlight in result
+
**Other issues you want to highlight in result
  
 
== IP Cleanup Testing Results ==
 
== IP Cleanup Testing Results ==
Line 29: Line 29:
  
 
According to one research paper CoinMP offers superior performance compared to lp_solve.  So the overall user impact from this change should be positive.
 
According to one research paper CoinMP offers superior performance compared to lp_solve.  So the overall user impact from this change should be positive.
| row 1, cell 5
+
| Create a sample file which based on Excel solver sample, the result can be found. So the function works.
 +
 
 +
Solver function works in svn rev. 1236487
 
|-
 
|-
 
| xpdf
 
| xpdf
 
| The xpdf source code was removed
 
| The xpdf source code was removed
 
| PDF import can only be built when the poppler library is pre-installed on the system. It will not be part of the binary release.
 
| PDF import can only be built when the poppler library is pre-installed on the system. It will not be part of the binary release.
| No test required
+
| xpdf is removed in svn rev. 1212451. It impacts extensions Oracle PDF import extension not function in OpenOffice.
 
|-
 
|-
|MySQL Connector/C++
+
| MySQL Connector/C++
 
|
 
|
|MySQL connector can only be built when the C++ connector is pre-installed on the system. It will not be part of the binary release.
+
| MySQL connector can only be built when the C++ connector is pre-installed on the system. It will not be part of the binary release.
 
It impact extension MySQL Connector for OpenOffice.org not function in OpenOffice
 
It impact extension MySQL Connector for OpenOffice.org not function in OpenOffice
|
+
| Module has been removed in svn rev. 1212451
 +
|-
 +
| SVG: librsvg, libcroco, libgsf, gdk-pixbuf, glib, gettext, pango
 +
| These libraries are being removed from the product.
 +
| Instead of using an external SVG rendering library, Apache OpenOffice 3.4 will feature native SVG support, giving high quality, scalable, standards-compliant rendering on screen, print and PDF export.
 +
|
 +
|-
 +
| i18nregexp
 +
| i18nregexp was replaced by ICU Regular Expressions.
 +
| No major impact for users; regular expressions will work as usual and be much faster. Some deprecated extended syntax supported in earlier versions may not be availabl
 +
| Find an regression issue, pls refer to bug 118887
 +
|-
 +
| dictionaries
 +
| Remove dictionaries from product package
 +
| Before install dictionaries extension, spell check won't work
 +
| Test in svn. 1240872, no dictionary
 
|-
 
|-
 
| libwpd
 
| libwpd
 
| The libwpd library is being removed from the product.  
 
| The libwpd library is being removed from the product.  
| The WordPerfect filter ("WordPerfect Document (.wpd)") won't be available anymore. No replacement unless someone creates a filter extension that can be installed separatel|
+
| The WordPerfect filter ("WordPerfect Document (.wpd)") won't be available anymore. No replacement unless someone creates a filter extension that can be installed separatel。
 +
| Module has been removed in svn rev. 1212451
 
|-
 
|-
 
| 3rd party/external library gentiumbasic-fonts & liberation-fonts
 
| 3rd party/external library gentiumbasic-fonts & liberation-fonts
 
| Remove fonts from product.
 
| Remove fonts from product.
 
| A useful set of high quality fonts, mostly equivalent to those from MS.
 
| A useful set of high quality fonts, mostly equivalent to those from MS.
|  
+
| It has been removed in svn rev. 1212451
 +
|-
 +
| fonts (liberation)
 +
| These fonts are being removed from the distribution due to an incompatible license.
 +
| Metrically equivalent fonts from Google's ChromeOS have been included as replacements: Tinos, Arimo and Cousine. Moreover, users may independently install liberation fonts to their system, in accordance with their license.  so there is no further user impact.
 +
|
 +
|-
 +
| libneon
 +
| The neon library is being removed from the distribution due to an incompatible license.
 +
| The neon library is used to for all http based communication including WebDAV. Without a replacement it is for example not possible to insert an image via an http Url.
 +
 
 +
Work on a replacement (118569) has started but we will potentially lose WebDAV support at the beginning.
 +
|<s>Test in r1291124, one Bug raised: 118980</s>
 +
Test in r1293350, blocked by bug 119000
 +
|-
 +
| berkeleydb
 +
| The berkeleydb library is being removed from the distribution due to an incompatible license.
 +
| The berkeleydb is used for managing extentions and was used for indexing help content.
 +
 
 +
Managing a handful of extensions using a database was overkill anyways and that is being rectified (118569). The impact is that extensions installed for older versions of OpenOffice have to be re-installed.
 +
| Test in svn. 1240872
 +
|-
 +
| core, flute, flow-engine, libbase, libfonts, libformula, liblayout, libloader, librepository, libserializer, libxml
 +
| Libraries used by the Report Builder extension are being removed due to an incompatible license.
 +
| Report Builder extension will not be available unless someone works on it as an external extension.
 +
|
 +
|-
 +
| ooo_crystal_images-1.tar.gz
 +
ooo_oxygen_images-2009-06-17
 +
| Crystal and Oxygen icons removed.
 +
| These were used by default in KDE and KDE4 only. The user can still choose other icon sets like galaxy or tango.
 +
| Test in r1240836 
 +
1. run in KDE enviorment. check Tools->Options->OOo-dev->View, the default value for "Icon size and style" is Galaxy 2.Crystal and Oxygen are not in the list.
 +
 
 +
Pass testing.
 +
|-
 +
| 3rd party/external library javamail
 +
| none as Java Mail is not used by mail merge
 +
| removing unnecessary strings and help content 
 +
| Test in r1243392 
 +
One bug raied: 118935 Since the problem also exists in OO3.3, it's not introduced by IP cleanup. Pass testing.
 +
|-
 +
| 3rd party/external library gdk-pixbuf
 +
| Used by AVMedia for Video playback
 +
| removing unnecessary strings and help content 
 +
| Test in svn. 1243392
 +
three bugs raied: 118944, 118955, 118957.
 +
118944 is closed as invalid and enhancement 118960 is opened to trace. It's blocking the testing on Windows.
 +
|-
 +
|3rd party/external library cups
 +
|Used for integrating into the print system on Unix
 +
|Using the system provided cups functionality
 +
|Test in r1240836 on Redhat 6.1
 +
118969 is raised but it's also exists in oo3.3
 +
Pass testing.
 +
|-
 +
|replace svg (LGPL) support
 +
|Used for the important Ooo3.4 feature: SVG support
 +
|figure out the dependent office functionalities Replacement for librsvg and cairo three options: 1) Deactivate 2) Replace with Java renderer 3) Write our own SVG import in C++
 +
|test in r1291124
 +
Three bugs raised: 118984 ,118986 ,118987 
 
|}
 
|}
  
Line 102: Line 180:
  
 
*Raised 3 defects
 
*Raised 3 defects
*Bug ID are i118739, i118790, i118810
+
*Bug ID are {{Bug|118739}}, {{Bug|118790}}, {{Bug|118810}}
 
*Undo/redo numbering/bullets is one weak area need pay more attetion
 
*Undo/redo numbering/bullets is one weak area need pay more attetion
  
Line 112: Line 190:
 
|Test Results:
 
|Test Results:
 
*Raised 6 defects, 1 crash defect
 
*Raised 6 defects, 1 crash defect
*Bug ID are i118759,i118754,i118760,i118763,i118764,i118765
+
*Bug ID are {{Bug|118759}}, {{Bug|118754}}, {{Bug|118760}}, {{Bug|118763}}, {{Bug|118764}}, {{Bug|118765}}
*Many defects are about Undo/Redo, Other Volunter also put forward Presentation's Undo/Redo work not well.So this part need strengthen to test.
+
*Many defects are about Undo/Redo, Other Volunteer also put forward Presentation's Undo/Redo work not well.So this part need strengthen to test.
 
|-
 
|-
 
|RedHat Enterprise Linux(RHEL) 6 32bit
 
|RedHat Enterprise Linux(RHEL) 6 32bit
Line 120: Line 198:
 
|Security
 
|Security
 
|Test Results:
 
|Test Results:
*One Block defect raised
+
*<s>One Block defect raised</s>
*Bug ID is 118702
+
*<s>Bug ID is {{Bug|118702}}</s>
*This maybe caused by IP Clearence according to volenteer's feedback, But I'm not sure. So I think this kind of defect need rasied for retest after completement of IP Clearence.
+
*<s>This maybe caused by IP Clearence according to volenteer's feedback, But I'm not sure. So I think this kind of defect need rasied for retest after completement of IP Clearence.</s>
 +
*The testing cover:
 +
 
 +
    * Save with password
 +
    * Save with File Sharing Password.
 +
 
 +
In details:
 +
 
 +
    * Save documents(odp,odt,ods) with open password
 +
    * Save documents(odp,odt,ods) with read-only password
 +
    * Save documents(odp,odt,ods) with edit password
 +
    * Reopen the documents protected by password
 +
 
 +
Pass testing.
 
|-
 
|-
 
|RedHat Enterprise Linux(RHEL) 6 32bit
 
|RedHat Enterprise Linux(RHEL) 6 32bit
Line 130: Line 221:
 
|Test Results:
 
|Test Results:
 
*Raised 2 defects
 
*Raised 2 defects
*Bug ID are i118766,i118767
+
*Bug ID are {{Bug|118766}}, {{Bug|118767}}
 
*These two defects block test about copy&paste&edit Annimation Effects.
 
*These two defects block test about copy&paste&edit Annimation Effects.
 
|-
 
|-
Line 214: Line 305:
 
*7 defects raised
 
*7 defects raised
 
*118789, 118795, 118793, 118799, 118800, 118801, 118803, 118809
 
*118789, 118795, 118793, 118799, 118800, 118801, 118803, 118809
 +
|-
 +
| Windows XP SP3
 +
| Aoo3.4_Rev_1236920
 +
| Writer
 +
| Envelope
 +
| The testing cover:
 +
 +
    * Insert envelope in current document
 +
    * Create enveloper in new document
 +
    * Modify the envelope format
 +
    * Verify the envelope dialog
 +
Pass testing
 +
|-
 +
| Windows XP SP3
 +
| Aoo3.4_Rev_1236920
 +
| Common Feature
 +
| Toolbar
 +
| The testing cover:
 +
 +
    * Predefined Toolbar customize
 +
    * Add new toolbar
 +
Pass testing
 +
|-
 +
| Windows XP SP3
 +
| Aoo3.4_Rev_1240836
 +
| Installer
 +
| Clean Install
 +
| Pass testing
 +
|-
 +
| Mac 10.6.8
 +
| Aoo3.4_Rev_1240836
 +
| Installer
 +
| Clean Install
 +
| Pass testing
 +
|-
 +
| Ubuntu 10.04
 +
| Aoo3.4_Rev_1240836
 +
| Installer
 +
| Clean Install
 +
| one bug raised for installation guide: 118916
 +
|-
 +
| RedHat 6.1
 +
| Aoo3.4_Rev_1240836
 +
| Installer
 +
| Clean Install
 +
| one bug raised: 118943
 +
|-
 +
| Ubuntu 10.04
 +
| r1293550
 +
| Installer
 +
| upgrade from oo 3.3 to 3.4
 +
| pass testing
 +
|-
 +
| Windows XP SP3
 +
| r1293550
 +
| Installer
 +
| upgrade from oo 3.3 to 3.4
 +
| pass testing
 +
| -
 +
| Redhat 6.1
 +
| r1293550
 +
| Installer
 +
| upgrade from oo 3.3 to 3.4
 +
| pass testing
 +
|-
 +
| Windows XP SP3
 +
| r1293550
 +
| Calc
 +
| Changes
 +
| bugs: 119140, 119130, 119107
 
|-
 
|-
 
| row 5, cell 1
 
| row 5, cell 1
Line 221: Line 382:
 
| row 5, cell 5
 
| row 5, cell 5
 
|}
 
|}
 +
 +
[[Category:Quality Assurance]]

Latest revision as of 14:30, 6 April 2013

Overview

This wiki page is for Apache OpenOffice 3.4 testing results.

Volunteers: Please follow the template below in summarizing your test results. Link to the bug reports and the location of any detailed materials:

  • Platform
  • Build
  • Component you conduct testing
  • Feature you conduct testing
  • General testing result as:
    • How many bugs you reported
    • What they are (use the template {{Bug|nnn}} to link to the issue)
    • Other issues you want to highlight in result

IP Cleanup Testing Results

IP Clearnup Testing Results:

Library What is changing User Impact Testing Result
lp_solve lp_solve is being replaced by CoinMP This functionality is invoked by the user in Calc via Tools->Solver. It is used for solving linear programming problems, including integer programming.

CoinMP comes from the Coin-OR open source project, an open source project that involves operations research professionals and includes cutting edge algorithms.

According to one research paper CoinMP offers superior performance compared to lp_solve. So the overall user impact from this change should be positive.

Create a sample file which based on Excel solver sample, the result can be found. So the function works.

Solver function works in svn rev. 1236487

xpdf The xpdf source code was removed PDF import can only be built when the poppler library is pre-installed on the system. It will not be part of the binary release. xpdf is removed in svn rev. 1212451. It impacts extensions Oracle PDF import extension not function in OpenOffice.
MySQL Connector/C++ MySQL connector can only be built when the C++ connector is pre-installed on the system. It will not be part of the binary release.

It impact extension MySQL Connector for OpenOffice.org not function in OpenOffice

Module has been removed in svn rev. 1212451
SVG: librsvg, libcroco, libgsf, gdk-pixbuf, glib, gettext, pango These libraries are being removed from the product. Instead of using an external SVG rendering library, Apache OpenOffice 3.4 will feature native SVG support, giving high quality, scalable, standards-compliant rendering on screen, print and PDF export.
i18nregexp i18nregexp was replaced by ICU Regular Expressions. No major impact for users; regular expressions will work as usual and be much faster. Some deprecated extended syntax supported in earlier versions may not be availabl Find an regression issue, pls refer to bug 118887
dictionaries Remove dictionaries from product package Before install dictionaries extension, spell check won't work Test in svn. 1240872, no dictionary
libwpd The libwpd library is being removed from the product. The WordPerfect filter ("WordPerfect Document (.wpd)") won't be available anymore. No replacement unless someone creates a filter extension that can be installed separatel。 Module has been removed in svn rev. 1212451
3rd party/external library gentiumbasic-fonts & liberation-fonts Remove fonts from product. A useful set of high quality fonts, mostly equivalent to those from MS. It has been removed in svn rev. 1212451
fonts (liberation) These fonts are being removed from the distribution due to an incompatible license. Metrically equivalent fonts from Google's ChromeOS have been included as replacements: Tinos, Arimo and Cousine. Moreover, users may independently install liberation fonts to their system, in accordance with their license. so there is no further user impact.
libneon The neon library is being removed from the distribution due to an incompatible license. The neon library is used to for all http based communication including WebDAV. Without a replacement it is for example not possible to insert an image via an http Url.

Work on a replacement (118569) has started but we will potentially lose WebDAV support at the beginning.

Test in r1291124, one Bug raised: 118980

Test in r1293350, blocked by bug 119000

berkeleydb The berkeleydb library is being removed from the distribution due to an incompatible license. The berkeleydb is used for managing extentions and was used for indexing help content.

Managing a handful of extensions using a database was overkill anyways and that is being rectified (118569). The impact is that extensions installed for older versions of OpenOffice have to be re-installed.

Test in svn. 1240872
core, flute, flow-engine, libbase, libfonts, libformula, liblayout, libloader, librepository, libserializer, libxml Libraries used by the Report Builder extension are being removed due to an incompatible license. Report Builder extension will not be available unless someone works on it as an external extension.
ooo_crystal_images-1.tar.gz

ooo_oxygen_images-2009-06-17

Crystal and Oxygen icons removed. These were used by default in KDE and KDE4 only. The user can still choose other icon sets like galaxy or tango. Test in r1240836

1. run in KDE enviorment. check Tools->Options->OOo-dev->View, the default value for "Icon size and style" is Galaxy 2.Crystal and Oxygen are not in the list.

Pass testing.

3rd party/external library javamail none as Java Mail is not used by mail merge removing unnecessary strings and help content Test in r1243392

One bug raied: 118935 Since the problem also exists in OO3.3, it's not introduced by IP cleanup. Pass testing.

3rd party/external library gdk-pixbuf Used by AVMedia for Video playback removing unnecessary strings and help content Test in svn. 1243392

three bugs raied: 118944, 118955, 118957. 118944 is closed as invalid and enhancement 118960 is opened to trace. It's blocking the testing on Windows.

3rd party/external library cups Used for integrating into the print system on Unix Using the system provided cups functionality Test in r1240836 on Redhat 6.1

118969 is raised but it's also exists in oo3.3 Pass testing.

replace svg (LGPL) support Used for the important Ooo3.4 feature: SVG support figure out the dependent office functionalities Replacement for librsvg and cairo three options: 1) Deactivate 2) Replace with Java renderer 3) Write our own SVG import in C++ test in r1291124

Three bugs raised: 118984 ,118986 ,118987

AOO 3.4 Code Changes Testing Results

Here is the AOO 3.4 code change:http://development.openoffice.org/releases/3.4beta.html

Please vlounteer get build from:http://ci.apache.org/projects/openoffice/install/ and check this link for related cases:http://wiki.services.openoffice.org/wiki/QA/TestCases/#AOO_3.4_Code_Change_Test_Cases and then update below table for the code change related testing results. If you find problem in testing, please go to bugzilla to raise bug report:https://issues.apache.org/ooo/. Remember you need create your bugzilla account first if you haven't before you can submit bug there:https://issues.apache.org/ooo/createaccount.cgi.

Feature title Task ID Description Dev. Owner Component Test Results
Improve ODF 1.2 encryption supporte in OOo i117562 The ODF1.2 specification allows to use W3C-specified algorithms to encrypt ODF1.2 documents. The new implementation let the following algorithms be used in case ODF1.2 encrypted document is stored: Start key generation: SHA256 Derived key generation: PBKDF2 Encryption algorithm: AES-256 Checksum generation: SAH256_1K It is possible to let start key and checksum generation use SHA1/SHA1_1K algorithms during storing of ODF1.2 encrypted document by setting the configuration entry org.openoffice.Office.Common/Save/ODF/UseSHA1InODF12 to "true". It is also possible to let Blowfish algorithm be used in this case by setting the entry org.openoffice.Office.Common/Save/ODF/UseBlowfishInODF12 to "true". The storing of encrypted ODF1.1/ODF1.0 documents is not affected. Please see http://docs.oasis-open.org/office/v1.2/csprd03/OpenDocument-v1.2-csprd03-part3.html for details. mikhail.voytenko@oracle.com ?? framew
row 2, cell 1 row 2, cell 2 row 2, cell 3 row 2, cell 4 row 2, cell 5 row 2, cell 6

General Testing Test Results

Please volunteer update below table to give your AOO 3.4 General Testing Result.

Platform Build Component Feature Test Results
RedHat Enterprise Linux (RHEL) 6 32 bit ooobasis3.4-sdk-3.4.0-1-linux-2.6-x86_64-2011-12-19.deb Impress Numbering and Bullet Test Results:
  • How many defects you raised
  • What they are
  • Other issues your want to highlight in results
RedHat Enterprise Linux(RHEL) 6 32bit r1228147 Impress Table Test Results:
RedHat Enterprise Linux(RHEL) 6 32bit r1228147 Common Features Security Test Results:
  • One Block defect raised
  • Bug ID is Issue 118702
  • This maybe caused by IP Clearence according to volenteer's feedback, But I'm not sure. So I think this kind of defect need rasied for retest after completement of IP Clearence.
  • The testing cover:
   * Save with password
   * Save with File Sharing Password. 

In details:

   * Save documents(odp,odt,ods) with open password
   * Save documents(odp,odt,ods) with read-only password
   * Save documents(odp,odt,ods) with edit password
   * Reopen the documents protected by password 

Pass testing.

RedHat Enterprise Linux(RHEL) 6 32bit r1228147 Impress Annimation Effects Test Results:
RedHat Enterprise Linux(RHEL) 6 32bit r1228147 Impress Graphic&Shape Test Results:
  • Raised 5 defect
  • Bug IDs are i118761,i118774,i118775,i118776,i118777
  • Not test detail points, need following test.
SUSE Linux Enterprise Desktop 11(i586) Build revision 1228147 Drawing Editing Test Results:
  • The properties of copied objects missed, Bug ID 118757.
  • Bug ID 118758.
SUSE Linux Enterprise Desktop 11(i586) Build revision 1229490 Drawing Formatting Test Results:
  • Formats modified by users can not be showed or saved correctly.
  • Bug ID 118772, 118773.
SUSE Linux Enterprise Desktop 11(i586) Build revision 1229490 Drawing UI Test Results:
  • Raised 2 defects, Bug ID 118794, But ID 118802.
SUSE Linux Enterprise Desktop 11(i586) Build revision 1229490 Drawing SVG Test Results:
  • Raised 1 defect, Bug ID 118796.
SUSE Linux Enterprise Desktop 11(i586) Build revision 1229490 Drawing FileSave Test Results:
  • Raised 1 defect, Bug ID 118804.
SUSE Linux Enterprise Desktop 11(i586) Build revision 1229490 Writer FileOpen Test Results:
  • Raised 1 defect, Bug ID 118812.
Ubuntu Linux Desktop 10.04(i686) Build revision 1228147 Calc Format Cell Test Results:
  • Raised 2 defect, Bug ID 118752,118755
Ubuntu Linux Desktop 10.04(i686) Build revision 1228147 Calc Data Test Results:
  • Raised 1 defect, Bug ID 118756
Ubuntu Linux Desktop 10.04(i686) Build revision 1228147 Calc Chart Test Results:
  • Raised 1 defect, Bug ID 118753
Windows XP SP3 Aoo3.4_Rev_1229490 Calc Hyperlink Test Results:
  • 7 defects raised
  • 118789, 118795, 118793, 118799, 118800, 118801, 118803, 118809
Windows XP SP3 Aoo3.4_Rev_1236920 Writer Envelope The testing cover:
   * Insert envelope in current document
   * Create enveloper in new document
   * Modify the envelope format
   * Verify the envelope dialog 

Pass testing

Windows XP SP3 Aoo3.4_Rev_1236920 Common Feature Toolbar The testing cover:
   * Predefined Toolbar customize
   * Add new toolbar 

Pass testing

Windows XP SP3 Aoo3.4_Rev_1240836 Installer Clean Install Pass testing
Mac 10.6.8 Aoo3.4_Rev_1240836 Installer Clean Install Pass testing
Ubuntu 10.04 Aoo3.4_Rev_1240836 Installer Clean Install one bug raised for installation guide: 118916
RedHat 6.1 Aoo3.4_Rev_1240836 Installer Clean Install one bug raised: 118943
Ubuntu 10.04 r1293550 Installer upgrade from oo 3.3 to 3.4 pass testing
Windows XP SP3 r1293550 Installer upgrade from oo 3.3 to 3.4 pass testing - Redhat 6.1 r1293550 Installer upgrade from oo 3.3 to 3.4 pass testing
Windows XP SP3 r1293550 Calc Changes bugs: 119140, 119130, 119107
row 5, cell 1 row 5, cell 2 row 5, cell 3 row 5, cell 4 row 5, cell 5
Personal tools