Performance/AOO3.4.1 PVT Introduction

From Apache OpenOffice Wiki
Jump to: navigation, search

Template:AOO Performance Test Introduction

Test Scenario

In AOO, “Asynchronous loading” is adopted to improve user experience. Therefore, we separated load scenario into two sub-scenario, “load show” and “load finish”.

Note: “Asynchronous loading” doesn’t apply to calc. Therefore, there is no “Load finish” for Calc.

  • Load Show
    • Steps:
      • Open a sample file by selecting menu “File->Open…”
    • Timing Interval: From opening the sample file to the first page of the sample file showing up
  • Load Finish
    • Steps:
      • Open a sample file by selecting menu “File->Open…”
    • Timing Interval: From opening the sample file to all pages of the sample file loaded in
  • Save
    • Steps:
      • Open a sample file by selecting menu “File->Open…”
      • Modify the sample file, such as inserting and deleting some words for writer sample files; inserting and deleting slide for impress sample files; Inputting and deleting words in a cell for calc sample files
      • Press “Ctrl + S” to start saving
    • Timing Interval: From pressing “Ctrl + S” to save finished

Here is an explanation in our report about test scenario:

Picture 6.png


Test Sample file

2 Odf format sample files and 2 MS format sample files are used for each editor. 12 sample files are used in all. In these 2 sample files, one only contains plain text and the other contains rich objects, such as tables, pictures, and OLE objects.

Sample file list:

Editor
Odf format
MS format
Writer

sw_plain_120p_odf1.2.odt

sw_plain_120p.doc


sw_complex_100p_odf1.2.odt

sw_complex_100p.doc

Impress

sd_plain_50p_odf1.2.odp

sd_plain_50p.ppt


sd_complex_51p_odf1.2.odp

sd_complex_51p.ppt

Calc

sc_plain_4sh_5kcell_new_odf1.2.ods

sc_plain_4sh_5kcell.xls


sc_complex_13sh_4kcell_new_odf1.2.ods

sc_complex_13sh_4kcell.xls


Here is an explanation in our report about sample files:

Picture 5.png


Test Method

  • Automation
  • Tools: Eclipse
  • Judgment criteria
    • Load Show: Editor showing up stands for the first page being loaded.
    • Load Finish: Getting the page number in the status bar. When the page number after the slash equals to the file page number, it stands for the file loading finish.

Picture 1.png

Picture 2.png

  • Save: Judge the insert sign in the status bar. The asterisk disappearing marks saving completing.

Picture 3.png

Result computation Method

Steps:

  • We run each test case on each sample file 8 times.
  • Remove the first round result, and in the rest of 7 round results, remove the minimum and maximum result
  • Compute the average and standard deviation of the rest 5 results.

Note:the standard deviation is to reflect whether the 8 round results are stable.

Here is an explanation in our PVT report about results:

Picture 4.png

Personal tools