Difference between revisions of "QA/SVT"

From Apache OpenOffice Wiki
< QA
Jump to: navigation, search
(SVT Result Summary)
Line 18: Line 18:
  
 
* There only one scenario “switchFileContainingChart” have obvious improvement(with green background).  
 
* There only one scenario “switchFileContainingChart” have obvious improvement(with green background).  
* There is one scenario “insertChartToOpenedSC” have obvious memory leak(with read background).
+
* There is one scenario “insertChartToOpenedSC” have obvious memory leak(with red background).
 
* Other scenario have little memory leak, and some with upward trend in new build.
 
* Other scenario have little memory leak, and some with upward trend in new build.
  

Revision as of 03:02, 22 October 2012

AOO SVT Report

Introduction

This SVT(System Verification Test) report use to report memory change between two builds in specific scenarios. Add report memory leak problem and memory leak improvement.

Platform: Widdows 7 64bit

Build: Run SVT cases on 20120625 build (r1353449) and 20121012build(r1397404) separately.

Cases: 100 iterations, 41 Scenarios, run 24hours.

SourceCode: /test/testgui/source/svt/gui

Calc

SVT Result Summary

  • There only one scenario “switchFileContainingChart” have obvious improvement(with green background).
  • There is one scenario “insertChartToOpenedSC” have obvious memory leak(with red background).
  • Other scenario have little memory leak, and some with upward trend in new build.

SVT Result Detail

Scenario

Memory Total(r1353449)

Memory(Per iteration)

Memory(r1397404)

Memory(Per iteration)

Memory trend between build

saveNewSCWithNumberFormat

75204KB – 84160KB

+89.56KB

80740KB – 90860KB

+101.2

Up

saveNewSCWithPrintRange

79152KB – 87924KB

+87.72KB

84676KB – 94608KB

+99.32

Up

saveNewSCWithText

73124KB – 81164KB

+80.4KB

78660KB – 87808KB

+91.48

Up

saveNewSCWithDataSort

73740KB – 81924KB

+81.84KB

79124KB – 88780KB

+96.56

Up

saveNewSCWithInsertSheets

68536KB – 76236KB

+77KB

75104KB – 84020KB

+89.16

Up

saveNewSCWithStandardFilter

73812KB – 82272KB

+84.6KB

78988KB – 89000KB

+100.12

Up

saveNewSCWithInsertPic

76416KB – 84194KB

+77.78KB

77012KB – 86388KB

+93.76KB

Up

saveNewSCWithValidaty

80180KB – 89096KB

+89.16KB

80264KB – 89796KB

+95.32KB

Up

insertChartToOpenedSC

104792KB – 1129952KB

+10251.6KB

106336KB – 1081332KB

+9749.96KB

Down

insertPicToOpenedSC

87064KB – 94836KB

+77.72KB

87892KB – 94456KB

+65.64KB

Down

insertFontWorkToOpenedSC

88584KB – 97008KB

+84.24KB

88744KB – 96400KB

+76.56KB

Down

switchFileContainingChart

101732KB – 336400KB

+2346.68KB

102360KB – 113808KB

+114.48KB

Down


SVT Cases Description

Scenario Name

Description

saveNewSCWithNumberFormat

  1. Create a new Calc
  2. Input number 0.3 to A1
  3. Change number format
  4. Save and reopen this Calc file

saveNewSCWithPrintRange

  1. Create a new Calc
  2. Select Format->Print Range->Edit in main menu
  3. In “Edit Print Ranges” dialog, Print range type Select “- user defined -” ,range select” $A$1:$C$4”
  4. Input text to A1
  5. Save and reopen this Calc file

saveNewSCWithText

  1. Create a new Calc
  2. Input text to A1
  3. Save and reopen this Calc file

saveNewSCWithDataSort

  1. Create a new Calc file
  2. Input some integer number in Column1
  3. Select Data->Sort in main menu
  4. Select Options tab in Sort dialog
  5. Sort by Column A with Ascending
  6. Save and reopen this Calc file

saveNewSCWithInsertSheets

  1. Create a new Calc file
  2. Insert new sheet after current sheet with specified sheet name
  3. Save and reopen this Calc file

saveNewSCWithStandardFilter

  1. Create a new Calc file
  2. Input some integer numbers in Column A
  3. Select Cell A1
  4. Select Data->Filter->Standard Filter
  5. Set Filter value
  6. Save and reopen this Calc file

saveNewSCWithInsertPic

  1. Create a new Calc file
  2. Insert a picture from jpg file
  3. Save and reopen this Calc file

saveNewSCWithValidaty

  1. Create a new Calc file
  2. Insert Data Validity
  3. Validity Criteria Allow “Whole Numbers”
  4. Validity Data greater than 1
  5. Input validity error alert message
  6. Input 1,2,3 in validity cell separately
  7. Save and reopen this Calc file

insertChartToOpenedSC

  1. Open plain ods sample file
  2. Input data and create a new Chart
  3. Close without save

insertPicToOpenedSC

  1. Open plain ods sample file
  2. Insert a new sheet
  3. Insert a picture from file
  4. Close without Save

insertFontWorkToOpenedSC

  1. Open plain ods sample file
  2. Insert a Fontwork
  3. Close without save

switchFileContainingChart

  1. Open 6 ods files with Chart
  2. Switch different window
  3. Close all opened files


Impress

SVT Result Summary

These scenarios on Impress have no various Improvement between two build, but they nearly all have >100KB memory growth.


SVT Result Detail

Scenario

Memory Total(r1353449)

Memory(Per iteration)

Memory(r1397404)

Memory(Per iteration)

Memory trend between build

saveNewSDWithNewSlides

79164KB – 90288KB

+111.24KB

78600KB – 90028KB

+114.28KB

No

saveNewSDWithTable

81364KB – 93120KB

+117.56KB

80376KB – 92000KB

+116.24KB

No

saveNewSDWithPic

80004KB – 91504KB

+115KB

78972KB – 90508KB

+115.36KB

No

saveNewSDWithTextbox

80324KB – 91572KB

+112.48KB

78952KB – 90956KB

+120.04KB

No

saveNewSDWithExternalSlides

94196KB – 105872KB

+116.76KB

94248KB – 104836KB

+105.88KB

Down

saveNewSDWithAnimation

84540KB – 97196KB

+126.56KB

84392KB – 96560KB

+121.68KB

No

saveNewSDWithShowSettings

96908KB – 109900KB

+129.92KB

98304KB – 108660KB

+103.56KB

Down

saveSDTemplate

82280KB – 93580KB

+113KB

81612KB – 91924KB

+103.12KB

Down

switchViewOfOpenedSD

84268KB – 93600KB

+93.32KB

86060KB – 93544KB

+74.84KB

Down


SVT Cases Description

Scenario Name

Description

saveNewSDWithNewSlides

  1. Create a new Impress file
  2. Insert a new Slide
  3. Save and reopen this Impress file

saveNewSDWithTable

  1. Create a new Impress file
  2. Insert a table with some number as content
  3. Save and reopen this Impress file

saveNewS

Personal tools