QA/SVT

From Apache OpenOffice Wiki
< QA
Revision as of 02:44, 22 October 2012 by Phoenixwang (Talk | contribs)

(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to: navigation, search
                                           AOO SVT Report

Contents

[ Introduction 1]

[ Calc 1]

[ SVT Result Summary 1]

[ SVT Result Detail 2]

[ SVT Cases Description 2]

[ Impress 3]

[ SVT Result Summary 3]

[ SVT Result Detail 4]

[ SVT Cases Description 4]

[ Writer 5]

[ SVT Result Summary 5]

[ SVT Result Detail 5]

[ SVT Cases Description 6]


Introduction

This SVT(System Verification Test) report use to report memory change between two builds in specific scenarios. Add report memory leak problem and memory leak improvement.

Platform: Widdows 7 64bit

Build: Run SVT cases on 20120625 build (r1353449) and 20121012build(r1397404) separately.

Cases: 100 iterations, 41 Scenarios, run 24hours.

SourceCode: /test/testgui/source/svt/gui

Calc

SVT Result Summary

  • There only one scenario “switchFileContainingChart” have obvious improvement(with green background).
  • There is one scenario “insertChartToOpenedSC” have obvious memory leak(with read background).
  • Other scenario have little memory leak, and some with upward trend in new build.

SVT Result Detail

Scenario

Memory Total(r1353449)

Memory(Per iteration)

Memory(r1397404)

Memory(Per iteration)

Memory trend between build

saveNewSCWithNumberFormat

75204KB – 84160KB

+89.56KB

80740KB – 90860KB

+101.2

Up

saveNewSCWithPrintRange

79152KB – 87924KB

+87.72KB

84676KB – 94608KB

+99.32

Up

saveNewSCWithText

73124KB – 81164KB

+80.4KB

78660KB – 87808KB

+91.48

Up

saveNewSCWithDataSort

73740KB – 81924KB

+81.84KB

79124KB – 88780KB

+96.56

Up

saveNewSCWithInsertSheets

68536KB – 76236KB

+77KB

75104KB – 84020KB

+89.16

Up

saveNewSCWithStandardFilter

73812KB – 82272KB

+84.6KB

78988KB – 89000KB

+100.12

Up

saveNewSCWithInsertPic

76416KB – 84194KB

+77.78KB

77012KB – 86388KB

+93.76KB

Up

saveNewSCWithValidaty

80180KB – 89096KB

+89.16KB

80264KB – 89796KB

+95.32KB

Up

insertChartToOpenedSC

104792KB – 1129952KB

+10251.6KB

106336KB – 1081332KB

+9749.96KB

Down

insertPicToOpenedSC

87064KB – 94836KB

+77.72KB

87892KB – 94456KB

+65.64KB

Down

insertFontWorkToOpenedSC

88584KB – 97008KB

+84.24KB

88744KB – 96400KB

+76.56KB

Down

switchFileContainingChart

101732KB – 336400KB

+2346.68KB

102360KB – 113808KB

+114.48KB

Down


SVT Cases Description

Scenario Name

Description

saveNewSCWithNumberFormat

  1. Create a new Calc
  2. Input number 0.3 to A1
  3. Change number format
  4. Save and reopen this Calc file

saveNewSCWithPrintRange

  1. Create a new Calc
  2. Select Format->Print Range->Edit in main menu
  3. In “Edit Print Ranges” dialog, Print range type Select “- user defined -” ,range select” $A$1:$C$4”
  4. Input text to A1
  5. Save and reopen this Calc file

saveNewSCWithText

  1. Create a new Calc
  2. Input text to A1
  3. Save and reopen this Calc file

saveNewSCWithDataSort

  1. Create a new Calc file
  2. Input some integer number in Column1
  3. Select Data->Sort in main menu
  4. Select Options tab in Sort dialog
  5. Sort by Column A with Ascending
  6. Save and reopen this Calc file

saveNewSCWithInsertSheets

  1. Create a new Calc file
  2. Insert new sheet after current sheet with specified sheet name
  3. Save and reopen this Calc file

saveNewSCWithStandardFilter

  1. Create a new Calc file
  2. Input some integer numbers in Column A
  3. Select Cell A1
  4. Select Data->Filter->Standard Filter
  5. Set Filter value
  6. Save and reopen this Calc file

saveNewSCWithInsertPic

  1. Create a new Calc file
  2. Insert a picture from jpg file
  3. Save and reopen this Calc file

saveNewSCWithValidaty

  1. Create a new Calc file
  2. Insert Data Validity
  3. Validity Criteria Allow “Whole Numbers”
  4. Validity Data greater than 1
  5. Input validity error alert message
  6. Input 1,2,3 in validity cell separately
  7. Save and reopen this Calc file

insertChartToOpenedSC

  1. Open plain ods sample file
  2. Input data and create a new Chart
  3. Close without save

insertPicToOpenedSC

  1. Open plain ods sample file
  2. Insert a new sheet
  3. Insert a picture from file
  4. Close without Save

insertFontWorkToOpenedSC

  1. Open plain ods sample file
  2. Insert a Fontwork
  3. Close without save

switchFileContainingChart

  1. Open 6 ods files with Chart
  2. Switch different window
  3. Close all opened files


Impress

SVT Result Summary

These scenarios on Impress have no various Improvement between two build, but they nearly all have >100KB memory growth.


SVT Result Detail

Scenario

Memory Total(r1353449)

Memory(Per iteration)

Memory(r1397404)

Memory(Per iteration)

Memory trend between build

saveNewSDWithNewSlides

79164KB – 90288KB

+111.24KB

78600KB – 90028KB

+114.28KB

No

saveNewSDWithTable

81364KB – 93120KB

+117.56KB

80376KB – 92000KB

+116.24KB

No

saveNewSDWithPic

80004KB – 91504KB

+115KB

78972KB – 90508KB

+115.36KB

No

saveNewSDWithTextbox

80324KB – 91572KB

+112.48KB

78952KB – 90956KB

+120.04KB

No

saveNewSDWithExternalSlides

94196KB – 105872KB

+116.76KB

94248KB – 104836KB

+105.88KB

Down

saveNewSDWithAnimation

84540KB – 97196KB

+126.56KB

84392KB – 96560KB

+121.68KB

No

saveNewSDWithShowSettings

96908KB – 109900KB

+129.92KB

98304KB – 108660KB

+103.56KB

Down

saveSDTemplate

82280KB – 93580KB

+113KB

81612KB – 91924KB

+103.12KB

Down

switchViewOfOpenedSD

84268KB – 93600KB

+93.32KB

86060KB – 93544KB

+74.84KB

Down


SVT Cases Description

Scenario Name

Description

saveNewSDWithNewSlides

  1. Create a new Impress file
  2. Insert a new Slide
  3. Save and reopen this Impress file

saveNewSDWithTable

  1. Create a new Impress file
  2. Insert a table with some number as content
  3. Save and reopen this Impress file

saveNewSDWithPic

  1. Create a new Impress file
  2. Insert a picture from file
  3. Save and reopen this Impress file

saveNewSDWithTextbox

  1. Create a new Impress file
  2. Create a new textbox
  3. Save and reopen this Impress file

saveNewSDWithExternalSlides

  1. Create a new Impress file
  2. Insert slides from external odp file
  3. Save and reopen this Impress file

saveNewSDWithAnimation

  1. Create a new Impress file
  2. Insert a Callout shape
  3. Add Circle Entrance Animation to this Callout shape
  4. F5 to Show this slide
  5. Exit Slide show
  6. Save and reopen this Impress file

saveNewSDWithShowSettings

  1. Create a new Impress file
  2. Insert Slide from external file
  3. Add Slide transition with slow speed to all slides.
  4. F5 to Show these slide.
  5. Save and reopen this Impress file

saveSDTemplate

  1. Open a otp file
  2. Save to odp and reopen this odp file

switchViewOfOpenedSD

  1. Open a plain odp file
  2. Switch view to Outline, Slide Sorter, Notes, Slide Master, Notes Master, Normal
  3. Close without Save this Impress file


Writer

SVT Result Summary

There is only one scenario “InsertChartToOpenedSW” may have memory leak. Other scenarios have no various memory growths.


SVT Result Detail

Scenario

Memory Total(r1353449)

Memory(Per iteration)

Memory(r1397404)

Memory(Per iteration)

Memory trend between build

saveNewSWWithPic

72912KB – 80980KB

+80.68KB

73476KB – 83940KB

+104.64KB

Up

saveNewSWWithBullet

78288KB – 85832KB

+75.44KB

77764KB – 87664KB

+99KB

Up

saveNewSWWithUnDoDelete

72956KB – 80168KB

+72.12KB

73412KB – 82840KB

+94.28

Up

saveNewSWWithSpellCheck

77772KB – 85580KB

+78.08KB

77156KB – 86960KB

+98.04KB

Up

saveNewSWWithHeaderFooter

76716KB – 83936KB

+72.2KB

76048KB – 85472KB

+94.24KB

Up

saveNewSWWithFrameAnchor

73928KB – 81292KB

+73.64KB

74964KB – 83900KB

+89.36KB

Up

saveNewSWWithSDAsOLE

90116KB – 99748KB

+96.32KB

91796KB – 98636KB

+68.4KB

Down

saveNewSWWithTOC

86284KB – 94552KB

+82.68KB

86032KB – 96000KB

+99.68KB

Up

splitMergeTableOnOpenedSW

70572KB – 74380KB

+38.08KB

71272KB – 76944KB

+56.72KB

Up

addDelColumnsRowsInTableOnOpenedSW

70800KB – 74612KB

+38.12KB

71372KB – 77160KB

+57.88KB

Up

setParaPropertoesOnOpenedSW

95412KB – 100472KB

+50.6KB

96268KB – 103028KB

+67.6KB

Up

InsertPicToOpenedSW

94900KB – 97444KB

+61KB

95368KB – 100248KB

+116KB

Up

InsertOLEToOpenedSW

103352KB – 113592KB

+102.4KB

104416KB – 115124KB

+107.8KB

No

InsertChartToOpenedSW

111364KB – 1125652KB

+10142.88KB

112628KB – 1088060KB

+9754.32KB

Down

openSWWithXForm

78732KB – 91148KB

+124.16KB

75800KB – 82764KB

+69.64KB

Down

openSWWithSecuritySignature

70676KB – 74340KB

+36.64KB

77504KB – 82784KB

+52.8KB

Up

saveNewSWWithShapeToHTML

68576KB – 80456KB

+118.8KB

69152KB – 82680KB

+135.28KB

Up

saveNewSWWithLineToDoc

73460KB – 90468KB

+170.08

75548KB – 92496KB

+169.48KB

No

saveNewSWWithPicToDoc

72944KB – 81720KB

+87.76KB

73320KB – 84100KB

+107.8KB

Up


SVT Cases Description

Scenario Name

Description

saveNewSWWithPic

  1. Create a new Writer file
  2. Insert a picture from file
  3. Save and reopen this Writer file

saveNewSWWithBullet

  1. Create a new Writer file
  2. Input some paragraphs
  3. Set bullet for these paragraphs
  4. Undo and Redo
  5. Save and reopen this Writer file

saveNewSWWithUnDoDelete

  1. Create a new Writer file
  2. Insert a Ellipse Shape
  3. Delete this shape
  4. Undo and Redo
  5. Save and reopen this Writer file

saveNewSWWithSpellCheck

  1. Create a new Writer file
  2. Input a word with wrong spell
  3. Pop up Spell check
  4. Select the first word in Suggest list
  5. Click Ignore Once button
  6. Save and reopen this Writer file

saveNewSWWithHeaderFooter

  1. Create a new Writer file
  2. Insert default header and footer
  3. Save and reopen this Writer file

saveNewSWWithFrameAnchor

  1. Create a new Writer file
  2. Insert a new Frame
  3. Format frame anchor “To Page”, “To Paragraph”, “To Character”, “As character”
  4. Save and reopen this Writer file

saveNewSWWithSDAsOLE

  1. Create a new Writer file
  2. Insert a odp file as OLE object, and link to file
  3. Activate this OLE object and exit
  4. Save and reopen this Writer file

saveNewSWWithTOC

  1. Create a new Writer file
  2. Input some paragraphs
  3. Set some style for them
  4. Insert Index and Tables
  5. Save and reopen this Writer file

splitMergeTableOnOpenedSW

  1. Open a odt file with table in it
  2. Split cells and Merge cell in this table
  3. Close without Save this file

addDelColumnsRowsInTableOnOpenedSW

  1. Open a odt file with table in it
  2. Insert row to this table
  3. Delete row of this table
  4. Insert column to this table
  5. Delete column of this table
  6. Close without save this file

setParaPropertoesOnOpenedSW

  1. Open a odt sample file
  2. Pop up paragraph dialog
  3. Set Vertical paragraph alignment with “Bottom”
  4. Close without save this file

InsertPicToOpenedSW

  1. Open a plain odt sample file
  2. Insert a picture from file
  3. Close without save

InsertOLEToOpenedSW

  1. Open a plain odt file
  2. Insert a default OLE object
  3. Close without save

InsertChartToOpenedSW

  1. Open a plain odt file
  2. Insert a default OLE object
  3. Close without save

openSWWithXForm

  1. Open a sample file with XForm
  2. Close this file

openSWWithSecuritySignature

  1. Open a sample file with security signature
  2. Close this file

saveNewSWWithShapeToHTML

  1. Create a new Writer file
  2. Insert a shape
  3. Save to html file then close

saveNewSWWithLineToDoc

  1. Create a new Writer file
  2. Insert 10 lines
  3. Save to doc file then close

saveNewSWWithPicToDoc

  1. Create a new Writer file
  2. Insert a picture from file
  3. Save to doc file then close
Personal tools