User:Foral/automation/testcase
From Apache OpenOffice Wiki
After automation test
After automation test.we should fill out what kind of error and warnings ...etc.
- step 1:Make Summary
- step 2:See the Log
- step 3:See the Testcase
- step 4:Do it by your hand and filling out the reasun.
Step 1:Make Summary
To get sammary,you can use tools/make_summary.pl and make a summary of test result. and you can explore the test result.
this sample from 3.1.1rc1 release testing. i tested on Fedora 11 with OOo3.1.1rc1 Linux without JRE version.
bash-4.0$ ./make_summary.pl ../../errorlogs/*.res Filename Errors Warnings Warnings_during_initialization ============================ ====== ======== ============================== c_import_general.res 0 0 0 c_updt1.res 1 1 0 c_updt2.res 0 0 0 c_xml_scenario.res 0 0 0 ch2_flexible_source_range_se 2 2 0 ch2_losa_ods_to_ods.res 0 0 0 ch2_losa_ods_to_xls.res 0 0 0 ch2_losa_sxc_to_ods.res 0 0 0 ch2_losa_sxc_to_sdc.res 0 0 0 ch2_lvl1_wizard.res 0 0 0 ch2_updt_calc.res 1 1 0 ch_xml_japanese_candlestick. 0 0 0 closeoffice.res 1 0 0 d_export_graphic_a.res 0 0 0 d_export_graphic_b.res 0 0 0 d_opt.res 0 0 0 d_updt.res 0 0 0 dba_Main.res 0 0 0 dba_ReportBuilder.res 0 0 0 dba_frm_FormFilter.res 0 0 0 dba_frm_Forms.res 1 3 0 dba_misc_RegisterDatabase.re 0 0 0 dba_rpt_DateTime.res 0 0 0 dba_rpt_ExecuteReport.res 0 0 0 dba_rpt_Formating.res 0 0 0 dba_rpt_Grouping.res 0 0 0 dba_rpt_PageNumber.res 0 1 0 dba_rpt_PropertyBrowser.res 0 0 0 dba_xf_Submission.res 0 0 0 dba_xforms_Main.res 0 0 0 e_fileopen.res 0 0 0 e_location.res 0 0 0 e_options.res 0 0 0 e_update.res 0 0 0 f_basic_dialogs.res 0 0 0 f_basic_issues.res 0 0 0 f_basic_protected_libraries. 0 0 0 f_basic_shared_modules.res 0 0 0 f_configuration.res 0 2 0 f_extras_labels.res 0 0 0 f_extras_tableautoformat.res 0 0 0 f_extras_templatepreview.res 0 0 0 f_filedlg_cjk_files.res 0 0 0 f_filedlg_reserved_names_uni 0 0 0 f_first.res 0 0 0 f_help_browser.res 0 0 0 f_help_compare_applications. 0 0 0 f_help_search.res 0 0 0 f_printer_administration.res 0 0 0 f_script_organizers.res 0 0 0 f_security_certification_dia 0 0 0 f_security_dialogs.res 0 0 0 f_security_incorrect_passwor 0 0 0 f_security_trusted_path.res 0 0 0 f_standard_toolbar.res 0 0 0 f_tools_customize.res 0 0 0 f_tools_options.res 0 0 0 f_topten.res 0 0 0 Filename Errors Warnings Warnings_during_initialization ============================ ====== ======== ============================== f_window_functions.res 0 0 0 f_wizards.res 1 1 0 g_autocorrection.res 0 0 0 g_character.res 0 4 0 g_customshapes.res 0 0 0 g_export_html.res 0 0 0 g_group.res 0 0 0 g_imagemap.res 0 0 0 g_line.res 0 0 0 g_mediaplayer.res 0 0 0 g_ole.res 0 0 0 g_paragraph.res 0 0 0 g_print.res 0 0 0 g_shaddow.res 0 0 0 g_tools.res 0 0 0 g_zoom.res 0 0 0 i_opt.res 0 0 0 i_slidecopy.res 0 0 0 i_updt_1.res 0 0 0 i_updt_2.res 0 0 0 m_lvl1.res 0 0 0 m_updt.res 0 0 0 oasis_graphics_update.res 0 0 0 resetoffice.res 0 0 0 w_numbering.res 0 5 0 w_section.res 2 16 0 w_shortcuts.res 0 0 0 w_sorting.res 0 0 0 w_spellcheck.res 0 5 0 w_updt.res 0 1 0 writer_xml_7_export.res 0 0 0 ============================================================================== Total 89 files 9 42 0
step 2:See the Log
you know which test script made error and warnings. so you should find out the log from result file.
bash-4.0$ ./translate_res_file.pl ../../errorlogs/ch2_flexible_source_range_selection.res |grep ^ERROR -B 5 MESSAGE: Close document TEST_CASE: TEST_CASE: tDataRangeDialogWriter MESSAGE: Open test document gTestToolPath/chart2/required/input/ch_flexrange07.odt MESSAGE: Select chart using navigator ERROR: Auswahlliste : Entry number 5 is too large in Select. Max. allowed is 0 -- WARNING: BORDERWINDOW "無題 1 - OpenOffice.org Writer TTD :localhost.localdomain[12479]" geschlossen, RType = BORDERWINDOW, UId = Active TEST_CASE: TEST_CASE: tDataSeriesDialogWriter MESSAGE: Open test document gTestToolPath/chart2/required/input/ch_flexrange08.odt MESSAGE: Select chart using navigator ERROR: Auswahlliste : Entry number 5 is too large in Select. Max. allowed is 0
cat ch2_flexible_source_range_selection01.inc |grep "testcase*\|'"
