Revision as of 12:18, 28 March 2010

Test Cleanup Project

See the mission statement mail.

User Interface

For tests in C++, plain CppUnit (at least version 1.12.1) is available. (OOo bundles CppUnit 1.12.1 as an external module; alternatively, you can configure --with-system-cppunit.)

• sal cppunittester
• ENABLE_EXCEPTIONS=TRUE, CFLAGSCXX+=$(CPPUNIT_CFLAGS), SHLnVERSIONMAP=...cppunitTestPlugIn, SHLnRPATH=NONE, SHLnSTDLIBS+=$(CPPUNITLIB)
• $(CPPUNITTESTER) uses $(AUGMENT_LIBRARY_PATH_LOCAL) to favor library instances in local output tree over ones in solver
• solenv/inc/_cppunit.mk (deprecated?)

For tests in Java, plain JUnit (at least version 4) is available. (OOo requires JUnit as a prerequisite, see junit.org for downloads; you can configure --with-junit if it is not automatically found; alternatively, you can configure --without-junit, disabling JUnit-based tests.)

Details

Working on CWS sb118  , CWS sb120  .

CppUnit 1.12.1

• Replace existing cppunit and testshl2 combo with latest CppUnit 1.12.1.
• OOo configure --with-system-cppunit (for now only if also --with-system-stl!); minimal required version for now arbitrarily 1.12.1.
• TODO: Upstream PATCH_FILES (windows.patch?!?).
• TODO: RPATH in generated libraries and executables.
• TODO: Improve CPPUNIT_PLUGIN_EXPORT and get rid of version maps (GCC exception problems?).
• TODO: cppunit/makefile.mk MY_LIBS = -lm Solaris hack.
• TODO: In general OOo build environment, no longer set CFLAGS etc. as environment variables; have package-specific OOO_package_CFLAGS etc. and combine those into CFLAGS etc. where necessary (see OOO_STLPORT_CXXFLAGS etc. in cppunit/makefile.mk).
• TODO: Why use cppunittester instead of DllPlugInTester? (Remove building/delivering DllPlugInTester.)
• TODO: Make CppUnit::assertion_traits<rtl::OUString> from smoketestoo_native/smoketest.cxx generally available.

testshl2

• solenv/inc_cppunit.mk/cppunit.mk: “adapted cppunit.mk to cppunittester and no longer require ‘dmake test’ to run tests”.
• TODO: DEV300_m68 introduced TESTSHL2LIB (which I removed again) and uses it in many qa makefiles (that I need to touch someday, anyway).

Unit Tests

• OOO_SUBSEQUENT_TESTS (build.lst lists local dependencies of those directories, so that modifying a module and then calling “OOO_SUBSEQUENT_TESTS=x build” rebuilds the module and executes the tests).
• TODO: If Build Environment 2.0 would build directly to solver (instead of local output tree/deliver), that would simplify tests that currently need to take care to test local libraries instead of solver ones (see, for example, OOO_TEST_PREFIX in the services.rdb of stoc/test/uriproc/makefile.mk).
• TODO: Constructs like “-env:UNO_…=$(my_file)…” would fail for problematic characters (spaces!) in paths.

Smoke Test

• Redesign smoketestoo_native to use CppUnit and pre-installed OOo.
• TODO: For smoketestoo_native/makefile.mk “-env:arg-env=$(OOO_LIBRARY_PATH_VAR)"$${{$(OOO_LIBRARY_PATH_VAR)+=$$$(OOO_LIBRARY_PATH_VAR)}}"” mechanism: osl_executeProcess ustrEnvironments members without “=”: all platforms; documentation; documentation of osl_executeProcess_WithRedicrectedIO.
• TODO: Dynamically create smoketestdoc.sxw?
• TODO: “changed tools/debug to never fall back from writing to shell to writing to file, and read DBGSV_INIT from rtl::Bootstrap; the latter causes problems if tools/debug is called from static code executing before SAL_MAIN has called osl_setCommandArgs → removed statics from code and added assertions to osl/process; various improvements to smoketests.cxx (incl. passing an appropriate dbgsv.ini for non-pro builds)”: Instead of -env:DBGSV_INIT= in smoketest.cxx (and supporting DBGSV_INIT as bootstrap variable), globally in the build environment let DBGSV_INIT environment variable point to a dbgsv.ini with error=coredump, to catch all assertions thrown during build time (incl. ones from tests like smoke test; see Issue 109142 ).
• TODO: -headless? (appears to still display windows on Windows and Mac OS X, however, see Issue 109052 )

Pre-Installed OOo

• For Sun Hamburg Release Engineering, take MWS archive installation sets from “S:” instead of solver: “take installation set from SHIPDRIVE if appropriate”.
• TODO: PKGFORMAT=installed instead of archive?

unoapi Tests

• Known issues: Issue 109517 , Issue 109518 , Issue 109643 , Issue 109917 .
• Missing tests: Issue 109564 .
• Sporadic failures: Issue 109728 , Issue 109770 , Issue 109916 , Issue 109939 , Issue 110253 .