Build Environment Effort/Scalability

Build Environment Effort
Quick Navigation Customers Build Performance Elimination of Non-Pro Dependencies Module Problems Split Build Scalability HID List New Build System Requirements External Source Tarballs ToDo Build System Analysis Zen of gbuild Gbuild Bootstrapping Module Migration Module Migration Tips Build System Analysis:capstone2013 windows build Capstone 2013 Client Requirements Document Capstone 2013 Technology Review & Implementation Document
About this template

Parallelization in the current build process

Measure Configuration

Hardware:

• System: Sun Ultra 24
• CPU: Intel(R) Core(TM)2 Quad CPU Q9650 @ 3.00GHz
• RAM: 8GB
• FS: ext3 relatime 224GB partition filled 90%

Software:

• OS: Ubuntu Linux 9.04
• Compiler: gcc (Ubuntu 4.3.3-5ubuntu4) 4.3.3
• Configure: ./configure --with-use-shell=bash --with-system-libs --without-system-jars --without-system-icu --without-system-agg --without-system-lpsolve --without-system-mspack --disable-mozilla
• Source: DEV300_m62

Results

no parallelization

A build --all took 11281 seconds (3:08:01 hours). Thus the theoretical ideal build time on this four-way system should be 2821 seconds (0:47:01 hours).

only parallelization by build.pl

A build --all -P9 took 3429 seconds (0:57:09 hours). Compared to the theoretical shortest build time this an overhead of 21.5%. Here is a graphic showing how much of the build time is spend with a given number of parallel dmake processes:

And here is the timeline: P9 P1 Timeline

parallelization by build.pl and dmake

A build --all -P4 -- -P4 took 2820 seconds (0:54:40 hours). Compared to the theoretical shortest build time this is an overhead of 16.3%. Here is a graphic showing how much of the build time is spend with a given number of parallel dmake processes:

And here is the timeline: P4 P4 Timeline