Apache OpenOffice Wiki - User contributions [en]

Performance/load performance implement

2010-12-06T09:12:42Z

Zengliangjun: /* Plan */

{{Performance}}
Please view [[Performance/load_performance_analysis]] about analysis. This document explain implement and some discussion.

= Implement =

== Collect data throught sax: ==
* The first step is simple, and no more problem.
* We can collect valid data information to a data structure throught sax parser, the structure's elements can be queried quickly by location identified. I select the vector, now.
* The element has these base fields:
** sal_uInt16 m_prefix;
** rtl_uString* mp_localName;
** sal_uInt32 m_local;
** sal_uInt32 m_distance;
** sal_uInt32 m_count;
** and other fields such as namespace / full name / cached token enum ...

== Processing method ==
* We can go through the result's element by element's "m_local" "m_distance" "m_count"; Get parent element and subelements.
* Every element's processing that has two process steps:
** Process itself , process the attribute and process subelements.
** The result information commit to the parent element.
[[Image:Odfcontext Process Implement.jpg]]

*** processElement() : Process element
**** _startElement() : Start element
**** processSubContexts() : If this element is a parent element, subelements process; every subelement processing will be divided into three steps.
***** _createChildContext(): Create son context
***** _processSubContext(): Process subelement
***** _collectSubContext(): Collect the subelement's result data
**** _characters(): Process element's content
**** _endElement(): End element
*** commit(): commit the result data to parent element

=== Solutions ===
An element has three solutions, Serial / Parallel / delayed processing.
==== Serial processing ====
* Every element will be same processing. As current processing end, back to parent. The parent will jump to next son processing if has next, or back to parent's parent.
==== Parallel processing ====
* One element that has many subelements, will split every subelement's "_processSubContext()" into different work thread. When all subelements end, the "_collectSubContext()" will be serial processing.
==== Delayed processing ====
* One element that has many subelements, the first subelement will process and the others will delay to the document processing end.

== Processing ==
* It is serial processing to the interests of the whole.
** We know an odf document will be four base parts : "meta" "settings" "styles" "content".
** The dependent relation is : "content" -> "styles" -> "settings" -> "meta"( I think it is no more problem -:) )
** So It will be same as now "meta" -> "settings" -> "styles" -> "content".

* To every part parallel processing ,that will be possible.
** Meta part, Settings part and Styles part those can be "Parallel processing".
** I think it can be "Parallel processing" or "Delayed processing", Conent part; No other part depend this part.

= Difficulty =

== Meta part ==
* We know "<office:meta>" , it's subelements is like "<meta:*>". I think the subelements has no correlation between. That can be parallel processing.
* Currently, this part process a DOM object, I do't know why. So this part is serial processing, now.

== Settings part ==
* The "<office:settings>", every subelement of that will get an "beans::PropertyValue". It can be parallel processing.

== Styles part and Conent part ==
* The object from sfx2 , sd , sc and sw; It is complex.

= Plan =
* Implement almost source code about sd to plan.
* Debug the Serial processing process is right.
* Try to test Parallel processing.
* Try to analysis the Delayed processing is feasibility.[[Performance/load_performance_implement_2]]

[[Category:Performance]]

Performance/load performance implement 2

2010-12-06T09:04:08Z

Zengliangjun:

Please view [[Performance/load_performance_analysis]] about analysis. This document explain implement and some discussion.

And This document is my second plan.

[[File:Lag_load.jpg]]

[[Category:Performance]]

Performance/load performance implement 2

2010-12-02T09:00:27Z

Zengliangjun: Created page with 'Please view Performance/load_performance_analysis about analysis. This document explain implement and some discussion. And This document is my second plan. [[File:Lag_load.…'

Please view [[Performance/load_performance_analysis]] about analysis. This document explain implement and some discussion.

And This document is my second plan.

[[File:Lag_load.jpg]]

File:Lag load.jpg

2010-12-02T08:59:49Z

Zengliangjun:

Performance/load performance implement parallel mutex

2010-05-31T05:05:22Z

Zengliangjun: /* Solve C */

{{Performance}}
Please view [[Performance/load_performance_implement]] about implement. This document explain parallel and dead lock problem and resolve plan.

= Problem =
Now I'd finished the part of odf impress's code, and wish is:

'''settings.xml''' when processing the <office:settings> element, it's subelement will be parallel processed.

'''styles.xml''' when processing the <office:styles> and <office:automatic-styles> and <office:master-styles> elements, it's subelement will be parallel processed.

'''content.xml''' when processing the <office:presentation> and styles's elements, it's subelement will be parallel processed.

When running, that will dead lock.

= Analysis =
We can understand OOo had three type mutex.
*''' Global Mutex''': It can be get from '''osl::Mutex::getGlobalMutex()''', and can be used at a simple critical which lock section no other mutex.

*'''Solar Mutex''': It can be get from '''Application::GetSolarMutex()''', and can be used any where. which lock section can had other mutex, and can be spin lock. It's used at the uno implement class's method section, main function is synchronization UNO environment.

*'''General Mutex''': It can be used other thread and OOo main thread, etc. Which can be as same type.

So, Dead lock will be, It like this:

[[Image:Parallel dead lock.jpg]]

= Solve =
It will be new parallel_mutex model, so we must let the 'Solar Mutex' will not acquire at parallel section; It is ease.

[[Image:Parallel dead lock solve.JPG]]

== Problem ==
But there will synchronization problem; where the base struct like svarray(svl) and std::vector etc. be there.

== Solve A ==
We must let the 'Solar Mutex' synchronization at parallel section, so there are an other mutex object.

So we can design 'Solar Mutex' has two mutex objects, One synchronize at general section and One synchronize at parallel section. How 'Solar Mutex' can know it is general or parallel section; there are function ''omp_in_parallel()'' in OpenMP . Now It like this:

[[Image:Parallel dead lock solve 1.JPG]]

Ok, that is right, Yes it not wrong. But performance no improve. I think it is that the synchronize section is much block. So the processing is multithread, But all most time only one thread can runing, and other thread is block.

== Solve B ==
Can we let those structs are all thread safe?
That can improve the performance? The consuming from thread safe will ....
And Do that can solve this problem?

== Solve C ==
Can we think the relation like document -> page -> shape -> ....

When create one shape, the document will add some info about shape, So document's data will be in multi-thread context. Can we reorder the operator create the relation of document with shape, let that will be at the page had process finished.

[[Category:Performance]]

Performance/load performance implement parallel mutex

2010-05-31T03:28:36Z

Zengliangjun:

{{Performance}}
Please view [[Performance/load_performance_implement]] about implement. This document explain parallel and dead lock problem and resolve plan.

= Problem =
Now I'd finished the part of odf impress's code, and wish is:

'''settings.xml''' when processing the <office:settings> element, it's subelement will be parallel processed.

'''styles.xml''' when processing the <office:styles> and <office:automatic-styles> and <office:master-styles> elements, it's subelement will be parallel processed.

'''content.xml''' when processing the <office:presentation> and styles's elements, it's subelement will be parallel processed.

When running, that will dead lock.

= Analysis =
We can understand OOo had three type mutex.
*''' Global Mutex''': It can be get from '''osl::Mutex::getGlobalMutex()''', and can be used at a simple critical which lock section no other mutex.

*'''Solar Mutex''': It can be get from '''Application::GetSolarMutex()''', and can be used any where. which lock section can had other mutex, and can be spin lock. It's used at the uno implement class's method section, main function is synchronization UNO environment.

*'''General Mutex''': It can be used other thread and OOo main thread, etc. Which can be as same type.

So, Dead lock will be, It like this:

[[Image:Parallel dead lock.jpg]]

= Solve =
It will be new parallel_mutex model, so we must let the 'Solar Mutex' will not acquire at parallel section; It is ease.

[[Image:Parallel dead lock solve.JPG]]

== Problem ==
But there will synchronization problem; where the base struct like svarray(svl) and std::vector etc. be there.

== Solve A ==
We must let the 'Solar Mutex' synchronization at parallel section, so there are an other mutex object.

So we can design 'Solar Mutex' has two mutex objects, One synchronize at general section and One synchronize at parallel section. How 'Solar Mutex' can know it is general or parallel section; there are function ''omp_in_parallel()'' in OpenMP . Now It like this:

[[Image:Parallel dead lock solve 1.JPG]]

Ok, that is right, Yes it not wrong. But performance no improve. I think it is that the synchronize section is much block. So the processing is multithread, But all most time only one thread can runing, and other thread is block.

== Solve B ==
Can we let those structs are all thread safe?
That can improve the performance? The consuming from thread safe will ....
And Do that can solve this problem?

== Solve C ==
Can we think the relation like document -> page -> shape -> ....
That create one shape and the document will add some info about shape, So document's data will be multi-thread. Can we reorder the operator create the relation of document with shape, let that will be at the page had process finished.

[[Category:Performance]]

File:Parallel dead lock solve.JPG

2010-05-31T02:56:29Z

Zengliangjun:

Performance/load performance implement parallel mutex

2010-05-31T02:29:45Z

Zengliangjun:

Performance/load performance implement parallel mutex

2010-05-31T01:56:02Z

Zengliangjun:

File:Parallel dead lock solve 1.JPG

2010-05-31T01:50:58Z

Zengliangjun: uploaded a new version of "File:Parallel dead lock solve 1.JPG"

Performance/load performance implement parallel mutex

2010-05-28T08:56:04Z

Zengliangjun: (checkpoint save)

{{Performance}}
Please view [[Performance/load_performance_implement]] about implement. This document explain parallel and dead lock problem and resolve plan.

= Problem =
Now I'd finished the part of odf impress's code, and wish is:

'''settings.xml''' when processing the <office:settings> element, it's subelement will be parallel processed.

'''styles.xml''' when processing the <office:styles> and <office:automatic-styles> and <office:master-styles> elements, it's subelement will be parallel processed.

'''content.xml''' when processing the <office:presentation> and styles's elements, it's subelement will be parallel processed.

When running, that will dead lock.

= Analysis =
We can understand OOo had three type mutex.
*''' Global Mutex''': It can be get from '''osl::Mutex::getGlobalMutex()''', and can be used at a simple critical which lock section no other mutex.

*'''Solar Mutex''': It can be get from '''Application::GetSolarMutex()''', and can be used any where. which lock section can had other mutex, and can be spin lock. It's used at the uno implement class's method section, main function is synchronization UNO environment.

*'''General Mutex''': It can be used other thread and OOo main thread, etc. Which can be as same type.

So, Dead lock will be, It like this:

[[Image:Parallel dead lock.jpg]]

<source lang="text">

= Solve A plan =

*'''The First:''' So we must let the 'Solar Mutex' will not acquire at parallel section, It is ease.

But there will synchronization problem; where the memory, and other error will be there.

*'''The Second:''' We must let the 'Solar Mutex' synchronization at parallel section, so there are an other mutex object.

So we can design 'Solar Mutex' has two mutex objects, One synchronize at general section and One synchronize at parallel section. How 'Solar Mutex' can know it is general or parallel section; we can register the parallel thread to 'Solar Mutex'. Now It like this:

[[Image:Parallel dead lock solve 1.JPG]]

Ok, that seem is right, Yes it not wrong. But performance no improve. I think it is that the synchronize section is much block. So the processing is multithread, But all most time only one thread can runing, and other thread is block.

So I design the new mutex model, and will test it right or no.
= Solve B plan =

*'''The First:'''
OOo use class 'Guard' to lock section. Can we register the first 'Guard' on mutex object, in the sub section a new 'Guard' can know this mutex had locked. So it will n't call the mutex acquire. When 'Guard' destory it will know it is the register 'Guard' or no, It will release the mutex as true.

*'''The Second:'''
We will define five type mutex.

(1) '''Simple Mutex:''' like the abover description.

(2) '''Parallel Mutex:''' It's only used at the parallel section, it will be invalid.

(3) '''Global Mutex:''' like OOo now, but when it used at the parallel section, it will used 'Parallel Mutex'.

(4) '''Solar Mutex:''' like OOo now, but when it used at the parallel section, it will be invalid.

(5) '''General Mutex:''' like OOo now, but when it used at the parallel section, it will used 'Parallel Mutex'.

So 'Parallel Mutex' will be used to synchronization the resource like 'memory' and 'ref count' and 'svarry' etc. at the parallel section .

</source>

[[Category:Performance]]

Performance/load performance implement parallel mutex

2010-05-28T08:50:18Z

Zengliangjun:

{{Performance}}
Please view [[Performance/load_performance_implement]] about implement. This document explain parallel and dead lock problem and resolve plan.

= Problem =
Now I'd finished the part of odf impress's code, and wish is:

'''settings.xml''' when processing the <office:settings> element, it's subelement will be parallel processed.

'''styles.xml''' when processing the <office:styles> and <office:automatic-styles> and <office:master-styles> elements, it's subelement will be parallel processed.

'''content.xml''' when processing the <office:presentation> and styles's elements, it's subelement will be parallel processed.

When running, that will dead lock.

= Analysis =
We can understand OOo had three type mutex.
*''' Global Mutex''': It can be get from '''osl::Mutex::getGlobalMutex()''', and can be used at a simple critical which lock section no other mutex.

*'''Solar Mutex''': It can be get from '''Application::GetSolarMutex()''', and can be used any where. which lock section can had other mutex, and can be spin lock. It's used at the uno implement class's method section, main function is synchronization UNO environment.

*'''General Mutex''': It can be used other thread and OOo main thread, etc. Which can be as same type.

So, Dead lock will be, It like this:

[[Image:Parallel dead lock.jpg]]

'============================================================'

= Solve A plan =

*'''The First:''' So we must let the 'Solar Mutex' will not acquire at parallel section, It is ease.

But there will synchronization problem; where the memory, and other error will be there.

*'''The Second:''' We must let the 'Solar Mutex' synchronization at parallel section, so there are an other mutex object.

So we can design 'Solar Mutex' has two mutex objects, One synchronize at general section and One synchronize at parallel section. How 'Solar Mutex' can know it is general or parallel section; we can register the parallel thread to 'Solar Mutex'. Now It like this:

[[Image:Parallel dead lock solve 1.JPG]]

Ok, that seem is right, Yes it not wrong. But performance no improve. I think it is that the synchronize section is much block. So the processing is multithread, But all most time only one thread can runing, and other thread is block.

So I design the new mutex model, and will test it right or no.
= Solve B plan =

*'''The First:'''
OOo use class 'Guard' to lock section. Can we register the first 'Guard' on mutex object, in the sub section a new 'Guard' can know this mutex had locked. So it will n't call the mutex acquire. When 'Guard' destory it will know it is the register 'Guard' or no, It will release the mutex as true.

*'''The Second:'''
We will define five type mutex.

(1) '''Simple Mutex:''' like the abover description.

(2) '''Parallel Mutex:''' It's only used at the parallel section, it will be invalid.

(3) '''Global Mutex:''' like OOo now, but when it used at the parallel section, it will used 'Parallel Mutex'.

(4) '''Solar Mutex:''' like OOo now, but when it used at the parallel section, it will be invalid.

(5) '''General Mutex:''' like OOo now, but when it used at the parallel section, it will used 'Parallel Mutex'.

So 'Parallel Mutex' will be used to synchronization the resource like 'memory' and 'ref count' and 'svarry' etc. at the parallel section .

'============================================================'

[[Category:Performance]]

Performance/load performance implement parallel mutex

2010-04-16T09:20:21Z

Zengliangjun: /* Solve B plan */

{{Performance}}
Please view [[Performance/load_performance_implement]] about implement. This document explain parallel and dead lock problem and resolve plan.

= Problem =
Now I'd finished the part of odf impress's code, and wish is:

'''settings.xml''' when processing the <office:settings> element, it's subelement will be parallel processed.

'''styles.xml''' when processing the <office:styles> and <office:automatic-styles> and <office:master-styles> elements, it's subelement will be parallel processed.

'''content.xml''' when processing the <office:presentation> and styles's elements, it's subelement will be parallel processed.

When running, that will dead lock.

= Analysis =
We can understand OOo had three type mutex.
*''' Global Mutex''': It can be get from '''osl::Mutex::getGlobalMutex()''', and can be used at a simple critical which lock section no other mutex.

*'''Solar Mutex''': It can be get from '''Application::GetSolarMutex()''', and can be used any where. which lock section can had other mutex, and can be spin lock. It's used at the uno implement class's method section, main function is synchronization UNO environment.

*'''General Mutex''': It can be used other thread and OOo main thread, etc. Which can be as same type.

So, Dead lock will be, It like this:

[[Image:Parallel dead lock.jpg]]
= Solve A plan =

*'''The First:''' So we must let the 'Solar Mutex' will not acquire at parallel section, It is ease.

But there will synchronization problem; where the memory, and other error will be there.

*'''The Second:''' We must let the 'Solar Mutex' synchronization at parallel section, so there are an other mutex object.

So we can design 'Solar Mutex' has two mutex objects, One synchronize at general section and One synchronize at parallel section. How 'Solar Mutex' can know it is general or parallel section; we can register the parallel thread to 'Solar Mutex'. Now It like this:

[[Image:Parallel dead lock solve 1.JPG]]

Ok, that seem is right, Yes it not wrong. But performance no improve. I think it is that the synchronize section is much block. So the processing is multithread, But all most time only one thread can runing, and other thread is block.

So I design the new mutex model, and will test it right or no.
= Solve B plan =

*'''The First:'''
OOo use class 'Guard' to lock section. Can we register the first 'Guard' on mutex object, in the sub section a new 'Guard' can know this mutex had locked. So it will n't call the mutex acquire. When 'Guard' destory it will know it is the register 'Guard' or no, It will release the mutex as true.

*'''The Second:'''
We will define five type mutex.

(1) '''Simple Mutex:''' like the abover description.

(2) '''Parallel Mutex:''' It's only used at the parallel section, it will be invalid.

(3) '''Global Mutex:''' like OOo now, but when it used at the parallel section, it will used 'Parallel Mutex'.

(4) '''Solar Mutex:''' like OOo now, but when it used at the parallel section, it will be invalid.

(5) '''General Mutex:''' like OOo now, but when it used at the parallel section, it will used 'Parallel Mutex'.

So 'Parallel Mutex' will be used to synchronization the resource like 'memory' and 'ref count' and 'svarry' etc. at the parallel section .

[[Category:Performance]]

Performance/load performance implement parallel mutex

2010-04-16T09:17:33Z

Zengliangjun: /* Solve B plan */ (checkpoint save)

{{Performance}}
Please view [[Performance/load_performance_implement]] about implement. This document explain parallel and dead lock problem and resolve plan.

= Problem =
Now I'd finished the part of odf impress's code, and wish is:

'''settings.xml''' when processing the <office:settings> element, it's subelement will be parallel processed.

'''styles.xml''' when processing the <office:styles> and <office:automatic-styles> and <office:master-styles> elements, it's subelement will be parallel processed.

'''content.xml''' when processing the <office:presentation> and styles's elements, it's subelement will be parallel processed.

When running, that will dead lock.

= Analysis =
We can understand OOo had three type mutex.
*''' Global Mutex''': It can be get from '''osl::Mutex::getGlobalMutex()''', and can be used at a simple critical which lock section no other mutex.

*'''Solar Mutex''': It can be get from '''Application::GetSolarMutex()''', and can be used any where. which lock section can had other mutex, and can be spin lock. It's used at the uno implement class's method section, main function is synchronization UNO environment.

*'''General Mutex''': It can be used other thread and OOo main thread, etc. Which can be as same type.

So, Dead lock will be, It like this:

[[Image:Parallel dead lock.jpg]]
= Solve A plan =

*'''The First:''' So we must let the 'Solar Mutex' will not acquire at parallel section, It is ease.

But there will synchronization problem; where the memory, and other error will be there.

*'''The Second:''' We must let the 'Solar Mutex' synchronization at parallel section, so there are an other mutex object.

So we can design 'Solar Mutex' has two mutex objects, One synchronize at general section and One synchronize at parallel section. How 'Solar Mutex' can know it is general or parallel section; we can register the parallel thread to 'Solar Mutex'. Now It like this:

[[Image:Parallel dead lock solve 1.JPG]]

Ok, that seem is right, Yes it not wrong. But performance no improve. I think it is that the synchronize section is much block. So the processing is multithread, But all most time only one thread can runing, and other thread is block.

So I design the new mutex model, and will test it right or no.
= Solve B plan =

*'''The First:'''
OOo use class 'Guard' to lock section. Can we register the first 'Guard' on mutex object, in the sub section a new 'Guard' can know this mutex had locked. So it will n't call the mutex acquire. When 'Guard' destory it will know it is the register 'Guard' or no, It will release the mutex as true.

*'''The Second:'''
We will define five type mutex.

(1) '''Simple Mutex:''' like the abover description.

(2) '''Parallel Mutex:''' It's only used at the parallel section, it will be invalid.

(3) '''Global Mutex:''' like OOo now, but when it used at the parallel section, it will used 'Parallel Mutex'.

(4) '''Solar Mutex:''' like OOo now, but when it used at the parallel section, it will be invalid.

(5) '''General Mutex:''' like OOo now, but when it used at the parallel section, it will used 'Parallel Mutex'.

So 'Parallel Mutex' will be used to synchronization the resource like 'memory' and 'ref count' and 'svarry' etc. at the parallel section .

Performance/load performance implement parallel mutex

2010-04-16T09:15:06Z

Zengliangjun:

{{Performance}}
Please view [[Performance/load_performance_implement]] about implement. This document explain parallel and dead lock problem and resolve plan.

= Problem =
Now I'd finished the part of odf impress's code, and wish is:

'''settings.xml''' when processing the <office:settings> element, it's subelement will be parallel processed.

'''styles.xml''' when processing the <office:styles> and <office:automatic-styles> and <office:master-styles> elements, it's subelement will be parallel processed.

'''content.xml''' when processing the <office:presentation> and styles's elements, it's subelement will be parallel processed.

When running, that will dead lock.

= Analysis =
We can understand OOo had three type mutex.
*''' Global Mutex''': It can be get from '''osl::Mutex::getGlobalMutex()''', and can be used at a simple critical which lock section no other mutex.

*'''Solar Mutex''': It can be get from '''Application::GetSolarMutex()''', and can be used any where. which lock section can had other mutex, and can be spin lock. It's used at the uno implement class's method section, main function is synchronization UNO environment.

*'''General Mutex''': It can be used other thread and OOo main thread, etc. Which can be as same type.

So, Dead lock will be, It like this:

[[Image:Parallel dead lock.jpg]]
= Solve A plan =

*'''The First:''' So we must let the 'Solar Mutex' will not acquire at parallel section, It is ease.

But there will synchronization problem; where the memory, and other error will be there.

*'''The Second:''' We must let the 'Solar Mutex' synchronization at parallel section, so there are an other mutex object.

So we can design 'Solar Mutex' has two mutex objects, One synchronize at general section and One synchronize at parallel section. How 'Solar Mutex' can know it is general or parallel section; we can register the parallel thread to 'Solar Mutex'. Now It like this:

[[Image:Parallel dead lock solve 1.JPG]]

Ok, that seem is right, Yes it not wrong. But performance no improve. I think it is that the synchronize section is much block. So the processing is multithread, But all most time only one thread can runing, and other thread is block.

So I design the new mutex model, and will test it right or no.
= Solve B plan =

*'''The First:'''
OOo use class 'Guard' to lock section. Can we register the first 'Guard' on mutex object, in the sub section a new 'Guard' can know this mutex had locked. So it will n't call the mutex acquire. When 'Guard' destory it will know it is the register 'Guard' or no, It will release the mutex as true.

*'''The Second:'''
We will define five type mutex.

(1) '''Simple Mutex:''' like the abover description.

(2) '''Parallel Mutex:''' It's only used at the parallel section, it will be invalid.

(3) '''Global Mutex:''' like OOo now, but when it used at the parallel section, it will used 'Parallel Mutex'.

(4) '''Solar Mutex:''' like OOo now, but when it used at the parallel section, it will be invalid.

(5) '''General Mutex:''' like OOo now, but when it used at the parallel section, it will used 'Parallel Mutex'.

So we will used 'Parallel Mutex' it will be used to synchronization the resource like 'memory' and 'ref count' and 'svarry' etc.

Performance/load performance implement parallel mutex

2010-04-16T08:08:41Z

Zengliangjun: (checkpoint save)

{{Performance}}
Please view [[Performance/load_performance_implement]] about implement. This document explain parallel and dead lock problem and resolve plan.

= Problem =
Now I'd finished the part of odf impress's code, and wish is:

'''settings.xml''' when processing the <office:settings> element, it's subelement will be parallel processed.

'''styles.xml''' when processing the <office:styles> and <office:automatic-styles> and <office:master-styles> elements, it's subelement will be parallel processed.

'''content.xml''' when processing the <office:presentation> and styles's elements, it's subelement will be parallel processed.

When running, that will dead lock.

= Analysis =
We can understand OOo had three type mutex.
*''' Global Mutex''': It can be get from '''osl::Mutex::getGlobalMutex()''', and can be used at a simple critical which lock section no other mutex.

*'''Solar Mutex''': It can be get from '''Application::GetSolarMutex()''', and can be used any where. which lock section can had other mutex, and can be spin lock. It's used at the uno implement class's method section, main function is synchronization UNO environment.

*'''General Mutex''': It can be used other thread and OOo main thread, etc. Which can be as same type.

So, Dead lock will be, It like this:

[[Image:Parallel dead lock.jpg]]
= Solve A plan =

*'''The First:''' So we must let the 'Solar Mutex' will not acquire at parallel section, It is ease.

But there will synchronization problem; where the memory, and other error will be there.

*'''The Second:''' We must let the 'Solar Mutex' synchronization at parallel section, so there are an other mutex object.

So we can design 'Solar Mutex' has two mutex objects, One synchronize at general section and One synchronize at parallel section. How 'Solar Mutex' can know it is general or parallel section; we can register the parallel thread to 'Solar Mutex'. Now It like this:

[[Image:Parallel dead lock solve 1.JPG]]

Ok, that seem is right, Yes it not wrong. But performance no improve. I think it is that the synchronize section is much block. So the processing is multithread, But all most time only one thread can runing, and other thread is block.

So I design the new mutex model, and will test it right or no.
= Solve B plan =

*'''The First:'''
OOo use class 'Guard' to lock section. Can we register the first 'Guard' on mutex object, in the sub section a new 'Guard' can know this mutex had locked. So it will n't call the mutex acquire. When 'Guard' destory it will know it is the register 'Guard' or no, It will release the mutex as true.

*'''The Second:'''
We will define five type mutex.
**(1) the simple mutex like the abover descri

Performance/load performance implement parallel mutex

2010-04-16T08:02:45Z

Zengliangjun:

{{Performance}}
Please view [[Performance/load_performance_implement]] about implement. This document explain parallel and dead lock problem and resolve plan.

= Problem =
Now I'd finished the part of odf impress's code, and wish is:

'''settings.xml''' when processing the <office:settings> element, it's subelement will be parallel processed.

'''styles.xml''' when processing the <office:styles> and <office:automatic-styles> and <office:master-styles> elements, it's subelement will be parallel processed.

'''content.xml''' when processing the <office:presentation> and styles's elements, it's subelement will be parallel processed.

When running, that will dead lock.

= Analysis =
We can understand OOo had three type mutex.
*''' Global Mutex''': It can be get from '''osl::Mutex::getGlobalMutex()''', and can be used at a simple critical which lock section no other mutex.

*'''Solar Mutex''': It can be get from '''Application::GetSolarMutex()''', and can be used any where. which lock section can had other mutex, and can be spin lock. It's used at the uno implement class's method section, main function is synchronization UNO environment.

*'''General Mutex''': It can be used other thread and OOo main thread, etc. Which can be as same type.

So, Dead lock will be, It like this:

[[Image:Parallel dead lock.jpg]]
= Solve A plan =

*'''The First:''' So we must let the 'Solar Mutex' will not acquire at parallel section, It is ease.

But there will synchronization problem; where the memory, and other error will be there.

*'''The Second:''' We must let the 'Solar Mutex' synchronization at parallel section, so there are an other mutex object.

So we can design 'Solar Mutex' has two mutex objects, One synchronize at general section and One synchronize at parallel section. How 'Solar Mutex' can know it is general or parallel section; we can register the parallel thread to 'Solar Mutex'. Now It like this:

[[Image:Parallel dead lock solve 1.JPG]]

Ok, that seem is right, Yes it not wrong. But performance no improve. I think it is that the synchronize section is much block. So the processing is multithread, But all most time only one thread can runing, and other thread is block.

So I design the new mutex model, and will test it right or no.
= Solve B plan =

*'''The First:'''
OOo use class 'Guard' to lock section. Can we register the first 'Guard' on mutex object, in the sub section a new 'Guard' can know this mutex had locked. So it will n't call the mutex acquire. When 'Guard' destory it will know it is the register 'Guard' or no, It will release the mutex as true.

*'''The Second:'''
We will define five type mutex.
**(1) the simple mutex like the abover descri

Performance/load performance implement parallel mutex

2010-04-16T07:15:20Z

Zengliangjun:

File:Parallel dead lock solve 1.JPG

2010-04-16T07:00:57Z

Zengliangjun:

File:Parallel dead lock.jpg

2010-04-16T06:32:39Z

Zengliangjun: uploaded a new version of "File:Parallel dead lock.jpg"

File:Parallel dead lock.jpg

2010-04-16T06:29:31Z

Zengliangjun: uploaded a new version of "File:Parallel dead lock.jpg"

Performance/load performance implement parallel mutex

2010-04-16T06:20:08Z

Zengliangjun: Created page with '{{Performance}} Please view Performance/load_performance_implement about implement. This document explain parallel and dead lock problem and resolve plan. = Problem = Now I'…'

File:Parallel dead lock.jpg

2010-04-16T06:18:31Z

Zengliangjun:

DomainDeveloper

2010-04-01T06:40:02Z

Zengliangjun: /* Developers */

A mapping of names to OOo accounts.

Abbrev.:

* PL : Project Lead
* CL : Project Co-Lead
* CC : Community Council Member
* ESC : Engineering Steering Committee Member
* CVS : has write access to the OOo CVS repository

----

=== Developers ===

{| class="prettytable sortable"
|-
! Name || CVS || @openoffice.org || [[IRC Communication]] || Notes || Affiliation
|-
| [[User:Agerskov|Claus Agerskov]]|| || cs||Agerskov, cagerskov||PL Project Management Tool ([http://oopm.openoffice.org oopm])||AgerCon
|-
| Volker Ahrendt|| X || va||||||Sun Microsystems
|-
| Kai Ahrens|| X || ka || Kai_Ahrens ||PL Graphic Applications||Sun Microsystems
|-
| Rail Aliev || X || rail || rail || Ru and Tr NL Co-lead || Infra-Resource
|-
| Gene Anaya|| || ganaya||||||
|-
| [[User:JoostAndrae|Joost Andrae]]|| X || ja||ja_||CL qa, release testing en-US builds and releasing/uploading builds and releases||Sun Microsystems
|-
| [[User:ericb|Eric Bachard]] || X || ericb||ericb2|| PL Education, Mac OSX/Linux PPC port and vcl/impress hacker || [http://education.openoffice.org Education project], unaffiliated
|-
| Kai Backman|| || kaib ||KaiB||||
|-
| Sascha Ballach|| X || sab||||||
|-
| Jayant Balraj Madavi|| || jayant_madavi||aZEN_JM||Connectivity / Database||Novell, Inc.
|-
| Jörg Barfurth|| X || jb||JoergB||Configuration Util||Sun Microsystems
|-
| Omer Bar-or|| X || cremlae||cremlae||Mac porting||Google Summer of Code
|-
| Mathias Bauer|| X || mba||||PL Writer, CL Framework, XML||Sun Microsystems
|-
| Thorsten Behrens|| X || thb||thorsten||vcl/impress/toolkit visionary||Novell, Inc.
|-
| Thomas Benisch|| X || tbe||||Scripting framework||Sun Microsystems
|-
| Stephan Bergmann|| X || sb||||CL UDK||Sun Microsystems
|-
| Andreas Bille|| X || abi||||||
|-
| Éric Bischoff|| X || ebischoff||ebischoff||KDE A/B driver||Bureau Cornavin
|-
| Nick Blievers|| X || nick||||IRIX||
|-
| Daniel Boelzle|| X || dbo||||UNO core/bridges/packages||Sun Microsystems
|-
| Oliver Bolte|| X || obo||||RE||Sun Microsystems
|-
| [[User:Cedricbosdo|Cédric Bosdonnat]]|| X || cedricbosdo || cbosdonnat || Writer Filters, ooeclipse integration || Novell, Inc.
|-
| Rafaella Braconi|| || coni||Rafaella ||PL l10n, Globalization Program Manager||Sun Microsystems
|-
| Michael Brauer|| X || mib||||PL XML||Sun Microsystems
|-
| Oliver Braun|| X || obr||obr||System Integration/Accessibility Hacker||Sun Microsystems
|-
| Andreas Bregas|| X || ab||||StarBasic||Sun Microsystems
|-
| Jörg Brunsmann|| || jbrunsmann||||UDK||
|-
| Jörg Budischewski|| || jbu||PyUNO hacker||||
|-
| Peter Burow|| X || pb||plumbumm||UI||Sun Microsystems
|-
| Aidan Butler|| || aidan||||XML filters||
|-
| [[User:ScottCarr|Scott Carr]] || X || kcarr||kcarr||PL Documentation||Progbits
|-
| Giuseppe Castagno || X || beppec56 || beppec56_ or beppe_c || PDF output||
|-
| Colin Charles|| || drbyte||bytee||Malaysian native-lang project||bytebot.net
|-
|Jian Hong Cheng || X || chengjh || || Writer || IBM Corp.
|-
| Xiuzhi Cheng|| X || xzcheng || xiuzhi|| ESC,Xml,ODF|| OOo community
|-
| [[User:jza|Alexandro Colorado]]|| X || jza || jza|| CL [[OOoES|ES]] ||
|-
| Behrend Cornelius|| X || bc||||Wizards||Sun Microsystems
|-
| [[User:ccornell|Clayton Cornell]] || X || ccornell || ccornell || Documentation Project co-lead ||Sun Microsystems
|-
| Michael Cziebalski|| || mci||||||
|-
| [[User:pdefilippis|Pierre de Filippis]]|| X || pdefilippis||aliscafo||Mac OSX native porting||
|-
| Yuri Dario || || ydario || Paperino || OS/2 Port || Serenity Systems intl
|-
| Andrew Dent|| X ||ace_dent||ace_dent||ui/custom_images||
|-
| Naren Devaiah|| || ||ndev||Performance||Intel Corporation
|-
| Nitin Dongre|| || ||nitin_BITS||||Novell, Inc.(intern)
|-
| Radek Doulik|| || radekdoulik||rodo_||Canvas hacker||Novell, Inc.
|-
| Carsten Driesner|| X || cd|| cd_oo ||PL Framework||Sun Microsystems
|-
| Herbert Duerr|| X || hdu||hdu_hh||GSL||Sun Microsystems
|-
| [[User:bei|Bernd Eilers]]|| X || bei||rfc821||[[EIS]]||Sun Microsystems
|-
| René Engelhard|| X || rene||_rene_||config_office, Debian packager||Debian
|-
| [[User:Pereriksson|Per Eriksson]] || || pereriksson || || CL, MarCon Sweden ||
|-
|[[User:Jbfaure|Jean-Baptiste Faure]]||X||jbfaure||jbfaure ||PL FR native-lang project||
|-
| Hubert Figuière|| X || hub || hub || PPTX || Novell, Inc.
|-
| Claudio F Filho|| || filhocf||filhocf||Brazilian portuguese Localization||BrOffice.org
|-
| Andre Fischer|| X || af||||Impress||Sun Microsystems
|-
| Uwe Fischer || X || ufi || ufiooo || Application Help || Sun Microsystems
|-
| Ken Foskey|| || waratah||waratah||config_office/dmake man||slug.org.au
|-
| Duncan Foster|| || dfoster||||||
|-
| David Fraser|| || davidfraser||davidfraser||South African translations, multilingual builds||translate.org.za
|-
| [[User:Nf|Nils Fuhrmann]]|| || nf||SunNF||||Sun Microsystems
|-
| Martin Gallwey|| X || mtg||marty_||XML/Writer/packaging||
|-
| Pierre-Andre Galmes || || pagalmes || pagalmes || Chart2 ||StarXpert
|-
| Tony Galmiche|| X || tonygalmiche||||FR native-lang project||
|-
| Sunil Gandhi|| || ||tyro||||NOSIP
|-
|Zemin Gao || || gaozemin|| gaozm || Calc || [[Beijing Redflag Chinese 2000 Software Co., Ltd.|Beijing Redflag CH2000]]
|-
| Sophie Gautier|| X || sgauti|| sophi || ||.
|-
| Vladimir Glazounov|| X || vg||||RE||Sun Microsystems
|-
| Laurent Godard || X || laurentgodard || lgodard || CC, PL Extensions, Fr Native-lang Project || inDesko/Nuxeo
|-
| Jody Goldberg|| X || jodygoldberg||jody||[[Calc]] spreadsheet-ness||
|-
| Dirk Grobler|| X || dg|||| ||Sun Microsystems
|-
| [[User:Sg|Steffen Grund]]|| X || sg|| || NetBeans Integration ||Sun Microsystems
|-
| Bettina Haberer|| || bh||||RFEOwner||Sun Microsystems
|-
| Bo Han || X || hanbo || hanbo || VBA Interop || [[Beijing Redflag Chinese 2000 Software Co., Ltd.|Beijing Redflag CH2000]]
|-
| Ingrid Halama|| X || iha||||Chart||Sun Microsystems
|-
| Chris Halls|| X || haggai||haggai||Debian packager&misc. hacker||Credativ Ltd., Debian
|-
| Gregor Hartmann|| X || gh|| Lachs ||Testtool, gsicheck, buildbot||Sun Microsystems
|-
| Bustamam Harun|| || bustamam||||Malaysian stuff||
|-
| Kevin Hendricks|| X || khendricks||||PL Lingucomponent, PowerPC||
|-
| Con Hennessy|| || cphennessy||cph2 or cph_||hacker & former council person||OpenApp
|-
| Ivo Hinkelmann|| X || ihi||ivo||l10n tooling/general/RE||Sun Microsystems
|-
| Eric Hoch|| X || maveric||mav_eric||Mac Porting||
|-
| [[User:Lutz_Hoeger|Lutz Hoeger]]|| X || lh ||lutzh||||Sun Microsystems
|-
| Michael Hönnig|| X || mi||||PL API||
|-
| Ilko Höpping|| X || ih||||||Sun Microsystems
|-
| Jan Holešovský|| X || kendy||kendy||KDE integration||Novell, Inc.
|-
| Martin Hollmichel|| X || mh||Ratte/Nesshof||PL External, Tools, Porting, CC||Sun Microsystems
|-
| Karl Hong|| X || khong||||i18n, CJK expert||
|-
| [[User:icobgr|Hristo Hristov]] || || icobgr || icobgr || PL Bulgarian native-lang project ||
|-
| Matthias Huetsch|| X || mhu||||Performance/strategy, PL UCB, CC, ESC||Sun Microsystems
|-
| Sven Jacobi|| X || sj||||Escherwizard||Sun Microsystems
|-
| Jörg Jahnke|| || jj||||tooling||Sun Microsystems
|-
| Pavel Janík|| X || pjanik||paveljanik||PL Czech native-lang project, CL l10n, CC, ESC, l10n builds||
|-
| Sunil Amitkumar Janki || || sjanki || sjanki || GNU Linux mipsel porter ||
|-
| Christian Jansen|| || cj ||||Menu and Toolbar?||Sun Microsystems
|-
| Ocke Janssen|| X || oj||Base||||Sun Microsystems
|-
| Berry Jia|| X || berryjia||||||
|-
| Mingfei Jia || X || jiamingfei || || Lotus Smart Suite filter,MS Word encryption || IBM Corp.
|-
| Chuang Jiang || || jiangc || || || [[Beijing Redflag Chinese 2000 Software Co., Ltd.|Beijing Redflag CH2000]]
|-
| Pascal Junck|| || pjunck||||||
|-
| [[User:pj@openoffice.org|Peter Junge]]|| X || pj|| peter13j|| OOo community contact ||
|-
| Christian Junker|| || Cyb||christianju||API||Trees For Life
|-
| Etsushi Kato || X || ekato || || Mac OS X Port || Independent
|-
| Hirano Kazunari|| || khirano||||Japanese||
|-
| Mihaela Kedikova|| X || misheto||||grid control||Sun Microsystems
|-
| Dhananjay Keskar|| X || dkeskar ||dkeskar||Performance,Buildbot,cat-herder||Intel Corporation
|-
| Volodymyr Khrystynych|| || volody||||XML Filter||
|-
| Robert Kinsella|| || rkinsella||||||Sun Microsystems
|-
| Matthias Klose|| || doko||doko||Ubuntu, gcc, python packager||Canonical, Inc.
|-
| Laszlo Kovacs|| || lkovacs||||Documentation||
|-
| Tobias Krause|| X || tkr||||ucb||Sun Microsystems
|-
| Martin Kretzschmar|| X || mkretzschmar||martink||Gnome / Debian||Student
|-
| Will Lachance|| || wlach||wlach_||Word Perfect File Filters||Net Integration Technologies, Inc.
|-
| Marcus Lange|| X || mla||mla||[http://download.openoffice.org download websites], uploading/releasing developer snapshots and releases||Sun Microsystems
|-
| Thomas Lange|| X || tl||tl13||||Sun Microsystems
|-
| Lars Langhans|| X || lla||||||Sun Microsystems
|-
| Hans-Joachim Lankenau|| X || hjs||ause||dmake makefile expert, RE||Sun Microsystems
|-
| Németh László|| X || nemeth||||PL lingucomponent||
|-
| Jakob Lechner|| X || jakob_lechner||||Writer||Fabalabs
|-
| Michael Leibowitz|| X || mikeleib ||mikeleib||performance||Intel Corporation
|-
| Hui Li|| || lihuiibm || Hui_Li ||VBA Interop||IBM Corp.
|-
|Jian Li|| || lijian || lijian|| Writer|| CS2C
|-
| Wind Li|| X || windly||||Address books||
|-
| Xing Li || X || lixxing || || Accessibility || IBM Corp.
|-
|Weike Liang || || liangweike || liangweike || Graphics || [[Beijing Redflag Chinese 2000 Software Co., Ltd.|Beijing Redflag CH2000]]
|-
| Ping Liao|| || pliao||||||
|-
| Tor Lillqvist|| X || tml||tml_||||Novell, Inc.
|-
| Fong Lin || X || pflin || Fong || VBA Interop, Scripting, CJK Enhancement || Novell, Inc.
|-
| Joachim Lingner|| X || jl||||Java, CLI||Sun Microsystems
|-
| Christian Lippka|| X || cl || cl ||Graphic Applications||Sun Microsystems
|-
| Chen Liu|| || liuchenn|| liuchen ||VBA Interop||IBM Corp.
|-
|Jianli Liu || || liujl|| liujianli || Graphics|| [[Beijing Redflag Chinese 2000 Software Co., Ltd.|Beijing Redflag CH2000]]
|-
| Mindy Liu|| || mindyliu||||||
|-
|[[User:liutao |Tao Liu]] || X || liutao || liutao ||PL modularization ,PyUNO, Async dialogs,||
|-
| YiSong Liu|| || Liu YiSong || Liu YiSong|| PYUNO || [[Beijing Redflag Chinese 2000 Software Co., Ltd.|Beijing Redflag CH2000]]
|-
|Yu Liu || X || ch2000liuy || LiuYU || Swriter || [[Beijing Redflag Chinese 2000 Software Co., Ltd.|Beijing Redflag CH2000]]
|-
|Yuhua Liu || || liuyuhua|| yuhua|| ||[[Beijing Redflag Chinese 2000 Software Co., Ltd.|Beijing Redflag CH2000]]
|-
| [[User:fl|Frank Loehmann]]|| X || fl ||frankl||PL [http://ux.openoffice.org User Experience]||Sun Microsystems
|-
| [[User:Dl|Dieter Loeschky]]|| X || dl ||||PL: ODF Toolkit||Sun Microsystems
|-
| Philipp Lohmann|| X || pl||PhilippL||VCL/X11 (GSL) hacker||Sun Microsystems
|-
| Michel Loiseleur|| || mloiseleur|| coren`|| Bugfixes ||Linagora
|-
| Jackson Low|| X || xxjack12xx||||Porting||
|-
| Patrick Luby|| || pluby||||Mac||
|-
|Jingrong Luo || || Luo Jingrong|| Luo Jingrong|| ||[[Beijing Redflag Chinese 2000 Software Co., Ltd.|Beijing Redflag CH2000]]
|-
|Yue Lv || || lvyue || lvyue || Calc ||[[Beijing Redflag Chinese 2000 Software Co., Ltd.|Beijing Redflag CH2000]]
|-
|[[User:majun|Jun Ma]]|| ||majun51 || || writer || [[Beijing Redflag Chinese 2000 Software Co., Ltd.|Beijing Redflag CH2000]]
|-
| Prasad Madhav || X || pmadhav || pmadhav || Buildbot || Intern@Intel
|-
| Babak Mahbod|| || bmahbod||||||
|-
| Martin Maher|| || mmaher||||Writer & Filter chap||
|-
| Nakata Maho|| X || maho||_maho_||PL QA, PL JA, FreeBSD guy||Independent
|-
|Yonggang Mao || X || maoyonggang|| maoyg|| Calc || CS2C
|-
| John Marmion|| X || jmarmion||||||
|-
| Andreas Martens|| X || ama||||PL Writer||Sun Microsystems
|-
| Shane M Mathews|| X || smmathews|| smmathews ||[[Impress:_OpenGL_rendered_transitions]]||student
|-
| Frank Mau|| X || fma||||tooling||Sun Microsystems
|-
| [[User:smsm1|Shaun McDonald]] || X || smsm1 || shaunmcdonald || Mac Port, buildbot MacPort1 || Graduate
|-
| Caolán McNamara|| X || cmc||caolan||CL Writer & Filter man|| [http://www.redhat.com Red Hat Inc.]
|-
| Michael Meeks|| X || mmeeks||michael_||ugly hack-er, ESC||Novell, Inc.
|-
| Frank Meies|| X || fme||||Writer||Sun Microsystems
|-
| Federico Mena-Quintero|| || federicomena||federico||perfectionist||Novell, Inc.
|-
| Ismael Merzaq|| X || isma87||ismael_||Mac OSX native porting||Student
|-
| Michael Mi|| || mmi||||||
|-
| Björn Michaelsen|| X || b_michaelsen ||b_michaelsen|| Writer, Bookmarks, Performance, User Feedback Program ||Sun Microsystems
|-
| Björn Milcke|| X || bm||bm_||Chart||Sun Microsystems
|-
| Petr Mladek|| || pmladek||pmladek||SUSE RPMs, ooo-build releases||Novell, Inc.
|-
| Cyrille Moureaux|| X || cyrillem||Cyrille||||
|-
| [[User:Mmp|Matthias Müller-Prove]]|| X || mmp|| mprove|| [[User Experience]] || Sun Microsystems
|-
| [[User:Bluedwarf|Takashi Nakamoto]]|| || bluedwarf|| || Japanese || Student
|-
| Jan Navrátil || X || jnavrati || jnavrati || || [http://www.redhat.com Red Hat Inc.]
|-
| Niklas Nebel|| X || nn||||PL [[Calc]]||Sun Microsystems
|-
| Christoph Neumann|| X || cn||||[[UnoApiTest]]||Sun Microsystems
|-
| Frank Neumann|| X || fne||||MacPort||
|-
| NicelKM|| X || mnicel||nicel||||Novell, Inc.
|-
| Jan Nieuwenhuizen|| X || jcn||janneke||Layout code, hacker ||Novell, Inc.
|-
| [[User:ChristophNoack|Christoph Noack]]|| X || christophnoack ||christoph_n||CL [http://ux.openoffice.org User Experience]||
|-
| Bertram Nolte|| || bnolte||||||
|-
| Tomas O'Connor|| || toconnor||||Scripting Framework||
|-
| Maximilian Odendahl|| X || mod||mod||[[Notes2]] [[SQL_Syntax_Highlighting]]|| Student / SEPT-Solutions
|-
| Takashi Ono || X || tono || || MinGW port || Independent
|-
| Lars Oppermann|| X || lo||||||
|-
| Rakesh Pandit || X || rakeshpandit|| chacha_chaudhry|| Education Project - Starmath/fix module warnings|| Education Project
|-
| Rodrigo Parra Novo|| X || rodarvus||rodarvus||Gnumeric/Abiword OpenDocument Format support and port to Maemo||INdT (Instituto Nokia de Tecnologia)
|-
| Pierre Pasteau|| X || pastea_p || pierrep|| Education Project, SeaMonkey migration || Education Project
|-
| Edward Peterlin|| X || OPENSTEP||||Mac||
|-
| [[User:Fpe|Frank Peters]]|| X || fpe||||CL Documentation||Sun Microsystems
|-
| Christof Pintaske|| X || cp||||||Sun Microsystems
|-
| Ron Piterman|| || rpiterman||||||
|-
| Sebastien Plisson|| X || plipli||plipli||Developer on Aqua port||OO Aqua Port
|-
| Noel Power|| || npower||noelp||VBA Interop, Scripting||Novell, Inc.
|-
| Nikolai Pretzell|| X || np || ||Autodoc, code quality||Sun Microsystems
|-
| Jonathan Pryor|| || jpryor || jonp || || Novell, Inc.
|-
| Canghua Qu|| || quch || Canghua || AutoTest, Graphics || [[Beijing Redflag Chinese 2000 Software Co., Ltd.|Beijing Redflag CH2000]]
|-
| Volker Quetschke|| X || vq||vq||W32-tcsh/bash build environment and dmake Hacker, ESC||Gravity Waves
|-
| Tino Rachui|| X || tra||tinor||GSL/Unix Hacker||Sun Microsystems
|-
| Goran Rakić || X ||goranrakic || || Serbian Native-Lang PL ||
|-
| [[User:Kr|Kay Ramme]]|| X || kr||||PL UDK||Sun Microsystems
|-
| [[User:ErAck|Eike Rathke]]|| X || er||erAck||CL [[Calc]], engine; CL i18n; stricken with number formatter||Sun Microsystems
|-
| Michael Rauch|| X || mrauch||||NetBSD||
|-
| Jens-Heiner Rechtien|| X || hr||blauwal||RE; OOo SCM (CVS, CWS tooling); Porting; Compilers||Sun Microsystems
|-
| Daniel Rentz|| X || dr|| drr ||[[Calc]] Excel filter, UI||Sun Microsystems
|-
| Florian Reuter|| X || flr||||Writer filters||Novell, Inc.
|-
| Georg Richter|| X || grichter||georg||Base, native MySQL driver||MySQL AB
|-
| G. Roderick Singleton|| || grsingleton||grsingleton||Documentation||pathtech.org
|-
| Hennes Rohling|| X || hro||||GSL & Util||Sun Microsystems
|-
| Bibek Sahu|| || Bibek||bibek||Impress pieces||Trees For Life
|-
| Andreas Schlüns|| X || as||||Framework||Sun Microsystems
|-
| Ingo Schmidt|| X || is||||(Native) Installation||Sun Microsystems
|-
| [[User:Jsc|Jürgen Schmidt]]|| X || jsc||jsc||PL API, PL Extensions, UNO, SDK||Sun Microsystems
|-
| [[User:Schmidtm|Matthias Schmidt]] || || schmidtm || schmidtm || Mac OSX Aqua Port || Sun Microsystems
|-
| Stephan Schäfer|| X || ssa||ssa||VCL||Sun Microsystems
|-
| Frank Schönheit|| X || fs||FrankS||Database Access, Forms||Sun Microsystems
|-
| [[User:Sus|Svante Schubert]]|| X || sus||Svante||XML & ODFTOOLKIT co-lead, ODFDOM project chair, Member of OASIS ODF TC, OASIS OIC TC, OASIS ODF SC Metadata||Sun Microsystems
|-
| [[User:Sts|Stella Schulze]]|| X || sts||||[http://ui.openoffice.org/nonav/VisualDesign/ Visual Design]||Sun Microsystems
|-
| Julian Seward || || sewardj || || valgrind ||
|-
| Darragh Sherwin|| || dsherwin||darragh||E-Legislation / E-GovSystems||Propylon
|-
| Wei Guo Shi || X || shiwg || || Accessibility and Smart Suite filter || IBM Corp.
|-
|[[User:Robertzhou | RobertZhou]]|| || robertzhou|| shizhoubo|| [[Framework]] || CS2C
|-
| Raul Siddhartha|| || rsiddhartha||raul||GTK File Selector||Novell, Inc.
|-
| Sarah Smith|| || ssmith||||||
|-
| [[User:mox|Mox Soini]] || X || mox || Moxed || Mac Porting ||
|-
| Rajesh Sola|| || rajeshsola||sola||misc.||NOSIP
|-
| Kai Sommerfeld|| X || kso||||manager & hacker||Sun Microsystems
|-
| Oliver Specht|| X || os||||PL UI||Sun Microsystems
|-
| Jörg Spindler|| || jspindler||||||
|-
| [[User:Rescue|Joey Stanford]] || || Rescue/k0fcc || Rinchen || CL [http://eo.openoffice.org/ Esperanto native-lang project] || [http://canonical.com Canonical]
|-
| Fridrich Štrba|| X || fridrich_strba||Fridrich||Word Perfect Hacker||Novell, Inc.
|-
| Keith Stribley|| X || kstribley||||Graphite fonts, Myanmar l10n||
|-
| [[User:Muthusuba|Muthu Subramanian]]|| X || muthusuba||muthusuba||misc.||
|-
| Louis Suárez-Potts|| || louis||louis||Community Manager||Collab.net
|-
|Quanfa Tang || || tqfa|| tangquanfa|| Calc || [[Beijing Redflag Chinese 2000 Software Co., Ltd.|Beijing Redflag CH2000]]
|-
| David Tardon || X || dtardon || dtardon || || [http://www.redhat.com Red Hat Inc.]
|-
| Stefan Taxhet|| X || st||stx12||CC, interpersonal problem fixer||Sun Microsystems
|-
| Armin Theissen|| || armin||||||
|-
| Caio Tiago Oliveira|| X || asrail||asrail||CL QA, release testing pt-BR builds||BrOffice.org
|-
| Jan Tietjens|| || tietjens||||||
|-
| Rüdiger Timm|| X || rt|| rtimm ||RE||Sun Microsystems
|-
| [[User:mt|Malte Timmermann]]|| X || mt|| Malte || Accessibility, Security, Performance||Sun Microsystems
|-
| Gerhard Tonn|| || tonn||||s390||
|-
| Willem van Dorp|| || willem.vandorp||||||
|-
| Tom Verbeek|| X || tv|||| ||
|-
| Sander Vesik|| || svesik||||||
|-
| Daniel Vogelheim|| X || dvo||||XML||
|-
| Mikhail Voitenko|| X || mav||mav||Framework||Sun Microsystems
|-
| Robert Vojta|| X || rvojta||rvojta||Mac OS X related issue||
|-
| Dirk Völzke|| X || dv||||Installation||Sun Microsystems
|-
|Xu Ming Wang || X || flyccloud or Wangxum || || Calc || IBM Corp.
|-
| [[User:Sparcmoz|Jim Watson]]|| X || sparcmoz|| sparcmoz||GNU Linux sparc porter||clug.org.au
|-
| [[User:Weiz |Zhao Wei ]] || || weiz || weiz || Chart2 || [[Beijing Redflag Chinese 2000 Software Co., Ltd.|Beijing Redflag CH2000]]
|-
| Armin Weiss|| X || aw||||||Sun Microsystems
|-
| Gerd Weiss|| X || gm||||RE||Sun Microsystems
|-
| Dan Williams|| X || fa||dcbw||Mac et. al. hacker|| [http://www.redhat.com Red Hat Inc.]
|-
| Oliver Wittmann|| X || od||Writer||||Sun Microsystems
|-
|[[User:wuy|Yan Wu]] || X || wuy || ||Framework ||CS2C
|-
| Stephan Wunderlich|| X || sw||||||
|-
| Antonio Xu|| X || antoxu || antoxu || Async dialogs, PRC improvements || Intel Corporation
|-
|Dehua Xu || || xudehua || xudh ||||
|-
| Steve Yin || X || steve_yin || steve_yin || Microsoft Office file format, PDF, Accessibility, ODF || IBM Corp.
|-
| Kohei Yoshida|| X || kohei||kohei_||[[Calc]] hacker, Calc optimization solver developer||Novell, Inc.
|-
| Guoqiang Yu|| X || yugq || yugq|| Performance || [[Beijing Redflag Chinese 2000 Software Co., Ltd.|Beijing Redflag CH2000]]
|-
| Xiaoyang Yu|| || || ||Disk block reordering||Intel Corporation
|-
| George Zahopoulos|| X || georgez||||||
|-
| Kurt Zenker|| X || kz||smoketester||RE||Sun Microsystems
|-
|[[User:Zhangxiaofei|Xiaofei Zhang]]|| || Zhangxiaofei || zhangxiaofei/FelixZ || [[Framework]] ||CS2C
|-
|Jianwei Zhao || || zhaojianwei || zhaojianwei || Swriter || [[Beijing Redflag Chinese 2000 Software Co., Ltd.|Beijing Redflag CH2000]]
|-
| Jeremy Zheng|| X || zhiming || Jeremy || Async dialogs, PRC improvements || Intel Corporation
|-
| Zengliangjun || X || Zengliangjun || liangjun || [[Performance]] ||[[Beijing Redflag Chinese 2000 Software Co., Ltd.|Beijing Redflag CH2000]]
|}

=== QA Engineers ===

{| border="2" cellpadding="4" cellspacing="0" style="margin: 1em 1em 1em 0; background: #f9f9f9; border: 1px #aaa solid; border-collapse: collapse;"
|-
! Name ||CVS||@openoffice.org || [[IRC Communication]] || Interested modules || Notes || Affiliation
|-
| Stefan Baltzer||||sba||||writer||||Sun Microsystems
|-
| Thorsten Bosbach||X||tbo||||framework, testautomation||framework test automation||Sun Microsystems
|-
| Oliver Craemer||X||oc||||[[Calc]], testautomation||calc test automation||Sun Microsystems
|-
| Helge Delfs||X||hde||||testautomation, writer||Test automation||Sun Microsystems
|-
| Fredrik Haegg||X||fha||||||||
|-
| Hasan Ilter||||hi||||writer, printing, pdf export||||Sun Microsystems
|-
| Michael Rüß||||mru||||writer, word im/export||||Sun Microsystems
|-
| Éric Savary||||es||||writer, accessibility||||Sun Microsystems
|-
| [[User:jsi|Joerg Sievers]]||X||jsi||jogi||porting||Mac- and Solaris SPARC port testing||
|-
| Joerg Skottke||X||jsk||skotti||framework, qa/qatesttool||Framework test automation||Sun Microsystems
|-
| Marc Neumann||X||msc||||database, testautomation||Database access test automation||Sun Microsystems
|-
| Chris Lukasiak||||clu||||database||||Sun Microsystems
|-
| Frank Stecher||||fst||||[[Calc]]||||Sun Microsystems
|-
| Jack Warchold|||| jw||||writer, import/export filters||||
|-
| Uwe Luebbers||||ul||||framework||||Sun Microsystems
|-
| Thorsten Martens||||tm||||framework||||Sun Microsystems
|-
| Olaf Felka|||| of||of_sun||framework, installation||||Sun Microsystems
|-
| Thomas Klarhoefer||||kla||||chart||||Sun Microsystems
|-
| Wolfram Garten||X|| wg||||draw, impress||draw, impress test automation||Sun Microsystems
|-
| Christian Guenther||||cgu||||draw, impress||||Sun Microsystems
|-
| Ulf Stroehler|||| us||||||||Sun Microsystems
|-
| [[User:Thorsten_Ziehm|Thorsten Ziehm]]||||| thorstenziehm||||||QA lead||Sun Microsystems
|}

We are tracking pending JCAs in the document [[Pending JCAs]].

== Related Pages ==
* [[Commit Rights]]
* [[Contributing Patches]]
* [[User_Experience/Community|User Experience Team]]
* A map of OOo developers around the world is available at http://www.frappr.com/ooodev, please add yourself to the map if you're involved in OOo development. It's just fun to see who's where :-)

[[Category:Development]]

User:Zengliangjun

2010-04-01T06:33:23Z

Zengliangjun:

*Name: Liangjun Zeng
*IRC: liangjun
*Email: zengliangjun@redoffice.com
*Company: [http://www.redflag2000.cn Beijing Redflag Chinese 2000 Software Co.,Ltd]
*Working as: Performance
*Location: Beijing, UTC + 8

User:Zengliangjun

2010-04-01T06:30:36Z

Zengliangjun: Created page with '*Name: Liangjun Zeng *OOo: liangjun *Email: zengliangjun@redoffice.com zengliangjun@openoffice.org *Company: [http://www.redflag2000.cn Beijing Redflag Chinese 2000 Software Co.,…'

*Name: Liangjun Zeng
*OOo: liangjun
*Email: zengliangjun@redoffice.com zengliangjun@openoffice.org
*Company: [http://www.redflag2000.cn Beijing Redflag Chinese 2000 Software Co.,Ltd]
*Working as: OOo Performance
*Location: Beijing, UTC + 8

Performance/Implement Merger Dynamic Library

2010-03-02T08:48:20Z

Zengliangjun:

Something about merger dynamic library please view [[Merge_UNO_Dlls]] and [[Performance/Ideas/Easy_UNO_Services_Merging]].

I will disucss the complete process here(exclude UNO runtime libraries).

= Analyze the loading libraries =
"'''B'''" is library's name.

"'''''I'''''" is module name.

== OOo base starting load libraries ==

basegfxmi.dll
'''behelper.uno.dll''' '''''configmgr'''''
comphelp4MSC.dll
'''configmgr2.uno.dll''' '''''configmgr'''''
'''dnd.dll''' '''''dtrans'''''
'''fsstorage.uno.dll''' '''''svtools'''''
fwemi.dll
fwimi.dll
'''fwkmi.dll''' '''''framework'''''
'''fwlmi.dll''' '''''framework'''''
i18nisolang1MSC.dll
'''i18npool.uno.dll''' '''''i18npool'''''
i18nutilMSC.dll
icudt40.dll
icuin40.dll
icuuc40.dll
jmi_g.dll
lngmi.dll
'''localebe1.uno.dll''' '''''shell'''''
'''package2.dll''' '''''package'''''
'''sax.uno.dll''' '''''sax'''''
saxmi.dll
sbmi.dll
sfxmi.dll
sofficeapp.dll
sotmi.dll
splmi.dll
svlmi.dll
svtmi.dll
sysmgr1.uno.dll
tkmi.dll
tlmi.dll
ucb1.dll
ucbhelper4MSC.dll
'''ucpfile1.dll''' '''''ucb'''''
utlmi.dll
vclmi.dll
vos3MSC.dll
xcrmi.dll
xomi.dll
== Write/Calc/Impress starting load libraries ==
'''fileacc.dll'''
'''filterconfig1.dll'''
'''ftransl.dll'''
'''guesslangmi.dll'''
'''ldapbe2.uno.dll'''
'''mcnttype.dll'''
'''sysdtrans.dll'''
'''ucpexpand1.uno.dll'''
'''unoxmlmi.dll'''
'''uuimi.dll'''
'''xstor.dll'''
== Write/Calc/Impress starting load libraries ==
'''evtatt.dll'''
'''frmmi.dll'''
'''hyphenmi.dll'''
'''lnthmi.dll'''
'''spellmi.dll'''
'''xmlsecurity.dll'''
= Rewrite the uno export method =
I will '''behelper.uno.dll''' as example.

== Implement new method ==
As we know, This library's UNO method is define in "configmgr/source/backendhelper/componentdf.cxx".

Now we will copy that file to a new file "configmgr/source/backendhelper/componentdf_merger.cxx".
And update the uno methods name like this([[Performance/Ideas/Easy_UNO_Services_Merging]]):

component_getImplementationEnvironment_''behelper''
component_writeInfo_''behelper''
component_getFactory_''behelper''

== Compile new lib file ==
Now we can update the "configmgr/source/backendhelper/makefile.mk", and compile the "behelper_merger.lib" file.
Add these content into this file.

LIB2TARGET=$(SLB)$/''behelper_merger.lib''
LIB2OBJFILES=\
$(SLO)$/backendlayerhelper.obj \
$(SLO)$/''componentdf_merger.obj''
== Deliver merger lib to solver dir ==
Update the "configmgr/prj/d.lst", add these content into this file

mkdir: %_DEST%\slb%_EXT%\base_merger
..\%__SRC%\slb\configmgr.lib %_DEST%\slb%_EXT%\base_merger\behelper_merger.lib
..\%__SRC%\slb\configmgr.lin %_DEST%\slb%_EXT%\base_merger\behelper_merger.lin

Now dealing with a dynamic library of the complete process has been completed.

= Merger liberary uno method implement =
We will implement these process in "postprocess" module.
== "merger" folder ==
Create new "postprocess/merger" folder, and add these content to "postprocess/prj/build.lst".

+po postprocess\merger nmake - all po_merger NULL
-po postprocess\checkxml nmake - all po_checkxml NULL
+po postprocess\checkxml nmake - all po_checkxml po_merger NULL
== "merger_XXX.cxx" file ==
Create new "postprocess/merger/merger_base.cxx" file.
And this file will be:

<source lang="cpp">
#include <cppuhelper/factory.hxx>

#define DECLARE_UNO_API( model ) \
void component_getImplementationEnvironment_##model \
(const sal_Char **, uno_Environment); \
sal_Bool component_writeInfo_##model \
(void *, void *); \
void* component_getFactory_##model \
(const sal_Char*, void *, void *);
//
#define CALL_UNO_API_WRITER_INFO(model ) \
if( !component_writeInfo_##model( pServiceManager, pRegistryKey) ) \
{ return sal_False; }
//
#define CALL_UNO_API_GET_FACTORY(model ) \
if( NULL != (pFactory = component_getFactory_##model( pImplName, pServiceManager, pRegistryKey)) ) \
{ return pFactory; }
//
rtl_StandardModuleCount g_moduleCount = MODULE_COUNT_INIT;

DECLARE_UNO_API( behelper );

extern "C"
{
void SAL_CALL component_getImplementationEnvironment(
const sal_Char ** ppEnvTypeName, uno_Environment ** )
{
*ppEnvTypeName = CPPU_CURRENT_LANGUAGE_BINDING_NAME;
}
sal_Bool SAL_CALL component_writeInfo( void * pServiceManager, void * pRegistryKey )
{
CALL_UNO_API_WRITER_INFO( behelper );
return sal_True;
}
void * SAL_CALL component_getFactory
(const sal_Char * pImplName, void * pServiceManager, void * pRegistryKey)
{
void * pFactory = NULL;
CALL_UNO_API_GET_FACTORY( behelper );
return pFactory;
}

}
</source>
== "makefile.mk" file ==
Create new "postprocess/merger/makefile.mk" file.
and this file will be

<source lang="">
PRJ=..

PRJNAME=postprocess
TARGET=merger_base

.INCLUDE : settings.mk

# ------ merger_base.uno ------
SHL1TARGET= merger_base.uno
SHL1OBJS= \
$(SLO)$/merger_base.obj

SHL1STDLIBS= \
$(CPPUHELPERLIB) \
$(CPPULIB) \
$(SALLIB)

SHL1DEPN=
SHL1IMPLIB= i$(TARGET)

SHL1LIBS= \
$(SOLARVER)$/$(INPATH)$/slb/base_merger/behelper_merger.lib

SHL1DEF= $(MISC)$/$(SHL1TARGET).def
DEF1NAME= $(SHL1TARGET)
DEF1EXPORTFILE= exports.dxp
</source>
== "exports.dxp" file ==
Create new "postprocess/merger/exports.dxp" file.
And this file will be:
<source lang="">
component_getImplementationEnvironment
component_writeInfo
component_getFactory
</source>
== Deliver ==
Deliver merger library to solver dir.
Add this content to file "postprocess/prj/d.lst":
<source lang="">
..\%__SRC%\bin\merger_base.uno.dll %_DEST%\bin%_EXT%\merger_base.uno.dll
</source>

Now we finished compile merger library process.

= Update the packge script file =
These process will be "scp2" module, has two types thing:
One is add merger libraries to package, the other is that do not add mergered libraries to package.
'''Clear the mergered libraries '''

update "scp2/source/ooo/file_library_ooo.scp":
<source lang="">
-File gid_File_Lib_Behelper
- TXT_FILE_BODY;
- Styles = (PACKED,UNO_COMPONENT);
- RegistryID = gid_Starregistry_Services_Rdb;
- Dir = gid_Dir_Program;
- #ifdef UNX
- Name = STRING(CONCAT2(behelper.uno,UNXSUFFIX));
- #else
- Name = "behelper.uno.dll";
- #endif
-End
</source>

update "scp2/source/ooo/module_hidden_ooo.scp":
<source lang="">
-gid_File_Lib_Behelper,
</source>

'''Add the merger libraries '''

update "scp2/source/ooo/file_library_ooo.scp":
<source lang="">
+File gid_File_Lib_Merger_base
+ TXT_FILE_BODY;
+ Styles = (PACKED,UNO_COMPONENT);
+ RegistryID = gid_Starregistry_Services_Rdb;
+ Dir = gid_Dir_Program;
+ #ifdef UNX
+ Name = STRING(CONCAT2(merger_base.uno,UNXSUFFIX));
+ #else
+ Name = "merger_base.uno.dll";
+ #endif
+ End
</source>
update "scp2/source/ooo/module_hidden_ooo.scp":
<source lang="">
+gid_File_Lib_Merger_base,
</source>
= Problem =
When I merger those library, that will report error when load OOo with UNO component. I do't know why.
= Discuss =
Can we merger the other liberaries, when I finished the complete process.

We can divide three steps:
#Compile merger lib files and deliver the lib files.
#Merger these libs to one dynamic library.
#Update the package scripts.

[[Category:Performance]]

Performance/Implement Merger Dynamic Library

2010-03-02T08:37:38Z

Zengliangjun:

Performance/Implement Merger Dynamic Library

2010-03-02T08:22:29Z

Zengliangjun:

Something about merger dynamic library please view [[Merge_UNO_Dlls]] and [[Performance/Ideas/Easy_UNO_Services_Merging]].

I will disucss the complete process here(exclude UNO runtime libraries).

= Analyze the loading libraries =
"'''B'''" is library's name.

"'''''I'''''" is module name.

== OOo base starting load libraries ==

basegfxmi.dll
'''behelper.uno.dll''' '''''configmgr'''''
comphelp4MSC.dll
'''configmgr2.uno.dll''' '''''configmgr'''''
'''dnd.dll''' '''''dtrans'''''
'''fsstorage.uno.dll''' '''''svtools'''''
fwemi.dll
fwimi.dll
'''fwkmi.dll''' '''''framework'''''
'''fwlmi.dll''' '''''framework'''''
i18nisolang1MSC.dll
'''i18npool.uno.dll''' '''''i18npool'''''
i18nutilMSC.dll
icudt40.dll
icuin40.dll
icuuc40.dll
jmi_g.dll
lngmi.dll
'''localebe1.uno.dll''' '''''shell'''''
'''package2.dll''' '''''package'''''
'''sax.uno.dll''' '''''sax'''''
saxmi.dll
sbmi.dll
sfxmi.dll
sofficeapp.dll
sotmi.dll
splmi.dll
svlmi.dll
svtmi.dll
sysmgr1.uno.dll
tkmi.dll
tlmi.dll
ucb1.dll
ucbhelper4MSC.dll
'''ucpfile1.dll''' '''''ucb'''''
utlmi.dll
vclmi.dll
vos3MSC.dll
xcrmi.dll
xomi.dll
== Write/Calc/Impress starting load libraries ==
'''fileacc.dll'''
'''filterconfig1.dll'''
'''ftransl.dll'''
'''guesslangmi.dll'''
'''ldapbe2.uno.dll'''
'''mcnttype.dll'''
'''sysdtrans.dll'''
'''ucpexpand1.uno.dll'''
'''unoxmlmi.dll'''
'''uuimi.dll'''
'''xstor.dll'''
== Write/Calc/Impress starting load libraries ==
'''evtatt.dll'''
'''frmmi.dll'''
'''hyphenmi.dll'''
'''lnthmi.dll'''
'''spellmi.dll'''
'''xmlsecurity.dll'''
= Rewrite the uno export method =
I will '''behelper.uno.dll''' as example.

== Implement new method ==
As we know, This library's UNO method is define in "configmgr/source/backendhelper/componentdf.cxx".

Now we will copy that file to a new file "configmgr/source/backendhelper/componentdf_merger.cxx".
And update the uno methods name like this([[Performance/Ideas/Easy_UNO_Services_Merging]]):

component_getImplementationEnvironment_''behelper''
component_writeInfo_''behelper''
component_getFactory_''behelper''

== Compile new lib file ==
Now we can update the "configmgr/source/backendhelper/makefile.mk", and compile the "behelper_merger.lib" file.
Add these content into this file.

LIB2TARGET=$(SLB)$/''behelper_merger.lib''
LIB2OBJFILES=\
$(SLO)$/backendlayerhelper.obj \
$(SLO)$/''componentdf_merger.obj''
== Deliver merger lib to solver dir ==
Update the "configmgr/prj/d.lst", add these content into this file

mkdir: %_DEST%\slb%_EXT%\base_merger
..\%__SRC%\slb\configmgr.lib %_DEST%\slb%_EXT%\base_merger\behelper_merger.lib
..\%__SRC%\slb\configmgr.lin %_DEST%\slb%_EXT%\base_merger\behelper_merger.lin

Now dealing with a dynamic library of the complete process has been completed.

= Merger liberary uno method implement =
We will implement these process in "postprocess" module.
== "merger" folder ==
Create new "postprocess/merger" folder, and add these content to "postprocess/prj/build.lst".

+po postprocess\merger nmake - all po_merger NULL
-po postprocess\checkxml nmake - all po_checkxml NULL
+po postprocess\checkxml nmake - all po_checkxml po_merger NULL
== "merger_XXX.cxx" file ==
Create new "postprocess/merger/merger_base.cxx" file.
And this file will be:

<source lang="cpp">
#include <cppuhelper/factory.hxx>

#define DECLARE_UNO_API( model ) \
void component_getImplementationEnvironment_##model \
(const sal_Char **, uno_Environment); \
sal_Bool component_writeInfo_##model \
(void *, void *); \
void* component_getFactory_##model \
(const sal_Char*, void *, void *);
//
#define CALL_UNO_API_WRITER_INFO(model ) \
if( !component_writeInfo_##model( pServiceManager, pRegistryKey) ) \
{ return sal_False; }
//
#define CALL_UNO_API_GET_FACTORY(model ) \
if( NULL != (pFactory = component_getFactory_##model( pImplName, pServiceManager, pRegistryKey)) ) \
{ return pFactory; }
//
rtl_StandardModuleCount g_moduleCount = MODULE_COUNT_INIT;

DECLARE_UNO_API( behelper );

extern "C"
{
void SAL_CALL component_getImplementationEnvironment(
const sal_Char ** ppEnvTypeName, uno_Environment ** )
{
*ppEnvTypeName = CPPU_CURRENT_LANGUAGE_BINDING_NAME;
}
sal_Bool SAL_CALL component_writeInfo( void * pServiceManager, void * pRegistryKey )
{
CALL_UNO_API_WRITER_INFO( behelper );
return sal_True;
}
void * SAL_CALL component_getFactory
(const sal_Char * pImplName, void * pServiceManager, void * pRegistryKey)
{
void * pFactory = NULL;
CALL_UNO_API_GET_FACTORY( behelper );
return pFactory;
}

}
</source>
== "makefile.mk" file ==
Create new "postprocess/merger/makefile.mk" file.
and this file will be

<source lang="">
PRJ=..

PRJNAME=postprocess
TARGET=merger_base

.INCLUDE : settings.mk

# ------ merger_base.uno ------
SHL1TARGET= merger_base.uno
SHL1OBJS= \
$(SLO)$/merger_base.obj

SHL1STDLIBS= \
$(CPPUHELPERLIB) \
$(CPPULIB) \
$(SALLIB)

SHL1DEPN=
SHL1IMPLIB= i$(TARGET)

SHL1LIBS= \
$(SOLARVER)$/$(INPATH)$/slb/base_merger/behelper_merger.lib

SHL1DEF= $(MISC)$/$(SHL1TARGET).def
DEF1NAME= $(SHL1TARGET)
DEF1EXPORTFILE= exports.dxp
</source>
== "exports.dxp" file ==
Create new "postprocess/merger/exports.dxp" file.
And this file will be:
<source lang="">
component_getImplementationEnvironment
component_writeInfo
component_getFactory
</source>
== Deliver ==
Deliver merger library to solver dir.
Add this content to file "postprocess/prj/d.lst":
<source lang="">
..\%__SRC%\bin\merger_base.uno.dll %_DEST%\bin%_EXT%\merger_base.uno.dll
</source>

Now we finished compile merger library process.

= Update the packge script file =
These process will be "scp2" module, has two types thing:
One is add merger libraries to package, the other is that do not add mergered libraries to package.
'''Clear the mergered libraries '''

update "scp2/source/ooo/file_library_ooo.scp":
<source lang="">
-File gid_File_Lib_Behelper
- TXT_FILE_BODY;
- Styles = (PACKED,UNO_COMPONENT);
- RegistryID = gid_Starregistry_Services_Rdb;
- Dir = gid_Dir_Program;
- #ifdef UNX
- Name = STRING(CONCAT2(behelper.uno,UNXSUFFIX));
- #else
- Name = "behelper.uno.dll";
- #endif
-End
</source>

update "scp2/source/ooo/module_hidden_ooo.scp":
<source lang="">
-gid_File_Lib_Behelper,
</source>

'''Add the merger libraries '''

update "scp2/source/ooo/file_library_ooo.scp":
<source lang="">
+File gid_File_Lib_Merger_base
+ TXT_FILE_BODY;
+ Styles = (PACKED,UNO_COMPONENT);
+ RegistryID = gid_Starregistry_Services_Rdb;
+ Dir = gid_Dir_Program;
+ #ifdef UNX
+ Name = STRING(CONCAT2(merger_base.uno,UNXSUFFIX));
+ #else
+ Name = "merger_base.uno.dll";
+ #endif
+ End
</source>
update "scp2/source/ooo/module_hidden_ooo.scp":
<source lang="">
+gid_File_Lib_Merger_base,
</source>

= Problem =
When I merger those library, that will report error when load OOo with UNO component. I do't know why.

Performance/Implement Merger Dynamic Library

2010-03-02T08:19:27Z

Zengliangjun: /* Deliver */

Performance/Implement Merger Dynamic Library

2010-03-02T08:17:03Z

Zengliangjun: Created page with 'Something about merger dynamic library please view Merge_UNO_Dlls and Performance/Ideas/Easy_UNO_Services_Merging. I will disucss the complete process here(exclude UNO r…'

Something about merger dynamic library please view [[Merge_UNO_Dlls]] and [[Performance/Ideas/Easy_UNO_Services_Merging]].

I will disucss the complete process here(exclude UNO runtime libraries).

= Analyze the loading libraries =
"'''B'''" is library's name.

"'''''I'''''" is module name.

== OOo base starting load libraries ==

basegfxmi.dll
'''behelper.uno.dll''' '''''configmgr'''''
comphelp4MSC.dll
'''configmgr2.uno.dll''' '''''configmgr'''''
'''dnd.dll''' '''''dtrans'''''
'''fsstorage.uno.dll''' '''''svtools'''''
fwemi.dll
fwimi.dll
'''fwkmi.dll''' '''''framework'''''
'''fwlmi.dll''' '''''framework'''''
i18nisolang1MSC.dll
'''i18npool.uno.dll''' '''''i18npool'''''
i18nutilMSC.dll
icudt40.dll
icuin40.dll
icuuc40.dll
jmi_g.dll
lngmi.dll
'''localebe1.uno.dll''' '''''shell'''''
'''package2.dll''' '''''package'''''
'''sax.uno.dll''' '''''sax'''''
saxmi.dll
sbmi.dll
sfxmi.dll
sofficeapp.dll
sotmi.dll
splmi.dll
svlmi.dll
svtmi.dll
sysmgr1.uno.dll
tkmi.dll
tlmi.dll
ucb1.dll
ucbhelper4MSC.dll
'''ucpfile1.dll''' '''''ucb'''''
utlmi.dll
vclmi.dll
vos3MSC.dll
xcrmi.dll
xomi.dll
== Write/Calc/Impress starting load libraries ==
'''fileacc.dll'''
'''filterconfig1.dll'''
'''ftransl.dll'''
'''guesslangmi.dll'''
'''ldapbe2.uno.dll'''
'''mcnttype.dll'''
'''sysdtrans.dll'''
'''ucpexpand1.uno.dll'''
'''unoxmlmi.dll'''
'''uuimi.dll'''
'''xstor.dll'''
== Write/Calc/Impress starting load libraries ==
'''evtatt.dll'''
'''frmmi.dll'''
'''hyphenmi.dll'''
'''lnthmi.dll'''
'''spellmi.dll'''
'''xmlsecurity.dll'''
= Rewrite the uno export method =
I will '''behelper.uno.dll''' as example.

== Implement new method ==
As we know, This library's UNO method is define in "configmgr/source/backendhelper/componentdf.cxx".

Now we will copy that file to a new file "configmgr/source/backendhelper/componentdf_merger.cxx".
And update the uno methods name like this([[Performance/Ideas/Easy_UNO_Services_Merging]]):

component_getImplementationEnvironment_''behelper''
component_writeInfo_''behelper''
component_getFactory_''behelper''

== Compile new lib file ==
Now we can update the "configmgr/source/backendhelper/makefile.mk", and compile the "behelper_merger.lib" file.
Add these content into this file.

LIB2TARGET=$(SLB)$/''behelper_merger.lib''
LIB2OBJFILES=\
$(SLO)$/backendlayerhelper.obj \
$(SLO)$/''componentdf_merger.obj''
== Deliver merger lib to solver dir ==
Update the "configmgr/prj/d.lst", add these content into this file

mkdir: %_DEST%\slb%_EXT%\base_merger
..\%__SRC%\slb\configmgr.lib %_DEST%\slb%_EXT%\base_merger\behelper_merger.lib
..\%__SRC%\slb\configmgr.lin %_DEST%\slb%_EXT%\base_merger\behelper_merger.lin

Now dealing with a dynamic library of the complete process has been completed.

= Merger liberary uno method implement =
We will implement these process in "postprocess" module.
== "merger" folder ==
Create new "postprocess/merger" folder, and add these content to "postprocess/prj/build.lst".

+po postprocess\merger nmake - all po_merger NULL
-po postprocess\checkxml nmake - all po_checkxml NULL
+po postprocess\checkxml nmake - all po_checkxml po_merger NULL
== "merger_XXX.cxx" file ==
Create new "postprocess/merger/merger_base.cxx" file.
And this file will be:

<source lang="cpp">
#include <cppuhelper/factory.hxx>

#define DECLARE_UNO_API( model ) \
void component_getImplementationEnvironment_##model \
(const sal_Char **, uno_Environment); \
sal_Bool component_writeInfo_##model \
(void *, void *); \
void* component_getFactory_##model \
(const sal_Char*, void *, void *);
//
#define CALL_UNO_API_WRITER_INFO(model ) \
if( !component_writeInfo_##model( pServiceManager, pRegistryKey) ) \
{ return sal_False; }
//
#define CALL_UNO_API_GET_FACTORY(model ) \
if( NULL != (pFactory = component_getFactory_##model( pImplName, pServiceManager, pRegistryKey)) ) \
{ return pFactory; }
//
rtl_StandardModuleCount g_moduleCount = MODULE_COUNT_INIT;

DECLARE_UNO_API( behelper );

extern "C"
{
void SAL_CALL component_getImplementationEnvironment(
const sal_Char ** ppEnvTypeName, uno_Environment ** )
{
*ppEnvTypeName = CPPU_CURRENT_LANGUAGE_BINDING_NAME;
}
sal_Bool SAL_CALL component_writeInfo( void * pServiceManager, void * pRegistryKey )
{
CALL_UNO_API_WRITER_INFO( behelper );
return sal_True;
}
void * SAL_CALL component_getFactory
(const sal_Char * pImplName, void * pServiceManager, void * pRegistryKey)
{
void * pFactory = NULL;
CALL_UNO_API_GET_FACTORY( behelper );
return pFactory;
}

}
</source>
== "makefile.mk" file ==
Create new "postprocess/merger/makefile.mk" file.
and this file will be

<source lang="">
PRJ=..

PRJNAME=postprocess
TARGET=merger_base

.INCLUDE : settings.mk

# ------ merger_base.uno ------
SHL1TARGET= merger_base.uno
SHL1OBJS= \
$(SLO)$/merger_base.obj

SHL1STDLIBS= \
$(CPPUHELPERLIB) \
$(CPPULIB) \
$(SALLIB)

SHL1DEPN=
SHL1IMPLIB= i$(TARGET)

SHL1LIBS= \
$(SOLARVER)$/$(INPATH)$/slb/base_merger/behelper_merger.lib

SHL1DEF= $(MISC)$/$(SHL1TARGET).def
DEF1NAME= $(SHL1TARGET)
DEF1EXPORTFILE= exports.dxp
</source>
== "exports.dxp" file ==
Create new "postprocess/merger/exports.dxp" file.
And this file will be:
<source lang="">
component_getImplementationEnvironment
component_writeInfo
component_getFactory
</source>
== Deliver ==
Deliver merger library to solver dir.
Add this content to file "postprocess/prj/d.lst":
<source lang="">
..\%__SRC%\bin\merger_base.uno.dll %_DEST%\bin%_EXT%\merger_base.uno.dll
</source>

Now we completed process to compile merger library.
= Update the packge script file =
These process will be "scp2" module, has two types thing:
One is add merger libraries to package, the other is that do not add mergered libraries to package.
'''Clear the mergered libraries '''

update "scp2/source/ooo/file_library_ooo.scp":
<source lang="">
-File gid_File_Lib_Behelper
- TXT_FILE_BODY;
- Styles = (PACKED,UNO_COMPONENT);
- RegistryID = gid_Starregistry_Services_Rdb;
- Dir = gid_Dir_Program;
- #ifdef UNX
- Name = STRING(CONCAT2(behelper.uno,UNXSUFFIX));
- #else
- Name = "behelper.uno.dll";
- #endif
-End
</source>

update "scp2/source/ooo/module_hidden_ooo.scp":
<source lang="">
-gid_File_Lib_Behelper,
</source>

'''Add the merger libraries '''

update "scp2/source/ooo/file_library_ooo.scp":
<source lang="">
+File gid_File_Lib_Merger_base
+ TXT_FILE_BODY;
+ Styles = (PACKED,UNO_COMPONENT);
+ RegistryID = gid_Starregistry_Services_Rdb;
+ Dir = gid_Dir_Program;
+ #ifdef UNX
+ Name = STRING(CONCAT2(merger_base.uno,UNXSUFFIX));
+ #else
+ Name = "merger_base.uno.dll";
+ #endif
+ End
</source>
update "scp2/source/ooo/module_hidden_ooo.scp":
<source lang="">
+gid_File_Lib_Merger_base,
</source>

Performance/Improver performance about string

2010-03-02T05:38:02Z

Zengliangjun: /* About some methods: */

I tried three methods.
= About string cache:=
Sometimes cache the struct 'rtl_uString' in a hash object.

That will add the cost like 'internRelease',
'rtl_ustring_intern_internal' when add a 'rtl_uString' and a 'rtl_uString' refCount is '0'.

I think it's purpose is reducing memory cost( right or no).

We can don't use the cache to improver performance.

= About some methods:=
Calculate the 'rtl_uString'/'rtl_String' hashCode and compare the 'rtl_uString'/'rtl_String',
that is one by one. So many 'sal_Cahr'/'sal_Unicode' and many operator times.

The 'sal_Cahr'/'sal_Unicode' and 'sal_Int32' are the same data type.

We can operator the 'sal_Cahr'/'sal_Unicode' like operator 'sal_Int32', and one 'sal_Int32' is 4/2 'sal_Cahr'/'sal_Unicode' ;that will reduce the operator times.

As :
<source lang="cpp">
sal_Int32 SAL_CALL IMPL_RTL_STRNAME( hashCode_WithLength )
( const IMPL_RTL_STRCODE* pStr, sal_Int32 nLen )
{
static sal_Int32 _count = sizeof(sal_Int32)/sizeof(IMPL_RTL_STRCODE);
sal_Int32 h = nLen;
while ( nLen > 0 )
{
if( nLen > _count )
{
h += (*((sal_Int32*)(void *)pStr ))*37;
pStr+= _count;
nLen-= _count;
}else
{
h = (h)*37 + IMPL_RTL_USTRCODE( *pStr );
pStr++;
nLen--;
}
}
return h;
}
</source>

= About string struct design:=
Now the struct has three members: 'refCount', 'length', 'buffer'.

Compare and calculate hash value for string that is frequent .

We can add a field it cache the string's hash value.

Some times Compare or calculate hash value; these will compare the cache value or return the cache value directly.

<b>I 'd tried the three methods; it is not particularly evident from the time comparison.</b>

[[Category:Performance]]

Performance/Improver performance about string

2010-03-02T03:58:59Z

Zengliangjun: Created page with 'I tried three methods. = About string cache:= Sometimes cache the struct 'rtl_uString' in a hash object. That will add the cost like 'internRelease', 'rtl_ustring_intern_inte…'

I tried three methods.
= About string cache:=
Sometimes cache the struct 'rtl_uString' in a hash object.

That will add the cost like 'internRelease',
'rtl_ustring_intern_internal' when add a 'rtl_uString' and a 'rtl_uString' refCount is '0'.

I think it's purpose is reducing memory cost( right or no).

We can don't use the cache to improver performance.

= About some methods:=
Calculate the 'rtl_uString'/'rtl_String' hashCode and compare the 'rtl_uString'/'rtl_String',
that is one by one. So many 'sal_Cahr'/'sal_Unicode' and many operator times.

The 'sal_Cahr'/'sal_Unicode' and 'sal_Int32' are the same data type.

We can operator the 'sal_Cahr'/'sal_Unicode' like operator 'sal_Int32', and one 'sal_Int32' is 4/2 'sal_Cahr'/'sal_Unicode' ;that will reduce the operator times.

As :

sal_Int32 SAL_CALL IMPL_RTL_STRNAME( hashCode_WithLength )
<nowiki>( const IMPL_RTL_STRCODE* pStr, sal_Int32 nLen )</nowiki>
<nowiki>{</nowiki>
<nowiki>static sal_Int32 _count = sizeof(sal_Int32)/sizeof(IMPL_RTL_STRCODE);</nowiki>
<nowiki>sal_Int32 h = nLen;</nowiki>
<nowiki>while ( nLen > 0 )</nowiki>
<nowiki>{</nowiki>
<nowiki>if( nLen > _count )</nowiki>
<nowiki>{</nowiki>
<nowiki>h += (*((sal_Int32*)(void *)pStr ))*37;</nowiki>
<nowiki>pStr+= _count;</nowiki>
<nowiki>nLen-= _count;</nowiki>
<nowiki>}else</nowiki>
<nowiki>{</nowiki>
<nowiki>h = (h)*39 + IMPL_RTL_USTRCODE( *pStr );</nowiki>
<nowiki>pStr++;</nowiki>
<nowiki>nLen--;</nowiki>
<nowiki>}</nowiki>
<nowiki>}</nowiki>
<nowiki>return h;</nowiki>
}

= About string struct design:=
Now the struct has three members: 'refCount', 'length', 'buffer'.

Compare and calculate hash value for string that is frequent .

We can add a field it cache the string's hash value.

Some times Compare or calculate hash value; these will compare the cache value or return the cache value directly.

<b>I 'd tried the three methods; it is not particularly evident from the time comparison.</b>

[[Category:Performance]]

Performance/load performance analysis

2009-12-08T05:14:31Z

Zengliangjun:

= A group of test data =
== Interesting contrast analysis data from SAX parser processing ==

{| class="prettytable"
| colspan="7" | <center>'''Start OOo writer, read a document which has a 3.9 MB "content.xml" '''</center>

|-
| ODF handler
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">12759</div>
| <div align="right">11805</div>
| <div align="right">13233</div>
| <div align="right">11312</div>
| <div align="right">13279</div>
|

|-
| Start
| <div align="right">6230</div>
| <div align="right">5245</div>
| <div align="right">6758</div>
| <div align="right">5378</div>
| <div align="right">6541</div>
|

|-
|
| <div align="right">'''6529'''</div>
| <div align="right">'''6560'''</div>
| <div align="right">'''6475'''</div>
| <div align="right">'''5934'''</div>
| <div align="right">'''6738'''</div>
| <div align="right">'''''6447.2'''''</div>

|-
| End
| <div align="right">31305</div>
| <div align="right">36262</div>
| <div align="right">30083</div>
| <div align="right">28452</div>
| <div align="right">28584</div>
|

|-
| Start
| <div align="right">24852</div>
| <div align="right">30694</div>
| <div align="right">23611</div>
| <div align="right">22018</div>
| <div align="right">22148</div>
|

|-
|
| <div align="right">'''6453'''</div>
| <div align="right">'''5568'''</div>
| <div align="right">'''6472'''</div>
| <div align="right">'''6434'''</div>
| <div align="right">'''6436'''</div>
| <div align="right">'''''6272.6'''''</div>

|}

{| class="prettytable"
| colspan="7" | <center>'''A simple application it implement a empty XdocumentHandler read the sample "content.xml" '''</center>

|-
| Empty handler
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">354</div>
| <div align="right">362</div>
| <div align="right">355</div>
| <div align="right">370</div>
| <div align="right">312</div>
|

|-
| Start
| <div align="right">30</div>
| <div align="right">30</div>
| <div align="right">29</div>
| <div align="right">30</div>
| <div align="right">24</div>
|

|-
|
| <div align="right">'''324'''</div>
| <div align="right">'''332'''</div>
| <div align="right">'''326'''</div>
| <div align="right">'''340'''</div>
| <div align="right">'''288'''</div>
| <div align="right">'''''322'''''</div>

|-
| End
| <div align="right">635</div>
| <div align="right">644</div>
| <div align="right">633</div>
| <div align="right">651</div>
| <div align="right">588</div>
|

|-
| Start
| <div align="right">354</div>
| <div align="right">362</div>
| <div align="right">355</div>
| <div align="right">370</div>
| <div align="right">312</div>
|

|-
|
| <div align="right">'''281'''</div>
| <div align="right">'''282'''</div>
| <div align="right">'''278'''</div>
| <div align="right">'''281'''</div>
| <div align="right">'''276'''</div>
| <div align="right">'''''279.6'''''</div>

|}
'''The first “start – end” contain load library cost ，the second “start – end” do not contain。'''

All test result are warm .

* '''We can find the OOo processing more cost than empty XdocumentHandler。'''

== Interesting contrast analysis data from Dual-core processing ==
The test with 912 xml files ( total size 44.2 MB )

{| class="prettytable"
| colspan="7" | <center>'''A simple application it implement a empty XdocumentHandler , use UCB and single thread process these files.'''</center>

|-
| Single thread
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">003604</div>
| <div align="right">003549</div>
| <div align="right">003500</div>
| <div align="right">003538</div>
| <div align="right">003492</div>
|

|-
| Start
| <div align="right">000029</div>
| <div align="right">000029</div>
| <div align="right">000029</div>
| <div align="right">000023</div>
| <div align="right">000029</div>
|

|-
|
| <div align="right">'''3575'''</div>
| <div align="right">'''3520'''</div>
| <div align="right">'''3471'''</div>
| <div align="right">'''3515'''</div>
| <div align="right">'''3463'''</div>
| <div align="right">'''''3508.8'''''</div>

|-
| End
| <div align="right">007076</div>
| <div align="right">006957</div>
| <div align="right">006924</div>
| <div align="right">007025</div>
| <div align="right">006897</div>
|

|-
| Start
| <div align="right">003604</div>
| <div align="right">003550</div>
| <div align="right">003500</div>
| <div align="right">003538</div>
| <div align="right">003492</div>
|

|-
|
| <div align="right">'''3472'''</div>
| <div align="right">'''3407'''</div>
| <div align="right">'''3424'''</div>
| <div align="right">'''3487'''</div>
| <div align="right">'''3405'''</div>
| <div align="right">'''''3439'''''</div>

|}

{| class="prettytable"
| colspan="7" | <center>'''A simple application it implement a empty XdocumentHandler , use UCB and one file one thread process these files.'''</center>

|-
| <center>'''one file one thread'''</center>
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">002696</div>
| <div align="right">002763</div>
| <div align="right">002560</div>
| <div align="right">002827</div>
| <div align="right">002133</div>
|

|-
| Start
| <div align="right">000018</div>
| <div align="right">000026</div>
| <div align="right">000028</div>
| <div align="right">000030</div>
| <div align="right">000033</div>
|

|-
|
| <div align="right">'''2678'''</div>
| <div align="right">'''2737'''</div>
| <div align="right">'''2532'''</div>
| <div align="right">'''2797'''</div>
| <div align="right">'''2100'''</div>
| <div align="right">'''''2568.8'''''</div>

|-
| End
| <div align="right">005318</div>
| <div align="right">005471</div>
| <div align="right">005224</div>
| <div align="right">005174</div>
| <div align="right">004816</div>
|

|-
| Start
| <div align="right">002696</div>
| <div align="right">002764</div>
| <div align="right">002560</div>
| <div align="right">002827</div>
| <div align="right">002133</div>
|

|-
|
| <div align="right">'''2622'''</div>
| <div align="right">'''2707'''</div>
| <div align="right">'''2664'''</div>
| <div align="right">'''2347'''</div>
| <div align="right">'''2683'''</div>
| <div align="right">'''''2604.6'''''</div>

|}

{| class="prettytable"
| colspan="7" | <center>'''A simple application it implement a empty XdocumentHandler , use UCB and two thread process these files.'''</center>

|-
| Two thread
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">002314</div>
| <div align="right">002332</div>
| <div align="right">002356</div>
| <div align="right">002377</div>
| <div align="right">002411</div>
|

|-
| Start
| <div align="right">000027</div>
| <div align="right">000029</div>
| <div align="right">000029</div>
| <div align="right">000030</div>
| <div align="right">000030</div>
|

|-
|
| <div align="right">'''2287'''</div>
| <div align="right">'''2303'''</div>
| <div align="right">'''2327'''</div>
| <div align="right">'''2347'''</div>
| <div align="right">'''2381'''</div>
| <div align="right">'''''2329'''''</div>

|-
| End
| <div align="right">004568</div>
| <div align="right">004611</div>
| <div align="right">004622</div>
| <div align="right">004639</div>
| <div align="right">004731</div>
|

|-
| Start
| <div align="right">002314</div>
| <div align="right">002332</div>
| <div align="right">002356</div>
| <div align="right">002377</div>
| <div align="right">002411</div>
|

|-
|
| <div align="right">'''2254'''</div>
| <div align="right">'''2279'''</div>
| <div align="right">'''2266'''</div>
| <div align="right">'''2262'''</div>
| <div align="right">'''2320'''</div>
| <div align="right">'''''2276.2'''''</div>

|}
== Interesting contrast analysis data from Mononuclear processing ==

{| class="prettytable"
| colspan="7" | <center>'''A simple application it implement a empty XdocumentHandler , use UCB and single thread process these files.'''</center>

|-
| Single thread
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">005062</div>
| <div align="right">005531</div>
| <div align="right">005516</div>
| <div align="right">005062</div>
| <div align="right">005110</div>
|

|-
| Start
| <div align="right">000062</div>
| <div align="right">000062</div>
| <div align="right">000047</div>
| <div align="right">000062</div>
| <div align="right">000047</div>
|

|-
|
| <div align="right">'''5000'''</div>
| <div align="right">'''5469'''</div>
| <div align="right">'''5469'''</div>
| <div align="right">'''5000'''</div>
| <div align="right">'''5063'''</div>
| <div align="right">'''''5200.2'''''</div>

|-
| End
| <div align="right">010016</div>
| <div align="right">010703</div>
| <div align="right">010469</div>
| <div align="right">010062</div>
| <div align="right">010078</div>
|

|-
| Start
| <div align="right">005062</div>
| <div align="right">005531</div>
| <div align="right">005516</div>
| <div align="right">005062</div>
| <div align="right">005110</div>
|

|-
|
| <div align="right">'''4954'''</div>
| <div align="right">'''5172'''</div>
| <div align="right">'''4953'''</div>
| <div align="right">'''5000'''</div>
| <div align="right">'''4968'''</div>
| <div align="right">'''''5009.4'''''</div>

|}

{| class="prettytable"
| colspan="7" | <center>'''A simple application it implement a empty XdocumentHandler , use UCB and one file one thread process these files.'''</center>

|-
| <center>'''one file one thread'''</center>
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">005391</div>
| <div align="right">005391</div>
| <div align="right">005422</div>
| <div align="right">005797</div>
| <div align="right">005516</div>
|

|-
| Start
| <div align="right">000063</div>
| <div align="right">000047</div>
| <div align="right">000047</div>
| <div align="right">000063</div>
| <div align="right">000063</div>
|

|-
|
| <div align="right">'''5328'''</div>
| <div align="right">'''5344'''</div>
| <div align="right">'''5375'''</div>
| <div align="right">'''5734'''</div>
| <div align="right">'''5453'''</div>
| <div align="right">'''''5446.8'''''</div>

|-
| End
| <div align="right">010719</div>
| <div align="right">010672</div>
| <div align="right">010703</div>
| <div align="right">011453</div>
| <div align="right">010797</div>
|

|-
| Start
| <div align="right">005391</div>
| <div align="right">005391</div>
| <div align="right">005422</div>
| <div align="right">005797</div>
| <div align="right">005516</div>
|

|-
|
| <div align="right">'''5328'''</div>
| <div align="right">'''5381'''</div>
| <div align="right">'''5281'''</div>
| <div align="right">'''5656'''</div>
| <div align="right">'''5281'''</div>
| <div align="right">'''''5385.4'''''</div>

|}

{| class="prettytable"
| colspan="7" | <center>'''A simple application it implement a empty XdocumentHandler , use UCB and two thread process these files.'''</center>

|-
| Two thread
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">005110</div>
| <div align="right">005062</div>
| <div align="right">005516</div>
| <div align="right">005531</div>
| <div align="right">005062</div>
|

|-
| Start
| <div align="right">000047</div>
| <div align="right">000062</div>
| <div align="right">000047</div>
| <div align="right">000062</div>
| <div align="right">000062</div>
|

|-
|
| <div align="right">'''5063'''</div>
| <div align="right">'''5000'''</div>
| <div align="right">'''5469'''</div>
| <div align="right">'''5469'''</div>
| <div align="right">'''5000'''</div>
| <div align="right">'''''5200'''''</div>

|-
| End
| <div align="right">010078</div>
| <div align="right">010062</div>
| <div align="right">010469</div>
| <div align="right">010703</div>
| <div align="right">010016</div>
|

|-
| Start
| <div align="right">005110</div>
| <div align="right">005062</div>
| <div align="right">005516</div>
| <div align="right">005531</div>
| <div align="right">005062</div>
|

|-
|
| <div align="right">'''4968'''</div>
| <div align="right">'''5000'''</div>
| <div align="right">'''4953'''</div>
| <div align="right">'''5172'''</div>
| <div align="right">'''4954'''</div>
| <div align="right">'''''5009.4'''''</div>

|}
= Overview =
== Through the first group data we can get a conclusion: ==
* ''' As load odf, OOo process that is great proportion .'''

== Through the late two sets data we can get the conclusions: ==
* ''' As single-core, one task divide into multiple small tasks；these are same cost, processing with single thread, one task one thread and two thread.( one task one thread performance relatively low) '''
* ''' As dual-core, one task divide into multiple small tasks；that is close to 0.7-0.8 compared one task one thread, that is close to 0.66 compared two threads process; to single thread. '''

= How to do =
== How can we improve ODF loading performance.==

* ''' As multi-core cpu, Can we split “content.xml” processing to some small tasks; process with multi-thread and merger the result. '''

* ''' As Single-core, Can we split “content.xml” processing to some small tasks; asynchronous processing.'''

<nowiki>* Now, we don't discuss the xml parser. </nowiki>

== How can we split “content.xml” processing to some small tasks: ==

* ''' Split “content.xml” content. '''

* ''' Colloect the result with sax parser, and Split the result '''

= Description =
== Split “content.xml” content ==
Change the document structure, complex nodules defined as a reference link to a single file,the main file contains only simple structure.

It will produce the ODF layout:

<nowiki>content.xml
complex/fragment1.xml
/fragment2.xml
/fragment3.xml
/fragment4.xml
…</nowiki>

And “content.xml” will be:

<nowiki>…
<table:table xlink:href= “complex/fragment1.xml” />
…</nowiki>

* I think it will produce the same performance optimization when save documentation, this way.

== Colloect the result with sax parser, and Split that ==
From the above test data, SAX process with relatively less cost itself. We can colloect SAX parser result, and split it to multi part.

{| class="prettytable"
| colspan="7" | <center>A simple application it implement a XdocumentHandler that colloect the SAX parser result , use UCB read thest files</center>

|-
| <center>Colloect the SAX parser result</center>
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">005706</div>
| <div align="right">005510</div>
| <div align="right">005200</div>
| <div align="right">005824</div>
| <div align="right">005527</div>
|

|-
| Start
| <div align="right">000029</div>
| <div align="right">000019</div>
| <div align="right">000019</div>
| <div align="right">000012</div>
| <div align="right">000011</div>
|

|-
|
| <div align="right">'''5677'''</div>
| <div align="right">'''5491'''</div>
| <div align="right">'''5181'''</div>
| <div align="right">'''5812'''</div>
| <div align="right">'''5516'''</div>
| <div align="right">'''''5695.4'''''</div>

|-
| End
| <div align="right">010814</div>
| <div align="right">010685</div>
| <div align="right">010297</div>
| <div align="right">010950</div>
| <div align="right">010794</div>
|

|-
| Start
| <div align="right">005706</div>
| <div align="right">005510</div>
| <div align="right">005200</div>
| <div align="right">005824</div>
| <div align="right">005527</div>
|

|-
|
| <div align="right">'''5108'''</div>
| <div align="right">'''5175'''</div>
| <div align="right">'''5097'''</div>
| <div align="right">'''5126'''</div>
| <div align="right">'''5267'''</div>
| <div align="right">'''''5154.6'''''</div>

|}

{| class="prettytable"
| colspan="7" | <center>'''A simple application it implement a empty XdocumentHandler , use UCB and single thread process these files.'''</center>

|-
| Empty handler
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">003788</div>
| <div align="right">003763</div>
| <div align="right">003908</div>
| <div align="right">004044</div>
| <div align="right">003702</div>
|

|-
| Start
| <div align="right">000015</div>
| <div align="right">000011</div>
| <div align="right">000013</div>
| <div align="right">000014</div>
| <div align="right">000016</div>
|

|-
|
| <div align="right">'''3773'''</div>
| <div align="right">'''3752'''</div>
| <div align="right">'''3895'''</div>
| <div align="right">'''4030'''</div>
| <div align="right">'''3686'''</div>
| <div align="right">'''''3821.2'''''</div>

|-
| End
| <div align="right">008330</div>
| <div align="right">007444</div>
| <div align="right">007836</div>
| <div align="right">007776</div>
| <div align="right">007465</div>
|

|-
| Start
| <div align="right">003788</div>
| <div align="right">003764</div>
| <div align="right">003908</div>
| <div align="right">004044</div>
| <div align="right">003703</div>
|

|-
|
| <div align="right">'''3542'''</div>
| <div align="right">'''3680'''</div>
| <div align="right">'''3924'''</div>
| <div align="right">'''3732'''</div>
| <div align="right">'''3762'''</div>
| <div align="right">'''''3728'''''</div>

|}
We can see it is less cost that colloect the SAX parser result. So we can split that throught some rules and multi-thread to process .

== Implement Description ==
It has two policies which split processing “content.xml”task to some small tasks：

a) Split “content.xml”to many sub files.

b) Colloect the result(attribute & content ) from sax parser, and split the result to many parts in some rules.

struct State
{
rtl_uString* mp_elementName; // current element tag name can replace to one flag
xml::sax::XAttributeList* mp_attributes; // current element's attributes
rtl_uString* mp_elementContent; // current element's content

sal_uInt32 m_local; // It's position at vector
sal_uInt32 m_distance; // It's distance from parent element
sal_uInt32 m_count; // It's count of all sub elements
};

<nowiki>typedef std::vector< State* > StateVectors;</nowiki>

From compared above multi-thread data, situation single-core / multi-core increase performance is different.

So I think it can consider asynchronous processing as single-core, it can consider parallel processing as multi-core.

It is 2 policies X 2 situations processing description( Of couse it is my imagines )：

=== Single Core + Many Fragments Asynchronism Process ===
[[Image:Single_Core_%2B_Many_Fragments_Asynchronism_Process.PNG]]
=== Single Core + split SAX result Asynchronism Process ===
[[Image:Single_Core_%2B_split_SAX_result_Asynchronism_Process.PNG]]

=== Multi Core + Many fragments Parallel Process ===
[[Image:Multi_Core_%2B_Many_fragments_Parallel_Process.PNG]]
=== Multi-Core + split SAX result Parallel Process ===
[[Image:Multi_Core_%2B_split_SAX_result_Parallel_Process.PNG]]

== Key points ==
=== The collected information segmentation algorithm ===
=== Now for OOo process is not very clear, do n't know whether be expected. Waits further research ===
= Appendix =
== Here is simple test, with no other considerations, just to test the feasibility of the technology. ==

{| class="prettytable"
| colspan="7" | <center>'''A simple application it implement a XdocumentHandler that colloect the SAX parser result , use UCB read thest files'''</center>

|-
| <center>Colloect the SAX parser result</center>
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">005560</div>
| <div align="right">005563</div>
| <div align="right">005551</div>
| <div align="right">005791</div>
| <div align="right">005558</div>
|

|-
| Start
| <div align="right">000033</div>
| <div align="right">000029</div>
| <div align="right">000030</div>
| <div align="right">000030</div>
| <div align="right">000023</div>
|

|-
|
| <div align="right">'''5527'''</div>
| <div align="right">'''5534'''</div>
| <div align="right">'''5521'''</div>
| <div align="right">'''5761'''</div>
| <div align="right">'''5535'''</div>
| <div align="right">'''''5575.6'''''</div>

|-
| End
| <div align="right">010952</div>
| <div align="right">011093</div>
| <div align="right">011069</div>
| <div align="right">011268</div>
| <div align="right">010972</div>
|

|-
| Start
| <div align="right">005560</div>
| <div align="right">005563</div>
| <div align="right">005551</div>
| <div align="right">005791</div>
| <div align="right">005558</div>
|

|-
|
| <div align="right">'''5392'''</div>
| <div align="right">'''5530'''</div>
| <div align="right">'''5518'''</div>
| <div align="right">'''5477'''</div>
| <div align="right">'''5414'''</div>
| <div align="right">'''''5466.2'''''</div>

|}

{| class="prettytable"
| colspan="7" | <center>'''A simple application it implement a XdocumentHandler that colloect the SAX parser result , use UCB read thest files, and one thread process one SAX parser result.'''</center>

|-
|
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">028326</div>
| <div align="right">028438</div>
| <div align="right">028115</div>
| <div align="right">27835</div>
| <div align="right">28054</div>
|

|-
| Start
| <div align="right">000035</div>
| <div align="right">000035</div>
| <div align="right">000030</div>
| <div align="right">30</div>
| <div align="right">20</div>
|

|-
|
| <div align="right">'''28291'''</div>
| <div align="right">'''28403'''</div>
| <div align="right">'''28085'''</div>
| <div align="right">'''27805'''</div>
| <div align="right">'''28034'''</div>
| <div align="right">'''''28123.6'''''</div>

|-
| End
| <div align="right">055763</div>
| <div align="right">056048</div>
| <div align="right">056294</div>
| <div align="right">056474</div>
| <div align="right">056538</div>
|

|-
| Start
| <div align="right">028326</div>
| <div align="right">028438</div>
| <div align="right">28115</div>
| <div align="right">027835</div>
| <div align="right">028054</div>
|

|-
|
| <div align="right">'''27437'''</div>
| <div align="right">'''27610'''</div>
| <div align="right">'''28179'''</div>
| <div align="right">'''28639'''</div>
| <div align="right">'''28484'''</div>
| <div align="right">'''''28069.8'''''</div>

|}
== A group of large data test ==
=== OOo calc “content.xml” 35.1 MB / 3.8M ===

{| class="prettytable"
| colspan="7" | <center>'''OOo reader “content.xml” '''</center>

|-
| ODF handler
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">38220</div>
| <div align="right">37340</div>
| <div align="right">37140</div>
| <div align="right">66316</div>
| <div align="right">35378</div>
|

|-
| Start
| <div align="right">6559</div>
| <div align="right">6292</div>
| <div align="right">7014</div>
| <div align="right">38431</div>
| <div align="right">6513</div>
|

|-
|
| <div align="right">'''31661'''</div>
| <div align="right">'''31048'''</div>
| <div align="right">'''30126'''</div>
| <div align="right">'''27885'''</div>
| <div align="right">'''28865'''</div>
| <div align="right">'''''29917'''''</div>

|-
| End
| <div align="right">79549</div>
| <div align="right">82462</div>
| <div align="right">81397</div>
| <div align="right">107576</div>
| <div align="right">873537</div>
|

|-
| Start
| <div align="right">47461</div>
| <div align="right">49710</div>
| <div align="right">50479</div>
| <div align="right">78099</div>
| <div align="right">844944</div>
|

|-
|
| <div align="right">'''32088'''</div>
| <div align="right">'''32752'''</div>
| <div align="right">'''30918'''</div>
| <div align="right">'''29477'''</div>
| <div align="right">'''28593'''</div>
| <div align="right">'''''30765.6'''''</div>

|}

{| class="prettytable"
| colspan="7" | <center>'''“XdocumentHandler” empty implement reader “content.xml” '''</center>

|-
| Empty handler
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">2082</div>
| <div align="right">2178</div>
| <div align="right">2118</div>
| <div align="right">2106</div>
| <div align="right">2082</div>
|

|-
| Start
| <div align="right">16</div>
| <div align="right">16</div>
| <div align="right">13</div>
| <div align="right">15</div>
| <div align="right">14</div>
|

|-
|
| <div align="right">'''2066'''</div>
| <div align="right">'''2162'''</div>
| <div align="right">'''2105'''</div>
| <div align="right">'''2091'''</div>
| <div align="right">'''2068'''</div>
| <div align="right">'''''2098.4'''''</div>

|-
| End
| <div align="right">4070</div>
| <div align="right">4752</div>
| <div align="right">4106</div>
| <div align="right">4088</div>
| <div align="right">4294</div>
|

|-
| Start
| <div align="right">2082</div>
| <div align="right">2178</div>
| <div align="right">2118</div>
| <div align="right">2106</div>
| <div align="right">2082</div>
|

|-
|
| <div align="right">'''1988'''</div>
| <div align="right">'''2574'''</div>
| <div align="right">'''1988'''</div>
| <div align="right">'''1982'''</div>
| <div align="right">'''2212'''</div>
| <div align="right">'''''2148.8'''''</div>

|}
=== OOo writer “content.xml” 62.6 MB / 2.0M ===

{| class="prettytable"
| colspan="7" | <center>'''OOo reader “content.xml” '''</center>

|-
| ODF handler
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">108876</div>
| <div align="right">108729</div>
| <div align="right">108997</div>
| <div align="right">108901</div>
| <div align="right">110140</div>
|

|-
| Start
| <div align="right">6201</div>
| <div align="right">6060</div>
| <div align="right">6240</div>
| <div align="right">7029</div>
| <div align="right">8415</div>
|

|-
|
| <div align="right">'''102675'''</div>
| <div align="right">'''102669'''</div>
| <div align="right">'''102757'''</div>
| <div align="right">'''101872'''</div>
| <div align="right">'''101725'''</div>
| <div align="right">'''''102339.6'''''</div>

|-
| End
| <div align="right">229982</div>
| <div align="right">228416</div>
| <div align="right">235011</div>
| <div align="right">234573</div>
| <div align="right">233124</div>
|

|-
| Start
| <div align="right">126660</div>
| <div align="right">125567</div>
| <div align="right">132174</div>
| <div align="right">132292</div>
| <div align="right">130810</div>
|

|-
|
| <div align="right">'''103322'''</div>
| <div align="right">'''102849'''</div>
| <div align="right">'''102837'''</div>
| <div align="right">'''102281'''</div>
| <div align="right">'''102314'''</div>
| <div align="right">'''''102720.6'''''</div>

|}

{| class="prettytable"
| colspan="7" | <center>'''“XdocumentHandler” empty implement reader “content.xml” '''</center>

|-
| Empty handler
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">4825</div>
| <div align="right">5595</div>
| <div align="right">5546</div>
| <div align="right">5658</div>
| <div align="right">6072</div>
|

|-
| Start
| <div align="right">20</div>
| <div align="right">59</div>
| <div align="right">12</div>
| <div align="right">23</div>
| <div align="right">629</div>
|

|-
|
| <div align="right">'''4805'''</div>
| <div align="right">'''5536'''</div>
| <div align="right">'''5534'''</div>
| <div align="right">'''5635'''</div>
| <div align="right">'''5443'''</div>
| <div align="right">'''''5390.6'''''</div>

|-
| End
| <div align="right">9899</div>
| <div align="right">11815</div>
| <div align="right">11280</div>
| <div align="right">11300</div>
| <div align="right">11394</div>
|

|-
| Start
| <div align="right">4825</div>
| <div align="right">5595</div>
| <div align="right">5546</div>
| <div align="right">5658</div>
| <div align="right">6072</div>
|

|-
|
| <div align="right">'''5074'''</div>
| <div align="right">'''6220'''</div>
| <div align="right">'''5734'''</div>
| <div align="right">'''5642'''</div>
| <div align="right">'''5322'''</div>
| <div align="right">'''''5598.4'''''</div>

|}

[[Category:Performance]]

Performance/load performance analysis

2009-12-08T04:17:01Z

Zengliangjun: /* Split “content.xml” content */ (checkpoint save)

= A group of test data =
== Interesting contrast analysis data from SAX parser processing ==

{| class="prettytable"
| colspan="7" | <center>'''Start OOo writer, read a document which has a 3.9 MB "content.xml" '''</center>

|-
| ODF handler
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">12759</div>
| <div align="right">11805</div>
| <div align="right">13233</div>
| <div align="right">11312</div>
| <div align="right">13279</div>
|

|-
| Start
| <div align="right">6230</div>
| <div align="right">5245</div>
| <div align="right">6758</div>
| <div align="right">5378</div>
| <div align="right">6541</div>
|

|-
|
| <div align="right">'''6529'''</div>
| <div align="right">'''6560'''</div>
| <div align="right">'''6475'''</div>
| <div align="right">'''5934'''</div>
| <div align="right">'''6738'''</div>
| <div align="right">'''''6447.2'''''</div>

|-
| End
| <div align="right">31305</div>
| <div align="right">36262</div>
| <div align="right">30083</div>
| <div align="right">28452</div>
| <div align="right">28584</div>
|

|-
| Start
| <div align="right">24852</div>
| <div align="right">30694</div>
| <div align="right">23611</div>
| <div align="right">22018</div>
| <div align="right">22148</div>
|

|-
|
| <div align="right">'''6453'''</div>
| <div align="right">'''5568'''</div>
| <div align="right">'''6472'''</div>
| <div align="right">'''6434'''</div>
| <div align="right">'''6436'''</div>
| <div align="right">'''''6272.6'''''</div>

|}

{| class="prettytable"
| colspan="7" | <center>'''A simple application it implement a empty XdocumentHandler read the sample "content.xml" '''</center>

|-
| Empty handler
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">354</div>
| <div align="right">362</div>
| <div align="right">355</div>
| <div align="right">370</div>
| <div align="right">312</div>
|

|-
| Start
| <div align="right">30</div>
| <div align="right">30</div>
| <div align="right">29</div>
| <div align="right">30</div>
| <div align="right">24</div>
|

|-
|
| <div align="right">'''324'''</div>
| <div align="right">'''332'''</div>
| <div align="right">'''326'''</div>
| <div align="right">'''340'''</div>
| <div align="right">'''288'''</div>
| <div align="right">'''''322'''''</div>

|-
| End
| <div align="right">635</div>
| <div align="right">644</div>
| <div align="right">633</div>
| <div align="right">651</div>
| <div align="right">588</div>
|

|-
| Start
| <div align="right">354</div>
| <div align="right">362</div>
| <div align="right">355</div>
| <div align="right">370</div>
| <div align="right">312</div>
|

|-
|
| <div align="right">'''281'''</div>
| <div align="right">'''282'''</div>
| <div align="right">'''278'''</div>
| <div align="right">'''281'''</div>
| <div align="right">'''276'''</div>
| <div align="right">'''''279.6'''''</div>

|}
'''The first “start – end” contain load library cost ，the second “start – end” do not contain。'''

All test result are warm .

* '''We can find the OOo processing more cost than empty XdocumentHandler。'''

== Interesting contrast analysis data from Dual-core processing ==
The test with 912 xml files ( total size 44.2 MB )

{| class="prettytable"
| colspan="7" | <center>'''A simple application it implement a empty XdocumentHandler , use UCB and single thread process these files.'''</center>

|-
| Single thread
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">003604</div>
| <div align="right">003549</div>
| <div align="right">003500</div>
| <div align="right">003538</div>
| <div align="right">003492</div>
|

|-
| Start
| <div align="right">000029</div>
| <div align="right">000029</div>
| <div align="right">000029</div>
| <div align="right">000023</div>
| <div align="right">000029</div>
|

|-
|
| <div align="right">'''3575'''</div>
| <div align="right">'''3520'''</div>
| <div align="right">'''3471'''</div>
| <div align="right">'''3515'''</div>
| <div align="right">'''3463'''</div>
| <div align="right">'''''3508.8'''''</div>

|-
| End
| <div align="right">007076</div>
| <div align="right">006957</div>
| <div align="right">006924</div>
| <div align="right">007025</div>
| <div align="right">006897</div>
|

|-
| Start
| <div align="right">003604</div>
| <div align="right">003550</div>
| <div align="right">003500</div>
| <div align="right">003538</div>
| <div align="right">003492</div>
|

|-
|
| <div align="right">'''3472'''</div>
| <div align="right">'''3407'''</div>
| <div align="right">'''3424'''</div>
| <div align="right">'''3487'''</div>
| <div align="right">'''3405'''</div>
| <div align="right">'''''3439'''''</div>

|}

{| class="prettytable"
| colspan="7" | <center>'''A simple application it implement a empty XdocumentHandler , use UCB and one file one thread process these files.'''</center>

|-
| <center>'''one file one thread'''</center>
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">002696</div>
| <div align="right">002763</div>
| <div align="right">002560</div>
| <div align="right">002827</div>
| <div align="right">002133</div>
|

|-
| Start
| <div align="right">000018</div>
| <div align="right">000026</div>
| <div align="right">000028</div>
| <div align="right">000030</div>
| <div align="right">000033</div>
|

|-
|
| <div align="right">'''2678'''</div>
| <div align="right">'''2737'''</div>
| <div align="right">'''2532'''</div>
| <div align="right">'''2797'''</div>
| <div align="right">'''2100'''</div>
| <div align="right">'''''2568.8'''''</div>

|-
| End
| <div align="right">005318</div>
| <div align="right">005471</div>
| <div align="right">005224</div>
| <div align="right">005174</div>
| <div align="right">004816</div>
|

|-
| Start
| <div align="right">002696</div>
| <div align="right">002764</div>
| <div align="right">002560</div>
| <div align="right">002827</div>
| <div align="right">002133</div>
|

|-
|
| <div align="right">'''2622'''</div>
| <div align="right">'''2707'''</div>
| <div align="right">'''2664'''</div>
| <div align="right">'''2347'''</div>
| <div align="right">'''2683'''</div>
| <div align="right">'''''2604.6'''''</div>

|}

{| class="prettytable"
| colspan="7" | <center>'''A simple application it implement a empty XdocumentHandler , use UCB and two thread process these files.'''</center>

|-
| Two thread
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">002314</div>
| <div align="right">002332</div>
| <div align="right">002356</div>
| <div align="right">002377</div>
| <div align="right">002411</div>
|

|-
| Start
| <div align="right">000027</div>
| <div align="right">000029</div>
| <div align="right">000029</div>
| <div align="right">000030</div>
| <div align="right">000030</div>
|

|-
|
| <div align="right">'''2287'''</div>
| <div align="right">'''2303'''</div>
| <div align="right">'''2327'''</div>
| <div align="right">'''2347'''</div>
| <div align="right">'''2381'''</div>
| <div align="right">'''''2329'''''</div>

|-
| End
| <div align="right">004568</div>
| <div align="right">004611</div>
| <div align="right">004622</div>
| <div align="right">004639</div>
| <div align="right">004731</div>
|

|-
| Start
| <div align="right">002314</div>
| <div align="right">002332</div>
| <div align="right">002356</div>
| <div align="right">002377</div>
| <div align="right">002411</div>
|

|-
|
| <div align="right">'''2254'''</div>
| <div align="right">'''2279'''</div>
| <div align="right">'''2266'''</div>
| <div align="right">'''2262'''</div>
| <div align="right">'''2320'''</div>
| <div align="right">'''''2276.2'''''</div>

|}
== Interesting contrast analysis data from Mononuclear processing ==

{| class="prettytable"
| colspan="7" | <center>'''A simple application it implement a empty XdocumentHandler , use UCB and single thread process these files.'''</center>

|-
| Single thread
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">005062</div>
| <div align="right">005531</div>
| <div align="right">005516</div>
| <div align="right">005062</div>
| <div align="right">005110</div>
|

|-
| Start
| <div align="right">000062</div>
| <div align="right">000062</div>
| <div align="right">000047</div>
| <div align="right">000062</div>
| <div align="right">000047</div>
|

|-
|
| <div align="right">'''5000'''</div>
| <div align="right">'''5469'''</div>
| <div align="right">'''5469'''</div>
| <div align="right">'''5000'''</div>
| <div align="right">'''5063'''</div>
| <div align="right">'''''5200.2'''''</div>

|-
| End
| <div align="right">010016</div>
| <div align="right">010703</div>
| <div align="right">010469</div>
| <div align="right">010062</div>
| <div align="right">010078</div>
|

|-
| Start
| <div align="right">005062</div>
| <div align="right">005531</div>
| <div align="right">005516</div>
| <div align="right">005062</div>
| <div align="right">005110</div>
|

|-
|
| <div align="right">'''4954'''</div>
| <div align="right">'''5172'''</div>
| <div align="right">'''4953'''</div>
| <div align="right">'''5000'''</div>
| <div align="right">'''4968'''</div>
| <div align="right">'''''5009.4'''''</div>

|}

{| class="prettytable"
| colspan="7" | <center>'''A simple application it implement a empty XdocumentHandler , use UCB and one file one thread process these files.'''</center>

|-
| <center>'''one file one thread'''</center>
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">005391</div>
| <div align="right">005391</div>
| <div align="right">005422</div>
| <div align="right">005797</div>
| <div align="right">005516</div>
|

|-
| Start
| <div align="right">000063</div>
| <div align="right">000047</div>
| <div align="right">000047</div>
| <div align="right">000063</div>
| <div align="right">000063</div>
|

|-
|
| <div align="right">'''5328'''</div>
| <div align="right">'''5344'''</div>
| <div align="right">'''5375'''</div>
| <div align="right">'''5734'''</div>
| <div align="right">'''5453'''</div>
| <div align="right">'''''5446.8'''''</div>

|-
| End
| <div align="right">010719</div>
| <div align="right">010672</div>
| <div align="right">010703</div>
| <div align="right">011453</div>
| <div align="right">010797</div>
|

|-
| Start
| <div align="right">005391</div>
| <div align="right">005391</div>
| <div align="right">005422</div>
| <div align="right">005797</div>
| <div align="right">005516</div>
|

|-
|
| <div align="right">'''5328'''</div>
| <div align="right">'''5381'''</div>
| <div align="right">'''5281'''</div>
| <div align="right">'''5656'''</div>
| <div align="right">'''5281'''</div>
| <div align="right">'''''5385.4'''''</div>

|}

{| class="prettytable"
| colspan="7" | <center>'''A simple application it implement a empty XdocumentHandler , use UCB and two thread process these files.'''</center>

|-
| Two thread
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">005110</div>
| <div align="right">005062</div>
| <div align="right">005516</div>
| <div align="right">005531</div>
| <div align="right">005062</div>
|

|-
| Start
| <div align="right">000047</div>
| <div align="right">000062</div>
| <div align="right">000047</div>
| <div align="right">000062</div>
| <div align="right">000062</div>
|

|-
|
| <div align="right">'''5063'''</div>
| <div align="right">'''5000'''</div>
| <div align="right">'''5469'''</div>
| <div align="right">'''5469'''</div>
| <div align="right">'''5000'''</div>
| <div align="right">'''''5200'''''</div>

|-
| End
| <div align="right">010078</div>
| <div align="right">010062</div>
| <div align="right">010469</div>
| <div align="right">010703</div>
| <div align="right">010016</div>
|

|-
| Start
| <div align="right">005110</div>
| <div align="right">005062</div>
| <div align="right">005516</div>
| <div align="right">005531</div>
| <div align="right">005062</div>
|

|-
|
| <div align="right">'''4968'''</div>
| <div align="right">'''5000'''</div>
| <div align="right">'''4953'''</div>
| <div align="right">'''5172'''</div>
| <div align="right">'''4954'''</div>
| <div align="right">'''''5009.4'''''</div>

|}
= Overview =
== Through the first group data we can get a conclusion: ==
* ''' As load odf, it is great proportion from OOo process.'''

== Through the late two sets data we can get the conclusions: ==
* ''' As single-core, one task divide into multiple small tasks；these are same cost, processing with single thread, one task one thread and two thread.( one task one thread performance relatively low) '''
* ''' As dual-core, one task divide into multiple small tasks；that is close to 0.7-0.8 compared one task one thread, that is close to 0.66 compared two threads process; to single thread. '''

= How to do =
== How can we improve ODF loading performance.==

* ''' As multi-core cpu, Can we split “content.xml” processing to some small tasks; process with multi-thread and merger the result. '''

* ''' As Single-core, Can we split “content.xml” processing to some small tasks; asynchronous processing.'''

<nowiki>* Now, we don't discuss the xml parser. </nowiki>

== How can we split “content.xml” processing to some small tasks: ==

* ''' Split “content.xml” content. '''

* ''' Colloect the result with sax parser, and Split the result '''

= Description =
== Split “content.xml” content ==
Change the document structure, complex nodules defined as a reference link to a single file,the main file contains only simple structure.

It will produce the ODF layout :

<nowiki>content.xml
complex/fragment1.xml
/fragment2.xml
/fragment3.xml
/fragment4.xml
…</nowiki>

And “content.xml” will be :

<nowiki>…
<table:table xlink:href= “complex/fragment1.xml” />
…</nowiki>

* I think it will produce the same performance optimization when save documentation, this way.

== Colloect the result with sax parser, and Split that ==
From the above test data, SAX process with relatively less cost itself. We can colloect SAX parser result, and split it to multi part.

{| class="prettytable"
| colspan="7" | <center>A simple application it implement a XdocumentHandler that colloect the SAX parser result , use UCB read thest files</center>

|-
| <center>Colloect the SAX parser result</center>
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">005706</div>
| <div align="right">005510</div>
| <div align="right">005200</div>
| <div align="right">005824</div>
| <div align="right">005527</div>
|

|-
| Start
| <div align="right">000029</div>
| <div align="right">000019</div>
| <div align="right">000019</div>
| <div align="right">000012</div>
| <div align="right">000011</div>
|

|-
|
| <div align="right">'''5677'''</div>
| <div align="right">'''5491'''</div>
| <div align="right">'''5181'''</div>
| <div align="right">'''5812'''</div>
| <div align="right">'''5516'''</div>
| <div align="right">'''''5695.4'''''</div>

|-
| End
| <div align="right">010814</div>
| <div align="right">010685</div>
| <div align="right">010297</div>
| <div align="right">010950</div>
| <div align="right">010794</div>
|

|-
| Start
| <div align="right">005706</div>
| <div align="right">005510</div>
| <div align="right">005200</div>
| <div align="right">005824</div>
| <div align="right">005527</div>
|

|-
|
| <div align="right">'''5108'''</div>
| <div align="right">'''5175'''</div>
| <div align="right">'''5097'''</div>
| <div align="right">'''5126'''</div>
| <div align="right">'''5267'''</div>
| <div align="right">'''''5154.6'''''</div>

|}

{| class="prettytable"
| colspan="7" | <center>'''A simple application it implement a empty XdocumentHandler , use UCB and single thread process these files.'''</center>

|-
| Empty handler
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">003788</div>
| <div align="right">003763</div>
| <div align="right">003908</div>
| <div align="right">004044</div>
| <div align="right">003702</div>
|

|-
| Start
| <div align="right">000015</div>
| <div align="right">000011</div>
| <div align="right">000013</div>
| <div align="right">000014</div>
| <div align="right">000016</div>
|

|-
|
| <div align="right">'''3773'''</div>
| <div align="right">'''3752'''</div>
| <div align="right">'''3895'''</div>
| <div align="right">'''4030'''</div>
| <div align="right">'''3686'''</div>
| <div align="right">'''''3821.2'''''</div>

|-
| End
| <div align="right">008330</div>
| <div align="right">007444</div>
| <div align="right">007836</div>
| <div align="right">007776</div>
| <div align="right">007465</div>
|

|-
| Start
| <div align="right">003788</div>
| <div align="right">003764</div>
| <div align="right">003908</div>
| <div align="right">004044</div>
| <div align="right">003703</div>
|

|-
|
| <div align="right">'''3542'''</div>
| <div align="right">'''3680'''</div>
| <div align="right">'''3924'''</div>
| <div align="right">'''3732'''</div>
| <div align="right">'''3762'''</div>
| <div align="right">'''''3728'''''</div>

|}
We can see it is less cost that colloect the SAX parser result. So we can split that throught some rules and multi-thread to process .

== Implement Description ==
It has two policies which split processing “content.xml”task to some small tasks：

a) Split “content.xml”to many sub files.

b) Colloect the result(attribute & content ) from sax parser, and split the result to many parts in some rules.

struct State
{
rtl_uString* mp_elementName; // current element tag name can replace to one flag
xml::sax::XAttributeList* mp_attributes; // current element's attributes
rtl_uString* mp_elementContent; // current element's content

sal_uInt32 m_local; // It's position at vector
sal_uInt32 m_distance; // It's distance from parent element
sal_uInt32 m_count; // It's count of all sub elements
};

<nowiki>typedef std::vector< State* > StateVectors;</nowiki>

From compared above multi-thread data, situation single-core / multi-core increase performance is different.

So I think it can consider asynchronous processing as single-core, it can consider parallel processing as multi-core.

It is 2 policies X 2 situations processing description( Of couse it is my imagines )：

=== Single Core + Many Fragments Asynchronism Process ===
[[Image:Single_Core_%2B_Many_Fragments_Asynchronism_Process.PNG]]
=== Single Core + split SAX result Asynchronism Process ===
[[Image:Single_Core_%2B_split_SAX_result_Asynchronism_Process.PNG]]

=== Multi Core + Many fragments Parallel Process ===
[[Image:Multi_Core_%2B_Many_fragments_Parallel_Process.PNG]]
=== Multi-Core + split SAX result Parallel Process ===
[[Image:Multi_Core_%2B_split_SAX_result_Parallel_Process.PNG]]

== Key points ==
=== The collected information segmentation algorithm ===
=== Now for OOo process is not very clear, do n't know whether be expected. Waits further research ===
= Appendix =
== Here is simple test, with no other considerations, just to test the feasibility of the technology. ==

{| class="prettytable"
| colspan="7" | <center>'''A simple application it implement a XdocumentHandler that colloect the SAX parser result , use UCB read thest files'''</center>

|-
| <center>Colloect the SAX parser result</center>
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">005560</div>
| <div align="right">005563</div>
| <div align="right">005551</div>
| <div align="right">005791</div>
| <div align="right">005558</div>
|

|-
| Start
| <div align="right">000033</div>
| <div align="right">000029</div>
| <div align="right">000030</div>
| <div align="right">000030</div>
| <div align="right">000023</div>
|

|-
|
| <div align="right">'''5527'''</div>
| <div align="right">'''5534'''</div>
| <div align="right">'''5521'''</div>
| <div align="right">'''5761'''</div>
| <div align="right">'''5535'''</div>
| <div align="right">'''''5575.6'''''</div>

|-
| End
| <div align="right">010952</div>
| <div align="right">011093</div>
| <div align="right">011069</div>
| <div align="right">011268</div>
| <div align="right">010972</div>
|

|-
| Start
| <div align="right">005560</div>
| <div align="right">005563</div>
| <div align="right">005551</div>
| <div align="right">005791</div>
| <div align="right">005558</div>
|

|-
|
| <div align="right">'''5392'''</div>
| <div align="right">'''5530'''</div>
| <div align="right">'''5518'''</div>
| <div align="right">'''5477'''</div>
| <div align="right">'''5414'''</div>
| <div align="right">'''''5466.2'''''</div>

|}

{| class="prettytable"
| colspan="7" | <center>'''A simple application it implement a XdocumentHandler that colloect the SAX parser result , use UCB read thest files, and one thread process one SAX parser result.'''</center>

|-
|
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">028326</div>
| <div align="right">028438</div>
| <div align="right">028115</div>
| <div align="right">27835</div>
| <div align="right">28054</div>
|

|-
| Start
| <div align="right">000035</div>
| <div align="right">000035</div>
| <div align="right">000030</div>
| <div align="right">30</div>
| <div align="right">20</div>
|

|-
|
| <div align="right">'''28291'''</div>
| <div align="right">'''28403'''</div>
| <div align="right">'''28085'''</div>
| <div align="right">'''27805'''</div>
| <div align="right">'''28034'''</div>
| <div align="right">'''''28123.6'''''</div>

|-
| End
| <div align="right">055763</div>
| <div align="right">056048</div>
| <div align="right">056294</div>
| <div align="right">056474</div>
| <div align="right">056538</div>
|

|-
| Start
| <div align="right">028326</div>
| <div align="right">028438</div>
| <div align="right">28115</div>
| <div align="right">027835</div>
| <div align="right">028054</div>
|

|-
|
| <div align="right">'''27437'''</div>
| <div align="right">'''27610'''</div>
| <div align="right">'''28179'''</div>
| <div align="right">'''28639'''</div>
| <div align="right">'''28484'''</div>
| <div align="right">'''''28069.8'''''</div>

|}
== A group of large data test ==
=== OOo calc “content.xml” 35.1 MB / 3.8M ===

{| class="prettytable"
| colspan="7" | <center>'''OOo reader “content.xml” '''</center>

|-
| ODF handler
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">38220</div>
| <div align="right">37340</div>
| <div align="right">37140</div>
| <div align="right">66316</div>
| <div align="right">35378</div>
|

|-
| Start
| <div align="right">6559</div>
| <div align="right">6292</div>
| <div align="right">7014</div>
| <div align="right">38431</div>
| <div align="right">6513</div>
|

|-
|
| <div align="right">'''31661'''</div>
| <div align="right">'''31048'''</div>
| <div align="right">'''30126'''</div>
| <div align="right">'''27885'''</div>
| <div align="right">'''28865'''</div>
| <div align="right">'''''29917'''''</div>

|-
| End
| <div align="right">79549</div>
| <div align="right">82462</div>
| <div align="right">81397</div>
| <div align="right">107576</div>
| <div align="right">873537</div>
|

|-
| Start
| <div align="right">47461</div>
| <div align="right">49710</div>
| <div align="right">50479</div>
| <div align="right">78099</div>
| <div align="right">844944</div>
|

|-
|
| <div align="right">'''32088'''</div>
| <div align="right">'''32752'''</div>
| <div align="right">'''30918'''</div>
| <div align="right">'''29477'''</div>
| <div align="right">'''28593'''</div>
| <div align="right">'''''30765.6'''''</div>

|}

{| class="prettytable"
| colspan="7" | <center>'''“XdocumentHandler” empty implement reader “content.xml” '''</center>

|-
| Empty handler
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">2082</div>
| <div align="right">2178</div>
| <div align="right">2118</div>
| <div align="right">2106</div>
| <div align="right">2082</div>
|

|-
| Start
| <div align="right">16</div>
| <div align="right">16</div>
| <div align="right">13</div>
| <div align="right">15</div>
| <div align="right">14</div>
|

|-
|
| <div align="right">'''2066'''</div>
| <div align="right">'''2162'''</div>
| <div align="right">'''2105'''</div>
| <div align="right">'''2091'''</div>
| <div align="right">'''2068'''</div>
| <div align="right">'''''2098.4'''''</div>

|-
| End
| <div align="right">4070</div>
| <div align="right">4752</div>
| <div align="right">4106</div>
| <div align="right">4088</div>
| <div align="right">4294</div>
|

|-
| Start
| <div align="right">2082</div>
| <div align="right">2178</div>
| <div align="right">2118</div>
| <div align="right">2106</div>
| <div align="right">2082</div>
|

|-
|
| <div align="right">'''1988'''</div>
| <div align="right">'''2574'''</div>
| <div align="right">'''1988'''</div>
| <div align="right">'''1982'''</div>
| <div align="right">'''2212'''</div>
| <div align="right">'''''2148.8'''''</div>

|}
=== OOo writer “content.xml” 62.6 MB / 2.0M ===

{| class="prettytable"
| colspan="7" | <center>'''OOo reader “content.xml” '''</center>

|-
| ODF handler
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">108876</div>
| <div align="right">108729</div>
| <div align="right">108997</div>
| <div align="right">108901</div>
| <div align="right">110140</div>
|

|-
| Start
| <div align="right">6201</div>
| <div align="right">6060</div>
| <div align="right">6240</div>
| <div align="right">7029</div>
| <div align="right">8415</div>
|

|-
|
| <div align="right">'''102675'''</div>
| <div align="right">'''102669'''</div>
| <div align="right">'''102757'''</div>
| <div align="right">'''101872'''</div>
| <div align="right">'''101725'''</div>
| <div align="right">'''''102339.6'''''</div>

|-
| End
| <div align="right">229982</div>
| <div align="right">228416</div>
| <div align="right">235011</div>
| <div align="right">234573</div>
| <div align="right">233124</div>
|

|-
| Start
| <div align="right">126660</div>
| <div align="right">125567</div>
| <div align="right">132174</div>
| <div align="right">132292</div>
| <div align="right">130810</div>
|

|-
|
| <div align="right">'''103322'''</div>
| <div align="right">'''102849'''</div>
| <div align="right">'''102837'''</div>
| <div align="right">'''102281'''</div>
| <div align="right">'''102314'''</div>
| <div align="right">'''''102720.6'''''</div>

|}

{| class="prettytable"
| colspan="7" | <center>'''“XdocumentHandler” empty implement reader “content.xml” '''</center>

|-
| Empty handler
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">4825</div>
| <div align="right">5595</div>
| <div align="right">5546</div>
| <div align="right">5658</div>
| <div align="right">6072</div>
|

|-
| Start
| <div align="right">20</div>
| <div align="right">59</div>
| <div align="right">12</div>
| <div align="right">23</div>
| <div align="right">629</div>
|

|-
|
| <div align="right">'''4805'''</div>
| <div align="right">'''5536'''</div>
| <div align="right">'''5534'''</div>
| <div align="right">'''5635'''</div>
| <div align="right">'''5443'''</div>
| <div align="right">'''''5390.6'''''</div>

|-
| End
| <div align="right">9899</div>
| <div align="right">11815</div>
| <div align="right">11280</div>
| <div align="right">11300</div>
| <div align="right">11394</div>
|

|-
| Start
| <div align="right">4825</div>
| <div align="right">5595</div>
| <div align="right">5546</div>
| <div align="right">5658</div>
| <div align="right">6072</div>
|

|-
|
| <div align="right">'''5074'''</div>
| <div align="right">'''6220'''</div>
| <div align="right">'''5734'''</div>
| <div align="right">'''5642'''</div>
| <div align="right">'''5322'''</div>
| <div align="right">'''''5598.4'''''</div>

|}

[[Category:Performance]]

Performance/load performance analysis

2009-12-08T03:46:55Z

Zengliangjun:

= A group of test data =
== Interesting contrast analysis data from SAX parser processing ==

{| class="prettytable"
| colspan="7" | <center>'''Start OOo writer, read a document which has a 3.9 MB "content.xml" '''</center>

|-
| ODF handler
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">12759</div>
| <div align="right">11805</div>
| <div align="right">13233</div>
| <div align="right">11312</div>
| <div align="right">13279</div>
|

|-
| Start
| <div align="right">6230</div>
| <div align="right">5245</div>
| <div align="right">6758</div>
| <div align="right">5378</div>
| <div align="right">6541</div>
|

|-
|
| <div align="right">'''6529'''</div>
| <div align="right">'''6560'''</div>
| <div align="right">'''6475'''</div>
| <div align="right">'''5934'''</div>
| <div align="right">'''6738'''</div>
| <div align="right">'''''6447.2'''''</div>

|-
| End
| <div align="right">31305</div>
| <div align="right">36262</div>
| <div align="right">30083</div>
| <div align="right">28452</div>
| <div align="right">28584</div>
|

|-
| Start
| <div align="right">24852</div>
| <div align="right">30694</div>
| <div align="right">23611</div>
| <div align="right">22018</div>
| <div align="right">22148</div>
|

|-
|
| <div align="right">'''6453'''</div>
| <div align="right">'''5568'''</div>
| <div align="right">'''6472'''</div>
| <div align="right">'''6434'''</div>
| <div align="right">'''6436'''</div>
| <div align="right">'''''6272.6'''''</div>

|}

{| class="prettytable"
| colspan="7" | <center>'''A simple application it implement a empty XdocumentHandler read the sample "content.xml" '''</center>

|-
| Empty handler
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">354</div>
| <div align="right">362</div>
| <div align="right">355</div>
| <div align="right">370</div>
| <div align="right">312</div>
|

|-
| Start
| <div align="right">30</div>
| <div align="right">30</div>
| <div align="right">29</div>
| <div align="right">30</div>
| <div align="right">24</div>
|

|-
|
| <div align="right">'''324'''</div>
| <div align="right">'''332'''</div>
| <div align="right">'''326'''</div>
| <div align="right">'''340'''</div>
| <div align="right">'''288'''</div>
| <div align="right">'''''322'''''</div>

|-
| End
| <div align="right">635</div>
| <div align="right">644</div>
| <div align="right">633</div>
| <div align="right">651</div>
| <div align="right">588</div>
|

|-
| Start
| <div align="right">354</div>
| <div align="right">362</div>
| <div align="right">355</div>
| <div align="right">370</div>
| <div align="right">312</div>
|

|-
|
| <div align="right">'''281'''</div>
| <div align="right">'''282'''</div>
| <div align="right">'''278'''</div>
| <div align="right">'''281'''</div>
| <div align="right">'''276'''</div>
| <div align="right">'''''279.6'''''</div>

|}
'''The first “start – end” contain load library cost ，the second “start – end” do not contain。'''

All test result are warm .

* '''We can find the OOo processing more cost than empty XdocumentHandler。'''

== Interesting contrast analysis data from Dual-core processing ==
The test with 912 xml files ( total size 44.2 MB )

{| class="prettytable"
| colspan="7" | <center>'''A simple application it implement a empty XdocumentHandler , use UCB and single thread process these files.'''</center>

|-
| Single thread
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">003604</div>
| <div align="right">003549</div>
| <div align="right">003500</div>
| <div align="right">003538</div>
| <div align="right">003492</div>
|

|-
| Start
| <div align="right">000029</div>
| <div align="right">000029</div>
| <div align="right">000029</div>
| <div align="right">000023</div>
| <div align="right">000029</div>
|

|-
|
| <div align="right">'''3575'''</div>
| <div align="right">'''3520'''</div>
| <div align="right">'''3471'''</div>
| <div align="right">'''3515'''</div>
| <div align="right">'''3463'''</div>
| <div align="right">'''''3508.8'''''</div>

|-
| End
| <div align="right">007076</div>
| <div align="right">006957</div>
| <div align="right">006924</div>
| <div align="right">007025</div>
| <div align="right">006897</div>
|

|-
| Start
| <div align="right">003604</div>
| <div align="right">003550</div>
| <div align="right">003500</div>
| <div align="right">003538</div>
| <div align="right">003492</div>
|

|-
|
| <div align="right">'''3472'''</div>
| <div align="right">'''3407'''</div>
| <div align="right">'''3424'''</div>
| <div align="right">'''3487'''</div>
| <div align="right">'''3405'''</div>
| <div align="right">'''''3439'''''</div>

|}

{| class="prettytable"
| colspan="7" | <center>'''A simple application it implement a empty XdocumentHandler , use UCB and one file one thread process these files.'''</center>

|-
| <center>'''one file one thread'''</center>
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">002696</div>
| <div align="right">002763</div>
| <div align="right">002560</div>
| <div align="right">002827</div>
| <div align="right">002133</div>
|

|-
| Start
| <div align="right">000018</div>
| <div align="right">000026</div>
| <div align="right">000028</div>
| <div align="right">000030</div>
| <div align="right">000033</div>
|

|-
|
| <div align="right">'''2678'''</div>
| <div align="right">'''2737'''</div>
| <div align="right">'''2532'''</div>
| <div align="right">'''2797'''</div>
| <div align="right">'''2100'''</div>
| <div align="right">'''''2568.8'''''</div>

|-
| End
| <div align="right">005318</div>
| <div align="right">005471</div>
| <div align="right">005224</div>
| <div align="right">005174</div>
| <div align="right">004816</div>
|

|-
| Start
| <div align="right">002696</div>
| <div align="right">002764</div>
| <div align="right">002560</div>
| <div align="right">002827</div>
| <div align="right">002133</div>
|

|-
|
| <div align="right">'''2622'''</div>
| <div align="right">'''2707'''</div>
| <div align="right">'''2664'''</div>
| <div align="right">'''2347'''</div>
| <div align="right">'''2683'''</div>
| <div align="right">'''''2604.6'''''</div>

|}

{| class="prettytable"
| colspan="7" | <center>'''A simple application it implement a empty XdocumentHandler , use UCB and two thread process these files.'''</center>

|-
| Two thread
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">002314</div>
| <div align="right">002332</div>
| <div align="right">002356</div>
| <div align="right">002377</div>
| <div align="right">002411</div>
|

|-
| Start
| <div align="right">000027</div>
| <div align="right">000029</div>
| <div align="right">000029</div>
| <div align="right">000030</div>
| <div align="right">000030</div>
|

|-
|
| <div align="right">'''2287'''</div>
| <div align="right">'''2303'''</div>
| <div align="right">'''2327'''</div>
| <div align="right">'''2347'''</div>
| <div align="right">'''2381'''</div>
| <div align="right">'''''2329'''''</div>

|-
| End
| <div align="right">004568</div>
| <div align="right">004611</div>
| <div align="right">004622</div>
| <div align="right">004639</div>
| <div align="right">004731</div>
|

|-
| Start
| <div align="right">002314</div>
| <div align="right">002332</div>
| <div align="right">002356</div>
| <div align="right">002377</div>
| <div align="right">002411</div>
|

|-
|
| <div align="right">'''2254'''</div>
| <div align="right">'''2279'''</div>
| <div align="right">'''2266'''</div>
| <div align="right">'''2262'''</div>
| <div align="right">'''2320'''</div>
| <div align="right">'''''2276.2'''''</div>

|}
== Interesting contrast analysis data from Mononuclear processing ==

{| class="prettytable"
| colspan="7" | <center>'''A simple application it implement a empty XdocumentHandler , use UCB and single thread process these files.'''</center>

|-
| Single thread
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">005062</div>
| <div align="right">005531</div>
| <div align="right">005516</div>
| <div align="right">005062</div>
| <div align="right">005110</div>
|

|-
| Start
| <div align="right">000062</div>
| <div align="right">000062</div>
| <div align="right">000047</div>
| <div align="right">000062</div>
| <div align="right">000047</div>
|

|-
|
| <div align="right">'''5000'''</div>
| <div align="right">'''5469'''</div>
| <div align="right">'''5469'''</div>
| <div align="right">'''5000'''</div>
| <div align="right">'''5063'''</div>
| <div align="right">'''''5200.2'''''</div>

|-
| End
| <div align="right">010016</div>
| <div align="right">010703</div>
| <div align="right">010469</div>
| <div align="right">010062</div>
| <div align="right">010078</div>
|

|-
| Start
| <div align="right">005062</div>
| <div align="right">005531</div>
| <div align="right">005516</div>
| <div align="right">005062</div>
| <div align="right">005110</div>
|

|-
|
| <div align="right">'''4954'''</div>
| <div align="right">'''5172'''</div>
| <div align="right">'''4953'''</div>
| <div align="right">'''5000'''</div>
| <div align="right">'''4968'''</div>
| <div align="right">'''''5009.4'''''</div>

|}

{| class="prettytable"
| colspan="7" | <center>'''A simple application it implement a empty XdocumentHandler , use UCB and one file one thread process these files.'''</center>

|-
| <center>'''one file one thread'''</center>
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">005391</div>
| <div align="right">005391</div>
| <div align="right">005422</div>
| <div align="right">005797</div>
| <div align="right">005516</div>
|

|-
| Start
| <div align="right">000063</div>
| <div align="right">000047</div>
| <div align="right">000047</div>
| <div align="right">000063</div>
| <div align="right">000063</div>
|

|-
|
| <div align="right">'''5328'''</div>
| <div align="right">'''5344'''</div>
| <div align="right">'''5375'''</div>
| <div align="right">'''5734'''</div>
| <div align="right">'''5453'''</div>
| <div align="right">'''''5446.8'''''</div>

|-
| End
| <div align="right">010719</div>
| <div align="right">010672</div>
| <div align="right">010703</div>
| <div align="right">011453</div>
| <div align="right">010797</div>
|

|-
| Start
| <div align="right">005391</div>
| <div align="right">005391</div>
| <div align="right">005422</div>
| <div align="right">005797</div>
| <div align="right">005516</div>
|

|-
|
| <div align="right">'''5328'''</div>
| <div align="right">'''5381'''</div>
| <div align="right">'''5281'''</div>
| <div align="right">'''5656'''</div>
| <div align="right">'''5281'''</div>
| <div align="right">'''''5385.4'''''</div>

|}

{| class="prettytable"
| colspan="7" | <center>'''A simple application it implement a empty XdocumentHandler , use UCB and two thread process these files.'''</center>

|-
| Two thread
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">005110</div>
| <div align="right">005062</div>
| <div align="right">005516</div>
| <div align="right">005531</div>
| <div align="right">005062</div>
|

|-
| Start
| <div align="right">000047</div>
| <div align="right">000062</div>
| <div align="right">000047</div>
| <div align="right">000062</div>
| <div align="right">000062</div>
|

|-
|
| <div align="right">'''5063'''</div>
| <div align="right">'''5000'''</div>
| <div align="right">'''5469'''</div>
| <div align="right">'''5469'''</div>
| <div align="right">'''5000'''</div>
| <div align="right">'''''5200'''''</div>

|-
| End
| <div align="right">010078</div>
| <div align="right">010062</div>
| <div align="right">010469</div>
| <div align="right">010703</div>
| <div align="right">010016</div>
|

|-
| Start
| <div align="right">005110</div>
| <div align="right">005062</div>
| <div align="right">005516</div>
| <div align="right">005531</div>
| <div align="right">005062</div>
|

|-
|
| <div align="right">'''4968'''</div>
| <div align="right">'''5000'''</div>
| <div align="right">'''4953'''</div>
| <div align="right">'''5172'''</div>
| <div align="right">'''4954'''</div>
| <div align="right">'''''5009.4'''''</div>

|}
= Overview =
== Through the first group data we can get a conclusion: ==
* ''' As load odf, it is great proportion from OOo process.'''

== Through the late two sets data we can get the conclusions: ==
* ''' As single-core, one task divide into multiple small tasks；these are same cost, processing with single thread, one task one thread and two thread.( one task one thread performance relatively low) '''
* ''' As dual-core, one task divide into multiple small tasks；that is close to 0.7-0.8 compared one task one thread, that is close to 0.66 compared two threads process; to single thread. '''

= How to do =
== How can we improve ODF loading performance.==

* ''' As multi-core cpu, Can we split “content.xml” processing to some small tasks; process with multi-thread and merger the result. '''

* ''' As Single-core, Can we split “content.xml” processing to some small tasks; asynchronous processing.'''

<nowiki>* Now, we don't discuss the xml parser. </nowiki>

== How can we split “content.xml” processing to some small tasks: ==

* ''' Split “content.xml” content. '''

* ''' Colloect the result with sax parser, and Split the result '''

= Description =
== Split “content.xml” content ==
Change the document structure, complex nodules defined as a reference link to a single file,the main file contains only simple structure.

It will produce the ODF layout :

<nowiki>content.xml
complex/fragment1.xml
/fragment2.xml
/fragment3.xml
/fragment4.xml
…</nowiki>

And “content.xml” will be :

<nowiki>…
<table:table xlink:href= “complex/fragment1.xml” />
…</nowiki>

* I think it will produce the same performance optimization when save documentation, this way.

== Colloect the result with sax parser, and Split that ==
From the above test data, SAX process with relatively less cost itself. We can colloect SAX parser result, and split it to multi part.

{| class="prettytable"
| colspan="7" | <center>A simple application it implement a XdocumentHandler that colloect the SAX parser result , use UCB read thest files</center>

|-
| <center>Colloect the SAX parser result</center>
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">005706</div>
| <div align="right">005510</div>
| <div align="right">005200</div>
| <div align="right">005824</div>
| <div align="right">005527</div>
|

|-
| Start
| <div align="right">000029</div>
| <div align="right">000019</div>
| <div align="right">000019</div>
| <div align="right">000012</div>
| <div align="right">000011</div>
|

|-
|
| <div align="right">'''5677'''</div>
| <div align="right">'''5491'''</div>
| <div align="right">'''5181'''</div>
| <div align="right">'''5812'''</div>
| <div align="right">'''5516'''</div>
| <div align="right">'''''5695.4'''''</div>

|-
| End
| <div align="right">010814</div>
| <div align="right">010685</div>
| <div align="right">010297</div>
| <div align="right">010950</div>
| <div align="right">010794</div>
|

|-
| Start
| <div align="right">005706</div>
| <div align="right">005510</div>
| <div align="right">005200</div>
| <div align="right">005824</div>
| <div align="right">005527</div>
|

|-
|
| <div align="right">'''5108'''</div>
| <div align="right">'''5175'''</div>
| <div align="right">'''5097'''</div>
| <div align="right">'''5126'''</div>
| <div align="right">'''5267'''</div>
| <div align="right">'''''5154.6'''''</div>

|}

{| class="prettytable"
| colspan="7" | <center>'''A simple application it implement a empty XdocumentHandler , use UCB and single thread process these files.'''</center>

|-
| Empty handler
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">003788</div>
| <div align="right">003763</div>
| <div align="right">003908</div>
| <div align="right">004044</div>
| <div align="right">003702</div>
|

|-
| Start
| <div align="right">000015</div>
| <div align="right">000011</div>
| <div align="right">000013</div>
| <div align="right">000014</div>
| <div align="right">000016</div>
|

|-
|
| <div align="right">'''3773'''</div>
| <div align="right">'''3752'''</div>
| <div align="right">'''3895'''</div>
| <div align="right">'''4030'''</div>
| <div align="right">'''3686'''</div>
| <div align="right">'''''3821.2'''''</div>

|-
| End
| <div align="right">008330</div>
| <div align="right">007444</div>
| <div align="right">007836</div>
| <div align="right">007776</div>
| <div align="right">007465</div>
|

|-
| Start
| <div align="right">003788</div>
| <div align="right">003764</div>
| <div align="right">003908</div>
| <div align="right">004044</div>
| <div align="right">003703</div>
|

|-
|
| <div align="right">'''3542'''</div>
| <div align="right">'''3680'''</div>
| <div align="right">'''3924'''</div>
| <div align="right">'''3732'''</div>
| <div align="right">'''3762'''</div>
| <div align="right">'''''3728'''''</div>

|}
We can see it is less cost that colloect the SAX parser result. So we can split that throught some rules and multi-thread to process .

== Implement Description ==
It has two policies which split processing “content.xml”task to some small tasks：

a) Split “content.xml”to many sub files.

b) Colloect the result(attribute & content ) from sax parser, and split the result to many parts in some rules.

struct State
{
rtl_uString* mp_elementName; // current element tag name can replace to one flag
xml::sax::XAttributeList* mp_attributes; // current element's attributes
rtl_uString* mp_elementContent; // current element's content

sal_uInt32 m_local; // It's position at vector
sal_uInt32 m_distance; // It's distance from parent element
sal_uInt32 m_count; // It's count of all sub elements
};

<nowiki>typedef std::vector< State* > StateVectors;</nowiki>

From compared above multi-thread data, situation single-core / multi-core increase performance is different.

So I think it can consider asynchronous processing as single-core, it can consider parallel processing as multi-core.

It is 2 policies X 2 situations processing description( Of couse it is my imagines )：

=== Single Core + Many Fragments Asynchronism Process ===
[[Image:Single_Core_%2B_Many_Fragments_Asynchronism_Process.PNG]]
=== Single Core + split SAX result Asynchronism Process ===
[[Image:Single_Core_%2B_split_SAX_result_Asynchronism_Process.PNG]]

=== Multi Core + Many fragments Parallel Process ===
[[Image:Multi_Core_%2B_Many_fragments_Parallel_Process.PNG]]
=== Multi-Core + split SAX result Parallel Process ===
[[Image:Multi_Core_%2B_split_SAX_result_Parallel_Process.PNG]]

== Key points ==
=== The collected information segmentation algorithm ===
=== Now for OOo process is not very clear, do n't know whether be expected. Waits further research ===
= Appendix =
== Here is simple test, with no other considerations, just to test the feasibility of the technology. ==

{| class="prettytable"
| colspan="7" | <center>'''A simple application it implement a XdocumentHandler that colloect the SAX parser result , use UCB read thest files'''</center>

|-
| <center>Colloect the SAX parser result</center>
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">005560</div>
| <div align="right">005563</div>
| <div align="right">005551</div>
| <div align="right">005791</div>
| <div align="right">005558</div>
|

|-
| Start
| <div align="right">000033</div>
| <div align="right">000029</div>
| <div align="right">000030</div>
| <div align="right">000030</div>
| <div align="right">000023</div>
|

|-
|
| <div align="right">'''5527'''</div>
| <div align="right">'''5534'''</div>
| <div align="right">'''5521'''</div>
| <div align="right">'''5761'''</div>
| <div align="right">'''5535'''</div>
| <div align="right">'''''5575.6'''''</div>

|-
| End
| <div align="right">010952</div>
| <div align="right">011093</div>
| <div align="right">011069</div>
| <div align="right">011268</div>
| <div align="right">010972</div>
|

|-
| Start
| <div align="right">005560</div>
| <div align="right">005563</div>
| <div align="right">005551</div>
| <div align="right">005791</div>
| <div align="right">005558</div>
|

|-
|
| <div align="right">'''5392'''</div>
| <div align="right">'''5530'''</div>
| <div align="right">'''5518'''</div>
| <div align="right">'''5477'''</div>
| <div align="right">'''5414'''</div>
| <div align="right">'''''5466.2'''''</div>

|}

{| class="prettytable"
| colspan="7" | <center>'''A simple application it implement a XdocumentHandler that colloect the SAX parser result , use UCB read thest files, and one thread process one SAX parser result.'''</center>

|-
|
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">028326</div>
| <div align="right">028438</div>
| <div align="right">028115</div>
| <div align="right">27835</div>
| <div align="right">28054</div>
|

|-
| Start
| <div align="right">000035</div>
| <div align="right">000035</div>
| <div align="right">000030</div>
| <div align="right">30</div>
| <div align="right">20</div>
|

|-
|
| <div align="right">'''28291'''</div>
| <div align="right">'''28403'''</div>
| <div align="right">'''28085'''</div>
| <div align="right">'''27805'''</div>
| <div align="right">'''28034'''</div>
| <div align="right">'''''28123.6'''''</div>

|-
| End
| <div align="right">055763</div>
| <div align="right">056048</div>
| <div align="right">056294</div>
| <div align="right">056474</div>
| <div align="right">056538</div>
|

|-
| Start
| <div align="right">028326</div>
| <div align="right">028438</div>
| <div align="right">28115</div>
| <div align="right">027835</div>
| <div align="right">028054</div>
|

|-
|
| <div align="right">'''27437'''</div>
| <div align="right">'''27610'''</div>
| <div align="right">'''28179'''</div>
| <div align="right">'''28639'''</div>
| <div align="right">'''28484'''</div>
| <div align="right">'''''28069.8'''''</div>

|}
== A group of large data test ==
=== OOo calc “content.xml” 35.1 MB / 3.8M ===

{| class="prettytable"
| colspan="7" | <center>'''OOo reader “content.xml” '''</center>

|-
| ODF handler
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">38220</div>
| <div align="right">37340</div>
| <div align="right">37140</div>
| <div align="right">66316</div>
| <div align="right">35378</div>
|

|-
| Start
| <div align="right">6559</div>
| <div align="right">6292</div>
| <div align="right">7014</div>
| <div align="right">38431</div>
| <div align="right">6513</div>
|

|-
|
| <div align="right">'''31661'''</div>
| <div align="right">'''31048'''</div>
| <div align="right">'''30126'''</div>
| <div align="right">'''27885'''</div>
| <div align="right">'''28865'''</div>
| <div align="right">'''''29917'''''</div>

|-
| End
| <div align="right">79549</div>
| <div align="right">82462</div>
| <div align="right">81397</div>
| <div align="right">107576</div>
| <div align="right">873537</div>
|

|-
| Start
| <div align="right">47461</div>
| <div align="right">49710</div>
| <div align="right">50479</div>
| <div align="right">78099</div>
| <div align="right">844944</div>
|

|-
|
| <div align="right">'''32088'''</div>
| <div align="right">'''32752'''</div>
| <div align="right">'''30918'''</div>
| <div align="right">'''29477'''</div>
| <div align="right">'''28593'''</div>
| <div align="right">'''''30765.6'''''</div>

|}

{| class="prettytable"
| colspan="7" | <center>'''“XdocumentHandler” empty implement reader “content.xml” '''</center>

|-
| Empty handler
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">2082</div>
| <div align="right">2178</div>
| <div align="right">2118</div>
| <div align="right">2106</div>
| <div align="right">2082</div>
|

|-
| Start
| <div align="right">16</div>
| <div align="right">16</div>
| <div align="right">13</div>
| <div align="right">15</div>
| <div align="right">14</div>
|

|-
|
| <div align="right">'''2066'''</div>
| <div align="right">'''2162'''</div>
| <div align="right">'''2105'''</div>
| <div align="right">'''2091'''</div>
| <div align="right">'''2068'''</div>
| <div align="right">'''''2098.4'''''</div>

|-
| End
| <div align="right">4070</div>
| <div align="right">4752</div>
| <div align="right">4106</div>
| <div align="right">4088</div>
| <div align="right">4294</div>
|

|-
| Start
| <div align="right">2082</div>
| <div align="right">2178</div>
| <div align="right">2118</div>
| <div align="right">2106</div>
| <div align="right">2082</div>
|

|-
|
| <div align="right">'''1988'''</div>
| <div align="right">'''2574'''</div>
| <div align="right">'''1988'''</div>
| <div align="right">'''1982'''</div>
| <div align="right">'''2212'''</div>
| <div align="right">'''''2148.8'''''</div>

|}
=== OOo writer “content.xml” 62.6 MB / 2.0M ===

{| class="prettytable"
| colspan="7" | <center>'''OOo reader “content.xml” '''</center>

|-
| ODF handler
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">108876</div>
| <div align="right">108729</div>
| <div align="right">108997</div>
| <div align="right">108901</div>
| <div align="right">110140</div>
|

|-
| Start
| <div align="right">6201</div>
| <div align="right">6060</div>
| <div align="right">6240</div>
| <div align="right">7029</div>
| <div align="right">8415</div>
|

|-
|
| <div align="right">'''102675'''</div>
| <div align="right">'''102669'''</div>
| <div align="right">'''102757'''</div>
| <div align="right">'''101872'''</div>
| <div align="right">'''101725'''</div>
| <div align="right">'''''102339.6'''''</div>

|-
| End
| <div align="right">229982</div>
| <div align="right">228416</div>
| <div align="right">235011</div>
| <div align="right">234573</div>
| <div align="right">233124</div>
|

|-
| Start
| <div align="right">126660</div>
| <div align="right">125567</div>
| <div align="right">132174</div>
| <div align="right">132292</div>
| <div align="right">130810</div>
|

|-
|
| <div align="right">'''103322'''</div>
| <div align="right">'''102849'''</div>
| <div align="right">'''102837'''</div>
| <div align="right">'''102281'''</div>
| <div align="right">'''102314'''</div>
| <div align="right">'''''102720.6'''''</div>

|}

{| class="prettytable"
| colspan="7" | <center>'''“XdocumentHandler” empty implement reader “content.xml” '''</center>

|-
| Empty handler
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">4825</div>
| <div align="right">5595</div>
| <div align="right">5546</div>
| <div align="right">5658</div>
| <div align="right">6072</div>
|

|-
| Start
| <div align="right">20</div>
| <div align="right">59</div>
| <div align="right">12</div>
| <div align="right">23</div>
| <div align="right">629</div>
|

|-
|
| <div align="right">'''4805'''</div>
| <div align="right">'''5536'''</div>
| <div align="right">'''5534'''</div>
| <div align="right">'''5635'''</div>
| <div align="right">'''5443'''</div>
| <div align="right">'''''5390.6'''''</div>

|-
| End
| <div align="right">9899</div>
| <div align="right">11815</div>
| <div align="right">11280</div>
| <div align="right">11300</div>
| <div align="right">11394</div>
|

|-
| Start
| <div align="right">4825</div>
| <div align="right">5595</div>
| <div align="right">5546</div>
| <div align="right">5658</div>
| <div align="right">6072</div>
|

|-
|
| <div align="right">'''5074'''</div>
| <div align="right">'''6220'''</div>
| <div align="right">'''5734'''</div>
| <div align="right">'''5642'''</div>
| <div align="right">'''5322'''</div>
| <div align="right">'''''5598.4'''''</div>

|}

[[Category:Performance]]

Performance/load performance analysis

2009-12-08T02:46:37Z

Zengliangjun: /* Interesting contrast analysis data SAX parser processing */

= A group of test data =
== Interesting contrast analysis data from SAX parser processing ==

{| class="prettytable"
| colspan="7" | <center>'''Start OOo writer, read a document which has a 3.9 MB "content.xml" '''</center>

|-
| ODF handler
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">12759</div>
| <div align="right">11805</div>
| <div align="right">13233</div>
| <div align="right">11312</div>
| <div align="right">13279</div>
|

|-
| Start
| <div align="right">6230</div>
| <div align="right">5245</div>
| <div align="right">6758</div>
| <div align="right">5378</div>
| <div align="right">6541</div>
|

|-
|
| <div align="right">'''6529'''</div>
| <div align="right">'''6560'''</div>
| <div align="right">'''6475'''</div>
| <div align="right">'''5934'''</div>
| <div align="right">'''6738'''</div>
| <div align="right">'''''6447.2'''''</div>

|-
| End
| <div align="right">31305</div>
| <div align="right">36262</div>
| <div align="right">30083</div>
| <div align="right">28452</div>
| <div align="right">28584</div>
|

|-
| Start
| <div align="right">24852</div>
| <div align="right">30694</div>
| <div align="right">23611</div>
| <div align="right">22018</div>
| <div align="right">22148</div>
|

|-
|
| <div align="right">'''6453'''</div>
| <div align="right">'''5568'''</div>
| <div align="right">'''6472'''</div>
| <div align="right">'''6434'''</div>
| <div align="right">'''6436'''</div>
| <div align="right">'''''6272.6'''''</div>

|}

{| class="prettytable"
| colspan="7" | <center>'''A simple application it implement a empty XdocumentHandler read the sample "content.xml" '''</center>

|-
| Empty handler
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">354</div>
| <div align="right">362</div>
| <div align="right">355</div>
| <div align="right">370</div>
| <div align="right">312</div>
|

|-
| Start
| <div align="right">30</div>
| <div align="right">30</div>
| <div align="right">29</div>
| <div align="right">30</div>
| <div align="right">24</div>
|

|-
|
| <div align="right">'''324'''</div>
| <div align="right">'''332'''</div>
| <div align="right">'''326'''</div>
| <div align="right">'''340'''</div>
| <div align="right">'''288'''</div>
| <div align="right">'''''322'''''</div>

|-
| End
| <div align="right">635</div>
| <div align="right">644</div>
| <div align="right">633</div>
| <div align="right">651</div>
| <div align="right">588</div>
|

|-
| Start
| <div align="right">354</div>
| <div align="right">362</div>
| <div align="right">355</div>
| <div align="right">370</div>
| <div align="right">312</div>
|

|-
|
| <div align="right">'''281'''</div>
| <div align="right">'''282'''</div>
| <div align="right">'''278'''</div>
| <div align="right">'''281'''</div>
| <div align="right">'''276'''</div>
| <div align="right">'''''279.6'''''</div>

|}
'''The first “start – end” contain load library cost ，the second “start – end” do not contain。'''

All test result are warm .

We can find the OOo processing more cost than empty XdocumentHandler。

== Interesting contrast analysis data Dual-core processing ==
The test with 912 xml files ( total size 44.2 MB )

{| class="prettytable"
| colspan="7" | <center>'''A simple application it implement a empty XdocumentHandler , use UCB and single thread process these files.'''</center>

|-
| Single thread
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">003604</div>
| <div align="right">003549</div>
| <div align="right">003500</div>
| <div align="right">003538</div>
| <div align="right">003492</div>
|

|-
| Start
| <div align="right">000029</div>
| <div align="right">000029</div>
| <div align="right">000029</div>
| <div align="right">000023</div>
| <div align="right">000029</div>
|

|-
|
| <div align="right">'''3575'''</div>
| <div align="right">'''3520'''</div>
| <div align="right">'''3471'''</div>
| <div align="right">'''3515'''</div>
| <div align="right">'''3463'''</div>
| <div align="right">'''''3508.8'''''</div>

|-
| End
| <div align="right">007076</div>
| <div align="right">006957</div>
| <div align="right">006924</div>
| <div align="right">007025</div>
| <div align="right">006897</div>
|

|-
| Start
| <div align="right">003604</div>
| <div align="right">003550</div>
| <div align="right">003500</div>
| <div align="right">003538</div>
| <div align="right">003492</div>
|

|-
|
| <div align="right">'''3472'''</div>
| <div align="right">'''3407'''</div>
| <div align="right">'''3424'''</div>
| <div align="right">'''3487'''</div>
| <div align="right">'''3405'''</div>
| <div align="right">'''''3439'''''</div>

|}

{| class="prettytable"
| colspan="7" | <center>'''A simple application it implement a empty XdocumentHandler , use UCB and one file one thread process these files.'''</center>

|-
| <center>'''one file one thread'''</center>
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">002696</div>
| <div align="right">002763</div>
| <div align="right">002560</div>
| <div align="right">002827</div>
| <div align="right">002133</div>
|

|-
| Start
| <div align="right">000018</div>
| <div align="right">000026</div>
| <div align="right">000028</div>
| <div align="right">000030</div>
| <div align="right">000033</div>
|

|-
|
| <div align="right">'''2678'''</div>
| <div align="right">'''2737'''</div>
| <div align="right">'''2532'''</div>
| <div align="right">'''2797'''</div>
| <div align="right">'''2100'''</div>
| <div align="right">'''''2568.8'''''</div>

|-
| End
| <div align="right">005318</div>
| <div align="right">005471</div>
| <div align="right">005224</div>
| <div align="right">005174</div>
| <div align="right">004816</div>
|

|-
| Start
| <div align="right">002696</div>
| <div align="right">002764</div>
| <div align="right">002560</div>
| <div align="right">002827</div>
| <div align="right">002133</div>
|

|-
|
| <div align="right">'''2622'''</div>
| <div align="right">'''2707'''</div>
| <div align="right">'''2664'''</div>
| <div align="right">'''2347'''</div>
| <div align="right">'''2683'''</div>
| <div align="right">'''''2604.6'''''</div>

|}

{| class="prettytable"
| colspan="7" | <center>'''A simple application it implement a empty XdocumentHandler , use UCB and two thread process these files.'''</center>

|-
| Two thread
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">002314</div>
| <div align="right">002332</div>
| <div align="right">002356</div>
| <div align="right">002377</div>
| <div align="right">002411</div>
|

|-
| Start
| <div align="right">000027</div>
| <div align="right">000029</div>
| <div align="right">000029</div>
| <div align="right">000030</div>
| <div align="right">000030</div>
|

|-
|
| <div align="right">'''2287'''</div>
| <div align="right">'''2303'''</div>
| <div align="right">'''2327'''</div>
| <div align="right">'''2347'''</div>
| <div align="right">'''2381'''</div>
| <div align="right">'''''2329'''''</div>

|-
| End
| <div align="right">004568</div>
| <div align="right">004611</div>
| <div align="right">004622</div>
| <div align="right">004639</div>
| <div align="right">004731</div>
|

|-
| Start
| <div align="right">002314</div>
| <div align="right">002332</div>
| <div align="right">002356</div>
| <div align="right">002377</div>
| <div align="right">002411</div>
|

|-
|
| <div align="right">'''2254'''</div>
| <div align="right">'''2279'''</div>
| <div align="right">'''2266'''</div>
| <div align="right">'''2262'''</div>
| <div align="right">'''2320'''</div>
| <div align="right">'''''2276.2'''''</div>

|}
== Interesting contrast analysis data Mononuclear processing ==

{| class="prettytable"
| colspan="7" | <center>'''A simple application it implement a empty XdocumentHandler , use UCB and single thread process these files.'''</center>

|-
| Single thread
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">005062</div>
| <div align="right">005531</div>
| <div align="right">005516</div>
| <div align="right">005062</div>
| <div align="right">005110</div>
|

|-
| Start
| <div align="right">000062</div>
| <div align="right">000062</div>
| <div align="right">000047</div>
| <div align="right">000062</div>
| <div align="right">000047</div>
|

|-
|
| <div align="right">'''5000'''</div>
| <div align="right">'''5469'''</div>
| <div align="right">'''5469'''</div>
| <div align="right">'''5000'''</div>
| <div align="right">'''5063'''</div>
| <div align="right">'''''5200.2'''''</div>

|-
| End
| <div align="right">010016</div>
| <div align="right">010703</div>
| <div align="right">010469</div>
| <div align="right">010062</div>
| <div align="right">010078</div>
|

|-
| Start
| <div align="right">005062</div>
| <div align="right">005531</div>
| <div align="right">005516</div>
| <div align="right">005062</div>
| <div align="right">005110</div>
|

|-
|
| <div align="right">'''4954'''</div>
| <div align="right">'''5172'''</div>
| <div align="right">'''4953'''</div>
| <div align="right">'''5000'''</div>
| <div align="right">'''4968'''</div>
| <div align="right">'''''5009.4'''''</div>

|}

{| class="prettytable"
| colspan="7" | <center>'''A simple application it implement a empty XdocumentHandler , use UCB and one file one thread process these files.'''</center>

|-
| <center>'''one file one thread'''</center>
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">005391</div>
| <div align="right">005391</div>
| <div align="right">005422</div>
| <div align="right">005797</div>
| <div align="right">005516</div>
|

|-
| Start
| <div align="right">000063</div>
| <div align="right">000047</div>
| <div align="right">000047</div>
| <div align="right">000063</div>
| <div align="right">000063</div>
|

|-
|
| <div align="right">'''5328'''</div>
| <div align="right">'''5344'''</div>
| <div align="right">'''5375'''</div>
| <div align="right">'''5734'''</div>
| <div align="right">'''5453'''</div>
| <div align="right">'''''5446.8'''''</div>

|-
| End
| <div align="right">010719</div>
| <div align="right">010672</div>
| <div align="right">010703</div>
| <div align="right">011453</div>
| <div align="right">010797</div>
|

|-
| Start
| <div align="right">005391</div>
| <div align="right">005391</div>
| <div align="right">005422</div>
| <div align="right">005797</div>
| <div align="right">005516</div>
|

|-
|
| <div align="right">'''5328'''</div>
| <div align="right">'''5381'''</div>
| <div align="right">'''5281'''</div>
| <div align="right">'''5656'''</div>
| <div align="right">'''5281'''</div>
| <div align="right">'''''5385.4'''''</div>

|}

{| class="prettytable"
| colspan="7" | <center>'''A simple application it implement a empty XdocumentHandler , use UCB and two thread process these files.'''</center>

|-
| Two thread
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">005110</div>
| <div align="right">005062</div>
| <div align="right">005516</div>
| <div align="right">005531</div>
| <div align="right">005062</div>
|

|-
| Start
| <div align="right">000047</div>
| <div align="right">000062</div>
| <div align="right">000047</div>
| <div align="right">000062</div>
| <div align="right">000062</div>
|

|-
|
| <div align="right">'''5063'''</div>
| <div align="right">'''5000'''</div>
| <div align="right">'''5469'''</div>
| <div align="right">'''5469'''</div>
| <div align="right">'''5000'''</div>
| <div align="right">'''''5200'''''</div>

|-
| End
| <div align="right">010078</div>
| <div align="right">010062</div>
| <div align="right">010469</div>
| <div align="right">010703</div>
| <div align="right">010016</div>
|

|-
| Start
| <div align="right">005110</div>
| <div align="right">005062</div>
| <div align="right">005516</div>
| <div align="right">005531</div>
| <div align="right">005062</div>
|

|-
|
| <div align="right">'''4968'''</div>
| <div align="right">'''5000'''</div>
| <div align="right">'''4953'''</div>
| <div align="right">'''5172'''</div>
| <div align="right">'''4954'''</div>
| <div align="right">'''''5009.4'''''</div>

|}
= Overview =
Through the above late two sets of data we can get the follows conclusion:

=== When Single-core, a task divide into multiple small tasks；these are same cost, processing with single thread, one task one thread and two thread.( one task one thread performance relatively low) ===
=== When Dual-core, a task divide into multiple small tasks；the waste is close to 0.7-0.8 with one task one thread process ,it is close to 0.66 with two threads process, a single thread process as a benchmark. ===

Through the first group of data we can get a conclusion:

=== That possess great proportion cost, OOo process ODF. ===
= How to do =
How can we improve ODF loading performance.

As multi-core cpu, Can we split process “content.xml” to some small tasks. Process with multi-thread , and merger the result.

As Single-core, Can we split process “content.xml” to some small tasks. Asynchronous load document .

<nowiki>* Of course, At the ODF parser will not improve performance?( But now we don't discuss ) </nowiki>

How can we split process “content.xml” to some small tasks:

a) Split “content.xml” content .

b) Colloect the result with sax parser, and Split the result.

= Description =
== Split “content.xml” content ==
Change the document structure, complex nodules defined as a reference link to a single file,the main file contains only simple structure.

It will produce the ODF layout :

content.xml
complex/fragment1.xml
/fragment2.xml
/fragment3.xml
/fragment4.xml
…

And “content.xml” will be :

…
<nowiki><table:table xlink:href= “complex/fragment1.xml” /></nowiki>
…

I think it will produce the same performance optimization when save documentation, this way.

== Colloect the result with sax parser, and Split that ==
From the above test data, SAX process with relatively less cost itself. We can colloect SAX parser result, and split it to multi part.

{| class="prettytable"
| colspan="7" | <center>A simple application it implement a XdocumentHandler that colloect the SAX parser result , use UCB read thest files</center>

|-
| <center>Colloect the SAX parser result</center>
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">005706</div>
| <div align="right">005510</div>
| <div align="right">005200</div>
| <div align="right">005824</div>
| <div align="right">005527</div>
|

|-
| Start
| <div align="right">000029</div>
| <div align="right">000019</div>
| <div align="right">000019</div>
| <div align="right">000012</div>
| <div align="right">000011</div>
|

|-
|
| <div align="right">'''5677'''</div>
| <div align="right">'''5491'''</div>
| <div align="right">'''5181'''</div>
| <div align="right">'''5812'''</div>
| <div align="right">'''5516'''</div>
| <div align="right">'''''5695.4'''''</div>

|-
| End
| <div align="right">010814</div>
| <div align="right">010685</div>
| <div align="right">010297</div>
| <div align="right">010950</div>
| <div align="right">010794</div>
|

|-
| Start
| <div align="right">005706</div>
| <div align="right">005510</div>
| <div align="right">005200</div>
| <div align="right">005824</div>
| <div align="right">005527</div>
|

|-
|
| <div align="right">'''5108'''</div>
| <div align="right">'''5175'''</div>
| <div align="right">'''5097'''</div>
| <div align="right">'''5126'''</div>
| <div align="right">'''5267'''</div>
| <div align="right">'''''5154.6'''''</div>

|}

{| class="prettytable"
| colspan="7" | <center>'''A simple application it implement a empty XdocumentHandler , use UCB and single thread process these files.'''</center>

|-
| Empty handler
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">003788</div>
| <div align="right">003763</div>
| <div align="right">003908</div>
| <div align="right">004044</div>
| <div align="right">003702</div>
|

|-
| Start
| <div align="right">000015</div>
| <div align="right">000011</div>
| <div align="right">000013</div>
| <div align="right">000014</div>
| <div align="right">000016</div>
|

|-
|
| <div align="right">'''3773'''</div>
| <div align="right">'''3752'''</div>
| <div align="right">'''3895'''</div>
| <div align="right">'''4030'''</div>
| <div align="right">'''3686'''</div>
| <div align="right">'''''3821.2'''''</div>

|-
| End
| <div align="right">008330</div>
| <div align="right">007444</div>
| <div align="right">007836</div>
| <div align="right">007776</div>
| <div align="right">007465</div>
|

|-
| Start
| <div align="right">003788</div>
| <div align="right">003764</div>
| <div align="right">003908</div>
| <div align="right">004044</div>
| <div align="right">003703</div>
|

|-
|
| <div align="right">'''3542'''</div>
| <div align="right">'''3680'''</div>
| <div align="right">'''3924'''</div>
| <div align="right">'''3732'''</div>
| <div align="right">'''3762'''</div>
| <div align="right">'''''3728'''''</div>

|}
We can see it is less cost that colloect the SAX parser result. So we can split that throught some rules and multi-thread to process .

== Implement Description ==
It has two policies which split processing “content.xml”task to some small tasks：

a) Split “content.xml”to many sub files.

b) Colloect the result(attribute & content ) from sax parser, and split the result to many parts in some rules.

struct State
{
rtl_uString* mp_elementName; // current element tag name can replace to one flag
xml::sax::XAttributeList* mp_attributes; // current element's attributes
rtl_uString* mp_elementContent; // current element's content

sal_uInt32 m_local; // It's position at vector
sal_uInt32 m_distance; // It's distance from parent element
sal_uInt32 m_count; // It's count of all sub elements
};

<nowiki>typedef std::vector< State* > StateVectors;</nowiki>

From compared above multi-thread data, situation single-core / multi-core increase performance is different.

So I think it can consider asynchronous processing as single-core, it can consider parallel processing as multi-core.

It is 2 policies X 2 situations processing description( Of couse it is my imagines )：

=== Single Core + Many Fragments Asynchronism Process ===
[[Image:Single_Core_%2B_Many_Fragments_Asynchronism_Process.PNG]]
=== Single Core + split SAX result Asynchronism Process ===
[[Image:Single_Core_%2B_split_SAX_result_Asynchronism_Process.PNG]]

=== Multi Core + Many fragments Parallel Process ===
[[Image:Multi_Core_%2B_Many_fragments_Parallel_Process.PNG]]
=== Multi-Core + split SAX result Parallel Process ===
[[Image:Multi_Core_%2B_split_SAX_result_Parallel_Process.PNG]]

== Key points ==
=== The collected information segmentation algorithm ===
=== Now for OOo process is not very clear, do n't know whether be expected. Waits further research ===
= Appendix =
== Here is simple test, with no other considerations, just to test the feasibility of the technology. ==

{| class="prettytable"
| colspan="7" | <center>'''A simple application it implement a XdocumentHandler that colloect the SAX parser result , use UCB read thest files'''</center>

|-
| <center>Colloect the SAX parser result</center>
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">005560</div>
| <div align="right">005563</div>
| <div align="right">005551</div>
| <div align="right">005791</div>
| <div align="right">005558</div>
|

|-
| Start
| <div align="right">000033</div>
| <div align="right">000029</div>
| <div align="right">000030</div>
| <div align="right">000030</div>
| <div align="right">000023</div>
|

|-
|
| <div align="right">'''5527'''</div>
| <div align="right">'''5534'''</div>
| <div align="right">'''5521'''</div>
| <div align="right">'''5761'''</div>
| <div align="right">'''5535'''</div>
| <div align="right">'''''5575.6'''''</div>

|-
| End
| <div align="right">010952</div>
| <div align="right">011093</div>
| <div align="right">011069</div>
| <div align="right">011268</div>
| <div align="right">010972</div>
|

|-
| Start
| <div align="right">005560</div>
| <div align="right">005563</div>
| <div align="right">005551</div>
| <div align="right">005791</div>
| <div align="right">005558</div>
|

|-
|
| <div align="right">'''5392'''</div>
| <div align="right">'''5530'''</div>
| <div align="right">'''5518'''</div>
| <div align="right">'''5477'''</div>
| <div align="right">'''5414'''</div>
| <div align="right">'''''5466.2'''''</div>

|}

{| class="prettytable"
| colspan="7" | <center>'''A simple application it implement a XdocumentHandler that colloect the SAX parser result , use UCB read thest files, and one thread process one SAX parser result.'''</center>

|-
|
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">028326</div>
| <div align="right">028438</div>
| <div align="right">028115</div>
| <div align="right">27835</div>
| <div align="right">28054</div>
|

|-
| Start
| <div align="right">000035</div>
| <div align="right">000035</div>
| <div align="right">000030</div>
| <div align="right">30</div>
| <div align="right">20</div>
|

|-
|
| <div align="right">'''28291'''</div>
| <div align="right">'''28403'''</div>
| <div align="right">'''28085'''</div>
| <div align="right">'''27805'''</div>
| <div align="right">'''28034'''</div>
| <div align="right">'''''28123.6'''''</div>

|-
| End
| <div align="right">055763</div>
| <div align="right">056048</div>
| <div align="right">056294</div>
| <div align="right">056474</div>
| <div align="right">056538</div>
|

|-
| Start
| <div align="right">028326</div>
| <div align="right">028438</div>
| <div align="right">28115</div>
| <div align="right">027835</div>
| <div align="right">028054</div>
|

|-
|
| <div align="right">'''27437'''</div>
| <div align="right">'''27610'''</div>
| <div align="right">'''28179'''</div>
| <div align="right">'''28639'''</div>
| <div align="right">'''28484'''</div>
| <div align="right">'''''28069.8'''''</div>

|}
== A group of large data test ==
=== OOo calc “content.xml” 35.1 MB / 3.8M ===

{| class="prettytable"
| colspan="7" | <center>'''OOo reader “content.xml” '''</center>

|-
| ODF handler
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">38220</div>
| <div align="right">37340</div>
| <div align="right">37140</div>
| <div align="right">66316</div>
| <div align="right">35378</div>
|

|-
| Start
| <div align="right">6559</div>
| <div align="right">6292</div>
| <div align="right">7014</div>
| <div align="right">38431</div>
| <div align="right">6513</div>
|

|-
|
| <div align="right">'''31661'''</div>
| <div align="right">'''31048'''</div>
| <div align="right">'''30126'''</div>
| <div align="right">'''27885'''</div>
| <div align="right">'''28865'''</div>
| <div align="right">'''''29917'''''</div>

|-
| End
| <div align="right">79549</div>
| <div align="right">82462</div>
| <div align="right">81397</div>
| <div align="right">107576</div>
| <div align="right">873537</div>
|

|-
| Start
| <div align="right">47461</div>
| <div align="right">49710</div>
| <div align="right">50479</div>
| <div align="right">78099</div>
| <div align="right">844944</div>
|

|-
|
| <div align="right">'''32088'''</div>
| <div align="right">'''32752'''</div>
| <div align="right">'''30918'''</div>
| <div align="right">'''29477'''</div>
| <div align="right">'''28593'''</div>
| <div align="right">'''''30765.6'''''</div>

|}

{| class="prettytable"
| colspan="7" | <center>'''“XdocumentHandler” empty implement reader “content.xml” '''</center>

|-
| Empty handler
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">2082</div>
| <div align="right">2178</div>
| <div align="right">2118</div>
| <div align="right">2106</div>
| <div align="right">2082</div>
|

|-
| Start
| <div align="right">16</div>
| <div align="right">16</div>
| <div align="right">13</div>
| <div align="right">15</div>
| <div align="right">14</div>
|

|-
|
| <div align="right">'''2066'''</div>
| <div align="right">'''2162'''</div>
| <div align="right">'''2105'''</div>
| <div align="right">'''2091'''</div>
| <div align="right">'''2068'''</div>
| <div align="right">'''''2098.4'''''</div>

|-
| End
| <div align="right">4070</div>
| <div align="right">4752</div>
| <div align="right">4106</div>
| <div align="right">4088</div>
| <div align="right">4294</div>
|

|-
| Start
| <div align="right">2082</div>
| <div align="right">2178</div>
| <div align="right">2118</div>
| <div align="right">2106</div>
| <div align="right">2082</div>
|

|-
|
| <div align="right">'''1988'''</div>
| <div align="right">'''2574'''</div>
| <div align="right">'''1988'''</div>
| <div align="right">'''1982'''</div>
| <div align="right">'''2212'''</div>
| <div align="right">'''''2148.8'''''</div>

|}
=== OOo writer “content.xml” 62.6 MB / 2.0M ===

{| class="prettytable"
| colspan="7" | <center>'''OOo reader “content.xml” '''</center>

|-
| ODF handler
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">108876</div>
| <div align="right">108729</div>
| <div align="right">108997</div>
| <div align="right">108901</div>
| <div align="right">110140</div>
|

|-
| Start
| <div align="right">6201</div>
| <div align="right">6060</div>
| <div align="right">6240</div>
| <div align="right">7029</div>
| <div align="right">8415</div>
|

|-
|
| <div align="right">'''102675'''</div>
| <div align="right">'''102669'''</div>
| <div align="right">'''102757'''</div>
| <div align="right">'''101872'''</div>
| <div align="right">'''101725'''</div>
| <div align="right">'''''102339.6'''''</div>

|-
| End
| <div align="right">229982</div>
| <div align="right">228416</div>
| <div align="right">235011</div>
| <div align="right">234573</div>
| <div align="right">233124</div>
|

|-
| Start
| <div align="right">126660</div>
| <div align="right">125567</div>
| <div align="right">132174</div>
| <div align="right">132292</div>
| <div align="right">130810</div>
|

|-
|
| <div align="right">'''103322'''</div>
| <div align="right">'''102849'''</div>
| <div align="right">'''102837'''</div>
| <div align="right">'''102281'''</div>
| <div align="right">'''102314'''</div>
| <div align="right">'''''102720.6'''''</div>

|}

{| class="prettytable"
| colspan="7" | <center>'''“XdocumentHandler” empty implement reader “content.xml” '''</center>

|-
| Empty handler
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">4825</div>
| <div align="right">5595</div>
| <div align="right">5546</div>
| <div align="right">5658</div>
| <div align="right">6072</div>
|

|-
| Start
| <div align="right">20</div>
| <div align="right">59</div>
| <div align="right">12</div>
| <div align="right">23</div>
| <div align="right">629</div>
|

|-
|
| <div align="right">'''4805'''</div>
| <div align="right">'''5536'''</div>
| <div align="right">'''5534'''</div>
| <div align="right">'''5635'''</div>
| <div align="right">'''5443'''</div>
| <div align="right">'''''5390.6'''''</div>

|-
| End
| <div align="right">9899</div>
| <div align="right">11815</div>
| <div align="right">11280</div>
| <div align="right">11300</div>
| <div align="right">11394</div>
|

|-
| Start
| <div align="right">4825</div>
| <div align="right">5595</div>
| <div align="right">5546</div>
| <div align="right">5658</div>
| <div align="right">6072</div>
|

|-
|
| <div align="right">'''5074'''</div>
| <div align="right">'''6220'''</div>
| <div align="right">'''5734'''</div>
| <div align="right">'''5642'''</div>
| <div align="right">'''5322'''</div>
| <div align="right">'''''5598.4'''''</div>

|}

[[Category:Performance]]

Performance/Odf document load performance implement

2009-12-07T09:19:02Z

Zengliangjun: moved Performance/Odf document load performance implement to Performance/load performance implement: Simple the title

#REDIRECT [[Performance/load performance implement]]

Performance/load performance implement

2009-12-07T09:19:02Z

Zengliangjun: moved Performance/Odf document load performance implement to Performance/load performance implement: Simple the title

Performance/load performance implement

2009-12-07T09:18:23Z

Zengliangjun:

Performance/Odf document load performance increase feasibility analysis

2009-12-07T09:16:01Z

Zengliangjun: moved Performance/Odf document load performance increase feasibility analysis to Performance/load performance analysis: simple the title

#REDIRECT [[Performance/load performance analysis]]

Performance/load performance analysis

2009-12-07T09:16:01Z

Zengliangjun: moved Performance/Odf document load performance increase feasibility analysis to Performance/load performance analysis: simple the title

= A group of test data =
== Interesting contrast analysis data SAX parser processing ==

{| class="prettytable"
| colspan="7" | <center>'''Start OOo writer, read a document which has a 3.9 MB "content.xml" '''</center>

|-
| ODF handler
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">12759</div>
| <div align="right">11805</div>
| <div align="right">13233</div>
| <div align="right">11312</div>
| <div align="right">13279</div>
|

|-
| Start
| <div align="right">6230</div>
| <div align="right">5245</div>
| <div align="right">6758</div>
| <div align="right">5378</div>
| <div align="right">6541</div>
|

|-
|
| <div align="right">'''6529'''</div>
| <div align="right">'''6560'''</div>
| <div align="right">'''6475'''</div>
| <div align="right">'''5934'''</div>
| <div align="right">'''6738'''</div>
| <div align="right">'''''6447.2'''''</div>

|-
| End
| <div align="right">31305</div>
| <div align="right">36262</div>
| <div align="right">30083</div>
| <div align="right">28452</div>
| <div align="right">28584</div>
|

|-
| Start
| <div align="right">24852</div>
| <div align="right">30694</div>
| <div align="right">23611</div>
| <div align="right">22018</div>
| <div align="right">22148</div>
|

|-
|
| <div align="right">'''6453'''</div>
| <div align="right">'''5568'''</div>
| <div align="right">'''6472'''</div>
| <div align="right">'''6434'''</div>
| <div align="right">'''6436'''</div>
| <div align="right">'''''6272.6'''''</div>

|}

{| class="prettytable"
| colspan="7" | <center>'''A simple application it implement a empty XdocumentHandler read the sample "content.xml" '''</center>

|-
| Empty handler
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">354</div>
| <div align="right">362</div>
| <div align="right">355</div>
| <div align="right">370</div>
| <div align="right">312</div>
|

|-
| Start
| <div align="right">30</div>
| <div align="right">30</div>
| <div align="right">29</div>
| <div align="right">30</div>
| <div align="right">24</div>
|

|-
|
| <div align="right">'''324'''</div>
| <div align="right">'''332'''</div>
| <div align="right">'''326'''</div>
| <div align="right">'''340'''</div>
| <div align="right">'''288'''</div>
| <div align="right">'''''322'''''</div>

|-
| End
| <div align="right">635</div>
| <div align="right">644</div>
| <div align="right">633</div>
| <div align="right">651</div>
| <div align="right">588</div>
|

|-
| Start
| <div align="right">354</div>
| <div align="right">362</div>
| <div align="right">355</div>
| <div align="right">370</div>
| <div align="right">312</div>
|

|-
|
| <div align="right">'''281'''</div>
| <div align="right">'''282'''</div>
| <div align="right">'''278'''</div>
| <div align="right">'''281'''</div>
| <div align="right">'''276'''</div>
| <div align="right">'''''279.6'''''</div>

|}
'''The first “start – end” contain load library cost ，the second “start – end” do not contain。'''

All test result are warm .

We can find the OOo processing more cost than empty XdocumentHandler。

== Interesting contrast analysis data Dual-core processing ==
The test with 912 xml files ( total size 44.2 MB )

{| class="prettytable"
| colspan="7" | <center>'''A simple application it implement a empty XdocumentHandler , use UCB and single thread process these files.'''</center>

|-
| Single thread
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">003604</div>
| <div align="right">003549</div>
| <div align="right">003500</div>
| <div align="right">003538</div>
| <div align="right">003492</div>
|

|-
| Start
| <div align="right">000029</div>
| <div align="right">000029</div>
| <div align="right">000029</div>
| <div align="right">000023</div>
| <div align="right">000029</div>
|

|-
|
| <div align="right">'''3575'''</div>
| <div align="right">'''3520'''</div>
| <div align="right">'''3471'''</div>
| <div align="right">'''3515'''</div>
| <div align="right">'''3463'''</div>
| <div align="right">'''''3508.8'''''</div>

|-
| End
| <div align="right">007076</div>
| <div align="right">006957</div>
| <div align="right">006924</div>
| <div align="right">007025</div>
| <div align="right">006897</div>
|

|-
| Start
| <div align="right">003604</div>
| <div align="right">003550</div>
| <div align="right">003500</div>
| <div align="right">003538</div>
| <div align="right">003492</div>
|

|-
|
| <div align="right">'''3472'''</div>
| <div align="right">'''3407'''</div>
| <div align="right">'''3424'''</div>
| <div align="right">'''3487'''</div>
| <div align="right">'''3405'''</div>
| <div align="right">'''''3439'''''</div>

|}

{| class="prettytable"
| colspan="7" | <center>'''A simple application it implement a empty XdocumentHandler , use UCB and one file one thread process these files.'''</center>

|-
| <center>'''one file one thread'''</center>
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">002696</div>
| <div align="right">002763</div>
| <div align="right">002560</div>
| <div align="right">002827</div>
| <div align="right">002133</div>
|

|-
| Start
| <div align="right">000018</div>
| <div align="right">000026</div>
| <div align="right">000028</div>
| <div align="right">000030</div>
| <div align="right">000033</div>
|

|-
|
| <div align="right">'''2678'''</div>
| <div align="right">'''2737'''</div>
| <div align="right">'''2532'''</div>
| <div align="right">'''2797'''</div>
| <div align="right">'''2100'''</div>
| <div align="right">'''''2568.8'''''</div>

|-
| End
| <div align="right">005318</div>
| <div align="right">005471</div>
| <div align="right">005224</div>
| <div align="right">005174</div>
| <div align="right">004816</div>
|

|-
| Start
| <div align="right">002696</div>
| <div align="right">002764</div>
| <div align="right">002560</div>
| <div align="right">002827</div>
| <div align="right">002133</div>
|

|-
|
| <div align="right">'''2622'''</div>
| <div align="right">'''2707'''</div>
| <div align="right">'''2664'''</div>
| <div align="right">'''2347'''</div>
| <div align="right">'''2683'''</div>
| <div align="right">'''''2604.6'''''</div>

|}

{| class="prettytable"
| colspan="7" | <center>'''A simple application it implement a empty XdocumentHandler , use UCB and two thread process these files.'''</center>

|-
| Two thread
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">002314</div>
| <div align="right">002332</div>
| <div align="right">002356</div>
| <div align="right">002377</div>
| <div align="right">002411</div>
|

|-
| Start
| <div align="right">000027</div>
| <div align="right">000029</div>
| <div align="right">000029</div>
| <div align="right">000030</div>
| <div align="right">000030</div>
|

|-
|
| <div align="right">'''2287'''</div>
| <div align="right">'''2303'''</div>
| <div align="right">'''2327'''</div>
| <div align="right">'''2347'''</div>
| <div align="right">'''2381'''</div>
| <div align="right">'''''2329'''''</div>

|-
| End
| <div align="right">004568</div>
| <div align="right">004611</div>
| <div align="right">004622</div>
| <div align="right">004639</div>
| <div align="right">004731</div>
|

|-
| Start
| <div align="right">002314</div>
| <div align="right">002332</div>
| <div align="right">002356</div>
| <div align="right">002377</div>
| <div align="right">002411</div>
|

|-
|
| <div align="right">'''2254'''</div>
| <div align="right">'''2279'''</div>
| <div align="right">'''2266'''</div>
| <div align="right">'''2262'''</div>
| <div align="right">'''2320'''</div>
| <div align="right">'''''2276.2'''''</div>

|}
== Interesting contrast analysis data Mononuclear processing ==

{| class="prettytable"
| colspan="7" | <center>'''A simple application it implement a empty XdocumentHandler , use UCB and single thread process these files.'''</center>

|-
| Single thread
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">005062</div>
| <div align="right">005531</div>
| <div align="right">005516</div>
| <div align="right">005062</div>
| <div align="right">005110</div>
|

|-
| Start
| <div align="right">000062</div>
| <div align="right">000062</div>
| <div align="right">000047</div>
| <div align="right">000062</div>
| <div align="right">000047</div>
|

|-
|
| <div align="right">'''5000'''</div>
| <div align="right">'''5469'''</div>
| <div align="right">'''5469'''</div>
| <div align="right">'''5000'''</div>
| <div align="right">'''5063'''</div>
| <div align="right">'''''5200.2'''''</div>

|-
| End
| <div align="right">010016</div>
| <div align="right">010703</div>
| <div align="right">010469</div>
| <div align="right">010062</div>
| <div align="right">010078</div>
|

|-
| Start
| <div align="right">005062</div>
| <div align="right">005531</div>
| <div align="right">005516</div>
| <div align="right">005062</div>
| <div align="right">005110</div>
|

|-
|
| <div align="right">'''4954'''</div>
| <div align="right">'''5172'''</div>
| <div align="right">'''4953'''</div>
| <div align="right">'''5000'''</div>
| <div align="right">'''4968'''</div>
| <div align="right">'''''5009.4'''''</div>

|}

{| class="prettytable"
| colspan="7" | <center>'''A simple application it implement a empty XdocumentHandler , use UCB and one file one thread process these files.'''</center>

|-
| <center>'''one file one thread'''</center>
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">005391</div>
| <div align="right">005391</div>
| <div align="right">005422</div>
| <div align="right">005797</div>
| <div align="right">005516</div>
|

|-
| Start
| <div align="right">000063</div>
| <div align="right">000047</div>
| <div align="right">000047</div>
| <div align="right">000063</div>
| <div align="right">000063</div>
|

|-
|
| <div align="right">'''5328'''</div>
| <div align="right">'''5344'''</div>
| <div align="right">'''5375'''</div>
| <div align="right">'''5734'''</div>
| <div align="right">'''5453'''</div>
| <div align="right">'''''5446.8'''''</div>

|-
| End
| <div align="right">010719</div>
| <div align="right">010672</div>
| <div align="right">010703</div>
| <div align="right">011453</div>
| <div align="right">010797</div>
|

|-
| Start
| <div align="right">005391</div>
| <div align="right">005391</div>
| <div align="right">005422</div>
| <div align="right">005797</div>
| <div align="right">005516</div>
|

|-
|
| <div align="right">'''5328'''</div>
| <div align="right">'''5381'''</div>
| <div align="right">'''5281'''</div>
| <div align="right">'''5656'''</div>
| <div align="right">'''5281'''</div>
| <div align="right">'''''5385.4'''''</div>

|}

{| class="prettytable"
| colspan="7" | <center>'''A simple application it implement a empty XdocumentHandler , use UCB and two thread process these files.'''</center>

|-
| Two thread
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">005110</div>
| <div align="right">005062</div>
| <div align="right">005516</div>
| <div align="right">005531</div>
| <div align="right">005062</div>
|

|-
| Start
| <div align="right">000047</div>
| <div align="right">000062</div>
| <div align="right">000047</div>
| <div align="right">000062</div>
| <div align="right">000062</div>
|

|-
|
| <div align="right">'''5063'''</div>
| <div align="right">'''5000'''</div>
| <div align="right">'''5469'''</div>
| <div align="right">'''5469'''</div>
| <div align="right">'''5000'''</div>
| <div align="right">'''''5200'''''</div>

|-
| End
| <div align="right">010078</div>
| <div align="right">010062</div>
| <div align="right">010469</div>
| <div align="right">010703</div>
| <div align="right">010016</div>
|

|-
| Start
| <div align="right">005110</div>
| <div align="right">005062</div>
| <div align="right">005516</div>
| <div align="right">005531</div>
| <div align="right">005062</div>
|

|-
|
| <div align="right">'''4968'''</div>
| <div align="right">'''5000'''</div>
| <div align="right">'''4953'''</div>
| <div align="right">'''5172'''</div>
| <div align="right">'''4954'''</div>
| <div align="right">'''''5009.4'''''</div>

|}
= Overview =
Through the above late two sets of data we can get the follows conclusion:

=== When Single-core, a task divide into multiple small tasks；these are same cost, processing with single thread, one task one thread and two thread.( one task one thread performance relatively low) ===
=== When Dual-core, a task divide into multiple small tasks；the waste is close to 0.7-0.8 with one task one thread process ,it is close to 0.66 with two threads process, a single thread process as a benchmark. ===

Through the first group of data we can get a conclusion:

=== That possess great proportion cost, OOo process ODF. ===
= How to do =
How can we improve ODF loading performance.

As multi-core cpu, Can we split process “content.xml” to some small tasks. Process with multi-thread , and merger the result.

As Single-core, Can we split process “content.xml” to some small tasks. Asynchronous load document .

<nowiki>* Of course, At the ODF parser will not improve performance?( But now we don't discuss ) </nowiki>

How can we split process “content.xml” to some small tasks:

a) Split “content.xml” content .

b) Colloect the result with sax parser, and Split the result.

= Description =
== Split “content.xml” content ==
Change the document structure, complex nodules defined as a reference link to a single file,the main file contains only simple structure.

It will produce the ODF layout :

content.xml
complex/fragment1.xml
/fragment2.xml
/fragment3.xml
/fragment4.xml
…

And “content.xml” will be :

…
<nowiki><table:table xlink:href= “complex/fragment1.xml” /></nowiki>
…

I think it will produce the same performance optimization when save documentation, this way.

== Colloect the result with sax parser, and Split that ==
From the above test data, SAX process with relatively less cost itself. We can colloect SAX parser result, and split it to multi part.

{| class="prettytable"
| colspan="7" | <center>A simple application it implement a XdocumentHandler that colloect the SAX parser result , use UCB read thest files</center>

|-
| <center>Colloect the SAX parser result</center>
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">005706</div>
| <div align="right">005510</div>
| <div align="right">005200</div>
| <div align="right">005824</div>
| <div align="right">005527</div>
|

|-
| Start
| <div align="right">000029</div>
| <div align="right">000019</div>
| <div align="right">000019</div>
| <div align="right">000012</div>
| <div align="right">000011</div>
|

|-
|
| <div align="right">'''5677'''</div>
| <div align="right">'''5491'''</div>
| <div align="right">'''5181'''</div>
| <div align="right">'''5812'''</div>
| <div align="right">'''5516'''</div>
| <div align="right">'''''5695.4'''''</div>

|-
| End
| <div align="right">010814</div>
| <div align="right">010685</div>
| <div align="right">010297</div>
| <div align="right">010950</div>
| <div align="right">010794</div>
|

|-
| Start
| <div align="right">005706</div>
| <div align="right">005510</div>
| <div align="right">005200</div>
| <div align="right">005824</div>
| <div align="right">005527</div>
|

|-
|
| <div align="right">'''5108'''</div>
| <div align="right">'''5175'''</div>
| <div align="right">'''5097'''</div>
| <div align="right">'''5126'''</div>
| <div align="right">'''5267'''</div>
| <div align="right">'''''5154.6'''''</div>

|}

{| class="prettytable"
| colspan="7" | <center>'''A simple application it implement a empty XdocumentHandler , use UCB and single thread process these files.'''</center>

|-
| Empty handler
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">003788</div>
| <div align="right">003763</div>
| <div align="right">003908</div>
| <div align="right">004044</div>
| <div align="right">003702</div>
|

|-
| Start
| <div align="right">000015</div>
| <div align="right">000011</div>
| <div align="right">000013</div>
| <div align="right">000014</div>
| <div align="right">000016</div>
|

|-
|
| <div align="right">'''3773'''</div>
| <div align="right">'''3752'''</div>
| <div align="right">'''3895'''</div>
| <div align="right">'''4030'''</div>
| <div align="right">'''3686'''</div>
| <div align="right">'''''3821.2'''''</div>

|-
| End
| <div align="right">008330</div>
| <div align="right">007444</div>
| <div align="right">007836</div>
| <div align="right">007776</div>
| <div align="right">007465</div>
|

|-
| Start
| <div align="right">003788</div>
| <div align="right">003764</div>
| <div align="right">003908</div>
| <div align="right">004044</div>
| <div align="right">003703</div>
|

|-
|
| <div align="right">'''3542'''</div>
| <div align="right">'''3680'''</div>
| <div align="right">'''3924'''</div>
| <div align="right">'''3732'''</div>
| <div align="right">'''3762'''</div>
| <div align="right">'''''3728'''''</div>

|}
We can see it is less cost that colloect the SAX parser result. So we can split that throught some rules and multi-thread to process .

== Implement Description ==
It has two policies which split processing “content.xml”task to some small tasks：

a) Split “content.xml”to many sub files.

b) Colloect the result(attribute & content ) from sax parser, and split the result to many parts in some rules.

struct State
{
rtl_uString* mp_elementName; // current element tag name can replace to one flag
xml::sax::XAttributeList* mp_attributes; // current element's attributes
rtl_uString* mp_elementContent; // current element's content

sal_uInt32 m_local; // It's position at vector
sal_uInt32 m_distance; // It's distance from parent element
sal_uInt32 m_count; // It's count of all sub elements
};

<nowiki>typedef std::vector< State* > StateVectors;</nowiki>

From compared above multi-thread data, situation single-core / multi-core increase performance is different.

So I think it can consider asynchronous processing as single-core, it can consider parallel processing as multi-core.

It is 2 policies X 2 situations processing description( Of couse it is my imagines )：

=== Single Core + Many Fragments Asynchronism Process ===
[[Image:Single_Core_%2B_Many_Fragments_Asynchronism_Process.PNG]]
=== Single Core + split SAX result Asynchronism Process ===
[[Image:Single_Core_%2B_split_SAX_result_Asynchronism_Process.PNG]]

=== Multi Core + Many fragments Parallel Process ===
[[Image:Multi_Core_%2B_Many_fragments_Parallel_Process.PNG]]
=== Multi-Core + split SAX result Parallel Process ===
[[Image:Multi_Core_%2B_split_SAX_result_Parallel_Process.PNG]]

== Key points ==
=== The collected information segmentation algorithm ===
=== Now for OOo process is not very clear, do n't know whether be expected. Waits further research ===
= Appendix =
== Here is simple test, with no other considerations, just to test the feasibility of the technology. ==

{| class="prettytable"
| colspan="7" | <center>'''A simple application it implement a XdocumentHandler that colloect the SAX parser result , use UCB read thest files'''</center>

|-
| <center>Colloect the SAX parser result</center>
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">005560</div>
| <div align="right">005563</div>
| <div align="right">005551</div>
| <div align="right">005791</div>
| <div align="right">005558</div>
|

|-
| Start
| <div align="right">000033</div>
| <div align="right">000029</div>
| <div align="right">000030</div>
| <div align="right">000030</div>
| <div align="right">000023</div>
|

|-
|
| <div align="right">'''5527'''</div>
| <div align="right">'''5534'''</div>
| <div align="right">'''5521'''</div>
| <div align="right">'''5761'''</div>
| <div align="right">'''5535'''</div>
| <div align="right">'''''5575.6'''''</div>

|-
| End
| <div align="right">010952</div>
| <div align="right">011093</div>
| <div align="right">011069</div>
| <div align="right">011268</div>
| <div align="right">010972</div>
|

|-
| Start
| <div align="right">005560</div>
| <div align="right">005563</div>
| <div align="right">005551</div>
| <div align="right">005791</div>
| <div align="right">005558</div>
|

|-
|
| <div align="right">'''5392'''</div>
| <div align="right">'''5530'''</div>
| <div align="right">'''5518'''</div>
| <div align="right">'''5477'''</div>
| <div align="right">'''5414'''</div>
| <div align="right">'''''5466.2'''''</div>

|}

{| class="prettytable"
| colspan="7" | <center>'''A simple application it implement a XdocumentHandler that colloect the SAX parser result , use UCB read thest files, and one thread process one SAX parser result.'''</center>

|-
|
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">028326</div>
| <div align="right">028438</div>
| <div align="right">028115</div>
| <div align="right">27835</div>
| <div align="right">28054</div>
|

|-
| Start
| <div align="right">000035</div>
| <div align="right">000035</div>
| <div align="right">000030</div>
| <div align="right">30</div>
| <div align="right">20</div>
|

|-
|
| <div align="right">'''28291'''</div>
| <div align="right">'''28403'''</div>
| <div align="right">'''28085'''</div>
| <div align="right">'''27805'''</div>
| <div align="right">'''28034'''</div>
| <div align="right">'''''28123.6'''''</div>

|-
| End
| <div align="right">055763</div>
| <div align="right">056048</div>
| <div align="right">056294</div>
| <div align="right">056474</div>
| <div align="right">056538</div>
|

|-
| Start
| <div align="right">028326</div>
| <div align="right">028438</div>
| <div align="right">28115</div>
| <div align="right">027835</div>
| <div align="right">028054</div>
|

|-
|
| <div align="right">'''27437'''</div>
| <div align="right">'''27610'''</div>
| <div align="right">'''28179'''</div>
| <div align="right">'''28639'''</div>
| <div align="right">'''28484'''</div>
| <div align="right">'''''28069.8'''''</div>

|}
== A group of large data test ==
=== OOo calc “content.xml” 35.1 MB / 3.8M ===

{| class="prettytable"
| colspan="7" | <center>'''OOo reader “content.xml” '''</center>

|-
| ODF handler
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">38220</div>
| <div align="right">37340</div>
| <div align="right">37140</div>
| <div align="right">66316</div>
| <div align="right">35378</div>
|

|-
| Start
| <div align="right">6559</div>
| <div align="right">6292</div>
| <div align="right">7014</div>
| <div align="right">38431</div>
| <div align="right">6513</div>
|

|-
|
| <div align="right">'''31661'''</div>
| <div align="right">'''31048'''</div>
| <div align="right">'''30126'''</div>
| <div align="right">'''27885'''</div>
| <div align="right">'''28865'''</div>
| <div align="right">'''''29917'''''</div>

|-
| End
| <div align="right">79549</div>
| <div align="right">82462</div>
| <div align="right">81397</div>
| <div align="right">107576</div>
| <div align="right">873537</div>
|

|-
| Start
| <div align="right">47461</div>
| <div align="right">49710</div>
| <div align="right">50479</div>
| <div align="right">78099</div>
| <div align="right">844944</div>
|

|-
|
| <div align="right">'''32088'''</div>
| <div align="right">'''32752'''</div>
| <div align="right">'''30918'''</div>
| <div align="right">'''29477'''</div>
| <div align="right">'''28593'''</div>
| <div align="right">'''''30765.6'''''</div>

|}

{| class="prettytable"
| colspan="7" | <center>'''“XdocumentHandler” empty implement reader “content.xml” '''</center>

|-
| Empty handler
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">2082</div>
| <div align="right">2178</div>
| <div align="right">2118</div>
| <div align="right">2106</div>
| <div align="right">2082</div>
|

|-
| Start
| <div align="right">16</div>
| <div align="right">16</div>
| <div align="right">13</div>
| <div align="right">15</div>
| <div align="right">14</div>
|

|-
|
| <div align="right">'''2066'''</div>
| <div align="right">'''2162'''</div>
| <div align="right">'''2105'''</div>
| <div align="right">'''2091'''</div>
| <div align="right">'''2068'''</div>
| <div align="right">'''''2098.4'''''</div>

|-
| End
| <div align="right">4070</div>
| <div align="right">4752</div>
| <div align="right">4106</div>
| <div align="right">4088</div>
| <div align="right">4294</div>
|

|-
| Start
| <div align="right">2082</div>
| <div align="right">2178</div>
| <div align="right">2118</div>
| <div align="right">2106</div>
| <div align="right">2082</div>
|

|-
|
| <div align="right">'''1988'''</div>
| <div align="right">'''2574'''</div>
| <div align="right">'''1988'''</div>
| <div align="right">'''1982'''</div>
| <div align="right">'''2212'''</div>
| <div align="right">'''''2148.8'''''</div>

|}
=== OOo writer “content.xml” 62.6 MB / 2.0M ===

{| class="prettytable"
| colspan="7" | <center>'''OOo reader “content.xml” '''</center>

|-
| ODF handler
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">108876</div>
| <div align="right">108729</div>
| <div align="right">108997</div>
| <div align="right">108901</div>
| <div align="right">110140</div>
|

|-
| Start
| <div align="right">6201</div>
| <div align="right">6060</div>
| <div align="right">6240</div>
| <div align="right">7029</div>
| <div align="right">8415</div>
|

|-
|
| <div align="right">'''102675'''</div>
| <div align="right">'''102669'''</div>
| <div align="right">'''102757'''</div>
| <div align="right">'''101872'''</div>
| <div align="right">'''101725'''</div>
| <div align="right">'''''102339.6'''''</div>

|-
| End
| <div align="right">229982</div>
| <div align="right">228416</div>
| <div align="right">235011</div>
| <div align="right">234573</div>
| <div align="right">233124</div>
|

|-
| Start
| <div align="right">126660</div>
| <div align="right">125567</div>
| <div align="right">132174</div>
| <div align="right">132292</div>
| <div align="right">130810</div>
|

|-
|
| <div align="right">'''103322'''</div>
| <div align="right">'''102849'''</div>
| <div align="right">'''102837'''</div>
| <div align="right">'''102281'''</div>
| <div align="right">'''102314'''</div>
| <div align="right">'''''102720.6'''''</div>

|}

{| class="prettytable"
| colspan="7" | <center>'''“XdocumentHandler” empty implement reader “content.xml” '''</center>

|-
| Empty handler
| <div align="right">No . 1</div>
| <div align="right">No . 2</div>
| <div align="right">No . 3</div>
| <div align="right">No . 4</div>
| <div align="right">No . 5</div>
|

|-
| End
| <div align="right">4825</div>
| <div align="right">5595</div>
| <div align="right">5546</div>
| <div align="right">5658</div>
| <div align="right">6072</div>
|

|-
| Start
| <div align="right">20</div>
| <div align="right">59</div>
| <div align="right">12</div>
| <div align="right">23</div>
| <div align="right">629</div>
|

|-
|
| <div align="right">'''4805'''</div>
| <div align="right">'''5536'''</div>
| <div align="right">'''5534'''</div>
| <div align="right">'''5635'''</div>
| <div align="right">'''5443'''</div>
| <div align="right">'''''5390.6'''''</div>

|-
| End
| <div align="right">9899</div>
| <div align="right">11815</div>
| <div align="right">11280</div>
| <div align="right">11300</div>
| <div align="right">11394</div>
|

|-
| Start
| <div align="right">4825</div>
| <div align="right">5595</div>
| <div align="right">5546</div>
| <div align="right">5658</div>
| <div align="right">6072</div>
|

|-
|
| <div align="right">'''5074'''</div>
| <div align="right">'''6220'''</div>
| <div align="right">'''5734'''</div>
| <div align="right">'''5642'''</div>
| <div align="right">'''5322'''</div>
| <div align="right">'''''5598.4'''''</div>

|}

[[Category:Performance]]

Performance/load performance implement

2009-12-07T09:06:33Z

Zengliangjun:

{{Performance}}
Please view [[Performance/Odf_document_load_performance_increase_feasibility_analysis]] about analysis. This document explain implement and some discussion.

= Implement =

== Collect data throught sax: ==
* The first step is simple, and no more problem.
* We can collect valid data information to a data structure throught sax parser, the structure's elements can be queried quickly by location identified. I select the vector, now.
* The element has these base fields:
** sal_uInt16 m_prefix;
** rtl_uString* mp_localName;
** sal_uInt32 m_local;
** sal_uInt32 m_distance;
** sal_uInt32 m_count;
** and other fields such as namespace / full name / cached token enum ...

== Processing method ==
* We can go through the result's element by element's "m_local" "m_distance" "m_count"; Get parent element and subelements.
* Every element's processing that has two process steps:
** Process itself , process the attribute and process subelements.
** The result information commit to the parent element.
[[Image:Odfcontext Process Implement.jpg]]

*** processElement() : Process element
**** _startElement() : Start element
**** processSubContexts() : If this element is a parent element, subelements process; every subelement processing will be divided into three steps.
***** _createChildContext(): Create son context
***** _processSubContext(): Process subelement
***** _collectSubContext(): Collect the subelement's result data
**** _characters(): Process element's content
**** _endElement(): End element
*** commit(): commit the result data to parent element

=== Solutions ===
An element has three solutions, Serial / Parallel / delayed processing.
==== Serial processing ====
* Every element will be same processing. As current processing end, back to parent. The parent will jump to next son processing if has next, or back to parent's parent.
==== Parallel processing ====
* One element that has many subelements, will split every subelement's "_processSubContext()" into different work thread. When all subelements end, the "_collectSubContext()" will be serial processing.
==== Delayed processing ====
* One element that has many subelements, the first subelement will process and the others will delay to the document processing end.

== Processing ==
* It is serial processing to the interests of the whole.
** We know an odf document will be four base parts : "meta" "settings" "styles" "content".
** The dependent relation is : "content" -> "styles" -> "settings" -> "meta"( I think it is no more problem -:) )
** So It will be same as now "meta" -> "settings" -> "styles" -> "content".

* To every part parallel processing ,that will be possible.
** Meta part, Settings part and Styles part those can be "Parallel processing".
** I think it can be "Parallel processing" or "Delayed processing", Conent part; No other part depend this part.

= Difficulty =

== Meta part ==
* We know "<office:meta>" , it's subelements is like "<meta:*>". I think the subelements has no correlation between. That can be parallel processing.
* Currently, this part process a DOM object, I do't know why. So this part is serial processing, now.

== Settings part ==
* The "<office:settings>", every subelement of that will get an "beans::PropertyValue". It can be parallel processing.

== Styles part and Conent part ==
* The object from sfx2 , sd , sc and sw; It is complex.

= Plan =
* Implement almost source code about sd to plan.
* Debug the Serial processing process is right.
* Try to test Parallel processing.
* Try to analysis the Delayed processing is feasibility.

[[Category:Performance]]

Performance/load performance implement

2009-12-07T08:59:36Z

Zengliangjun:

{{Performance}}
Please view [[Performance/Odf_document_load_performance_increase_feasibility_analysis]] about analysis. This document explain implement and some discussion.

= Implement =

== Collect data throught sax: ==
* The first step is simple, and no more problem.
* We can collect valid data information to a data structure throught sax parser, the structure's elements can be queried quickly by location identified. I select the vector, now.
* The element has these base fields:
** sal_uInt16 m_prefix;
** rtl_uString* mp_localName;
** sal_uInt32 m_local;
** sal_uInt32 m_distance;
** sal_uInt32 m_count;
** and other fields such as namespace / full name / cached token enum ...

== Processing method ==
* We can go through the result's element by element's "m_local" "m_distance" "m_count"; Get parent element and subelements.
* Every element's processing that has two process steps:
** Process itself , process the attribute and process subelements.
** The result information commit to the parent element.
[[Image:Odfcontext Process Implement.jpg]]

*** processElement() : Process element
**** _startElement() : Start element
**** processSubContexts() : If this element is a parent element, subelements process; every subelement processing will be divided into three steps.
***** _createChildContext(): Create son context
***** _processSubContext(): Process subelement
***** _collectSubContext(): Collect the subelement's result data
**** _characters(): Process element's content
**** _endElement(): End element
*** commit(): commit the result data to parent element

* An element has three solutions, Serial / Parallel / delayed processing.
** Serial processing: every element will be same processing. As current processing end, back to parent. The parent will jump to next son processing if has next, or back to parent's parent.
** Parallel processing: One element that has many subelements, will split every subelement's "_processSubContext()" into different work thread. When all subelements end, the "_collectSubContext()" will be serial processing.
** Delayed processing: One element that has many subelements, the first subelement will process and the others will delay to the document processing end.

== Processing ==
* It is serial processing to the interests of the whole.
** We know an odf document will be four base parts : "meta" "settings" "styles" "content".
** The dependent relation is : "content" -> "styles" -> "settings" -> "meta"( I think it is no more problem -:) )
** So It will be same as now "meta" -> "settings" -> "styles" -> "content".

* To every part parallel processing ,that will be possible.
** Meta part, Settings part and Styles part those can be "Parallel processing".
** I think it can be "Parallel processing" or "Delayed processing", Conent part; No other part depend this part.

= Difficulty =

== Meta part ==
* We know "<office:meta>" , it's subelements is like "<meta:*>". I think the subelements has no correlation between. That can be parallel processing.
* Currently, this part process a DOM object, I do't know why. So this part is serial processing, now.

== Settings part ==
* The "<office:settings>", every subelement of that will get an "beans::PropertyValue". It can be parallel processing.

== Styles part and Conent part ==
* The object from sfx2 , sd , sc and sw; It is complex.

= Plan =
* Implement almost source code about sd to plan.
* Debug the Serial processing process is right.
* Try to test Parallel processing.
* Try to analysis the Delayed processing is feasibility.

[[Category:Performance]]

Performance/Odf document load performance increase feasibility analysis/Implement

2009-12-07T03:23:29Z

Zengliangjun: moved Performance/Odf document load performance increase feasibility analysis/Implement to Performance/Odf document load performance implement: Description of odf document load performance

#REDIRECT [[Performance/Odf document load performance implement]]

Performance/load performance implement

2009-12-07T03:23:29Z

Implement is in 'xmloff', and each element processing is divided into several steps:

1 )processElement() : Process element
2) _startElement() : Start element
3) processSubContexts() : Sub elements process,
if this element is a parent element.
Every sub element processing will be divided into three steps.
4)_createChildContext(): Create Sub Context
5)_processSubContext(): Process sub element
7)_collectSubContext(): Collect the sub element's result data
9) _characters(): Process element's content
10)_endElement(): End element
11)commit(): commit the result data to parent element

And every parent element has three solutions to process sub elements:

a) Serial processing

b) Parallel processing

c) delayed processing

In the 'content.xml' stream,

it is 'c)' the top parent element of display element.

In the 'settings.xml/styles.xml' stream,

it is 'b)' the top parent element of setting/style element.

And 'meta.xml', 'settings.xml', 'styles.xml', 'content.xml' It is serial processing.

[[Image:Odfcontext Process Implement.jpg]]

[[Category:Performance]]

Performance/load performance implement

2009-07-22T07:46:38Z

Zengliangjun:

Performance/load performance implement

2009-07-22T07:45:24Z

Zengliangjun:

Implement is in 'xmloff', and each element processing is divided into several steps:

1 )processElement() : Process element
2) _startElement() : Start element
3) processSubContexts() : Sub elements process,
if this element is a parent element.
Every sub element processing will be divided into three steps.
4)_createChildContext(): Create Sub Context
5)_processSubContext(): Process sub element
7)_collectSubContext(): Collect the sub element's result data
9) _characters(): Process element's content
10)_endElement(): End element

11)commit(): commit the result data to parent element

And every parent element has three solutions to process sub elements:

a) Serial processing

b) Parallel processing

c) delayed processing

In the 'content.xml' stream,

it is 'c)' the top parent element of display element.

In the 'settings.xml/styles.xml' stream,

it is 'b)' the top parent element of setting/style element.

And 'meta.xml', 'settings.xml', 'styles.xml', 'content.xml' It is serial processing.

[[Image:Odfcontext Process Implement.jpg]]

[[Category:Performance]]

Performance/load performance implement

2009-07-22T07:42:10Z

Zengliangjun: (checkpoint save)

Implement is in 'xmloff', and each element processing is divided into several steps:

1 )processElement() : Process element
2) _startElement() : Start element
3) processSubContexts() : Sub elements process,
if this element is a parent element.
Every sub element processing will be divided into three steps.
4)_createChildContext(): Create Sub Context
5)_processSubContext(): Process sub element
7)_collectSubContext(): Collect the sub element's result data
9) _characters(): Process element's content
10)_endElement(): End element

11)commit(): commit the result data to parent element

And every parent element has three solutions to process sub elements:

a) Serial processing

b) Parallel processing

c) delayed processing

In the 'content.xml' stream,

it is 'c)' the top parent element of display element.

In the 'settings.xml/styles.xml' stream,

it is 'b)' the top parent element of setting/style element.

And 'meta.xml', 'settings.xml', 'styles.xml', 'content.xml' It is serial processing.

[[Image:Odfcontext Process Implement.jpg]]

File:Odfcontext Process Implement.jpg

2009-07-22T07:36:31Z

Zengliangjun: