Difference between revisions of "Rough ideas for the OpenOffice.org Open Mirror Network System version 3.0"
(Created page with '== Status of this document == * Rough ideas for brainstorming == Concept == {| border=1 cellpadding=3 ! Concept ! Descriptions |- | Distributed computer network | * One subsys…') |
(Added items to the next generation) |
||
Line 207: | Line 207: | ||
* In addition to version 3, (just some ideas) | * In addition to version 3, (just some ideas) | ||
** providing communication features between redirectors and each mirror server | ** providing communication features between redirectors and each mirror server | ||
+ | ** logging for preciser download statistics calculation | ||
** taking timezone into account | ** taking timezone into account | ||
|} | |} | ||
Line 228: | Line 229: | ||
*** Mirror server: "I have currently room for more download." | *** Mirror server: "I have currently room for more download." | ||
*** Redirector: "OK, I am increasing the amount of download requests for you." | *** Redirector: "OK, I am increasing the amount of download requests for you." | ||
+ | |||
+ | To calculate preciser download statistics, installing a small program in every or most mirror servers and the program prepare download logs. Logging Servers gather download logs from each mirror server and calculate download statistics. | ||
In addition to the communication, timezone would be also taken into account. E.g during a day time in Europa, some traffic from the inside of Europa could be routed to America where it is early morning. | In addition to the communication, timezone would be also taken into account. E.g during a day time in Europa, some traffic from the inside of Europa could be routed to America where it is early morning. |
Revision as of 15:56, 17 December 2009
Contents
Status of this document
- Rough ideas for brainstorming
Concept
Concept | Descriptions |
---|---|
Distributed computer network |
|
Simple, open API |
|
Maintainability |
|
Scalability & High Availability |
|
Surveillance & Alert |
|
Network Diagram
Subsystem
The OpenOffice.org Open Mirror Network System consists of several subsystems. Each subsystem is loosely connected from one subsystem to another subsystem using the platform, programming language, and application independent API.
Subsystem | Descriptions |
---|---|
Mirror Server |
|
OpenOffice.org Web |
|
Download Concierge Server |
|
Redirector Server |
|
Scanner Server |
|
Repository |
|
Logging Server |
|
Statistics Calculation Server |
|
Surveillance Servers & User's PC |
|
API
Each subsystem communicates by obtaining remote files via HTTP GET. There are basically three types of file:
Type | Example |
---|---|
A plain text file (.txt) | Scan results (URL, path, type of entry (d: directory, f: file, l: symbolic link)
http://mirror.aarnet.edu.au/pub/openoffice /stable/3.1.1/ d http://mirror.aarnet.edu.au/pub/openoffice /stable/3.1.1/OOo_3.1.1_Win32Intel_install_en-US.exe f http://mirror.aarnet.edu.au/pub/openoffice /stable/3.1.1/OOo_3.1.1_Win32Intel_install_wJRE_en-US.exe f ... http://openoffice.mirror.aussiehq.net.au /stable/3.1.1/ d http://openoffice.mirror.aussiehq.net.au /stable/3.1.1/OOo_3.1.1_Win32Intel_install_en-US.exe f http://openoffice.mirror.aussiehq.net.au /stable/3.1.1/OOo_3.1.1_Win32Intel_install_wJRE_en-US.exe f ... |
XML file (.xml) | A list of mirror server
<site location="Australia" code="au" type="regular" name="AussieHQ"> <uri set="extended" scheme="ftp">ftp://openoffice.mirror.aussiehq.net.au/pub/openoffice/</uri> <uri set="extended" scheme="http">http://openoffice.mirror.aussiehq.net.au/</uri> <uri set="extended" scheme="rsync">rsync://openoffice.mirror.aussiehq.net.au/openoffice-extended/</uri> <uri set="main" scheme="rsync">rsync://openoffice.mirror.aussiehq.net.au/openoffice/</uri> <contact name="Foo Bar"> <email>foo.bar@xxx.yyy</email> </contact> </site> |
ZIP-archive file (.zip) |
|
Strength
Strengh | Descriptions |
---|---|
Maintainability |
|
Scalability and high availability |
|
Openness |
|
Weakness
Weakness | Descriptions |
---|---|
Complexity |
|
Generation
Generation | System | Descriptions |
---|---|---|
1 | Bouncer |
|
2 | MirrorBrain |
|
3 | Open Mirror Network System version 3 |
|
4 | Open Mirror Network System version 4 |
|
The Next Generation
In the version 4, redirectors and mirror servers would communicate each other over SOAP or other protocol to make situation better.
- The availability of content
- Pooling
- Redirector: "What files do you currently have?"
- Mirror server: "I have this, this, ... and this file."
- Reporting
- Mirror server: "I have gotten this file and deleted that file."
- Redirector: "Thanks."
- Pooling
- The load of server
- Pooling
- Redirector: "How is it going?"
- Mirror server: "Well, I have been busy, could you throttle the amount of download requests towards me?"
- Reporting
- Mirror server: "I have currently room for more download."
- Redirector: "OK, I am increasing the amount of download requests for you."
- Pooling
To calculate preciser download statistics, installing a small program in every or most mirror servers and the program prepare download logs. Logging Servers gather download logs from each mirror server and calculate download statistics.
In addition to the communication, timezone would be also taken into account. E.g during a day time in Europa, some traffic from the inside of Europa could be routed to America where it is early morning.
Developer Assignment
Subsystem | Developer |
---|---|
Mirror Server | - (no need to be developed) |
OpenOffice.org Web | (website project, release engineer) |
Download Concierge Server | (website project, release engineer, mirror project) |
Redirector Server | (Persons who know redirector) |
Scanner Server | (Probably Tora) |
Repository | - (no need to be developed) |
Logging Server | (Probably Tora) |
Statistics Calculation Server | (Persons who know statistics, marketing project, or simply use existing software) |
Surveillance Servers & User's PC | (Persons who are interested in this area) |
Schedule
(To be discussed.)