New OOo Mirror Structure
From Apache OpenOffice Wiki
Contents
New mirror structure for OpenOffice.org
Ideas for a new structure to distribute OpenOffice.org builds in the mirror network
The number of native language teams are increasing and therefore install sets for more languages of OpenOffice.org (OOo) are possible to release. The result is that more and more space on the mirrors network is needed to cover such demand by the contributors and the users. We want to endorse this demand by providing more languages.
The demand will increase ... :
- on
/extendedto ca. 300 GB (for RCs, Beta, Dev Builds, L10N, ISO files) and - on
/stableand/localizedto ca. 200 GB.
In order to not increase the mirror sizes on purely it could be an alternative to split some parts into packages:
- The
/stablepart contains en-US builds only. As this is very interesting for the very most it it will stay as it is. - The
/localizedpart contains all languages regardless if you want to distribute them in the region you are working. But what about splitting this into packages?
- Define a package that contains languages by coherent regions
We can split all languages into reasonable packages and you can choose which ones you like to have on your mirror. With this method you can decide on your own about the total size you need. When we need more space in total you can try to hold your current size with choosing only a set of packages.
- Define a package that contains languages by their download rate
It's also possible to look at the download rate for all languages and define packages depending on this. So, the most downloaded languages can be in one package, the second most in another package and so on.
- Do you have another idea?
Of course we do not want to predefine the packages that you have to choose. We can speak about the number of languages and/or the total file sizes for each package. Or maybe about another structure? At the end you have the decision on your own how many languages and MB's you want to distribute through your servers.
- The last part is
/extendedwhich contains mostly Beta / RC's, Developer Snapshots and L10N relevant files. Also this part needs to be increased as we expect larger RC's in the future. E.g., the newest OOo 3.3.0 RC 3 is about 78 GB. However, only the mirrors that support the extended set are affected and these are mostly very powerful servers. - Disk space on archive mirrors will also need to be upgraded as we want to keep every legacy product release there.
Please give us your comment on this. Either via mail or in this Wiki. We are open to your opinions. Thank you.
Some statistical sizes
File sizes are calculated with OOo 3.2.1 as basis. All other numbers are reflecting the future:
| Description | Size |
Current total size of the /stable part (GB) |
7 |
Current total size of the /localized part (GB) |
44 |
Current total size of the /extended part (GB) |
90 |
| Average file size of a full install build (MB) | 162 |
| Average file size of a langpack build (MB) | 21 |
| Full install platforms (#) | 11 |
| Langpack platforms (#) | 9 |
| Languages full builds (#) | 99 |
| Languages langpacks (#) | 99 |
Future total size of the /stable part (GB) |
2 |
Future total size of the /localized part (GB) |
200 |
Future total size of the /extended part (GB) |
300 |
Possibility 1
The following packages are defined with languages within a common region:
English (US)
| ISO code | Language | Mostly spoken in (region) |
Size (GB) |
Languages (#) |
| en-US | English (US) | World | 2 | 1 |
Europe
| ISO code | Language | Mostly spoken in (region) |
Size (GB) |
Languages (#) |
| bg | Bulgarian | Eastern Europe | ||
| be-BY | Belarusian | Eastern Europe | ||
| et | Estonian | Eastern Europe | ||
| hu | Hungarian | Eastern Europe | ||
| lt | Lithuanian | Eastern Europe | ||
| lv | Latvian | Eastern Europe | ||
| ro | Romanian | Eastern Europe | ||
| uk | Ukrainian | Eastern Europe | ||
| Package 1 | 15 | 8 | ||
| br | Bretonian | Middle Europe | ||
| cy | Welsh | Middle Europe | ||
| en-GB | English (GB) | Middle Europe | ||
| fr | French | Middle Europe | ||
| ga | Irish | Middle Europe | ||
| gl | Galician | Middle Europe | ||
| oc | Occitan-Lengadocian | Middle Europe | ||
| sc | Sardinian | Middle Europe | ||
| Package 2 | 15 | 8 | ||
| cs | Czech | Middle Europe | ||
| de | German | Middle Europe | ||
| eo | Esperanto | World | ||
| mk | Macedonian | Middle Europe | ||
| nl | Dutch | Middle Europe | ||
| pl | Polish | Middle Europe | ||
| sk | Slovak | Middle Europe | ||
| sl | Slovenian | Middle Europe | ||
| Package 3 | 15 | 8 | ||
| is | Icelandic | Northern Europe | ||
| sv | Swedish | Northern Europe | ||
| nb | Norwegian (Bokmal) | Northern Europe | ||
| fi | Finnish | Northern Europe | ||
| da | Danish | Northern Europe | ||
| nn | Norwegian (Nynorsk) | Northern Europe | ||
| Package 4 | 12 | 6 | ||
| ast | Asturian | Southern Europe | ||
| ca | Catalan | Southern Europe | ||
| ca-XV | Catalan (Valencian) | Southern Europe | ||
| el | Greek | Southern Europe | ||
| es | Spanish | Southern Europe | ||
| eu | Basque | Southern Europe | ||
| pt | Portuguese (Europe) | Southern Europe | ||
| pt-BR | Portuguese (Brazil) | South America | ||
| Package 5 | 15 | 8 | ||
| bs | Bosnian | Southern Europe | ||
| hr | Croatian | Southern Europe | ||
| it | Italian | Southern Europe | ||
| sh | Serbian Latin | Southern Europe | ||
| sq | Albanian | Southern Europe | ||
| sr | Serbian Cyrillic | Southern Europe | ||
| Package 6 | 12 | 6 |
Asia
| ISO code | Language | Mostly spoken in (region) |
Size (GB) |
Languages (#) |
| bn | Bengali | Central Asia | ||
| dz | Dzongkha | Central Asia | ||
| ka | Georgian | Central Asia | ||
| my | Burmese | Central Asia | ||
| ne | Nepali | Central Asia | ||
| ru | Russian | Central Asia | ||
| tg | Tajik | Central Asia | ||
| uz | Uzbek | Central Asia | ||
| Package 7 | 15 | 8 | ||
| bo | Tibetan | Eastern Asia | ||
| ja | Japanese | Eastern Asia | ||
| ko | Korean | Eastern Asia | ||
| mn | Mongolian | Eastern Asia | ||
| ug | Uyghur | Eastern Asia | ||
| zh-CN | Chinese (simplified, China) | Eastern Asia | ||
| zh-TW | Chinese (traditional, Taiwan) | Eastern Asia | ||
| Package 8 | 13 | 7 | ||
| as | Assamese | Indian | ||
| brx | Bodo | Indian | ||
| dgo | Dogri | Indian | ||
| gu | Gujarati | Indian | ||
| hi | Hindi | Indian | ||
| kn | Kannada | Indian | ||
| kok | Konkani | Indian | ||
| ks | Kashmiri | Indian | ||
| mai | Maithili | Indian | ||
| Package 9 | 17 | 9 | ||
| ml | Malayalam | Indian | ||
| mr | Marathi | Indian | ||
| or | Oriya | Indian | ||
| pa-IN | Punjabi | Indian | ||
| sa-IN | Sanskrit | Indian | ||
| sd | Sindhi | Indian | ||
| si | Sinhala | Indian | ||
| ta | Tamil | Indian | ||
| te | Telugu | Indian | ||
| Package 10 | 17 | 9 | ||
| ar | Arabic | Middle East | ||
| he | Hebrew | Middle East | ||
| ku | Kurdish | Middle East | ||
| tr | Turkish | Middle East | ||
| Package 11 | 8 | 4 | ||
| id | Indonesian | Southern Asia | ||
| km | Khmer | Southern Asia | ||
| th | Thai | Southern Asia | ||
| vi | Vietnamese | Southern Asia | ||
| Package 12 | 8 | 6 |
Africa
| ISO code | Language | Mostly spoken in (region) |
Size (GB) |
Languages (#) |
| om | Oromo | Eastern Africa | ||
| rw | Kinyarwanda | Eastern Africa | ||
| sw-TZ | Swahili | Eastern Africa | ||
| Package 13 | 6 | 3 | ||
| af | Afrikaans | Southern Africa | ||
| en-ZA | English (ZA) | Southern Africa | ||
| nr | Ndebele | Southern Africa | ||
| ns | Northern Sotho | Southern Africa | ||
| ss | Swati / Swazi | Southern Africa | ||
| st | Southern Sotho | Southern Africa | ||
| ts | Tsonga | Southern Africa | ||
| ve | Venda | Southern Africa | ||
| xh | Xhosa | Southern Africa | ||
| zu | Zulu | Southern Africa | ||
| Package 14 | 19 | 10 |
Calculation example 1
Now
| Description | Size | Comment |
/stable |
7 GB | en-US builds only |
/localized |
44 GB | all localized languages |
/extended |
90 GB | files for RCs, Beta, Dev Builds, L10N, ISO files |
Future
| Description | Size | Comment |
/stable |
2 GB | en-US builds only |
/localized |
43 GB | localized languages from packages 3,5,8 only |
/extended |
300 GB | files for RCs, Beta, Dev Builds, L10N, ISO files |
Possibility 2
The following packages are defined with languages regarding their percental download rate:
| Rank | ISO code | Language | Percent | Size (GB) |
Languages (#) |
| 1 | en-US | English (US) | 47.05% | ||
| Package 1 | 2 | 1 | |||
| 2 | fr | French | 13.67% | ||
| 3 | de | German | 8.82% | ||
| 4 | it | Italian | 8.40% | ||
| 5 | ja | Japanese | 5.71% | ||
| 6 | es | Spanish | 3.49% | ||
| 7 | pl | Polish | 3.30% | ||
| Package 2 | 12 | 6 | |||
| 8 | ru | Russian | 2.43% | ||
| 9 | nl | Dutch | 1.82% | ||
| 10 | sv | Swedish | 1.14% | ||
| 11 | da | Danish | 0.92% | ||
| 12 | zh-CN | Chinese (simplified, China) | 0.77% | ||
| 13 | zh-TW | Chinese (traditional, Taiwan) | 0.66% | ||
| 14 | nb | Norwegian (Bokmal) | 0.59% | ||
| 15 | tr | Turkish | 0.42% | ||
| Package 3 | 15 | 8 | |||
| 16 | ko | Korean | 0.25% | ||
| 17 | pt-BR | Portuguese (Brazil) | 0.18% | ||
| 18 | el | Greek | 0.08% | ||
| 19 | gl | Galician | 0.06% | ||
| 20 | pt | Portuguese | 0.06% | ||
| 21 | nn | Norwegian (Nynorsk) | 0.05% | ||
| 22 | vi | Vietnamese | 0.05% | ||
| 23 | lt | Lithuanian | 0.04% | ||
| Package 4 | 15 | 8 | |||
| 24 | mk | Macedonian | 0.01% | ||
| 25 | sh | Serbian (latin) | <0.01% | ||
| 26 | ku | Kurdish | <0.01% | ||
| 27 | sr | Serbian (cyrillic) | <0.01% | ||
| 28 | ga | Irish | <0.01% | ||
| 29 | en-GB | English (GB) | <0.01% | ||
| 30 | et | Estonian | <0.01% | ||
| 31 | ar | Arabic | <0.01% | ||
| Package 5 | 15 | 8 |
Calculation example 2
Now
| Description | Size | Comment |
/stable |
7 GB | en-US builds only |
/localized |
44 GB | all localized languages |
/extended |
90 GB | files for RCs, Beta, Dev Builds, L10N, ISO files |
Future
| Description | Size | Comment |
/stable |
2 GB | en-US builds only |
/localized |
42 GB | localized languages from packages 2,3,4 only |
/extended |
300 GB | files for RCs, Beta, Dev Builds, L10N, ISO files |
