Difference between revisions of "User:TerryE/phpBB3.0.5 Migration/Follow-up Issues and Actions"

From Apache OpenOffice Wiki
Jump to: navigation, search
(Site Home Page (Closed))
(Follow-up Issues and Actions)
 
(47 intermediate revisions by the same user not shown)
Line 1: Line 1:
 
= Follow-up Issues and Actions =
 
= Follow-up Issues and Actions =
 +
:''Activities on this page are now closed.  Any further work on these follow-up Issues will now be carried out in the context of the phpBB 3.0.7 migration.''
 
{| cellspacing="0" cellpadding="0" style="clear: {{{clear|right}}}; margin-bottom: .5em; float: right; padding: .5em 0 .8em 1.4em; background: none; width: {{{width|{{{1|auto}}}}}};" {{#if:{{{limit|}}}|class="toclimit-{{{limit}}}"}}
 
{| cellspacing="0" cellpadding="0" style="clear: {{{clear|right}}}; margin-bottom: .5em; float: right; padding: .5em 0 .8em 1.4em; background: none; width: {{{width|{{{1|auto}}}}}};" {{#if:{{{limit|}}}|class="toclimit-{{{limit}}}"}}
 
| __TOC__
 
| __TOC__
 
|}
 
|}
I have included the list of issue in alphabetic order below.
+
I have included the list of open issues in alphabetic order below.  For closed issues see [[User:TerryE/phpBB3.0.4 Migration — Closed Issues and Actions|Closed Issues and Actions]]. My current intent is now to defer any further work to the phpBB3.0.5 Migration
 
+
== Attachment Quotas (Closed) ==
+
 
+
I set the attachment quotas on the EN and FR boards as 300Mb and 500Mb respectively, with the other boards are set at 100Mb for now. Unfortunately I used the values 300Mb where this should have been a number which resulted in attachments being disabledThe first time I fixed it, I had finger trouble on the update (accidentally typing a ";" before the where clause in a update has a disastrous result :lol:).  
+
:"Oups, seems there is a problem in the counts bottom of page: all are set to 314,872,800 topics/posts/users!"
+
Another hour extracting and restoring '''phpbb_''XX''_config''' tables from the last backup and rolling forward the changes that I made.
+
 
+
== Automated Mailbox Robot ==
+
 
+
I now have this working for each forum, subject to limitation that the '''Admin Mailbox Configuration''' post must be correctly configured.  There seems to be something wrong with the forum permissions propagations. I have used the workaround of using my administrator powers to adopt a moderators permissions so I have now (as at UTC 02:08, 18 May 2009) set up all of the forum mailboxes and tested each by sending a test message to each.  The NL admins mostly have some more playing/tweaking of the configs but the robot is broadly working.
+
  
 
== Automated Unactivated Users Prune ==
 
== Automated Unactivated Users Prune ==
  
== Banned user flag on viewtopics and viewforum ==
+
This is another batch script that I have still in development.  It automates a tedious twice weekly task. Low priority until the issues which are impacting the NL Administrators are sorted.
  
== Caching Setup and Policy ==
+
== Automated Backup ==
  
I have enabled the APC (Another Php Cache) cache for the site.
+
I had a set of scripts that ran as a cron job for the old server with the PostgresSQL D/B, but I turned these off when I moved to MySQL and we decommissioned using the OUCV server as a second site.  I have a script which I use manually about once per week (on top of standard Solaris backups), but I would prefer to have a nightly dump.
  
apc.enabled=1
+
== Write up phpBB 3.0.5 configuration ==
apc.shm_segments=1
+
apc.cache_by_default=1
+
apc.optimization=0
+
apc.shm_size=64
+
apc.ttl=240
+
apc.user_ttl=240
+
apc.gc_ttl=120
+
apc.stat=1
+
apc.num_files_hint=1024
+
apc.user_entries_hint=200
+
apc.mmap_file_mask=/dev/zero
+
apc.enable_cli=1
+
  
APC seems to work fine apart from the setting ''apc.stat=1'' doesn't seem to work in CSK 1.3.1.  It worked fine in 1.3.  ''Something to track down when I have time''.  In the meantime, the simplest workaround is to restart Apache if any of the cache Software is updated.
+
I have decided to do this in the phpBB wiki because this will be of more interest to phpBB admins rather than OOo Volunteers and NL AdminsI will post the link here when I've done it.
 
+
You can see how effective this is by executing a temporary APC query [http://user.services.openoffice.org/apc.php?files=yes usOOO &mash; APC Cache Summary].  I just ran this report and on a 47hr window since last refresh we are running at around 170K cache reference/hr and of these we have a 99.4% cache hit rate.  The figure is even bigger when weighted by code size.
+
 
+
=== Cache Follow-up ===
+
:Any time phpBB executes a SQL query, style template, or dataset retrieval, it creates an md5 of the sql query / tempate and stores this under the name sql_<md5Value> in the cache (or euqivalent for the other types)Before executing the query, it does an existence check for the file andexecutes an @include it to evaluate it.  PHP loades the cached bytecode version instead. Here is a typical example
+
 
+
      <?php
+
        /* SELECT COUNT(DISTINCT s.session_ip) as num_guests FROM phpbb_en_sessions s \
+
          WHEREs.session_user_id = 1 AND s.session_time >= 1242322740 AND s.session_forum_id = 61  */
+
        $expired = (time() > 1242323134) ? true : false;
+
        if ($expired) { return; }
+
        $this->sql_rowset[$query_id] = unserialize('a:1:{i:0;a:1:{s:10:"num_guests";s:1:"0";}}');
+
        ?>
+
 
+
: This code sets the boolean $expired and if false then also returns the results set. If true or the file doesn't exist then the execution does the SQL query then creates this file (but only for what the application deems as reusable queries). With this phpBB cache the results are latched for a specific time (in this example the expiry time was some 6 mins after the start of the session) even if the underlying DB data has changed. Thanks to the APC, the code for this is also cached to executing this is quick. This approach is different to the MySQL cache, where the execution plan for each SQL queries is cached in an LRU buffer. This saves parse costs, but the query is still re-evaluated each call.
+
  
 
== Forum Permissions and Access ==
 
== Forum Permissions and Access ==
Line 69: Line 33:
 
that is for other than the O/P, '''acl_get''' must return the '''m_edit''' privilege for that forum.
 
that is for other than the O/P, '''acl_get''' must return the '''m_edit''' privilege for that forum.
  
Until I can work this one out the work around is to pick a moderator and test his permissions.
+
Until I can work this one out the work around is to pick a moderator and test his permissions.  Alternatively you need to be explicitly placed in a  Moderator Group.  Admins by default don't seem to inherit all moderator rights.
  
== Language Localisation ==
+
After some debate with the NL administrators, I've downloaded and rebaselined to the latest 3.0.5 NL packs for all supported languages.
  
The out-of-the-box language packs contain some mistranslations, A number of the NL Administrators have posted changes asking me to correct various miswordings in their translations.  It's a little error-prone for me to do as I usually don't understand the nuances of the text and its context.    There is a feature (now working) whereby the administrators can now do these changes themselves through the ACP if that have founding administrator rights in you forum, but as most of you don't have this on your own database:
+
== Retiring Custom Fields ==
* You log onto '''/forum/test''' database as '''TestFounder''' (pwd ''openofficetest'') and then through the ACP through the link at the foot of the page which is visible when you are logged in as an administrator.
+
* You navigate to ACP->System->Language Packs.  This lists the Language packs installed in your NL Forum.  Each of the named packs is a URI; click on the pack you want to edit. 
+
* Under the '''Language entries''' there is a drop down allowing you to pick the file that you want to review / change.  There are Language Files which relate 1-1 with the page URIs (e.g. posting.php is all of the NL strings specific to the posting form) and a common one for NL strings that are used on multiple forums.  There are also templates for emails and registration.  Make the changes that you need.  One great advantage of doing it this way is that the encoding is UTF.
+
* Unfortunately, you need to be a Founding Administrator to have these right, and the NL admins do'nt have this, so I have added an account to the /test/forum instance (name and password provided on our private forum). Go into this test forum to do this work. Since all the NL instances use the same code and language packs, you can do this work here.
+
* When you are done click the "submit and download" button.  This saves a copy on the server and downloads a copy to your PC which you can then review and edit (in a UTF8 enabled editor) at your leisure or pass to colleagues for them to update.  For all but the simplest edits it is safe to do this download, because if you leave and back to the form you will start again with the installed version.  (In fact you may just prefer to use an editor rather than the form interface in which case you select the file and click submit and download straight-away.)
+
* When you are happy with the changes then email the files to me (TerryE at the mail domain OpenOffice.org) and I will install them for you pretty much as soon as I pick up the email.
+
  
As an aside, I had real troubles getting this to work  :crazy: It was a bastard to debug.  (See [http://www.phpbb.com/community/viewtopic.php?f=46&t=1271345&p=9588175#p9588175 phpBB — (ACP) Unable to submit large forms]).
+
This functionality has been moved into the standard signature format, but I've got about 800 accounts across three forums where I need to move this data into the signatures before I can switch this off.
  
Given that I am the resource bottleneck at the moment, can I ask all NL administrators which outstanding translation change requests to use this mechanism.
+
== Standardising Forum Configurations ==
  
=== Language Pack Inconsistencies ===
+
With 9 forums ''any'' degree of divergence can cause problems on upgrade and through-life maintenance, so we need to standardise where possibleI am ''not'' talking about language packs or basic forum structure but things like the extra BBcodes, permissible file extensions for upload, etc..  If they make sense in one OOo forum then they should be in all.
 
+
Even though the Langauge packs are shared, the corresponding language tables in the forums were brought across from the old databases and are therefore inconsistent.  This doesn't impact phpBB at an applications level, but it would make sense to standardise these as a one off(The only difference should be whether the individual packs are enabled for a given forum.)
+
 
+
== Mail subscriptions aren't working ==
+
 
+
You are supposed to be able to subscribe to a forum or post and this will trigger automatic mail notificationsThis doesn't appear to be working.  It works on my test VM, so I will need to use the test NL forum on the server to try this out.
+
  
 
== RSS Feed ==
 
== RSS Feed ==
  
A number of the power users on the '''fr''' forum used the previous RSS feed.  This functionality has been temporarily dropped and needs reinstituted.
+
A number of the power users on the '''fr''' forum used the previous RSS feed.  This functionality has been temporarily dropped and needs reinstituted.  The current implementation adopts the [http://www.phpbb.com/community/viewtopic.php?f=69&t=1189825 Simple RSS mod for phpBB3].  However, this mod has significant limitations that I can't ignoreMost importantly it bypasses the phpBB access control system, allowing unregistered users to browse closed forums.
 
+
== Site Home Page (Closed) ==
+
 
+
I hadn't migrated this one so for a day, the home page as '''It works!'''Oops.  A few people raised this so I hacked quick-and-dirty home page based on the main OOo homepage and style. Since I didn't change the CSS, we've got a couple of wobbly columns.  See [http://user.services.openoffice.org/ user.services.OpenOffice.org] for this example.   
+
 
+
[[User:DrewJensen|Drew]] is going to reimplement a proper home page.
+
 
+
I also had to add redirectors from '''/en''' to '''/en/forum''', etcAgain symlink to a shared redirector the '''/var/www/phpBB-common''' folder.
+
 
+
== View New Post (Count) ==
+
  
This count is no longer being updated during the session.
+
I need to discuss this further with the fr proponents of this mod.

Latest revision as of 05:18, 13 March 2010

Follow-up Issues and Actions

Activities on this page are now closed. Any further work on these follow-up Issues will now be carried out in the context of the phpBB 3.0.7 migration.

I have included the list of open issues in alphabetic order below. For closed issues see Closed Issues and Actions. My current intent is now to defer any further work to the phpBB3.0.5 Migration

Automated Unactivated Users Prune

This is another batch script that I have still in development. It automates a tedious twice weekly task. Low priority until the issues which are impacting the NL Administrators are sorted.

Automated Backup

I had a set of scripts that ran as a cron job for the old server with the PostgresSQL D/B, but I turned these off when I moved to MySQL and we decommissioned using the OUCV server as a second site. I have a script which I use manually about once per week (on top of standard Solaris backups), but I would prefer to have a nightly dump.

Write up phpBB 3.0.5 configuration

I have decided to do this in the phpBB wiki because this will be of more interest to phpBB admins rather than OOo Volunteers and NL Admins. I will post the link here when I've done it.

Forum Permissions and Access

I am an admin on all forums and should therefore have edit access to all forums. If I go into the ACP->Manage Groups->Group Forum Permissions and check, the Admin group has full permission on all forums. However in some forums, e.g. es and fr, I don't have edit edit access to topics but I do on some such as en. I haven't bottomed out what the difference is yet. The relevant code fragment from viewtopic.php (prettied for readability) is:

  'U_EDIT'       => (!$user->data['is_registered']) ?  : 
                       ( ( ( $user->data['user_id'] == $poster_id && 
                             $auth->acl_get('f_edit', $forum_id) && 
                             ( $row['post_time'] > time() - ( $config['edit_time'] * 60 ) || 
                               !$config['edit_time']
                             )
                           ) || $auth->acl_get('m_edit', $forum_id)
                         ) ? append_sid("{$phpbb_root_path}posting.$phpEx", 
                                        "mode=edit&f=$forum_id&p={$row['post_id']}") :
                             ),

that is for other than the O/P, acl_get must return the m_edit privilege for that forum.

Until I can work this one out the work around is to pick a moderator and test his permissions. Alternatively you need to be explicitly placed in a Moderator Group. Admins by default don't seem to inherit all moderator rights.

After some debate with the NL administrators, I've downloaded and rebaselined to the latest 3.0.5 NL packs for all supported languages.

Retiring Custom Fields

This functionality has been moved into the standard signature format, but I've got about 800 accounts across three forums where I need to move this data into the signatures before I can switch this off.

Standardising Forum Configurations

With 9 forums any degree of divergence can cause problems on upgrade and through-life maintenance, so we need to standardise where possible. I am not talking about language packs or basic forum structure but things like the extra BBcodes, permissible file extensions for upload, etc.. If they make sense in one OOo forum then they should be in all.

RSS Feed

A number of the power users on the fr forum used the previous RSS feed. This functionality has been temporarily dropped and needs reinstituted. The current implementation adopts the Simple RSS mod for phpBB3. However, this mod has significant limitations that I can't ignore. Most importantly it bypasses the phpBB access control system, allowing unregistered users to browse closed forums.

I need to discuss this further with the fr proponents of this mod.

Personal tools