Starts: 2009/11/03 22:00 Ends 2009/11/03 23:59
We are performing maintenance on the following systems and services tonight:
- VoIP Control Panel (new product launch)
- Hosting Control Panel (misc server maintenance)
- IAX Proxy (iax.trunk.gradwell.com) (fix for audio-out issues)
We apologise in advance, but during this maintenance, these systems/services may not be available to our customers. We will do our best to keep disruption to a minimum.
UPDATE 22:38: Maintenance has been successfully completed.
We will be taking down one of our database servers (white.gradwell.net) in 3 hours at 2200BST to perform migrations to a new server. During the migration process all databases on white.gradwell.net will be unavailable. Customers affected have already been notified by email, if you have not already received an email then your service will not be affected.
** UPDATE ** new server is online as of 23:20BST and serving databases
We will be migrating our Mailman ‘list.yourdomain.com’ interface to a server in a different datacentre shortly, and we need to change the IP address of the system from 193.84.87.101 to 212.11.71.211. We will be automatically modifying all hosted domains automatically, and the change should take effect in approximately an hour. Due to the nature of list archives and mail queues, we will not be able to operate both servers during the switch over, so customers may experience some, minimal down time with this service.
Update 17:11 - We have resolved an issue with the new server configuration which was preventing the migration. The old Mailman server has now been disabled, and the web interfaced removed to ensure nothing changes before our final migration to the new server.
Update 19:47 - Apologies for the delay with this new server, which had to copy the remaining mail over from the old server, without any changes being accepted, the new server is now active on 212.11.71.211, all hosted DNS has been updated and is now propagating over the internet. This maintenance has been essential because the IP address space available to us in Sovereign House is being re-allocated.
Our senior engineers are currently investigating an issue with our Mailman implementation which is currently causing delivery issues, although the web interface is now working correctly.
Update 22:30 - Our Mailman migration is now complete, our engineers have found and corrected the issue with mail not being delivered and the server has been processing queued mail correctly for the past 30 minutes.
This evening from approximately 23:00 until 00:00, we will be performing maintanance on our web load-balancers, which is part of the work for removing the legacy FreeBSD cluster. There is a possibiity of a brief outage on all web clusters as this work progresses. We will update this site once the maintenance has been completed, or with any further updates. Thank for you for patience during these essential works.
This maintenance has now been completed, all PHP 5 sites are now running from our new virtualised PHP 5.2 platform. Our legacy load balancer has been decommissioned.
Will we be performing essential maintenance this evening at 18:00 which will switch our primary customer-facing FTP service - ftp.gradwell.com on to a load balancer. Additionally, for the majority of customers, this will take FTP traffic away from the customer shell server and on to a separate back-end FTP service running a different FTP daemon from that on the shell server.
Customers should not notice any changes in the switch-over, and already running FTP sessions will not be interrupted.
This is a necessary change to control load on the customer shell server - shell.gradwell.com. Operations on shell.gradwell.com will not be affected by this maintenance.
This maintenance was completed as planned with no known customer issues.
Starts: 2009/07/09 20:00 Ends: 2009/07/09 22:00
We will be making changes to the shell.gradwell.com customer shell server on the evening of Thursday 9th July between 20:00 and 22:00 which will involve one or more brief outages to make software upgrades for security reasons.
Due to a small number of customers keeping database connections open for a long time, we have implemented a new policy to disconnect any open connection to the customer database servers which is open any longer than 15 minutes. Some code may not handle this correctly, so we would encourage customers to check any scripts they run for backups or log/data processing which takes a long time.
Code which assumes the database connection will stay open indefinitely during the process may need to be altered by customers.
This announcement is intended to serve as an End of Life (EOL) notice
against two of our legacy shell servers, which are running FreeBSD.
Removal from service will occur on 30th April 2009 and all customers are
hereby advised to migrate to ’shell.gradwell.net’ in the next 4-5 weeks.
End of Life
30th April 2009
Affected Hosts:
ochre.gradwell.net
newred.gradwell.net
Any scheduled jobs (via cron) or screen sessions running on these hosts
must be migrated over prior to the removal date, customers should note
that the new shell servers are running CentOS 5.x and not FreeBSD.
Any data which is not located in your home directory on these servers
will *not* be migrated, so please ensure you do not use other locations
on the filesystem (ie: /tmp) for essential data.
Please contact the support team if you have questions.
Starts: 2009/02/26 22:00 Ends: 2009/02/27 6:00
We will be performing the following maintenance on our infrastructure and equipment hosted in our Telehouse suite:
- Network switch replacement in rack C4 (affects services running on VMWare ESX)
- Memory upgrade for mysqldb4-1 server
- Decommissioning of burgundy server
- Replacing network cables of the voip-manager and lon-pbx-1 servers
All services may be affected for short periods of time during this maintenance window. We apologise in advance for any inconvenience this may cause, and will endeavour to keep all downtime to a minimum.
Starts: 2009/02/19 05:00 Ends: 2009/02/19 06:00
On Tuesday morning, we will be performing maintenance on lon-file-3 and lon-file-4 to investigate an issue with NFS locking which is affecting the PHP web servers. During this period, all customer websites may be unavailable. We will endeavour to keep downtime to a minimum.
We apologise in advance for any inconvenience this maintenance may cause.
UPDATE 2009/02/17 9:30 This maintenance has been rescheduled for Thursday morning.
