(39) (9) (65) (63) (63) (10) (12) (3) (110)We have restarted the VoIP Centrex Server lon-pbx-11 due to load-related issues which the server was experiencing, which woul have resulted in extended call setup times and difficultly transfering calls or registering extensions. We apologise for any inconvenience caused.
We are currently experiencing an intermittent issue with one of our back-end storage servers which handles some of our internal scheduled tasks. This server is being checked at the moment and we have been alerted to a possibility that this is causing legacy FreeBSD-hosted sites to not respond in a timely manner. We are working to bring this server back up as quickly as possible and move the data to an alternative server.
Update 21:48: We have brought this server back online and are continuing to migrate all data from it, as this serever remains at risk. Our internal monitoring systems show that lon-web-1 and lon-web-2 have now recovered.
Update: June 30th 23:00: We have now migrated enough from our legacy system ‘Azure’, to mark our new HP/Lefthand copy active and do not expect any more outages with Azure to to affect back-end scripts from running and we therefore consider this issue closed.
Since 10:50 One of our legacy ESX servers has experienced an issue communicating with our legacy storage servers which has stopped several servers operating correctly. The only remaining server experiencing an issue is v-mail-file-10, which holds 12 mailboxes which are the only mailboxes not yet migrated on to our HP/Lefthand storage. This server has been brought back up on an alternative host and is currently undergoing a file-system test before being brought back online. We apologise for any inconvenience caused.
Update: This issue was fully resolved at 12:30
18:50 We are currently experiencing an issue with one of the servers which provides our NNTP/usenet feeds and our server team is investigating.
Update: This issue has been resolved since 21:30 hours.
Update: Apologies for some additional DNS resolution issues which were encountered after this this point which delayed resolution of the service. The service was restored by 22:50.
Our VoIP Centrex server lon-pbx-12 has just been restarted due to excessive load preventing the server for responding in a timely manner. This issue is being investigated internally and we apologise for any inconvenience caused.
One of our PBXs - lon-pbx-11.gradwell.net swapped to its backup server just after 12:00 .
We have now restarted lon-pbx-11 and it has now taken over from the backup and is passing calls correctly. We apologise for any issues you may have experienced whilst this changeover took place.
If you are experiencing any problems after this changeover, please reboot your VoIP device to enable it to re-register.
We are currently investigating an inbound mail delay to hosted domains and email forwarding. This issue has been narrowed down to a firewall configuration issue and is being worked on by our on-call server engineers. We apologise for any inconvenience caused.
Update 23:30: The root cause of this issue has now been corrected and mail queues are being cleared down, which is likely to last around half an hour.
Update 00:47: An additional issue has been found with delivery to local mailboxes from the affected inbound servers and has now been corrected.
Update: This issue was resolved by 02:00.
We are currently experiencing a technical issue where access to the Gradwell Hosting and VoIP control panels may be unavailable for customers.
Customers upon trying to login to their control panels will be seeing a System Error message displayed in their web browser.
An oncall engineer has been altered to this problem and we will update this status posting once further information is received.
Update 08:30: An issue has been investigated and fixed with our internal API server which has been restarted and resolves this problem.
We have identified a DNS issue which affects access to our core database services. This issue will affect call set up times and access to our control panels. Our server team are currently investigating this problem and will update gradwellstatus as soon as possible.
This issue has now been resolved, due to some configuration changes on our core database server cluster.
Starts: 2009/07/01 01:00 Ends: 2009/07/01 05:00
Our ADSL carrier has informed us that a number of exchanges will experience intermittent connectivity issues while the DSLAM software is upgraded , this will allow us to expand the availability of our Premier Plus broadband package.
Users connected to the following exchanges will be disconnected for upto 20 minutes while the software is upgraded, customers routers should reconnect automatically once the upgrade has been performed.
