14:55 We have been alerted to a problem with a PSTN interconnection with one of our inbound number providers which is affecting a number of telephone numbers on our network. Our inbound provider is investigating the cause of this with their engineers. We are not aware of this issue affecting any outbound calls and the majority of our outbound calls are handled by our own in-house PSTN interconnect. We apologise for any inconvenience caused and will update our customers as soon as we receive any new information.
15:47 We have received an update from our inbound number provider to tell us that the issue previously reported on gradwellstatus.com is resolved. We will post any further updates once we receive them from our provider.
Starts: 2008/09/16 18:30 Ends: 2008/09/16 19:00
This evening we will be releasing a series of improvements to our partner VoIP CSR’s. Partners may have difficulty using the CSR admin area for a short period of time while the upgrade takes place.
This upgrade will only affect the CSR admin area, and will not affect the functioning of end users VoIP service.
09:45
We are currently experiencing a filesystem problem with our v-mail-file-4 server, which will affect mail collection for customers using IMAP and POP3 for that server only. We are currently performing a full file system check on the associated drives and will update customers as soon as possible. We apologise for any inconvenience caused.
10:31 The file system checking is complete and mailbox access should be fully restored. If you should see any continued issues please contact our customer services team who will be happy to help.
We will be temporarily taking our v-mail-file-4 server down for essential maintenance at 22:00 this evening and expect the maintenance window to last roughly thirty minutes. We apologise for any inconvenience and the short notice given.
UPDATE @ 22:06 :: The maintenance has been successfully completed.
We are pleased to announce the beginning of the deployment of our new nat proxy service. The NAT proxy service helps connect phone calls for customers using firewalls and private networks.
This new NAT proxy is part of our new VoIP network (79.135.125.128/26 255.255.255.192) and customers should ensure they have not firewalled these IP addresses.
Customers wishing to try the new nat proxy may change their VoIP phones to use natproxy.gradwell.net:5082 (instead of nat.gradwell.net:5082).
Our first deployment will take place on Thursday 18th September, when a few hundred customers will be migrated to the new platform. No customer changes will be required.
We are currently experiencing an issue with our back-end database server which we are working to resolve very shortly. We apologise for any inconvenience caused. This may result in call setups failing, however, active calls will not be dropped.
Update 12:35
We have restored database connectivity. This issue was caused by a DNS issue internally which is currently being investigated in more details to ensure that more redundancy is added to ensure this does not happen again.
We are still seeing issues with whitelabel VoIP partners’ control panels which we are investigating currently.
Update 13:45
Our partner login areas are now working normally again, this issue is related to our database, which due to being unavailable had a backlog of work, which has now cleared. We apologise for the inconvenience this will have caused you.
We have been made aware of an issue relating to our conferencing platform - calls to conference rooms are failing to complete successfully.
Our server admins are currently investigating this problem on our network and we will update customers once further information is available.
Our server admins have now resolved this issue , an internal timing module which Asterisk uses failed to reload correctly.
If you are still experiencing problems logging into conference rooms on our network please raise a support request via the Gradwell Portal.
Starts: 2008-09-12 01:00 Ends: 2008/09/12 02:00
Due to a memory error, we have lost access to the management unit in our main cisco switch stack in Telehouse and therefore need to reboot one of the switch nodes.
Although the switches contain redundant controllers, we cannot be sure that the backup will take over, and there may be a short outage to our core network whilst it reboots.
As a precaution, we plan to shutdown most of our virtual servers to a bare minimum, and specifically we will switch off those providing the email system (as their hard disks are accessed via network based storage), and therefore no email collection or delivery will be available during this maintenance window.
We do expect our voip platform to continue working, although some calls may be dropped.
We expect this work to take under 15 minutes to complete, but please accept our apologies for this interuption to service.
Update - 03:15
The switch was successfully rebooted at 01:30 and nearly all services were fully functional by 02:00. At the time of writing (03:15) we believe all services are back to normal.
Thank you for your patience during this maintenance and we apologize for any inconvenience caused.
We are currently experiencing an issue with our news server and apologise for any inconvenience customers may be having accessing the news feeds.
Engineers have been notified and we hope to restore the service as soon as possible.
Update:
The previously announced issue with the news server is resolved. We are currently working on migrating the news service to our virtualised platform due to a hardware fault, which we expect to resolve the problems with the news service.
We are currently experiencing an internal fault on our VoIP Centrex Server lon-pbx-12.
Our server team are urgently investigating the issue and we are aiming to resolve the problem as soon as possible. Customers may experience issues with calls terminating at present and we apologise for this.
Update 14:43
Our server team have created an emergency fix for two unrelated problems which were causing an intermittent fault on lon-pbx-12 and the server has now been stable for 75 minutes. Once the changes have been reviewed, they will be rolled out to customers on other servers.
We apologise for the inconvenience caused by this unavoidable problem.
