Gradwell Internet for business people

Gradwell Service News

Monthly Archive November, 2009

RESOLVED - Incoming call problems

Some users are seeing issues with incoming calls falling to NU tone. We are investigating this now and will post an update here as soon as possible.

We apologise for any problems this is causing you

***UPDATE*** 14:40

This is now cleared, the fault was not with us but with several misconfigured PBXs on users sites.

RESOLVED: Io storage outage

Our server team are currently investigating an issue with our back-end storage which is affecting access to the portal, Mailman connectivity and customer scheduled jobs (cron).  Further information will be posted as soon as it is available.

Update 17:00: We are currently experiencing a problem with inbound calls due to this issue, call setup may be affected.  We are working to bring back the affected VoIP SIP routers.

Update:17:15: This issue has now been resolved.  We have restarted several services which rely on the ‘Io’ back-end storage.  We apologise for any inconvenience caused.

COMPLETED: Maintenance on dixie file server

Starts: 2009/11/26 23:00 Sends: 2009/11/27 00:00

We will be performing some maintenance on the ‘Dixie’ file server which serves approximately one quarter of our customer home directory storage, serving web sites and back-end regular ‘cron’ jobs. The maintenance will be completed from 23:00 until mid night, Thursday 26th November 2009. This will involve a brief outage for web-sites whilst we correct an NFS consistency problem across the network.

Update 23:00: This maintenance window is now in progress.

Update 00:08: We completed these changes at 23:40 and have checked that services are working correctly.  Should you experience any remaining issues, please submit a support incident or call out an engineer if urgent.  Thank you.

RESOLVED: DSL authentication problems

Some users might be seeing some problems making a connection to our Gradwell DSL service. This is being investigated now by our on-call system admin team and our core network engineers. We will post any updates here as soon as possible.

We apologise for any problems this is causing

Update 13:53 - Our network engineers have discovered a problem on our DSL termination equipment which did not appear to have responded to a fault earlier in the day which meant that one of our RADIUS servers was no longer available.  The fault has been corrected and we will be working with our hardware vendors to determine what the best course of action is to ensure this type of fault cannot happen in future.

RESOLVED: Home directory storage

Our engineers have been investigating an issue with the home directory storage ‘Dixie’.  Customers with home directories on this storage server will have had problems accessing their websites and FTP access.  This problem started at approximately 02:45.  Due to an unrelated problem with gradwellstatus.com itself, the announcements for this fault have been unavoidably delayed.  We apologise for any inconvenience caused and the time taken to restore service to these files.

RESOLVED: Mailing Lists

We are currently experiencing an issue where email delivery to our mailing list servers is failing.

This will affect customers who run mailing lists under the subdomain “list.yourdomainname.dom”

An oncall system engineer has been alerted to this issue by our internal monitoring and further updates will be posted once available.

Update: this issue was resolved at 11:45 this morning and was caused by a low-level MTA port conflict on our Mailman server.  We cannot be sure why this happened, however, we have changed the configuration to ensure only Exim runs in future.  We apologise for any inconvenience caused.  Mailman is now processing the backlogged queue and weill attempt re-delivery for all unprocessed messages.

RESOLVED - news.gradwell.com

We are aware that news.gradwell.com is currently not responding. Our server admin are currently liasing with the news server administration team to get this resolved as soon as possible.We will post all updates here.

Sorry for any problems this may be causing you

***Update 13:35***

This problem has now been fully resolved by the news server administrator.

IAX Proxy maintenance (iax-lb)

Starts: 2009/11/08 23:00 Ends: 2009/11/08 23:59

On Sunday night we will be installing updated code onto our IAX proxy server “iax-lb.gradwell.net”.  This will involve restarting the proxy which will drop any active calls however following the restart service should resume almost immediately.

We apologize in advance for any inconvenience this update may cause.

Update (Sunday, 23:21): This maintenance has been completed as planned.  Initial checks confirm the IAX proxy is functioning normally.  We will continue to monitor the situation closely.

IAX Proxy maintenance (iax-out)

Starts: 2009/11/09 23:00 Ends: 2009/11/09 23:59

Tomorrow night we will be installing updated code onto our IAX proxy server “iax-out.gradwell.net”.  This will involve restarting the proxy which will drop any active calls however following the restart service should resume almost immediately.

We apologize in advance for any inconvenience this update may cause.

Update (Sunday, 23:22): This maintenance has been postponed until Monday, 9th November, 23:00-23:59.

Update (Monday, 23:45): This maintenance has been completed as planned.  Our initial checks show the service is working normally.

Control Panel And IAX Proxy Maintenance

Starts: 2009/11/03 22:00 Ends 2009/11/03 23:59

We are performing maintenance on the following systems and services tonight:

  • VoIP Control Panel (new product launch)
  • Hosting Control Panel (misc server maintenance)
  • IAX Proxy (iax.trunk.gradwell.com) (fix for audio-out issues)
We apologise in advance, but during this maintenance, these systems/services may not be available to our customers.  We will do our best to keep disruption to a minimum.
UPDATE 22:38: Maintenance has been successfully completed.