We are currently investigating a fault with our back-end virtual-systems. This may affect multiple services and our engineers are investigating urgently to resolve the issue as soon as possible. We apologise for inconvenience this will be causing customers and we will update you as soon as more information is available.

Update 21:25: An on-site engineer in London has been authorised to manually restart one of the machines in our virtualised server cluster which will be done within the next few minutes to restore capacity to our network. We are currently aware of two potential issues with our mail file servers (3 & 7) and these will be addressed as soon as possible.

Update 22:20: We are currently experiencing an extended outage of one of the servers in our virtual infrastructure cluster.  The majority of services are functioning correctly.  However, we are aware that the following services are experiencing issues:

One of one load-balanced POP3 servers is currently offline which may result in intermittent POP3 collection problems.
Our back-end mail storage server, v-mail-file-3 is offline.  This will result in an outage for customers with mailboxes on this platform.  Mail will continue to be held on our inbound mail queues, however delivery will be delayed and this will result in errors collecting mail.  We apologise for this inconvenience and assure all customers that we are working with our engineers to ensure the service are restored as soon as possible.
Our UK SSL site is currently offline, again, we are working to restore this as soon as possible.

Update 22:50: We have raised an urgent support request with VMware and one of their engineers is now working to restore service.  When this is completed we will work with VMware to establish why the automatic resilience measures did not maintain a running service.

Update 23:10: We have now restored the majority of services, including uk-ssl.com. We are currently waiting for a full disk check to complete on v-mail-file-3 and are performing a maintenance restart on v-mail-file-7 which we expect to interrupt service only briefly.

Update 00:00: The disk checks on the 2 file servers have now completed and we believe all services are back to normal.

Related Posts

• No Related Post