News
Apr
30
[QUAR] [Core Network] Maintenance window 6th May 2014
Posted by David Croft on 30 April 2014 01:12 PM
Please be advised of the following maintenance window scheduled on one
of our transit connections:

Date: Tuesday, 6th May 2014
Start time: 15:00 BST (UTC+0100)
End time: 18:00 GMT (UTC+0100)

Purpose:

We will be re-routing one of our circuits with one of our transit
providers in order to increase the level of physical resilience.

Services affected:

Internet access.

Impact:

Low.

We will bring the affected circuit out of service before the
maintenance begins, and traffic will be automatically shifted onto
redundant connections. The level of resilience will be reduced
slightly during the maintenance window, however we will still have
diverse links to multiple transit providers.

No outage is anticipated due to the resilient nature of our network
and transit connections, however services are "at-risk" during this
window. IP voice services will be unaffected.

Comtec NOC is tracking this issue under ticket [#NNI-221-78467].

Regards,

David Croft
Read more »



Apr
14
[Core Network] Service Alert 14th April 2014
Posted by David Croft on 14 April 2014 05:09 PM
This is an incident notification regarding a power event at site
LNPOP02 (Telecity HEX 6-7).

Date: Monday, 14th April 2014
Start time: 16:19 BST (UTC+0100)
End time: 16:22 BST (UTC+0100)

Services affected:

Power loss at LNPOP02 (Telecity HEX 6-7).

Report:

At 16:19 we lost power to our equipment at Telecity HEX 6-7. This was
restored immediately and all equipment had completed booting a few
minutes later by 16:22.

This would have affected customers single-homed out of this location.
Other sites were unaffected due to the resilient nature of our
network.

Although our equipment is protected by both UPS and generator backups,
upon investigation by the data centre it was determined that the cause
of this outage was human error by a Telecity engineer working on a
nearby cabinet not related to our own.

Comtec NOC is tracking this issue under ticket [#GML-273-50413].

Regards,

David Croft
Read more »



Mar
31
[Core Network] Maintenance window 13th April 2014
Posted by David Croft on 31 March 2014 05:10 PM
Please be advised of the following maintenance window scheduled by one
of our transit providers:

Date: Sunday, 13th April 2014
Start time: 00:01 BST (UTC+0100)
End time: 02:00 BST (UTC+0100)

Please note that this maintenance has been rescheduled from 15th April 2014.

Purpose:

One of our transit providers will be performing hardware upgrades in
order to prevent future interruptions to service.

Services affected:

Internet access.

Impact:

Low.

Routing to some Internet destinations will fail over to alternative
circuits during this window. No outage is anticipated due to the
resilient nature of our network and transit connections, however
services are "at-risk" during this window. IP voice services will be
unaffected.

Comtec NOC is tracking this issue under ticket [#YNR-112-64152].

Regards,

David Croft
Read more »



Mar
27
[Core Network] Maintenance window 15th April 2014
Posted by David Croft on 27 March 2014 02:04 AM
Please be advised of the following maintenance window scheduled by one
of our transit providers:

Date: Tuesday, 15th April 2014
Start time: 00:01 GMT
End time: 02:00 GMT

Purpose:

One of our transit providers will be performing hardware upgrades in
order to prevent future interruptions to service.

Services affected:

Internet access.

Impact:

Low.

Routing to some Internet destinations will fail over to alternative
circuits during this window. No outage is anticipated due to the
resilient nature of our network and transit connections, however
services are "at-risk" during this window. IP voice services will be
unaffected.

Comtec NOC is tracking this issue under ticket [#YNR-112-64152].

Regards,

David Croft
Read more »



Mar
20
This is an incident notification regarding IP Voice Services and
Hosted Contact Centre.

Date: Tuesday, 18th March 2014
Start time: 11:45 GMT
End time: 14:21 GMT

Services affected:

IP Voice Services
Hosted Contact Centre

Impact:

HIGH.

Report:

During this time there were issues with one-way audio on calls on both
the IPVS and HCC platforms. On-net calls were not affected.

A subset of calls to and from the PSTN via certain routes on the PSTN
Gateway experienced one way speech or no media between 11:45 and
14:12.

The issue with media failing to establish correctly on calls to/from
the PSTN via certain routes on the PSTN Gateway was caused by a change
to the PE routers by the 21CN Plan and Build team who had been asked
to do some preparatory work (to reserve ports for another service i.e.
not IP Exchange) ahead of a maintenance window.

This change was reverted at 14:12 and service was returned to normal.

The PSTN Gateway Team has the root cause under investigation to
understand why this preparatory work was designated as non-service
affecting.

Timeline:

11:45 Test calls failed on Manchester 04 SBC
11:50 1st customer report of OWT received
11:55 3rd line engaged
12:00 Test calls indicated more SBCs affected, vendor engaged
12:01 Initial service alert sent to customers
12:08 Technical bridge call set up
12:38 Service alert update sent to customers
12:55 21C network team join technical bridge
13:35 PE routers identified as causing the issue
13:40 Notification of incident received from the PSTN Gateway Team
14:05 Service alert update sent to customers
14:12 Service restored
14:53 Notification received from the PSTN Gateway Team that issue
was resolved and service had been restored to normal
15:07 Service alert all-clear sent to customers

Regards,

David Croft
Read more »



Mar
18
This is an incident notification regarding IP Voice Services and Hosted
Contact Centre.

Date: Tuesday, 18th March 2014
Start time: 11:45 GMT
End time: 14:21 GMT

Services affected:

IP Voice Services
Hosted Contact Centre

Impact:

HIGH.

Report:

During this time there were issues with one-way audio on calls on both
the IPVS and HCC platforms. On-net calls were not affected.

IP Exchange have informed us that the issue was caused during a preparatory
work for a planned upgrade on the BT 21CN core network. These changes have
since been rolled back and service is confirmed fully restored as of 14:21.

We will issue a further update if more information becomes available.

Regards,

David Croft
Read more »