News
Jun
30
[IP Voice Services] Service Alert 30th June 2014
Posted by David Croft on 30 June 2014 06:19 PM
This is an incident notification regarding IP Voice Services.

Date: Monday, 30th June 2014
Start time: 18:00 BST (UTC+0100)

Services affected:

IP Voice Services routing to/from PSTN.

Report:

The engineering team is currently investigating an issue affecting all
off-net call routing.

On net calls remain unaffected.

This matter has been escalated to our supplier. Further details will
be supplied as they become available.

The next update will be issued in 30 minutes.

Comtec NOC is tracking this issue under ticket [#OEE-382-69090].

Best regards,

David Croft
Read more »



Jun
28
[Cloud Ethernet/ADSL/FTTC] Maintenance window 12th/13th July 2014
Posted by David Croft on 28 June 2014 09:46 AM
Please be advised of the following maintenance window scheduled by BT
on the 20C and 21C networks:

Date: Saturday, 12th July 2014
Start time: 22:00 BST (UTC+0100)
End time: 11:30 BST Sunday (UTC+0100)

Purpose:

BT have advised us that they will be performing maintenance on the
systems supporting their 20C and 21C networks.

Services affected:

Cloud Ethernet (All variants).
ADSL/FTTC (All BT variants).

Impact:

Low.

The 20C and 21C networks will continue to operate as normal, however
the back-end systems supporting them will be out of service for
upgrades.

This includes provisioning but most importantly assurance
functionality. It will not be possible to perform diagnostics during
this window, nor will it be possible to raise faults or schedule
repair.

We are advised that this work will not affect the operation of the
networks themselves, however in the event that an unrelated problem
arises, we will be unable to troubleshoot or raise a fault until the
maintenance is concluded. SLAs during this window are therefore
suspended.

Comtec NOC is tracking this issue under ticket [#GFB-891-27828].

Regards,

David Croft
Read more »



Jun
27
[Core Network] Maintenance window 13th July 2014
Posted by David Croft on 27 June 2014 10:51 PM
Please be advised of the following maintenance window scheduled on our network:

Date: Sunday, 13th July 2014
Start time: 10:00 BST (UTC+0100)
End time: 14:00 BST (UTC+0100)

Purpose:

We will be performing software upgrades on our distribution switches at Reigate.

Services affected:

All services hosted in Comtec House, Reigate (LSREI01).

Impact:

Low.

The redundant pair of distribution switches will be upgraded one at a
time. Customers who have connected to both distribution switches per
our recommendations will observe no operational impact as they will
fail over to the redundant switch while the other is being upgraded.

Customers who are single-homed to our network will observe a period of
downtime of 5-15 minutes during this window. In the event that
roll-back is required, there will be a further interruption while the
original software is restored.

No outage is anticipated due to the resilient nature of our network
and transport out of Reigate, however services are "at-risk" during
this window. IP voice services will be unaffected.

Comtec NOC is tracking this issue under ticket [#GZO-670-71256].

Regards,

David Croft
Read more »



Jun
10
[ADSL/FTTC] Service Alert 9th June 2014 - Update 5
Posted by David Croft on 10 June 2014 12:50 PM
This is an incident notification regarding ADSL/FTTC services.

Date: Monday, 9th June 2014
Start time: 11:00 BST (UTC+0100)
End time: 11:44 BST (Workaround applied)
End time: 10 June 12:22 BST (Resilience restored)

Services affected:

ADSL/FTTC customers, excluding Cloud Ethernet FTTC.

Report:

We experienced an issued that caused all ADSL/FTTC customers to
disconnect and be unable to reconnect. We determined that this issue
was not caused by our network and escalated this matter with our
supplier.

At that time we put into place a workaround allowing customers to
reconnect using a backup route.

Our supplier has determined that the root cause was a bug in Brocade
software causing an invalid configuration to be applied to a core
network router. This issue was resolved in conjunction with Brocade
TAC.

The primary path has therefore been tested and put back into service.
At this time, all services are operating normally with full
resilience.

This is the final update.

Comtec NOC was tracking this issue under ticket [#ROI-515-53554].

Best regards,

David Croft
Read more »



Jun
9
[ADSL/FTTC] Service Alert 9th June 2014 - Update 4
Posted by David Croft on 09 June 2014 02:11 PM
This is an incident notification regarding ADSL/FTTC services.

Date: Monday, 9th June 2014
Start time: 11:00 BST (UTC+0100)

Services affected:

ADSL/FTTC customers, excluding Cloud Ethernet FTTC.

Report:

We experienced an issued that caused all ADSL/FTTC customers to
disconnect and be unable to reconnect. We determined that this issue
was not caused by our network and escalated this matter with our
supplier.

Update: Our supplier has determined that the root cause is a bug in
one of their core routers. They have raised this issue with Brocade
TAC.

We have a workaround in place and have migrated all customers to a
backup link. All customers should be connected and if you are
experiencing any issues, please contact the NOC.

At this time all services are operating normally, albeit with reduced
resilience. The next update will therefore be issued as more
information becomes available.

Comtec NOC is tracking this issue under ticket [#ROI-515-53554].

Best regards,

David Croft
Read more »



Jun
9
[ADSL/FTTC] Service Alert 9th June 2014 - Update 3
Posted by David Croft on 09 June 2014 01:08 PM
This is an incident notification regarding ADSL/FTTC services.

Date: Monday, 9th June 2014
Start time: 11:00 BST (UTC+0100)

Services affected:

ADSL/FTTC customers, excluding Cloud Ethernet FTTC.

Report:

We are aware of an issue on the BT network that has caused all
ADSL/FTTC customers to disconnect and be unable to reconnect.

We have determined that this issue is not caused by our network and
have escalated this matter with our supplier.

Update: At the moment they are investigating a particular network link
that appears to be the root cause. We have put in a temporary
workaround to allow customers to reconnect while we troubleshoot the
root cause with our supplier.

The next update will be issued in 1 hour.

Comtec NOC is tracking this issue under ticket [#ROI-515-53554].

Best regards,

David Croft
Read more »