News
|
Nov 19 |
[Core Network] Service Alert 19th November 2014 - Update 1
Posted by David Croft on 19 November 2014 10:45 PM |
|
This is an incident notification regarding Internet connectivity. Date: Wednesday, 19th November 2014 Start time: 14:50 GMT End time: 22:00 GMT Services affected: Internet access. Summary: The LONAP peering exchange experienced issues which had a knock-on effect on Internet connectivity across UK ISPs. We resolved the issue at the time by disabling our connections to LONAP, and have now restored them. Report: Due to an instability on the LONAP peering exchange causing packet loss and dropped sessions, we shut down our connections in order to reduce the impact to our customers. Traffic was routed via resilient alternate peering and transit routes and no further packet loss occurred. At 15:35 we were informed by LONAP that the issue was a result of high CPU across all switches caused by a large volume of multicast traffic from a reseller member port. The port was shut down and continues to be shut down until the member has demonstrated that they have resolved their issue. LONAP is continuing to investigate why port-security did not automatically shut down the affected port, however the exchange has been stable since that time. As it is our policy not to make non-emergency engineering changes during working hours, we did not re-establish our connections until 22:00 GMT. We are observing no continuing problems, although we will continue to monitor carefully. This is the final update. Comtec NOC was tracking this issue under ticket [#OTX-874-67976]. Regards, David Croft | |
Comments (0)