EXN Status Page
All Systems Operational
Client Portal ? Operational
Shared Hosting ? Operational
DC Connect ? Operational
IP Transit Services ? Operational
Leased Lines Operational
Virtual Data Centre (vDC) - Global Switch 2 ? Operational
Virtual Data Centre (vDC) - Virtus Enfield ? Operational
Datacentres Operational
Global Switch 2 Operational
Reading Operational
Telecity Meridian Gate Operational
Virtus Enfield Operational
Virtus Hayes Operational
Volta GSS Operational
Telehouse North Operational
Telehouse East Operational
Virtus Slough Operational
Equinix LD8 Operational
Operational
Degraded Performance
Partial Outage
Major Outage
Maintenance
Scheduled Maintenance
As advised by Cisco TAC, EX Networks will be performing a software upgrade on the core router located in Equinix LD8 – toucan.ld8.exn.uk. We will be upgrading the version of IOS-XR which will introduce several bug fixes to ensure service stability as well as a number of new features.

Due to the nature of this upgrade, the router and line cards will need to be reloaded. This will cause an outage for directly connected clients, and BGP sessions both with clients and upstream Tier-1 partners as well as peering exchanges.

At EXN we designed our network with maintenance and outages in mind, and as such upstream connections and linknets between data centres will be gracefully failed over before the reload. This means only directly connected clients and client BGP sessions will be “DOWN” during the reload. Other services should be considered “AT RISK” during this work.

As these routers have several line cards and FPGA’s there will be several reloads of individual components. Therefore, all client facing ports will be shutdown and EXN engineers will confirm the stability of the device before bringing the ports back up.

Over the next few days the affected clients will be contacted individually by EXN.

Location: Equinix LD8
Start: 09/03/2019 – 00:00 (UTC +0)
End: 09/03/2019 – 06:00 (UTC +0)
Affected Services: Connectivity Services
Reason: Software Update
Classification: Service Affecting (Directly Connected Clients) / At Risk
Rollback plan: Revert to previous version of IOS-XR

Please don’t hesitate to contact us through the usual channels should you have any questions regarding this maintenance.
Posted on Feb 18, 11:22 GMT
As advised by Cisco TAC, EX Networks will be performing a software upgrade on the core router located in Telehouse East – runner.the.exn.uk. We will be upgrading the version of IOS-XR which will introduce several bug fixes to ensure service stability as well as a number of new features.

Due to the nature of this upgrade, the router and line cards will need to be reloaded. This will cause an outage for directly connected clients, and BGP sessions both with clients and upstream Tier-1 partners as well as peering exchanges.

At EXN we designed our network with maintenance and outages in mind, and as such upstream connections and linknets between data centres will be gracefully failed over before the reload. This means only directly connected clients and client BGP sessions will be “DOWN” during the reload. Other services should be considered “AT RISK” during this work.

As these routers have several line cards and FPGA’s there will be several reloads of individual components. Therefore, all client facing ports will be shutdown and EXN engineers will confirm the stability of the device before bringing the ports back up.

Over the next few days the affected clients will be contacted individually by EXN.

Location: Telehouse East
Start: 16/03/2019 – 00:00 (UTC +0)
End: 16/03/2019 – 06:00 (UTC +0)
Affected Services: Connectivity Services
Reason: Software Update
Classification: Service Affecting (Directly Connected Clients) / At Risk
Rollback plan: Revert to previous version of IOS-XR

Please don’t hesitate to contact us through the usual channels should you have any questions regarding this maintenance.
Posted on Feb 18, 11:23 GMT
As advised by Cisco TAC, EX Networks will be performing a software upgrade on the core router located in Telehouse North – zephyr.thn.exn.uk. We will be upgrading the version of IOS-XR which will introduce several bug fixes to ensure service stability as well as a number of new features.

Due to the nature of this upgrade, the router and line cards will need to be reloaded. This will cause an outage for directly connected clients, and BGP sessions both with clients and upstream Tier-1 partners as well as peering exchanges.

At EXN we designed our network with maintenance and outages in mind, and as such upstream connections and linknets between data centres will be gracefully failed over before the reload. This means only directly connected clients and client BGP sessions will be “DOWN” during the reload. Other services should be considered “AT RISK” during this work.

As these routers have several line cards and FPGA’s there will be several reloads of individual components. Therefore, all client facing ports will be shutdown and EXN engineers will confirm the stability of the device before bringing the ports back up.

Over the next few days the affected clients will be contacted individually by EXN.

Location: Telehouse North
Start: 23/03/2019 – 00:00 (UTC +0)
End: 23/03/2019 – 06:00 (UTC +0)
Affected Services: Connectivity Services
Reason: Software Update
Classification: Service Affecting (Directly Connected Clients) / At Risk
Rollback plan: Revert to previous version of IOS-XR

Please don’t hesitate to contact us through the usual channels should you have any questions regarding this maintenance.
Posted on Feb 18, 11:23 GMT
Past Incidents
Feb 20, 2019

No incidents reported today.

Feb 19, 2019

No incidents reported.

Feb 18, 2019

No incidents reported.

Feb 17, 2019

No incidents reported.

Feb 16, 2019
Resolved - After a period of stability, we have put this link back into service. This incident has now been resolved and full redundancy has been restored.
Feb 16, 11:04 GMT
Monitoring - The fibre has been repaired and connectivity has been restored.

We will be keeping traffic away from the link for the moment to ensure the link is stable and free of errors before bringing it back into full service.

All systems remain stable however the site should be considered "AT RISK" during this time.

EXN have also implemented a change freeze on devices in Enfield and Telehouse East to avoid any potential disruption to the working leg.
Feb 15, 21:10 GMT
Update - Our fibre provider has stated:

"Current Update: Crews are onsite splicing at this time. We are starting to see services restore at this time. ETR is 30 minutes."

All systems remain stable however the site should be considered "AT RISK" during this time.

EXN have also implemented a change freeze on devices in Enfield and Telehouse East to avoid any potential disruption to the working leg.
Feb 15, 19:11 GMT
Update - Our fibre provider has stated:

"Current Update: Our engineers are continuing to work to reroute services away from the damaged fibre. We are in regular contact with our field engineers and advise we are nearing a resolution. We sincerely apologise for the delay in resolving this incident and hope to bring your service back up soon."

All systems remain stable however the site should be considered "AT RISK" during this time.

EXN have also implemented a change freeze on devices in Enfield and Telehouse East to avoid any potential disruption to the working leg.
Feb 15, 17:22 GMT
Update - Our fibre provider has stated:

"Current Update: Technicians have located the break. The location of the fibre break is a construction site in the London Olympic park area. Our 3rd party provider engineers are testing fibres either side of the next available joints."

All systems remain stable however the site should be considered "AT RISK" during this time.

EXN have also implemented a change freeze on devices in Enfield and Telehouse East to avoid any potential disruption to the working leg.
Feb 15, 15:50 GMT
Update - Our fibre provider has stated:

"OSP has now confirmed their 2nd Crew of engineers are at the break location investigating. It is believed fiber damage has been caused by contractors/engineering work. OSP is also exploring reroute options. Thank you for your patience. More updates will be provided as they become available"

All systems remain stable however the site should be considered "AT RISK" during this time.

EXN have also implemented a change freeze on devices in Enfield and Telehouse East to avoid any potential disruption to the working leg.
Feb 15, 11:18 GMT
Update - Our fibre provider has stated:

"Fiber test crews have provided and ETA of 10:00am GMT. We will provide more updates as they are provided."

All systems remain stable however the site should be considered "AT RISK" during this time.

EXN have also implemented a change freeze on devices in Enfield and Telehouse East to avoid any potential disruption to the working leg.
Feb 15, 09:04 GMT
Update - Our fibre provider has stated:

"OSP are having trouble locating the damage. They are still working to narrow the exact joint where the damage is located. We have escalated to their management team to try to get further progress. We have also notified our management team of the delays in locating the break. OSP continue to work towards fault isolation at this time and we will continue to press for updates and progress. More updates to follow as events unfold."

All systems remain stable however the site should be considered "AT RISK" during this time.
Feb 15, 05:42 GMT
Identified - Our fibre provider has stated:

"We have located a fibre fault 9 KM from Telehouse. Crews have been dispatched for the repair."

All systems remain stable however the site should be considered "AT RISK" during this time.
Feb 14, 23:01 GMT
Update - Our fibre provider has stated:

"Current Update: We have dispatched technicians to test and locate the fibre damage. We have just received word that access has been approved and we are now waiting for technicians to arrive onsite."

All systems remain stable however the site should be considered "AT RISK" during this time.
Feb 14, 21:45 GMT
Update - Our fibre provider has stated:

"We have reached out to our technicians and they are working on getting technicians dispatched. We have multiple circuits down in the area and are trying to verify a fibre cut."

All systems remain stable however the site should be considered "AT RISK" during this time.
Feb 14, 19:22 GMT
Update - We are continuing to investigate this issue.
Feb 14, 19:21 GMT
Update - Our fibre provider is investigating the issue. Next update in approx 1 hour. All systems remain stable however the site should be considered "AT RISK" during this time.
Feb 14, 18:19 GMT
Update - Our fibre provider is currently investigating the issue. All systems remain stable however the site should be considered "AT RISK" during this time.
Feb 14, 16:29 GMT
Investigating - At 16:01 today EXN lost connectivity between Telehouse North and Virtus Enfield. All services have failed over to link between Telehouse East and Virtus Enfield.

At this stage the Virtus Enfield should be considered "AT RISK".
Feb 14, 16:07 GMT
Feb 13, 2019

No incidents reported.

Feb 12, 2019

No incidents reported.

Feb 11, 2019

No incidents reported.

Feb 10, 2019

No incidents reported.

Feb 9, 2019

No incidents reported.

Feb 8, 2019

No incidents reported.

Feb 7, 2019

No incidents reported.

Feb 6, 2019

No incidents reported.