Core Router Software Upgrade – Telehouse North
Scheduled Maintenance Report for EX Networks
Completed
The line card has now been swapped and full redundancy has been restored to the network. Customers may have noticed minor packet loss during this time. If you are experiencing any issues, please get in touch via the usual channels. Thank you for your patience during this maintenance window.
Posted Mar 23, 2019 - 08:35 GMT
Update
The replacement card is now on site and engineers are working to install it.
Posted Mar 23, 2019 - 07:52 GMT
Update
The upgrade work on zephyr.thn has been completed and all services are back up and running. However during the reload of the router, an infrastructure facing line card failed. This failure may have resulted in some packet loss for a brief period of time for certain clients. EXN have raised this with Cisco TAC and we are expecting a replacement card to arrive at 07:46 this morning.

At this time, certain data centres will be classified as "AT RISK" until the card has been replaced. We expect to fully close this maintenance window at 09:00 this morning.

We will keep you update on the progress.
Posted Mar 23, 2019 - 06:02 GMT
In progress
Scheduled maintenance is currently in progress. We will provide updates as necessary.
Posted Mar 23, 2019 - 00:00 GMT
Scheduled
As advised by Cisco TAC, EX Networks will be performing a software upgrade on the core router located in Telehouse North – zephyr.thn.exn.uk. We will be upgrading the version of IOS-XR which will introduce several bug fixes to ensure service stability as well as a number of new features.

Due to the nature of this upgrade, the router and line cards will need to be reloaded. This will cause an outage for directly connected clients, and BGP sessions both with clients and upstream Tier-1 partners as well as peering exchanges.

At EXN we designed our network with maintenance and outages in mind, and as such upstream connections and linknets between data centres will be gracefully failed over before the reload. This means only directly connected clients and client BGP sessions will be “DOWN” during the reload. Other services should be considered “AT RISK” during this work.

As these routers have several line cards and FPGA’s there will be several reloads of individual components. Therefore, all client facing ports will be shutdown and EXN engineers will confirm the stability of the device before bringing the ports back up.

Over the next few days the affected clients will be contacted individually by EXN.

Location: Telehouse North
Start: 23/03/2019 – 00:00 (UTC +0)
End: 23/03/2019 – 06:00 (UTC +0)
Affected Services: Connectivity Services
Reason: Software Update
Classification: Service Affecting (Directly Connected Clients) / At Risk
Rollback plan: Revert to previous version of IOS-XR

Please don’t hesitate to contact us through the usual channels should you have any questions regarding this maintenance.
Posted Feb 18, 2019 - 11:23 GMT
This scheduled maintenance affected: DC Connect, IP Transit Services, Leased Lines and Datacentres (Telehouse North).