Link MAD1 - ZUR1 **Updated**

Type

Outage

Timeframe

29.10.2024 18:11 UTC - 14.11.2024 12:10 UTC
29.10.2024 19:11 CET - 14.11.2024 13:10 CET

CaseID:

5419

Description

Aktuell kommt es zu Störungen auf den folgenden Links:

Madrid1 (Interxion MAD1) - Zürich1 (Interxion ZRH1)

Es wurde bereits ein Ticket beim Leitungsanbieter eröffnet.

Aufgrund des redundanten Netzaufbaus kommt es zu keinen Ausfällen.

Eine genaue Dauer des Problems ist noch nicht bekannt.

Sollten Sie Fragen haben, kontaktieren Sie unser Operations Center unter operations@core-backbone.com

======================​======================​======================


We are currently seeing an Outage on the following Links:

Madrid1 (Interxion MAD1) - Zurich1 (Interxion ZRH1)

A ticket with the third-party supplier has already been opened.

Due to the redundant network structure, there is no outage.

An ETR is not available yet.

If you have any questions, please contact our operations center at operations@core-backbone.com
Update 14.11.2024 12:10 UTC/14.11.2024 13:10 CET
Das Problem wurde behoben.

================================================================

The problem has been solved.
Update 13.11.2024 06:55 UTC/13.11.2024 07:55 CET
The equipment has now arrived. Teams are onsite and prepared to work 24/7 to get it all installed, commissioned and turned up. We expect services to restore over the next 48 hours.
Update 12.11.2024 09:07 UTC/12.11.2024 10:07 CET
Requisite equipment has gained custom clearance and will be delivered via DHL, today morning during start of business hours. Respective engineers who stayed in the local hotel around the site last night, will be receiving the shipment.
Update 11.11.2024 07:38 UTC/11.11.2024 08:38 CET
Cleaning has been completed, and a dehumidifier has been installed to address a humidity issue; it will remain active over the weekend. The equipment shipment is still awaiting customs inspection and release, with DHL prepared to provide same-day transport directly from Madrid to Valencia as soon as clearance is granted.
Update 07.11.2024 11:11 UTC/07.11.2024 12:11 CET
Chassis removal is complete, and cleaning is in progress. The site is prepared for spare installation, expected to arrive in Valencia and ready for transport to site by 8/11/2024. The secure 5m pedestrian walkway has also been delivered and installed.
Update 06.11.2024 10:38 UTC/06.11.2024 11:38 CET
The restoration work is continuing in and around Valencia POP due to severity of flood damage. Site clean up is expected to be completed by tomorrow. Outside plant fibres are all now fixed and removal of damaged equipment has started. Power is also now online via a portable generator. Once site clean up is concluded and damaged equipment removed, field team will begin installing spare equipment and restoring services. Due to the nature of this work and the extent of the damage no ETR is available.
Update 06.11.2024 07:29 UTC/06.11.2024 08:29 CET
The restoration work is continuing in and around the Valencia POP site due to the severity of the flood damage. This includes clearing and cleaning of the transmission room, restoring outside plant fibre, infrastructure and then Isolating and securing damaged power cables. At present, the ETR (Estimated Time to Restore) is not available. Portable generator is now on site.
Update 05.11.2024 07:41 UTC/05.11.2024 08:41 CET
The restoration work is continuing in and around the Valencia POP site due to the severity of the flood damage. This includes clearing and cleaning of the transmission room, restoring outside plant fiber, infrastructure and then Isolating and securing damaged power cables. At present, the ETR (Estimated Time to Restore) is not available.

The replacement of equipment has been built and at pre-stage, with shipping expected to be completed today. Delivery is expected in next 2-3 days. The local field team will then work with Technical Support on the installation of the new equipment.
Update 04.11.2024 11:57 UTC/04.11.2024 12:57 CET
Cleanup activities are ongoing at the site. A visual inspection has been completed, and no issues were identified. Civil engineers are planning a comprehensive site survey. A secure pedestrian pathway to the site is being established. Exposed power cables have been secured, and both a temporary and a large generator are being organized to restore power. The fiber teams are conducting optical measurements from the site or a nearby manhole to verify the fiber status towards Barcelona, as one cable appears to be the least damaged based on visual inspection. Spare equipment is being arranged to replace faulty components. The engineering team has completed the rebuild and pre-staging of all spare equipment, and the logistics team is working on delivering these to a nearby secure site.
Update 02.11.2024 09:03 UTC/02.11.2024 10:03 CET
The cleanup activity will continue through the weekend. Power equipment tests confirm no damage. Commercial power is expected to be offline for a week; a generator and secure site access are being arranged. Fiber testing and new equipment assembly will progress over the weekend, with shipment timelines anticipated by Monday 04/11/2024.
Update 01.11.2024 19:41 UTC/01.11.2024 20:41 CET
Cleanup continues and will proceed through the weekend. Power equipment tests confirm no damage. Commercial power is expected to be offline for a week; a generator and secure site access are being arranged, aiming for Monday setup. Fibre testing and new equipment assembly will progress over the weekend, with shipment timelines anticipated by Monday.
Update 01.11.2024 12:46 UTC/01.11.2024 13:46 CET
Contractors have accessed the site, but due to significant water and mud inside the building, the cleanup is estimated to take 2-3 days. A large hole at the front of the building has prompted a request for the regional Health and Safety officer to ensure compliance before any power work or equipment shipment can proceed. Meanwhile, logistics are dispatching parts to begin assembling the replacement equipment.
Update 31.10.2024 19:44 UTC/31.10.2024 20:44 CET
Local team coordinates with authorities to verify site safety and security for dispatching technicians. Due to road closures and blocks in place by local authorities, it has taken a great deal of time for engineers to arrive in Valencia (from Madrid). Due to there being no power in the area engineers will be attending tomorrow during day lights hours.
Update 31.10.2024 10:28 UTC/31.10.2024 11:28 CET
The local team coordinates with local authorities to verify site safety and security for dispatching technicians. They are also confirming if roads are clear and accessible for travel to the location. Further updates will follow based on their assessment.
Update 31.10.2024 07:32 UTC/31.10.2024 08:32 CET
Fault site in Valencia remains heavily flooded, with water levels preventing safe access. Given current conditions, access is expected to be unlikely before business hours on 31/10/2024. Further updates will be provided as the situation develops.
Update 30.10.2024 17:17 UTC/30.10.2024 18:17 CET
The latest report confirms that the area remains isolated due to the collapse of two rivers and a destroyed bridge, which has severely impacted access routes. Emergency services are on-site and are prioritizing rescue and evacuation operations to ensure the safety of those affected. Further updates will be provided as the situation develops.
Update 30.10.2024 12:15 UTC/30.10.2024 13:15 CET
Severe flooding from Storm Dana has rendered our Valencia site inaccessible, with the local highway partially collapsed. Heavy machinery is on-site for clearance.
Potential spare parts in case of water damage are identified, but specifics remain unclear until access is granted.
Update 30.10.2024 09:10 UTC/30.10.2024 10:10 CET
The local team has confirmed that industrial area of Los Olivares in Valencia is totally flooded and cannot be accessed. The teams have to wait for water level to go down and teams are on continuously monitoring the situation and ready to go to site as soon situation improves during the course of the day.
Update 29.10.2024 22:44 UTC/29.10.2024 23:44 CET
There is a suspected power outage or equipment failure in Valencia, Spain. The engineer is not having access to the site due to extreme weather conditions. The police have closed off roads due to rising water levels. The country is under a severe weather alert for Storm Dana, which is bringing torrential rain to the south and east.