Top Navigation

Archive | Notices

RackSpace DFW Switching Loop

Many cloud and dedicated servers in the RackSpace DFW datacenter have been offline for the last hour due to a switching loop. Official statement from RackSpace is:

Switching Loop in DFW1

On 26 May 2016, at 21:26 CDT, engineers were alerted to a switching loop occurring in the DFW1 data center. Engineers are engaged and working to resolve the issue. During this time, Customers may be unable to access their Cloud instances hosted within the DFW1 data center. If you have any further questions, please reach out to a member of your support team.

Posted on May 26, 2016 at 9:05 PM

We are closely monitoring this situation and will update as more information becomes available.

11:53PM EST UPDATE

New statement from RackSpace:

Switching Loop in DFW1

Engineers continue to work with DCOPS in isolating the switching loop occurring in RackConnect within the DFW region. Engineers have begun to remove interfaces to help alleviate impact to customers and help in isolating the switching loop. During this time, customers may be unable to access their Cloud instances hosted within the DFW1 region, Cloud DNS records pointed to DFW may give errors, and may be unable to reach parts of the dedicated environment through RackConnect, If you have any further questions, please reach out to a member of your support team.

Posted on May 26, 2016 at 9:51 PM

Some affected servers have come back online but we’re still seeing a many offline.

12:41AM EST UPDATE

New statement from RackSpace:

Switching Loop in DFW1

On 26 May 2016, from 21:26 to 23:00 CDT, engineers worked to resolve a switching loop with RackConnect within the DFW region. The interface that the loop was occurring within has been isolated, and other interfaces are being tested for confirmation of resolution. During this time, impact has been mitigated, however, services may experience latency or loss of connection intermittently during testing. If you have any further questions, please reach out to a member of your support team.

Posted on May 26, 2016 at 10:21 PM

4:20AM EST UPDATE

Switching Loop in DFW1

From 27 May 2016, at 21:26 to 00:34 CDT, engineers worked to resolve a switching loop issue occurring withing the DFW1 region. Engineers identified the loop occurring within RackConnect and disconnected RackConnect interfaces to isolate the loop and restore stability to the network. Interfaces and port channels were brought back online slowly to maintain network stability. The final port channel was restored at 00:34 CDT. Many services have been restored at this point. During the time of impact, customers may have experienced 400 errors when managing PTR records for Cloud DNS. Customers configured through RackConnect connections may have experienced downtime as the interfaces were brought back online.

Cloud Block Storage customers and other bootable volume services may be currently in a read-only state, engineers continue to work towards resolving these issues.

If you have any further questions or concerns, please reach out to a member of your support team.
Posted on May 27, 2016 at 12:05 AM

 

04-19-2015 – RackSpace DFW Maint

Many cloud and dedicated accounts are receiving notices like the one shown below. We expect little to no impact from this maintenance.

— START —

Hello,

Rackspace has prepared the following summary for this scheduled maintenance window.

Data Center:
DFW2
Time Window:
April 19th, 2015
00:01 – 06:00 CDT

Maintenance events:
On April 19th, 2015, from 00:01 – 06:00 CDT, Rackspace will upgrade the operating system on an aggregation router providing service to a network switch in your cabinet.

During this time, you may lose network connectivity. Once the switch has been upgraded, all connectivity will be restored. We have taken precautions in preparation for this maintenance and anticipate only a few brief disruptions during the 6 hour window.

The following devices will be impacted:
Instance ID
……

We apologize for any inconvenience. These changes are necessary to help Rackspace continue to deliver optimal performance and reliability for your hosting environment. If you have any questions, please contact your support team.

Regards,
Rackspace

— END —