You are here

Bugaboo

Bugaboo System Status

Post date System Status: Update Notes
2015-11-22 - 13:06 PST Online

Bugaboo down due to data centre power failure

Update, Nov. 22, 13:00

The Bugaboo facility is available again. We do not expect any filesystem corruption. Nevertheless, please check whether your files look ok.

Update, Nov. 20, 18:00

The file system check is proceeding so slowly, that there is little hope that the system will come back up this weekend. We apologize. This is exceedingly frustrating for everybody involved.

Update, Nov. 18, 22:15

After the disk rebuild finished around noon today file system errors were detected that need to be repaired first. This file system check is running now and is not expected to finish today. We hope that we will be able to make the system available tomorrow (Nov. 19).

Update, Nov. 17, 23:45

The Bugaboo system is expected to become available again sometime tomorrow (Nov. 18) assuming that we will be able to bring up the filesystems after the disk rebuild has been completed. And assuming that the storm that currently moves through the Vancouver area does not cause a power outage in the data centre.

Update, Nov. 16, 13:45

Due to the power failure there are many disks in the storage system that need to be rebuilt. While the disks are rebuilt the system is in a critical state. We have been advised that it is not recommended to make the system available at this time, but let the rebuilds finish first. For that reason the Bugaboo system will not be available today. There is a slight chance that the rebuilds will finish tomorrow (Nov. 17).

Update, Nov. 15.

Power was restored today. However, we are experiencing disk issues related to bugaboo Lustre filesystems. Vendor is investigating the problem. The system will be down until further notice. Sorry for the inconvenience.

2015-11-20 - 18:07 PST Offline

Bugaboo down due to data centre power failure

Update, Nov. 20, 18:00

The file system check is proceeding so slowly, that there is little hope that the system will come back up this weekend. We apologize. This is exceedingly frustrating for everybody involved.

Update, Nov. 18, 22:15

After the disk rebuild finished around noon today file system errors were detected that need to be repaired first. This file system check is running now and is not expected to finish today. We hope that we will be able to make the system available tomorrow (Nov. 19).

Update, Nov. 17, 23:45

The Bugaboo system is expected to become available again sometime tomorrow (Nov. 18) assuming that we will be able to bring up the filesystems after the disk rebuild has been completed. And assuming that the storm that currently moves through the Vancouver area does not cause a power outage in the data centre.

Update, Nov. 16, 13:45

Due to the power failure there are many disks in the storage system that need to be rebuilt. While the disks are rebuilt the system is in a critical state. We have been advised that it is not recommended to make the system available at this time, but let the rebuilds finish first. For that reason the Bugaboo system will not be available today. There is a slight chance that the rebuilds will finish tomorrow (Nov. 17).

Update, Nov. 15.

Power was restored today. However, we are experiencing disk issues related to bugaboo Lustre filesystems. Vendor is investigating the problem. The system will be down until further notice. Sorry for the inconvenience.

2015-11-18 - 22:14 PST Offline

Bugaboo down due to data centre power failure

Update, Nov. 18, 22:15

After the disk rebuild finished around noon today file system errors were detected that need to be repaired first. This file system check is running now and is not expected to finish today. We hope that we will be able to make the system available tomorrow (Nov. 19).

Update, Nov. 17, 23:45

The Bugaboo system is expected to become available again sometime tomorrow (Nov. 18) assuming that we will be able to bring up the filesystems after the disk rebuild has been completed. And assuming that the storm that currently moves through the Vancouver area does not cause a power outage in the data centre.

Update, Nov. 16, 13:45

Due to the power failure there are many disks in the storage system that need to be rebuilt. While the disks are rebuilt the system is in a critical state. We have been advised that it is not recommended to make the system available at this time, but let the rebuilds finish first. For that reason the Bugaboo system will not be available today. There is a slight chance that the rebuilds will finish tomorrow (Nov. 17).

Update, Nov. 15.

Power was restored today. However, we are experiencing disk issues related to bugaboo Lustre filesystems. Vendor is investigating the problem. The system will be down until further notice. Sorry for the inconvenience.

2015-11-17 - 23:46 PST Offline

Bugaboo down due to data centre power failure

Update, Nov. 17, 23:45

The Bugaboo system is expected to become available again sometime tomorrow (Nov. 18) assuming that we will be able to bring up the filesystems after the disk rebuild has been completed. And assuming that the storm that currently moves through the Vancouver area does not cause a power outage in the data centre.

Update, Nov. 16, 13:45

Due to the power failure there are many disks in the storage system that need to be rebuilt. While the disks are rebuilt the system is in a critical state. We have been advised that it is not recommended to make the system available at this time, but let the rebuilds finish first. For that reason the Bugaboo system will not be available today. There is a slight chance that the rebuilds will finish tomorrow (Nov. 17).

Update, Nov. 15.

Power was restored today. However, we are experiencing disk issues related to bugaboo Lustre filesystems. Vendor is investigating the problem. The system will be down until further notice. Sorry for the inconvenience.

2015-11-16 - 13:45 PST Offline

Bugaboo down due to data centre power failure

Update, Nov. 16, 13:45

Due to the power failure there are many disks in the storage system that need to be rebuilt. While the disks are rebuilt the system is in a critical state. We have been advised that it is not recommended to make the system available at this time, but let the rebuilds finish first. For that reason the Bugaboo system will not be available today. There is a slight chance that the rebuilds will finish tomorrow (Nov. 17).

Update, Nov. 15.

Power was restored today. However, we are experiencing disk issues related to bugaboo Lustre filesystems. Vendor is investigating the problem. The system will be down until further notice. Sorry for the inconvenience.

2015-11-15 - 17:58 PST Offline

Bugaboo down due to data centre power failure

Power was restored today. However, we are experiencing disk issues related to bugaboo Lustre filesystems. Vendor is investigating the problem. The system will be down until further notice. Sorry for the inconvenience.

2015-11-15 - 01:36 PST Offline

Bugaboo down due to data centre power failure

After the scheduled electrical system maintenance in the data centre at SFU on Saturday, November 14, there was an unscheduled power outage. WestGrid services hosted at SFU will be unavailable until the cause of the electrical failure has been determined and the problem fixed. Systems affected include the Bugaboo cluster and portal.westgrid.ca .  This notice will be updated when more information becomes available.  Sorry for the inconvenience.

Pages