All posts by Derek Calderon

All Services Online, 8/1/2018 8:40 AM

This maintenance has been completed and all services have been restored. If you notice any problems, please try rebooting the affected machines, and then email if the issue continues after rebooting.

Our new UPS (battery backup) system is also online and working as expected (which was the purpose of this maintenance).

Scheduled Maintenance: Most IRIS Services Offline, 7/31 11PM – 8/1 9AM

Power will be shut down to our primary server room in order to complete tests of and apply load to our new UPS backup system. Most services including file storage will be offline from 11PM Tues. 7/31 to 9AM Wed. 8/1.

  • Network infrastructure including wired and wireless networks and DHCP/DNS services will remain online (except in 290 Soda).
  • LDAP and Active Directory authentication services will remain online.
  • The IRIS website and portions of the department website including personal homepages, as well as other IRIS services that depend on file storage, will be shut down starting at 11PM Tues. 7/31.
  • Storage services, including home and project file storage, will be shut down at 12 AM Wed. 8/1.
  • All services are scheduled to be restored by 9AM Wed. 8/1, but may be online earlier if maintenance is completed ahead of schedule.

As the IRIS website will be unavailable during this maintenance, will be available for in-the-moment status updates.

Please contact with any questions or concerns.

IT and Electrical Maintenance Shutdown, Fri. 6/15 11PM – Sat. 6/16 9PM

On Saturday, June 16th, the campus high voltage team will be cutting power to Soda, Jacobs, Etcheverry, and North Gate Halls to complete critical power grid maintenance. The electrical shutdown is currently scheduled for 8AM to 1PM and these buildings will be closed during this time to all but critical staff related to the maintenance projects.

We are also taking this time to perform safety tests in our server and network rooms, as well as replacing the failed battery backup system in our primary server room. As a result, the outage window for most IT services (other than basic network connectivity) is 11PM 6/15 – 9PM 6/16.

Anybody with computers and electronics in Soda and Jacobs is STRONGLY RECOMMENDED to power off their noncritical systems when leaving the office on Friday, June 15. Critical systems MUST be powered off by 6AM on Saturday the 16th. This includes machines hosted in the 340 Soda server room, and a separate message will be sent to those system administrators next week.

As most of EECS’ IT infrastructure is hosted in Soda Hall, this will have some impacts which are detailed below. This will affect all EECS locations which are not undergoing electrical maintenance: Cory, Sutardja Dai and Blum Halls, the Calvin Lab, and BWRC as well as remote users.

  • Network infrastructure (wired and wireless connections, including DHCP and DNS services) will be offline for a brief period between 6:00 and 6:30 AM in order to perform annual Emergency Power Off and Fire Alarm tests in our network core. Basic networking will be restored by 6:30 and should remain up for the remainder of the day for all locations outside of Soda and Jacobs Hall.
  • The IRIS website and portions of the department website including personal homepages, as well as other IRIS services that depend on file storage, will be shut down starting at 11PM Fri. 6/15
  • Storage services, including home and project file storage, will be shut down at 12 AM Sat. 6/16
  • All services are scheduled to be restored by 9PM, but may be online earlier if maintenance is completed ahead of schedule.

As the IRIS website will be unavailable during this maintenance, will be available for in-the-moment status updates.

Please contact with any questions or concerns.

EECS Network Border Malfunctioning, 2/15/18

We are currently experiencing an issue at the EECS network border which is causing intermittent outages. The connection affected is between EECS and the outside world.

This means that communication within the EECS network should be unaffected, and connectivity to campus or the Internet is intermittently unavailable.

Impact to the research computing cluster in Soda Hall is currently undetermined.

Network staff are coming onsite to better diagnose the issue, and an update will be posted here when we have more detail or an ETA.

Update 11:54 AM:

We are troubleshooting an issue where OSPF control traffic is intermittently dropped between our core and edge router, causing all data traffic to stop.

Traffic is affected between:

  • EECS network and campus/Internet
  • EECS network and Soda research compute network

Traffic is not affected:

  • within the EECS network
  • between Soda research compute and campus/Internet

Network Border Temporarily Disabled 2/15/18

Derek Calderon at 12:31 p.m. Feb 15, 2018

We are temporarily disabling network uplinks to the outside world in order to troubleshoot without impacting network security.

We need to determine whether the network firewall is implicated in this issue before engaging vendor support. In order to do this without making the network vulnerable from a security perspective, we must disable the links to campus and the Internet while this work is performed.

During this time no traffic will be able to enter or leave the department. We expect this will last for up to 30 minutes.

Soda Hall Power Shutdown, Wed. 11/29 2AM

Originally Published 1:09 p.m. Nov 22, 2017
Services Affected Wired Networking and Wireless Networking Begins 2:00 a.m. Nov 29, 2017

There will be a power shutdown for Soda Hall on the early morning of Wednesday, November 29th, scheduled for 2 to 6 AM. The shutdown and short notice are due to an urgent need for the campus high voltage team to complete repairs from line damage in June. It is also possible that the outage could be extended if difficult circumstances are encountered.

We have arranged with campus facilities to receive generator power for 288 and 290 Soda so that we can continue to provide IT services to the outside world while Soda is dark. As such, no interruptions to IRIS services outside Soda Hall are expected at this time. However, due to many electrical load variables it is possible that we may need to shut down some services without notice during the maintenance window.

Power to research server rooms 420A and 287 will be lost and the sysadmins of those rooms are coordinating a full system shutdown.

For sysadmins of machines in 340 Soda, you will also need to shut down your machines. We recommend doing so before midnight.

UPDATE: EECS Network and Service Outage 12/22/16

We ran into a number of difficulties on the electrical side which delayed restoration of services, but basic networking (wired and wireless) were brought back at approximately 12PM.

At this time we are experiencing some slowness in the LDAP system, and we have also encountered trouble in bringing the NetApp file servers online. As a result the department website and file storage, as well as other services which rely on them, are still offline.

EECS Full Network and Service Outage, Thurs. 12/22/16 7:30AM – 1:00PM

Published 2:43 p.m. Nov 01, 2016

Scheduled Maintenance

Services Affected: Active Directory, DHCP, DNS, FTP Server, Home Directory Storage, IRIS Website, Mailing Lists, Project Storage, Repo Service, Unix Login Server, Wiki Hosting, Windows Terminal Server, Wired Networking, and Wireless Networking

Begins 7:30 a.m. Dec 22, 2016

We will have a full system shutdown on Thursday, December 22nd at 7:30 AM to perform necessary fire and emergency power testing in our server rooms. The entire EECS network and all hosted resources will be offline during this maintenance.

This will affect networking in the following locations:

Wired and wireless networks offline:

  • Soda Hall
  • Cory Hall
  • Sutardja Dai Hall
  • Jacobs Hall
  • BWRC

Wireless networks offline, wired remains online:

  • Blum Hall
  • Calvin Lab

Hosted resources such as the EECS website, file servers, etc. will be offline and globally inaccessible.

The facilities maintenance window is scheduled from 7:30 AM to 1 PM, but we anticipate the network and critical services should be back by 11AM if all goes well.

The intent is to perform these tests annually going forward; however we will learn from this year’s procedure and aim to keep more critical services online in the future.

If you have any questions about this maintenance, please contact

Network Outage Resolved

As of about 9:45 PM, production services were externally available, and internal building networking came online during the next few hours. As of 1:30 AM we have restored service to all locations except a small handful, which currently include BWRC and Blum Hall. We will be making use of tomorrow’s scheduled contingency maintenance period to fully restore all services in all locations.