Server maintenance

Over the coming week from Friday the 13th at 10pm Amsterdam timezone until Friday evening the 20th at 11:59pm we'll perform maintenance on multiple servers.

To increase the redundancy we'll configure all servers in a bonded network configuration, what this effectively means is we double the network capacity of each individual server, but also ensure that even if one of our switches were to have issues, the other one will simply handle the traffic automatically with failover in place.

We expect the downtime to be minimal for each server, however an outage of up to 15 minutes could be possible. In most cases the downtime will be less than 1 minute.

13/Jun/2025:

Update 9:58pm: We'll start with nlsh04 shortly

Update 10:08pm: nlsh04 completed. IPv4 had 26 seconds of downtime, and IPv6 had 5 minutes and 12 seconds of downtime.

Update 10:24pm: We'll proceed with nlcp01 shortly

Update 11:16pm: An attempt was made to change to bonding on nlcp01, however it resulted in no connectivity after the bonding got re-established despite the bonding itself came up as expected. Multiple things were tried to restore connectivity, until we then decided to roll back the configuration to the original config. This also means we'll halt the changes for all remaining systems today.

We'll try to replicate the issue in our test environment to see if we can reproduce the issue specifically related to this.

14/Jun/2025:

Update 01:02am: We managed to replicate the issue in our testing environment, specifically to specific cPanel configuration. A fix has been identified and implemented across all servers, and we will continue to perform the network change tomorrow evening.

Update 11:17pm: We'll start with nlcp02 shortly.

Update 11:32pm: nlcp02 completed. IPv4 had 26 seconds of downtime. We'll prepare nlcp01.

Update 11:38pm: nlcp01 completed. IPv4 had 25 seconds of downtime. We'll prepare nlcp03.

Update 11:57pm: nlcp03 completed. IPv4 had 33 seconds of downtime. We'll prepare nlcp05.

15/Jun/2025:

Update 00:18am: nlcp05 completed. IPv4 had 62 seconds of downtime. We'll prepare nlcp06.

Update 01:08am: nlcp06 completed. IPv4 had 43 seconds of downtime. The remaining two systems will be completed in the evening (sunday) after 10pm.

Update 9:55pm: We'll start with nlcp07 shortly.

Update 10:10pm: nlcp07 completed. IPv4/IPv6 had 21 seconds of downtime. We'll proceed with nlcp08 shortly.

Update 22:15pm: nlcp08 completed. IPv4 had 25 seconds of downtime. This marks the completion, and all servers now have bonded NICs.