Active Incident

Updated a few seconds ago

For detailed Network status please visit: https://www.sunet.se/tickets

Network




Operational

Box




Operational

eduID




Operational

eduroam




Operational

eduSign




Operational

Kaltura




Partial Service Disruption

Mailfilter-ng




Operational

Ping




Operational

SWAMID




Operational

SUNET Web




Operational

Survey




Operational

Zoom




Operational

SUNET Drive




Operational

External Services

Box

Fastly

Inspera

Instructure (Canvas)

Let's Encrypt

Ouriginal

Safespring

Sectigo

Slack

Status.io

Zoom

Issue with ZoomOperational

Incident Status

Operational

Components

Zoom

Locations

On-Prem, Recording


October 22, 2024 19:18 CEST
October 22, 2024 17:18 UTC
[Investigating] There are currently connection issues with Zoom. We're investigating.

October 22, 2024 22:35 CEST
October 22, 2024 20:35 UTC
[Investigating] The issue is still being investigated along with Zoom engineers.

October 22, 2024 22:55 CEST
October 22, 2024 20:55 UTC
[Monitoring] Issue is resolved and Zoom service is now restored.
Issue with Kaltura Live streaming Partial Service Disruption

Incident Status

Partial Service Disruption

Components

Kaltura

Locations

Live streaming


October 3, 2024 12:29 CEST
October 3, 2024 10:29 UTC
[Investigating] Kaltura Live streaming is down. We are investigating.

October 3, 2024 14:21 CEST
October 3, 2024 12:21 UTC
[Resolved] Issue has been resolved.

October 4, 2024 08:35 CEST
October 4, 2024 06:35 UTC
[Investigating] Kaltura Live streaming is down again. We are investigating.

October 4, 2024 08:45 CEST
October 4, 2024 06:45 UTC
[Monitoring] Issue resolved with Kaltura Live streaming. Monitoring further.

October 14, 2024 11:18 CEST
October 14, 2024 09:18 UTC
[Investigating] Underlying cause is still not found so streams can still crash. They should now restart the service automatically and quickly, but it'll still interrupt running streams.
SUNET Drive login issuesPartial Service Disruption

Incident Status

Partial Service Disruption

Components

SUNET Drive

Locations

BTH, GiH, HB, HH, HIS, HV, KAU, KMH, LNU, LTU, MAU, MDU, Non affiliated SUNET customer, SciLifeLab, SHH, SU, SUNET, SUNI, UU, VR


September 12, 2024 14:23 CEST
September 12, 2024 12:23 UTC
[Identified] Det är just nu problem med skapandet av nya användarkonton i Sunet Drive. Man kan få ett felmeddelande när man loggar in första gången, men efterföljande inloggningar ska fungera. Nextcloud är medvetna om problemet och arbetar på att få fram en fix så fort som möjligt. There is an issue with the provisioning of new user accounts. You might receive an error message when you log on to Sunet Drive for the first time, but subsequent logons should succeed. Nextcloud is aware of the issue and will provide a fix as soon as possible.
Zoom Recording issueDegraded Performance

Incident Status

Degraded Performance

Components

Zoom

Locations

Recording


September 2, 2024 14:22 CEST
September 2, 2024 12:22 UTC
[Investigating] There's an issue with zoom Recording. You may notice delays and the recordings take longer than normal to appear. This has been escalated to Zoom but please send in a ticket to media@sunet.se anyway so we know how many that is affected.

September 16, 2024 15:20 CEST
September 16, 2024 13:20 UTC
[Investigating] When utilisation increased after the summer holidays, we have encountered an intermediate issue with the Zoom on-premise recording service. This has resulted in the delay of the processing and making the recordings available and has unfortunately led to the loss of recordings that cannot be recovered. During the period from August 27 to September 5, the average loss of recordings was around 5%, in total around 250 recordings were lost. The night between September 5 and 6 NORDUnet implemented a workaround changing the disc configuration on the recording server VM’s. After that the number of lost recordings has dropped to less than 0,5% and a total of 5 recordings have been lost since. The root cause for the problem has so far not been identified. There are currently two different lines of investigations. NORDUnet are in constant contact with Zoom and provide them with all requested information. If there are critical recording needs, it is recommended to use local recording until the issue has been fully resolved.

September 27, 2024 08:25 CEST
September 27, 2024 06:25 UTC
[Investigating] The root cause for the problem has still not been identified. Zoom has deployed a new version of the recorder with added debugging, to help with the investigations. The level of lost recordings is still in the 0,5% range. Some of the lost recordings can be partly recovered manually, others are just very late (+48Hours) If there are very critical recording needs, it is recommended to use local recording until the issue has been fully resolved.

October 14, 2024 13:33 CEST
October 14, 2024 11:33 UTC
[Identified] Zoom believe that they have identified the root cause of the problem. It has to do with that the recording connector needs to migrate files during processing. (If the disk is busy at the time the file movement might fail and this is resulting in a “dirty” file, and this also affects subsequent files and is the reasoning for the generic slowness.) Zoom is working on a new release of the recording connector, that will be deployed as soon as available.
Zoom dashboard issueOperational

Incident Status

Operational

Components

Zoom

Locations

On-Prem


June 25, 2024 09:00 CEST
June 25, 2024 07:00 UTC
[Identified] There is slow population of the account Dashboard with meeting data. Zoom is aware and a fix is to be implemented during this week.

July 1, 2024 13:25 CEST
July 1, 2024 11:25 UTC
[Identified] The dashboard issue hasn't been fixed yet. Waiting for Zoom.

July 5, 2024 10:25 CEST
July 5, 2024 08:25 UTC
[Monitoring] Dashboard problem mitigated since the 3rd, Zoom is looking into recovering old data as the queue was cleared in the process.

August 28, 2024 14:11 CEST
August 28, 2024 12:11 UTC
[Monitoring] We've added more resources available to process the information into the Dashboard. We will add more this coming weekend and continue monitoring the situation.

1

Upcoming Maintenances

5

Active Incidents

1

Incidents Last 7 Days

Metrics

ping.sunet.se

100.00%




ping.sunet.se

100.00%




ping.sunet.se

100.00%




Scheduled Maintenance

Sunet Drive - MaintenancePlanned Maintenance

Schedule

October 29, 2024 17:00 - 20:00 CET
October 29, 2024 16:00 - 19:00 UTC

Components

SUNET Drive

Locations

BTH, GiH, HB, HH, HIS, HV, KAU, KMH, LNU, LTU, MAU, MDU, Non affiliated SUNET customer, SciLifeLab, SHH, SU, SUNET, SUNI, UU, VR

Description

SUNET kommer att utföra underhåll på SUNET Drive i form av minor uppgraderingar av Nextcloud mjukvaran. Detta kommer att resultera i driftstopp på ca 5 minuter för fullnodskuner och ca 20 minuter för singelnodskunder. SUNET will perform maintenance on SUNET Drive to perform minor upgrades of the Nextcloud software. This will result in downtime of around 5 minutes to full node customers and around 20 minutes for a single node customers.

Locations

History (Last 7 days)

SUNET wiki maintenancePlanned Maintenance

Description

Maintenance will be carried out on wiki.sunet.se. SUNET wiki will be unavailable during maintenance window.


Components

SUNET Web


Locations

Wiki


Schedule

October 24, 2024 07:30 - October 24, 2024 08:30 CEST
October 24, 2024 05:30 - October 24, 2024 06:30 UTC


October 24, 2024 08:41 CEST
October 24, 2024 06:41 UTC
[Update] Maintenance ongoing.

October 24, 2024 09:45 CEST
October 24, 2024 07:45 UTC
[Update] Maintenance has been completed.