Summary

• Page properties (2 modified, 0 added, 0 removed)

Details

Page properties

Author

...	...	@@ -1,1 +1,1 @@
1		-XWiki.hbpadmin
	1	+XWiki.mmorgan

Content

...	...	@@ -1,5 +1,34 @@
1		-=== **Collaboratory Drive maintenance (2022-08-19)** ===
	1	+(% class="wikigeneratedid" %)
	2	+=== **EBRAINS infrastructure was down this morning (Fixed)** ===
2	2
	4	+The cloud infrastructure at that hosts most EBRAINS services had at the [[Swiss National Computing Center (CSCS)>>https://cscs.ch]] experienced some downtime this morning from 9:25 to 10:15 CEST. This interrupted access to the storage of most of our services making them unavailable to end users. Service is up again.
	5	+
	6	+We will update this page with more information when we receive information about the root causes.
	7	+
	8	+We apologize to EBRAINS users for the down time. Please [[contact Support>>https://ebrains.eu/support]] if you still experience issues with any service.
	9	+
	10	+=== **Drive is currently down (Fixed)** ===
	11	+
	12	+The Drive is currently down and not usable. This is due to infrastructure issues and service will be restored as soon as possible.
	13	+
	14	+Update 2022-10-17 21:30 CEST: CSCS and RedHat are still debugging the issue.
	15	+
	16	+2022-10-18: The issue has been resolved and the Drive is now accessible again. The issue was caused by the restart of an Openstack hypervisor with an inconsistent status of volumes in Openstack. This locked the VM running the Collaboratory Drive in a shutoff state. CSCS had been informed of the problem 6 weeks earlier.
	17	+
	18	+=== **Unable to save files to Drive (Fixed)** ===
	19	+
	20	+The file system that the Drive runs on is currently full. Unfortunately, our detection of the file system being nearly full did not work. As such users cannot upload files nor save any changes to their files in the Drive. Due to another, unrelated issue, it is not possible for us to simply expand the file system. For this reason, we are currently in the process of moving the Drive data to a bigger volume. This is causing the delay. We will update this page as soon as we are finished with the move.
	21	+\\Please note that as most services run off the Drive, this also affects the Lab, although you can run Notebooks and even modify notebooks, any changes you make will not be saved.
	22	+
	23	+NOTE: We transferred everything from the affected volume to a larger volume, the service is now usable again.
	24	+
	25	+=== **No uploads allowed to Data-proxy (Fixed)** ===
	26	+
	27	+At the moment uploads are not permitted due to the data-proxy exceeding its quota allowance. We are working to solve this as soon as possible.
	28	+\\**Fixed: **Quota was increased, files can no be uploaded again.
	29	+
	30	+=== **Collaboratory Drive maintenance (2022-08-19) (Completed)** ===
	31	+
3	3	The Drive was meant to be taken down for routine maintenance to increase the available space available for Drive storage this afternoon. That operation has had to be rescheduled due to technical issues on the storage infrastructure.
4	4
5	5	=== **Intermittent issues with the Bucket (data-proxy) (Solved)** ===